diff options
| author | Yash Datta <Yash.Datta@guavus.com> | 2015-09-18 08:22:38 -0700 |
|---|---|---|
| committer | Yin Huai <yhuai@databricks.com> | 2015-09-18 08:22:38 -0700 |
| commit | 20fd35dfd1ac402b622604e7bbedcc53a580b0a2 (patch) | |
| tree | 25523c5576a064b9033a2aca64636a4853b20508 /project | |
| parent | e3b5d6cb29e0f983fcc55920619e6433298955f5 (diff) | |
| download | spark-20fd35dfd1ac402b622604e7bbedcc53a580b0a2.tar.gz spark-20fd35dfd1ac402b622604e7bbedcc53a580b0a2.tar.bz2 spark-20fd35dfd1ac402b622604e7bbedcc53a580b0a2.zip | |
[SPARK-10451] [SQL] Prevent unnecessary serializations in InMemoryColumnarTableScan
Many of the fields in InMemoryColumnar scan and InMemoryRelation can be made transient.
This reduces my 1000ms job to abt 700 ms . The task size reduces from 2.8 mb to ~1300kb
Author: Yash Datta <Yash.Datta@guavus.com>
Closes #8604 from saucam/serde.
Diffstat (limited to 'project')
0 files changed, 0 insertions, 0 deletions