diff options
author | Reynold Xin <rxin@cs.berkeley.edu> | 2012-05-16 14:16:55 -0700 |
---|---|---|
committer | Reynold Xin <rxin@cs.berkeley.edu> | 2012-05-16 14:16:55 -0700 |
commit | d0c6e9f63982b1508487d6a283f6aae62f0e36e7 (patch) | |
tree | 75a07c31a4d73789894c4b5e0866d4b387319d91 /repl | |
parent | 16461e2edab5253e1cc3b9b8a74cc8adbb6b9be3 (diff) | |
download | spark-d0c6e9f63982b1508487d6a283f6aae62f0e36e7.tar.gz spark-d0c6e9f63982b1508487d6a283f6aae62f0e36e7.tar.bz2 spark-d0c6e9f63982b1508487d6a283f6aae62f0e36e7.zip |
Made some RDD dependencies transient to reduce the amount of data needed
to be serialized in closure serialization. This can significantly reduce
the task setup time in Shark when the query involves a large number of
(Hive) partitions.
Diffstat (limited to 'repl')
0 files changed, 0 insertions, 0 deletions