diff options
| author | Yin Huai <yhuai@databricks.com> | 2015-05-07 20:59:42 -0700 |
|---|---|---|
| committer | Yin Huai <yhuai@databricks.com> | 2015-05-07 20:59:42 -0700 |
| commit | 3af423c92f117b5dd4dc6832dc50911cedb29abc (patch) | |
| tree | 97f6bc9e5642fd2ee2b533c55a2aa74f8026abe1 /repl | |
| parent | 92f8f803a68e0c16771e9793098c6d76dfdf99af (diff) | |
| download | spark-3af423c92f117b5dd4dc6832dc50911cedb29abc.tar.gz spark-3af423c92f117b5dd4dc6832dc50911cedb29abc.tar.bz2 spark-3af423c92f117b5dd4dc6832dc50911cedb29abc.zip | |
[SPARK-6986] [SQL] Use Serializer2 in more cases.
With https://github.com/apache/spark/commit/0a2b15ce43cf6096e1a7ae060b7c8a4010ce3b92, the serialization stream and deserialization stream has enough information to determine it is handling a key-value pari, a key, or a value. It is safe to use `SparkSqlSerializer2` in more cases.
Author: Yin Huai <yhuai@databricks.com>
Closes #5849 from yhuai/serializer2MoreCases and squashes the following commits:
53a5eaa [Yin Huai] Josh's comments.
487f540 [Yin Huai] Use BufferedOutputStream.
8385f95 [Yin Huai] Always create a new row at the deserialization side to work with sort merge join.
c7e2129 [Yin Huai] Update tests.
4513d13 [Yin Huai] Use Serializer2 in more places.
Diffstat (limited to 'repl')
0 files changed, 0 insertions, 0 deletions