diff options
| author | Tathagata Das <tathagata.das1565@gmail.com> | 2014-11-25 14:16:27 -0800 |
|---|---|---|
| committer | Tathagata Das <tathagata.das1565@gmail.com> | 2014-11-25 14:16:27 -0800 |
| commit | 8838ad7c135a585cde015dc38b5cb23314502dd9 (patch) | |
| tree | f70a5e123e11a07d88e6fdf4e1bdbaffc0b6a989 /docs | |
| parent | bf1a6aaac577757a293a573fe8eae9669697310a (diff) | |
| download | spark-8838ad7c135a585cde015dc38b5cb23314502dd9.tar.gz spark-8838ad7c135a585cde015dc38b5cb23314502dd9.tar.bz2 spark-8838ad7c135a585cde015dc38b5cb23314502dd9.zip | |
[SPARK-4196][SPARK-4602][Streaming] Fix serialization issue in PairDStreamFunctions.saveAsNewAPIHadoopFiles
Solves two JIRAs in one shot
- Makes the ForechDStream created by saveAsNewAPIHadoopFiles serializable for checkpoints
- Makes the default configuration object used saveAsNewAPIHadoopFiles be the Spark's hadoop configuration
Author: Tathagata Das <tathagata.das1565@gmail.com>
Closes #3457 from tdas/savefiles-fix and squashes the following commits:
bb4729a [Tathagata Das] Same treatment for saveAsHadoopFiles
b382ea9 [Tathagata Das] Fix serialization issue in PairDStreamFunctions.saveAsNewAPIHadoopFiles.
Diffstat (limited to 'docs')
0 files changed, 0 insertions, 0 deletions