diff options
| author | Tathagata Das <tathagata.das1565@gmail.com> | 2013-12-11 14:01:36 -0800 |
|---|---|---|
| committer | Tathagata Das <tathagata.das1565@gmail.com> | 2013-12-11 14:01:36 -0800 |
| commit | 5e9ce83d682d6198cda4631faf11cb53fcccf07f (patch) | |
| tree | f88ed888af44976a4bf3479fc2cf6f5224fc4b6b /yarn/pom.xml | |
| parent | 6169fe14a140146602fb07cfcd13eee6efad98f9 (diff) | |
| download | spark-5e9ce83d682d6198cda4631faf11cb53fcccf07f.tar.gz spark-5e9ce83d682d6198cda4631faf11cb53fcccf07f.tar.bz2 spark-5e9ce83d682d6198cda4631faf11cb53fcccf07f.zip | |
Fixed multiple file stream and checkpointing bugs.
- Made file stream more robust to transient failures.
- Changed Spark.setCheckpointDir API to not have the second
'useExisting' parameter. Spark will always create a unique directory
for checkpointing underneath the directory provide to the funtion.
- Fixed bug wrt local relative paths as checkpoint directory.
- Made DStream and RDD checkpointing use
SparkContext.hadoopConfiguration, so that more HDFS compatible
filesystems are supported for checkpointing.
Diffstat (limited to 'yarn/pom.xml')
0 files changed, 0 insertions, 0 deletions