diff options
author | Andrew Or <andrew@databricks.com> | 2015-07-02 10:57:02 -0700 |
---|---|---|
committer | Andrew Or <andrew@databricks.com> | 2015-07-02 10:57:02 -0700 |
commit | 2e2f32603c110b9c6ddfbb836f63882eacf0a8cc (patch) | |
tree | 4b082c2e7984d303e0001f3433afebc082314c0a /repl | |
parent | 0e553a3e9360a736920e2214d634373fef0dbcf7 (diff) | |
download | spark-2e2f32603c110b9c6ddfbb836f63882eacf0a8cc.tar.gz spark-2e2f32603c110b9c6ddfbb836f63882eacf0a8cc.tar.bz2 spark-2e2f32603c110b9c6ddfbb836f63882eacf0a8cc.zip |
[SPARK-8581] [SPARK-8584] Simplify checkpointing code + better error message
This patch rewrites the old checkpointing code in a way that is easier to understand. It also adds a guard against an invalid specification of checkpoint directory to provide a clearer error message. Most of the changes here are relatively minor.
Author: Andrew Or <andrew@databricks.com>
Closes #6968 from andrewor14/checkpoint-cleanup and squashes the following commits:
4ef8263 [Andrew Or] Use global synchronized instead
6f6fd84 [Andrew Or] Merge branch 'master' of github.com:apache/spark into checkpoint-cleanup
b1437ad [Andrew Or] Warn instead of throw
5484293 [Andrew Or] Merge branch 'master' of github.com:apache/spark into checkpoint-cleanup
7fb4af5 [Andrew Or] Guard against bad settings of checkpoint directory
691da98 [Andrew Or] Simplify checkpoint code / code style / comments
Diffstat (limited to 'repl')
0 files changed, 0 insertions, 0 deletions