diff options
| author | Liang-Chi Hsieh <viirya@appier.com> | 2015-10-19 16:16:31 -0700 |
|---|---|---|
| committer | Andrew Or <andrew@databricks.com> | 2015-10-19 16:16:31 -0700 |
| commit | a1413b3662250dd5e980e8b1f7c3dc4585ab4766 (patch) | |
| tree | 18c4ed4a2c15d44ae770aceb8e64572ad6b5592b /python | |
| parent | 7ab0ce6501c37f0fc3a49e3332573ae4e4def3e8 (diff) | |
| download | spark-a1413b3662250dd5e980e8b1f7c3dc4585ab4766.tar.gz spark-a1413b3662250dd5e980e8b1f7c3dc4585ab4766.tar.bz2 spark-a1413b3662250dd5e980e8b1f7c3dc4585ab4766.zip | |
[SPARK-11051][CORE] Do not allow local checkpointing after the RDD is materialized and checkpointed
JIRA: https://issues.apache.org/jira/browse/SPARK-11051
When a `RDD` is materialized and checkpointed, its partitions and dependencies are cleared. If we allow local checkpointing on it and assign `LocalRDDCheckpointData` to its `checkpointData`. Next time when the RDD is materialized again, the error will be thrown.
Author: Liang-Chi Hsieh <viirya@appier.com>
Closes #9072 from viirya/no-localcheckpoint-after-checkpoint.
Diffstat (limited to 'python')
0 files changed, 0 insertions, 0 deletions