diff options
| author | Andrew Or <andrew@databricks.com> | 2015-05-12 01:40:55 -0700 |
|---|---|---|
| committer | Andrew Or <andrew@databricks.com> | 2015-05-12 01:40:55 -0700 |
| commit | f3e8e60063ccf0d713d03e671a3231560475f90d (patch) | |
| tree | c1612a1a0e075deef5c02cfd87dd10559b51f744 /python/pyspark/shell.py | |
| parent | 82e890fb19d6fbaffa69856eecb4699f2f8a81eb (diff) | |
| download | spark-f3e8e60063ccf0d713d03e671a3231560475f90d.tar.gz spark-f3e8e60063ccf0d713d03e671a3231560475f90d.tar.bz2 spark-f3e8e60063ccf0d713d03e671a3231560475f90d.zip | |
[SPARK-7467] Dag visualization: treat checkpoint as an RDD operation
Such that a checkpoint RDD does not go into random scopes on the UI, e.g. `take`. We've seen this in streaming.
Author: Andrew Or <andrew@databricks.com>
Closes #6004 from andrewor14/dag-viz-checkpoint and squashes the following commits:
9217439 [Andrew Or] Fix checkpoints
4ae8806 [Andrew Or] Merge branch 'master' of github.com:apache/spark into dag-viz-checkpoint
19bc07b [Andrew Or] Treat checkpoint as an RDD operation
Diffstat (limited to 'python/pyspark/shell.py')
0 files changed, 0 insertions, 0 deletions