diff options
author | Joseph K. Bradley <joseph@databricks.com> | 2015-02-02 17:02:29 -0800 |
---|---|---|
committer | Xiangrui Meng <meng@databricks.com> | 2015-02-02 17:02:29 -0800 |
commit | f133dece569f7faedb06a0da6e9f86c5d615e9be (patch) | |
tree | c69d65adf9b42f4d9952709d1ec4c3ecebbb5d4c /streaming | |
parent | 8aa3cfff661753d6d87a8d9a87373d403436dd92 (diff) | |
download | spark-f133dece569f7faedb06a0da6e9f86c5d615e9be.tar.gz spark-f133dece569f7faedb06a0da6e9f86c5d615e9be.tar.bz2 spark-f133dece569f7faedb06a0da6e9f86c5d615e9be.zip |
[SPARK-5534] [graphx] Graph getStorageLevel fix
This fixes getStorageLevel for EdgeRDDImpl and VertexRDDImpl (and therefore for Graph).
See code example on JIRA which failed before but works with this patch: [https://issues.apache.org/jira/browse/SPARK-5534]
(The added unit tests also failed before but work with this fix.)
Note: I used partitionsRDD, assuming that getStorageLevel will only be called on the driver.
CC: mengxr (related to LDA PR), rxin ankurdave Thanks in advance!
Author: Joseph K. Bradley <joseph@databricks.com>
Closes #4317 from jkbradley/graphx-storagelevel and squashes the following commits:
1c21e49 [Joseph K. Bradley] made graph getStorageLevel test more robust
18d64ca [Joseph K. Bradley] Added tests for getStorageLevel in VertexRDDSuite, EdgeRDDSuite, GraphSuite
17b488b [Joseph K. Bradley] overrode getStorageLevel in Vertex/EdgeRDDImpl to use partitionsRDD
Diffstat (limited to 'streaming')
0 files changed, 0 insertions, 0 deletions