diff options
| author | xutingjun <xutingjun@huawei.com> | 2015-06-17 22:31:01 -0700 |
|---|---|---|
| committer | Andrew Or <andrew@databricks.com> | 2015-06-17 22:31:01 -0700 |
| commit | e2cdb0568b14df29bbdb1ee9a13ee361c9ddad9c (patch) | |
| tree | 81c590f876f54b0268e1ee8e3c3a94cad4435b60 /graphx | |
| parent | 22732e1eca730929345e440ba831386ee7446b74 (diff) | |
| download | spark-e2cdb0568b14df29bbdb1ee9a13ee361c9ddad9c.tar.gz spark-e2cdb0568b14df29bbdb1ee9a13ee361c9ddad9c.tar.bz2 spark-e2cdb0568b14df29bbdb1ee9a13ee361c9ddad9c.zip | |
[SPARK-8392] RDDOperationGraph: getting cached nodes is slow
```def getAllNodes: Seq[RDDOperationNode] =
{ _childNodes ++ _childClusters.flatMap(_.childNodes) }```
when the ```_childClusters``` has so many nodes, the process will hang on. I think we can improve the efficiency here.
Author: xutingjun <xutingjun@huawei.com>
Closes #6839 from XuTingjun/DAGImprove and squashes the following commits:
53b03ea [xutingjun] change code to more concise and easier to read
f98728b [xutingjun] fix words: node -> nodes
f87c663 [xutingjun] put the filter inside
81f9fd2 [xutingjun] put the filter inside
Diffstat (limited to 'graphx')
0 files changed, 0 insertions, 0 deletions