diff options
author | xutingjun <xutingjun@huawei.com> | 2015-06-17 22:31:01 -0700 |
---|---|---|
committer | Andrew Or <andrew@databricks.com> | 2015-06-17 22:31:01 -0700 |
commit | e2cdb0568b14df29bbdb1ee9a13ee361c9ddad9c (patch) | |
tree | 81c590f876f54b0268e1ee8e3c3a94cad4435b60 /scalastyle-config.xml | |
parent | 22732e1eca730929345e440ba831386ee7446b74 (diff) | |
download | spark-e2cdb0568b14df29bbdb1ee9a13ee361c9ddad9c.tar.gz spark-e2cdb0568b14df29bbdb1ee9a13ee361c9ddad9c.tar.bz2 spark-e2cdb0568b14df29bbdb1ee9a13ee361c9ddad9c.zip |
[SPARK-8392] RDDOperationGraph: getting cached nodes is slow
```def getAllNodes: Seq[RDDOperationNode] =
{ _childNodes ++ _childClusters.flatMap(_.childNodes) }```
when the ```_childClusters``` has so many nodes, the process will hang on. I think we can improve the efficiency here.
Author: xutingjun <xutingjun@huawei.com>
Closes #6839 from XuTingjun/DAGImprove and squashes the following commits:
53b03ea [xutingjun] change code to more concise and easier to read
f98728b [xutingjun] fix words: node -> nodes
f87c663 [xutingjun] put the filter inside
81f9fd2 [xutingjun] put the filter inside
Diffstat (limited to 'scalastyle-config.xml')
0 files changed, 0 insertions, 0 deletions