diff options
author | Xiangrui Meng <meng@databricks.com> | 2015-05-14 16:56:32 -0700 |
---|---|---|
committer | Andrew Or <andrew@databricks.com> | 2015-05-14 16:56:32 -0700 |
commit | 57ed16cf9372c109e84bd51b728f2c82940949a7 (patch) | |
tree | 632e22055c8faace1e2f87a5ec1f52be1be46a8e | |
parent | 93dbb3ad83fd60444a38c3dc87a2053c667123af (diff) | |
download | spark-57ed16cf9372c109e84bd51b728f2c82940949a7.tar.gz spark-57ed16cf9372c109e84bd51b728f2c82940949a7.tar.bz2 spark-57ed16cf9372c109e84bd51b728f2c82940949a7.zip |
[SPARK-7643] [UI] use the correct size in RDDPage for storage info and partitions
`dataDistribution` and `partitions` are `Option[Seq[_]]`. andrewor14 squito
Author: Xiangrui Meng <meng@databricks.com>
Closes #6157 from mengxr/SPARK-7643 and squashes the following commits:
99fe8a4 [Xiangrui Meng] use the correct size in RDDPage for storage info and partitions
-rw-r--r-- | core/src/main/scala/org/apache/spark/ui/storage/RDDPage.scala | 7 |
1 files changed, 5 insertions, 2 deletions
diff --git a/core/src/main/scala/org/apache/spark/ui/storage/RDDPage.scala b/core/src/main/scala/org/apache/spark/ui/storage/RDDPage.scala index 05f94a7507..fbce917a08 100644 --- a/core/src/main/scala/org/apache/spark/ui/storage/RDDPage.scala +++ b/core/src/main/scala/org/apache/spark/ui/storage/RDDPage.scala @@ -77,14 +77,17 @@ private[ui] class RDDPage(parent: StorageTab) extends WebUIPage("rdd") { <div class="row-fluid"> <div class="span12"> - <h4> Data Distribution on {rddStorageInfo.dataDistribution.size} Executors </h4> + <h4> + Data Distribution on {rddStorageInfo.dataDistribution.map(_.size).getOrElse(0)} + Executors + </h4> {workerTable} </div> </div> <div class="row-fluid"> <div class="span12"> - <h4> {rddStorageInfo.partitions.size} Partitions </h4> + <h4> {rddStorageInfo.partitions.map(_.size).getOrElse(0)} Partitions </h4> {blockTable} </div> </div>; |