diff options
| author | jerryshao <sshao@hortonworks.com> | 2016-07-25 15:17:06 -0700 |
|---|---|---|
| committer | Josh Rosen <joshrosen@databricks.com> | 2016-07-25 15:17:06 -0700 |
| commit | f5ea7fe53974a7e8cbfc222b9a6f47669b53ccfd (patch) | |
| tree | 2f5d5bb48568f2dfcac15516a746293775542a71 /core/pom.xml | |
| parent | cda4603de340d533c49feac1b244ddfd291f9bcf (diff) | |
| download | spark-f5ea7fe53974a7e8cbfc222b9a6f47669b53ccfd.tar.gz spark-f5ea7fe53974a7e8cbfc222b9a6f47669b53ccfd.tar.bz2 spark-f5ea7fe53974a7e8cbfc222b9a6f47669b53ccfd.zip | |
[SPARK-16166][CORE] Also take off-heap memory usage into consideration in log and webui display
## What changes were proposed in this pull request?
Currently in the log and UI display, only on-heap storage memory is calculated and displayed,
```
16/06/27 13:41:52 INFO MemoryStore: Block rdd_5_0 stored as values in memory (estimated size 17.8 KB, free 665.9 MB)
```
<img width="1232" alt="untitled" src="https://cloud.githubusercontent.com/assets/850797/16369960/53fb614e-3c6e-11e6-8fa3-7ffe65abcb49.png">
With [SPARK-13992](https://issues.apache.org/jira/browse/SPARK-13992) off-heap memory is supported for data persistence, so here change to also take off-heap storage memory into consideration.
## How was this patch tested?
Unit test and local verification.
Author: jerryshao <sshao@hortonworks.com>
Closes #13920 from jerryshao/SPARK-16166.
Diffstat (limited to 'core/pom.xml')
0 files changed, 0 insertions, 0 deletions