diff options
| author | Carson Wang <carson.wang@intel.com> | 2015-10-15 10:36:54 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2015-10-15 10:36:54 -0700 |
| commit | d45a0d3ca23df86cf0a95508ccc3b4b98f1b611c (patch) | |
| tree | f8d3a36004b430aa89f35981357800ddab6e423d /launcher | |
| parent | 523adc24a683930304f408d477607edfe9de7b76 (diff) | |
| download | spark-d45a0d3ca23df86cf0a95508ccc3b4b98f1b611c.tar.gz spark-d45a0d3ca23df86cf0a95508ccc3b4b98f1b611c.tar.bz2 spark-d45a0d3ca23df86cf0a95508ccc3b4b98f1b611c.zip | |
[SPARK-11047] Internal accumulators miss the internal flag when replaying events in the history server
Internal accumulators don't write the internal flag to event log. So on the history server Web UI, all accumulators are not internal. This causes incorrect peak execution memory and unwanted accumulator table displayed on the stage page.
To fix it, I add the "internal" property of AccumulableInfo when writing the event log.
Author: Carson Wang <carson.wang@intel.com>
Closes #9061 from carsonwang/accumulableBug.
Diffstat (limited to 'launcher')
0 files changed, 0 insertions, 0 deletions