diff options
| author | zsxwing <zsxwing@gmail.com> | 2015-06-30 00:46:55 +0900 |
|---|---|---|
| committer | Kousuke Saruta <sarutak@oss.nttdata.co.jp> | 2015-06-30 00:46:55 +0900 |
| commit | 630bd5fd80193ab6dc6ad0e7bcc13ee0dadabd38 (patch) | |
| tree | c7f1c130c950b885f027fe62329ebf6160fc4058 /dev/run-tests.py | |
| parent | 660c6cec75dc165cf5d62cdc1b0951bdb93df365 (diff) | |
| download | spark-630bd5fd80193ab6dc6ad0e7bcc13ee0dadabd38.tar.gz spark-630bd5fd80193ab6dc6ad0e7bcc13ee0dadabd38.tar.bz2 spark-630bd5fd80193ab6dc6ad0e7bcc13ee0dadabd38.zip | |
[SPARK-8702] [WEBUI] Avoid massive concating strings in Javascript
When there are massive tasks, such as `sc.parallelize(1 to 100000, 10000).count()`, the generated JS codes have a lot of string concatenations in the stage page, nearly 40 string concatenations for one task.
We can generate the whole string for a task instead of execution string concatenations in the browser.
Before this patch, the load time of the page is about 21 seconds.
After this patch, it reduces to about 17 seconds.
One disadvantage is that the generated JS codes become hard to read.
Author: zsxwing <zsxwing@gmail.com>
Closes #7082 from zsxwing/js-string and squashes the following commits:
b29231d [zsxwing] Avoid massive concating strings in Javascript
Diffstat (limited to 'dev/run-tests.py')
0 files changed, 0 insertions, 0 deletions