diff options
| author | Davies Liu <davies@databricks.com> | 2014-11-18 13:37:21 -0800 |
|---|---|---|
| committer | Patrick Wendell <pwendell@gmail.com> | 2014-11-18 13:37:21 -0800 |
| commit | e34f38ff1a0dfbb0ffa4bd11071e03b1a58de998 (patch) | |
| tree | 7d8b40e36742b219bd7afcc4010a4a6eb9db80c7 /pom.xml | |
| parent | 80f31778820586a93d73fa15279a204611cc3c60 (diff) | |
| download | spark-e34f38ff1a0dfbb0ffa4bd11071e03b1a58de998.tar.gz spark-e34f38ff1a0dfbb0ffa4bd11071e03b1a58de998.tar.bz2 spark-e34f38ff1a0dfbb0ffa4bd11071e03b1a58de998.zip | |
[SPARK-4017] show progress bar in console
The progress bar will look like this:
In the right corner, the numbers are: finished tasks, running tasks, total tasks.
After the stage has finished, it will disappear.
The progress bar is only showed if logging level is WARN or higher (but progress in title is still showed), it can be turned off by spark.driver.showConsoleProgress.
Author: Davies Liu <davies@databricks.com>
Closes #3029 from davies/progress and squashes the following commits:
95336d5 [Davies Liu] Merge branch 'master' of github.com:apache/spark into progress
fc49ac8 [Davies Liu] address commentse
2e90f75 [Davies Liu] show multiple stages in same time
0081bcc [Davies Liu] address comments
38c42f1 [Davies Liu] fix tests
ab87958 [Davies Liu] disable progress bar during tests
30ac852 [Davies Liu] re-implement progress bar
b3f34e5 [Davies Liu] Merge branch 'master' of github.com:apache/spark into progress
6fd30ff [Davies Liu] show progress bar if no task finished in 500ms
e4e7344 [Davies Liu] refactor
e1f524d [Davies Liu] revert unnecessary change
a60477c [Davies Liu] Merge branch 'master' of github.com:apache/spark into progress
5cae3f2 [Davies Liu] fix style
ea49fe0 [Davies Liu] address comments
bc53d99 [Davies Liu] refactor
e6bb189 [Davies Liu] fix logging in sparkshell
7e7d4e7 [Davies Liu] address commments
5df26bb [Davies Liu] fix style
9e42208 [Davies Liu] show progress bar in console and title
Diffstat (limited to 'pom.xml')
| -rw-r--r-- | pom.xml | 1 |
1 files changed, 1 insertions, 0 deletions
@@ -977,6 +977,7 @@ <spark.test.home>${session.executionRootDirectory}</spark.test.home> <spark.testing>1</spark.testing> <spark.ui.enabled>false</spark.ui.enabled> + <spark.ui.showConsoleProgress>false</spark.ui.showConsoleProgress> <spark.executor.extraClassPath>${test_classpath}</spark.executor.extraClassPath> <spark.driver.allowMultipleContexts>true</spark.driver.allowMultipleContexts> </systemProperties> |