diff options
| author | Davies Liu <davies@databricks.com> | 2015-02-12 14:54:38 -0800 |
|---|---|---|
| committer | Andrew Or <andrew@databricks.com> | 2015-02-12 14:54:43 -0800 |
| commit | bf0d15c5255f054d2fb70d82ca96797a3665f058 (patch) | |
| tree | 6eb6c95a36ae499e5b95fabf87742f18b39fbbbd | |
| parent | 11a0d5b6dce49c2beac8fd7eae2ccadf59a1e030 (diff) | |
| download | spark-bf0d15c5255f054d2fb70d82ca96797a3665f058.tar.gz spark-bf0d15c5255f054d2fb70d82ca96797a3665f058.tar.bz2 spark-bf0d15c5255f054d2fb70d82ca96797a3665f058.zip | |
[SPARK-5780] [PySpark] Mute the logging during unit tests
There a bunch of logging coming from driver and worker, it's noisy and scaring, and a lots of exception in it, people are confusing about the tests are failing or not.
This PR will mute the logging during tests, only show them if any one failed.
Author: Davies Liu <davies@databricks.com>
Closes #4572 from davies/mute and squashes the following commits:
1e9069c [Davies Liu] mute the logging during python tests
(cherry picked from commit 0bf031582588723dd5a4ca42e6f9f36bc2da1a0b)
Signed-off-by: Andrew Or <andrew@databricks.com>
| -rwxr-xr-x | python/run-tests | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/python/run-tests b/python/run-tests index 58a26dd8ff..077ad60d76 100755 --- a/python/run-tests +++ b/python/run-tests @@ -35,7 +35,7 @@ rm -rf metastore warehouse function run_test() { echo "Running test: $1" | tee -a $LOG_FILE - SPARK_TESTING=1 time "$FWDIR"/bin/pyspark $1 2>&1 | tee -a $LOG_FILE + SPARK_TESTING=1 time "$FWDIR"/bin/pyspark $1 >> $LOG_FILE 2>&1 FAILED=$((PIPESTATUS[0]||$FAILED)) |