You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by an...@apache.org on 2015/02/12 23:54:38 UTC

spark git commit: [SPARK-5780] [PySpark] Mute the logging during unit tests

Repository: spark
Updated Branches:
  refs/heads/master 26c816e73 -> 0bf031582


[SPARK-5780] [PySpark] Mute the logging during unit tests

There a bunch of logging coming from driver and worker, it's noisy and scaring, and a lots of exception in it, people are confusing about the tests are failing or not.

This PR will mute the logging during tests, only show them if any one failed.

Author: Davies Liu <da...@databricks.com>

Closes #4572 from davies/mute and squashes the following commits:

1e9069c [Davies Liu] mute the logging during python tests


Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/0bf03158
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/0bf03158
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/0bf03158

Branch: refs/heads/master
Commit: 0bf031582588723dd5a4ca42e6f9f36bc2da1a0b
Parents: 26c816e
Author: Davies Liu <da...@databricks.com>
Authored: Thu Feb 12 14:54:38 2015 -0800
Committer: Andrew Or <an...@databricks.com>
Committed: Thu Feb 12 14:54:38 2015 -0800

----------------------------------------------------------------------
 python/run-tests | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/spark/blob/0bf03158/python/run-tests
----------------------------------------------------------------------
diff --git a/python/run-tests b/python/run-tests
index 58a26dd..077ad60 100755
--- a/python/run-tests
+++ b/python/run-tests
@@ -35,7 +35,7 @@ rm -rf metastore warehouse
 function run_test() {
     echo "Running test: $1" | tee -a $LOG_FILE
 
-    SPARK_TESTING=1 time "$FWDIR"/bin/pyspark $1 2>&1 | tee -a $LOG_FILE
+    SPARK_TESTING=1 time "$FWDIR"/bin/pyspark $1 >> $LOG_FILE 2>&1
 
     FAILED=$((PIPESTATUS[0]||$FAILED))
 


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org