diff options
| author | Cheng Lian <lian@databricks.com> | 2015-08-18 20:15:33 +0800 |
|---|---|---|
| committer | Cheng Lian <lian@databricks.com> | 2015-08-18 20:15:33 +0800 |
| commit | 5723d26d7e677b89383de3fcf2c9a821b68a65b7 (patch) | |
| tree | 6e1820a777b971ce02d5968b9edc379543cf4968 /conf | |
| parent | c34e9ff0eac2032283b959fe63b47cc30f28d21c (diff) | |
| download | spark-5723d26d7e677b89383de3fcf2c9a821b68a65b7.tar.gz spark-5723d26d7e677b89383de3fcf2c9a821b68a65b7.tar.bz2 spark-5723d26d7e677b89383de3fcf2c9a821b68a65b7.zip | |
[SPARK-8118] [SQL] Redirects Parquet JUL logger via SLF4J
Parquet hard coded a JUL logger which always writes to stdout. This PR redirects it via SLF4j JUL bridge handler, so that we can control Parquet logs via `log4j.properties`.
This solution is inspired by https://github.com/Parquet/parquet-mr/issues/390#issuecomment-46064909.
Author: Cheng Lian <lian@databricks.com>
Closes #8196 from liancheng/spark-8118/redirect-parquet-jul.
Diffstat (limited to 'conf')
| -rw-r--r-- | conf/log4j.properties.template | 2 |
1 files changed, 2 insertions, 0 deletions
diff --git a/conf/log4j.properties.template b/conf/log4j.properties.template index 27006e45e9..74c5cea944 100644 --- a/conf/log4j.properties.template +++ b/conf/log4j.properties.template @@ -10,6 +10,8 @@ log4j.logger.org.spark-project.jetty=WARN log4j.logger.org.spark-project.jetty.util.component.AbstractLifeCycle=ERROR log4j.logger.org.apache.spark.repl.SparkIMain$exprTyper=INFO log4j.logger.org.apache.spark.repl.SparkILoop$SparkILoopInterpreter=INFO +log4j.logger.org.apache.parquet=ERROR +log4j.logger.parquet=ERROR # SPARK-9183: Settings to avoid annoying messages when looking up nonexistent UDFs in SparkSQL with Hive support log4j.logger.org.apache.hadoop.hive.metastore.RetryingHMSHandler=FATAL |