diff options
| author | Cheng Lian <lian@databricks.com> | 2015-08-18 20:15:33 +0800 |
|---|---|---|
| committer | Cheng Lian <lian@databricks.com> | 2015-08-18 20:15:33 +0800 |
| commit | 5723d26d7e677b89383de3fcf2c9a821b68a65b7 (patch) | |
| tree | 6e1820a777b971ce02d5968b9edc379543cf4968 /sql/hive/src/test/resources/log4j.properties | |
| parent | c34e9ff0eac2032283b959fe63b47cc30f28d21c (diff) | |
| download | spark-5723d26d7e677b89383de3fcf2c9a821b68a65b7.tar.gz spark-5723d26d7e677b89383de3fcf2c9a821b68a65b7.tar.bz2 spark-5723d26d7e677b89383de3fcf2c9a821b68a65b7.zip | |
[SPARK-8118] [SQL] Redirects Parquet JUL logger via SLF4J
Parquet hard coded a JUL logger which always writes to stdout. This PR redirects it via SLF4j JUL bridge handler, so that we can control Parquet logs via `log4j.properties`.
This solution is inspired by https://github.com/Parquet/parquet-mr/issues/390#issuecomment-46064909.
Author: Cheng Lian <lian@databricks.com>
Closes #8196 from liancheng/spark-8118/redirect-parquet-jul.
Diffstat (limited to 'sql/hive/src/test/resources/log4j.properties')
| -rw-r--r-- | sql/hive/src/test/resources/log4j.properties | 7 |
1 files changed, 6 insertions, 1 deletions
diff --git a/sql/hive/src/test/resources/log4j.properties b/sql/hive/src/test/resources/log4j.properties index 92eaf1f279..fea3404769 100644 --- a/sql/hive/src/test/resources/log4j.properties +++ b/sql/hive/src/test/resources/log4j.properties @@ -48,9 +48,14 @@ log4j.logger.hive.log=OFF log4j.additivity.parquet.hadoop.ParquetRecordReader=false log4j.logger.parquet.hadoop.ParquetRecordReader=OFF +log4j.additivity.org.apache.parquet.hadoop.ParquetRecordReader=false +log4j.logger.org.apache.parquet.hadoop.ParquetRecordReader=OFF + +log4j.additivity.org.apache.parquet.hadoop.ParquetOutputCommitter=false +log4j.logger.org.apache.parquet.hadoop.ParquetOutputCommitter=OFF + log4j.additivity.hive.ql.metadata.Hive=false log4j.logger.hive.ql.metadata.Hive=OFF log4j.additivity.org.apache.hadoop.hive.ql.io.RCFile=false log4j.logger.org.apache.hadoop.hive.ql.io.RCFile=ERROR - |