diff options
author | Steve Lindemann <steve.lindemann@engineersgatelp.com> | 2015-07-06 10:17:05 -0700 |
---|---|---|
committer | Cheng Lian <lian@databricks.com> | 2015-07-06 10:17:05 -0700 |
commit | 39e4e7e4d89077a637c4cad3a986e0e3447d1ae7 (patch) | |
tree | 558fa9891084fbbe453368d1ca4ad1aa278ceed2 /docs/configuration.md | |
parent | 86768b7b3b0c2964e744bc491bc20a1d3140ce93 (diff) | |
download | spark-39e4e7e4d89077a637c4cad3a986e0e3447d1ae7.tar.gz spark-39e4e7e4d89077a637c4cad3a986e0e3447d1ae7.tar.bz2 spark-39e4e7e4d89077a637c4cad3a986e0e3447d1ae7.zip |
[SPARK-8841] [SQL] Fix partition pruning percentage log message
When pruning partitions for a query plan, a message is logged indicating what how many partitions were selected based on predicate criteria, and what percent were pruned.
The current release erroneously uses `1 - total/selected` to compute this quantity, leading to nonsense messages like "pruned -1000% partitions". The fix is simple and obvious.
Author: Steve Lindemann <steve.lindemann@engineersgatelp.com>
Closes #7227 from srlindemann/master and squashes the following commits:
c788061 [Steve Lindemann] fix percentPruned log message
Diffstat (limited to 'docs/configuration.md')
0 files changed, 0 insertions, 0 deletions