diff options
| author | Sameer Agarwal <sameer@databricks.com> | 2016-06-17 09:47:41 -0700 |
|---|---|---|
| committer | Herman van Hovell <hvanhovell@databricks.com> | 2016-06-17 09:47:41 -0700 |
| commit | 34d6c4cd113729fcc1d0bc1df8916d06b8854922 (patch) | |
| tree | 10d314289311b18647ba12d0a0b2e6abed3275a6 /sql | |
| parent | ef43b4ed87894982678fcc6f2c61cf1487ee9e14 (diff) | |
| download | spark-34d6c4cd113729fcc1d0bc1df8916d06b8854922.tar.gz spark-34d6c4cd113729fcc1d0bc1df8916d06b8854922.tar.bz2 spark-34d6c4cd113729fcc1d0bc1df8916d06b8854922.zip | |
Remove non-obvious conf settings from TPCDS benchmark
## What changes were proposed in this pull request?
My fault -- these 2 conf entries are mysteriously hidden inside the benchmark code and makes it non-obvious to disable whole stage codegen and/or the vectorized parquet reader.
PS: Didn't attach a JIRA as this change should otherwise be a no-op (both these conf are enabled by default in Spark)
## How was this patch tested?
N/A
Author: Sameer Agarwal <sameer@databricks.com>
Closes #13726 from sameeragarwal/tpcds-conf.
Diffstat (limited to 'sql')
| -rw-r--r-- | sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/TPCDSQueryBenchmark.scala | 2 |
1 files changed, 0 insertions, 2 deletions
diff --git a/sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/TPCDSQueryBenchmark.scala b/sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/TPCDSQueryBenchmark.scala index 398d8d98be..957a1d6426 100644 --- a/sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/TPCDSQueryBenchmark.scala +++ b/sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/TPCDSQueryBenchmark.scala @@ -64,8 +64,6 @@ object TPCDSQueryBenchmark { require(dataLocation.nonEmpty, "please modify the value of dataLocation to point to your local TPCDS data") val tableSizes = setupTables(dataLocation) - spark.conf.set(SQLConf.PARQUET_VECTORIZED_READER_ENABLED.key, "true") - spark.conf.set(SQLConf.WHOLESTAGE_CODEGEN_ENABLED.key, "true") queries.foreach { name => val queryString = fileToString(new File(Thread.currentThread().getContextClassLoader .getResource(s"tpcds/$name.sql").getFile)) |