diff options
| author | Davies Liu <davies@databricks.com> | 2015-06-04 10:28:59 -0700 |
|---|---|---|
| committer | Davies Liu <davies@databricks.com> | 2015-06-04 10:28:59 -0700 |
| commit | c8709dcfd1237ffa19ee9286e99ddf2718a616d8 (patch) | |
| tree | 633db0167d2c5aec29525400e22d879ad2564f34 /sql/catalyst/pom.xml | |
| parent | 10ba1880878d0babcdc5c9b688df5458ea131531 (diff) | |
| download | spark-c8709dcfd1237ffa19ee9286e99ddf2718a616d8.tar.gz spark-c8709dcfd1237ffa19ee9286e99ddf2718a616d8.tar.bz2 spark-c8709dcfd1237ffa19ee9286e99ddf2718a616d8.zip | |
[SPARK-7956] [SQL] Use Janino to compile SQL expressions into bytecode
In order to reduce the overhead of codegen, this PR switch to use Janino to compile SQL expressions into bytecode.
After this, the time used to compile a SQL expression is decreased from 100ms to 5ms, which is necessary to turn on codegen for general workload, also tests.
cc rxin
Author: Davies Liu <davies@databricks.com>
Closes #6479 from davies/janino and squashes the following commits:
cc689f5 [Davies Liu] remove globalLock
262d848 [Davies Liu] Merge branch 'master' of github.com:apache/spark into janino
eec3a33 [Davies Liu] address comments from Josh
f37c8c3 [Davies Liu] fix DecimalType and cast to String
202298b [Davies Liu] Merge branch 'master' of github.com:apache/spark into janino
a21e968 [Davies Liu] fix style
0ed3dc6 [Davies Liu] Merge branch 'master' of github.com:apache/spark into janino
551a851 [Davies Liu] fix tests
c3bdffa [Davies Liu] remove print
6089ce5 [Davies Liu] change logging level
7e46ac3 [Davies Liu] fix style
d8f0f6c [Davies Liu] Merge branch 'master' of github.com:apache/spark into janino
da4926a [Davies Liu] fix tests
03660f3 [Davies Liu] WIP: use Janino to compile Java source
f2629cd [Davies Liu] Merge branch 'master' of github.com:apache/spark into janino
f7d66cf [Davies Liu] use template based string for codegen
Diffstat (limited to 'sql/catalyst/pom.xml')
| -rw-r--r-- | sql/catalyst/pom.xml | 16 |
1 files changed, 5 insertions, 11 deletions
diff --git a/sql/catalyst/pom.xml b/sql/catalyst/pom.xml index bf0a7327a5..f4b1cc3a4f 100644 --- a/sql/catalyst/pom.xml +++ b/sql/catalyst/pom.xml @@ -38,10 +38,6 @@ <dependencies> <dependency> <groupId>org.scala-lang</groupId> - <artifactId>scala-compiler</artifactId> - </dependency> - <dependency> - <groupId>org.scala-lang</groupId> <artifactId>scala-reflect</artifactId> </dependency> @@ -67,6 +63,11 @@ <artifactId>scalacheck_${scala.binary.version}</artifactId> <scope>test</scope> </dependency> + <dependency> + <groupId>org.codehaus.janino</groupId> + <artifactId>janino</artifactId> + <version>2.7.8</version> + </dependency> </dependencies> <build> <outputDirectory>target/scala-${scala.binary.version}/classes</outputDirectory> @@ -108,13 +109,6 @@ <activation> <property><name>!scala-2.11</name></property> </activation> - <dependencies> - <dependency> - <groupId>org.scalamacros</groupId> - <artifactId>quasiquotes_${scala.binary.version}</artifactId> - <version>${scala.macros.version}</version> - </dependency> - </dependencies> </profile> </profiles> </project> |