diff options
| author | wangfei <wangfei1@huawei.com> | 2014-10-31 11:27:59 -0700 |
|---|---|---|
| committer | Michael Armbrust <michael@databricks.com> | 2014-10-31 11:27:59 -0700 |
| commit | 7c41d135709c148d4fa3a1b06b5905715c970519 (patch) | |
| tree | 78206ad76d5ae1f48917b53f6b68dcf3e01ca765 /pom.xml | |
| parent | adb6415c1d65d466a10c50e8dc6cb3bf2805ebdf (diff) | |
| download | spark-7c41d135709c148d4fa3a1b06b5905715c970519.tar.gz spark-7c41d135709c148d4fa3a1b06b5905715c970519.tar.bz2 spark-7c41d135709c148d4fa3a1b06b5905715c970519.zip | |
[SPARK-3826][SQL]enable hive-thriftserver to support hive-0.13.1
In #2241 hive-thriftserver is not enabled. This patch enable hive-thriftserver to support hive-0.13.1 by using a shim layer refer to #2241.
1 A light shim layer(code in sql/hive-thriftserver/hive-version) for each different hive version to handle api compatibility
2 New pom profiles "hive-default" and "hive-versions"(copy from #2241) to activate different hive version
3 SBT cmd for different version as follows:
hive-0.12.0 --- sbt/sbt -Phive,hadoop-2.3 -Phive-0.12.0 assembly
hive-0.13.1 --- sbt/sbt -Phive,hadoop-2.3 -Phive-0.13.1 assembly
4 Since hive-thriftserver depend on hive subproject, this patch should be merged with #2241 to enable hive-0.13.1 for hive-thriftserver
Author: wangfei <wangfei1@huawei.com>
Author: scwf <wangfei1@huawei.com>
Closes #2685 from scwf/shim-thriftserver1 and squashes the following commits:
f26f3be [wangfei] remove clean to save time
f5cac74 [wangfei] remove local hivecontext test
578234d [wangfei] use new shaded hive
18fb1ff [wangfei] exclude kryo in hive pom
fa21d09 [wangfei] clean package assembly/assembly
8a4daf2 [wangfei] minor fix
0d7f6cf [wangfei] address comments
f7c93ae [wangfei] adding build with hive 0.13 before running tests
bcf943f [wangfei] Merge branch 'master' of https://github.com/apache/spark into shim-thriftserver1
c359822 [wangfei] reuse getCommandProcessor in hiveshim
52674a4 [scwf] sql/hive included since examples depend on it
3529e98 [scwf] move hive module to hive profile
f51ff4e [wangfei] update and fix conflicts
f48d3a5 [scwf] Merge branch 'master' of https://github.com/apache/spark into shim-thriftserver1
41f727b [scwf] revert pom changes
13afde0 [scwf] fix small bug
4b681f4 [scwf] enable thriftserver in profile hive-0.13.1
0bc53aa [scwf] fixed when result filed is null
dfd1c63 [scwf] update run-tests to run hive-0.12.0 default now
c6da3ce [scwf] Merge branch 'master' of https://github.com/apache/spark into shim-thriftserver
7c66b8e [scwf] update pom according spark-2706
ae47489 [scwf] update and fix conflicts
Diffstat (limited to 'pom.xml')
| -rw-r--r-- | pom.xml | 29 |
1 files changed, 23 insertions, 6 deletions
@@ -129,7 +129,7 @@ <flume.version>1.4.0</flume.version> <zookeeper.version>3.4.5</zookeeper.version> <!-- Version used in Maven Hive dependency --> - <hive.version>0.13.1</hive.version> + <hive.version>0.13.1a</hive.version> <!-- Version used for internal directory structure --> <hive.version.short>0.13.1</hive.version.short> <derby.version>10.10.1.1</derby.version> @@ -240,6 +240,18 @@ <enabled>false</enabled> </snapshots> </repository> + <repository> + <!-- This is temporarily included to fix issues with Hive 0.13 --> + <id>spark-staging-hive13</id> + <name>Spring Staging Repository Hive 13</name> + <url>https://oss.sonatype.org/content/repositories/orgspark-project-1089/</url> + <releases> + <enabled>true</enabled> + </releases> + <snapshots> + <enabled>false</enabled> + </snapshots> + </repository> </repositories> <pluginRepositories> <pluginRepository> @@ -908,9 +920,9 @@ by Spark SQL for code generation. --> <compilerPlugins> <compilerPlugin> - <groupId>org.scalamacros</groupId> - <artifactId>paradise_${scala.version}</artifactId> - <version>${scala.macros.version}</version> + <groupId>org.scalamacros</groupId> + <artifactId>paradise_${scala.version}</artifactId> + <version>${scala.macros.version}</version> </compilerPlugin> </compilerPlugins> </configuration> @@ -1314,14 +1326,19 @@ </dependencies> </profile> <profile> - <id>hive-0.12.0</id> + <id>hive</id> <activation> <activeByDefault>false</activeByDefault> </activation> - <!-- TODO: Move this to "hive" profile once 0.13 JDBC is supported --> <modules> <module>sql/hive-thriftserver</module> </modules> + </profile> + <profile> + <id>hive-0.12.0</id> + <activation> + <activeByDefault>false</activeByDefault> + </activation> <properties> <hive.version>0.12.0-protobuf-2.5</hive.version> <hive.version.short>0.12.0</hive.version.short> |