diff options
| author | wangfei <wangfei1@huawei.com> | 2014-10-31 11:27:59 -0700 |
|---|---|---|
| committer | Michael Armbrust <michael@databricks.com> | 2014-10-31 11:27:59 -0700 |
| commit | 7c41d135709c148d4fa3a1b06b5905715c970519 (patch) | |
| tree | 78206ad76d5ae1f48917b53f6b68dcf3e01ca765 /assembly | |
| parent | adb6415c1d65d466a10c50e8dc6cb3bf2805ebdf (diff) | |
| download | spark-7c41d135709c148d4fa3a1b06b5905715c970519.tar.gz spark-7c41d135709c148d4fa3a1b06b5905715c970519.tar.bz2 spark-7c41d135709c148d4fa3a1b06b5905715c970519.zip | |
[SPARK-3826][SQL]enable hive-thriftserver to support hive-0.13.1
In #2241 hive-thriftserver is not enabled. This patch enable hive-thriftserver to support hive-0.13.1 by using a shim layer refer to #2241.
1 A light shim layer(code in sql/hive-thriftserver/hive-version) for each different hive version to handle api compatibility
2 New pom profiles "hive-default" and "hive-versions"(copy from #2241) to activate different hive version
3 SBT cmd for different version as follows:
hive-0.12.0 --- sbt/sbt -Phive,hadoop-2.3 -Phive-0.12.0 assembly
hive-0.13.1 --- sbt/sbt -Phive,hadoop-2.3 -Phive-0.13.1 assembly
4 Since hive-thriftserver depend on hive subproject, this patch should be merged with #2241 to enable hive-0.13.1 for hive-thriftserver
Author: wangfei <wangfei1@huawei.com>
Author: scwf <wangfei1@huawei.com>
Closes #2685 from scwf/shim-thriftserver1 and squashes the following commits:
f26f3be [wangfei] remove clean to save time
f5cac74 [wangfei] remove local hivecontext test
578234d [wangfei] use new shaded hive
18fb1ff [wangfei] exclude kryo in hive pom
fa21d09 [wangfei] clean package assembly/assembly
8a4daf2 [wangfei] minor fix
0d7f6cf [wangfei] address comments
f7c93ae [wangfei] adding build with hive 0.13 before running tests
bcf943f [wangfei] Merge branch 'master' of https://github.com/apache/spark into shim-thriftserver1
c359822 [wangfei] reuse getCommandProcessor in hiveshim
52674a4 [scwf] sql/hive included since examples depend on it
3529e98 [scwf] move hive module to hive profile
f51ff4e [wangfei] update and fix conflicts
f48d3a5 [scwf] Merge branch 'master' of https://github.com/apache/spark into shim-thriftserver1
41f727b [scwf] revert pom changes
13afde0 [scwf] fix small bug
4b681f4 [scwf] enable thriftserver in profile hive-0.13.1
0bc53aa [scwf] fixed when result filed is null
dfd1c63 [scwf] update run-tests to run hive-0.12.0 default now
c6da3ce [scwf] Merge branch 'master' of https://github.com/apache/spark into shim-thriftserver
7c66b8e [scwf] update pom according spark-2706
ae47489 [scwf] update and fix conflicts
Diffstat (limited to 'assembly')
| -rw-r--r-- | assembly/pom.xml | 6 |
1 files changed, 0 insertions, 6 deletions
diff --git a/assembly/pom.xml b/assembly/pom.xml index 11d4bea936..9e8525dd46 100644 --- a/assembly/pom.xml +++ b/assembly/pom.xml @@ -201,12 +201,6 @@ <artifactId>spark-hive_${scala.binary.version}</artifactId> <version>${project.version}</version> </dependency> - </dependencies> - </profile> - <profile> - <!-- TODO: Move this to "hive" profile once 0.13 JDBC is supported --> - <id>hive-0.12.0</id> - <dependencies> <dependency> <groupId>org.apache.spark</groupId> <artifactId>spark-hive-thriftserver_${scala.binary.version}</artifactId> |