diff options
author | Josh Rosen <joshrosen@databricks.com> | 2016-04-08 13:58:58 -0700 |
---|---|---|
committer | Josh Rosen <joshrosen@databricks.com> | 2016-04-08 13:58:58 -0700 |
commit | 464a3c1e02c665c7ad2709f8c47898b682526eb3 (patch) | |
tree | e0b6b8a379a0c9bb36bb8295520df861e2e0c232 /docs/hadoop-provided.md | |
parent | f8c9beca38f1f396eb3220b23db6d77112a50293 (diff) | |
download | spark-464a3c1e02c665c7ad2709f8c47898b682526eb3.tar.gz spark-464a3c1e02c665c7ad2709f8c47898b682526eb3.tar.bz2 spark-464a3c1e02c665c7ad2709f8c47898b682526eb3.zip |
[SPARK-14435][BUILD] Shade Kryo in our custom Hive 1.2.1 fork
This patch updates our custom Hive 1.2.1 fork in order to shade Kryo in Hive. This is a blocker for upgrading Spark to use Kryo 3 (see #12076).
The source for this new fork of Hive can be found at https://github.com/JoshRosen/hive/tree/release-1.2.1-spark2
Here's the complete diff from the official Hive 1.2.1 release: https://github.com/apache/hive/compare/release-1.2.1...JoshRosen:release-1.2.1-spark2
Here's the diff from the sources that pwendell used to publish the current `1.2.1.spark` release of Hive: https://github.com/pwendell/hive/compare/release-1.2.1-spark...JoshRosen:release-1.2.1-spark2. This diff looks large because his branch used a shell script to rewrite the groupId, whereas I had to commit the groupId changes in order to prevent the find-and-replace from affecting the package names in our relocated Kryo classes: https://github.com/pwendell/hive/compare/release-1.2.1-spark...JoshRosen:release-1.2.1-spark2#diff-6ada9aaec70e069df8f2c34c5519dd1e
Using these changes, I was able to publish a local version of Hive and verify that this change fixes the test failures which are blocking #12076. Note that this PR will not compile until we complete the review of the Hive POM changes and stage and publish a release.
/cc vanzin, steveloughran, and pwendell for review.
Author: Josh Rosen <joshrosen@databricks.com>
Closes #12215 from JoshRosen/shade-kryo-in-hive.
Diffstat (limited to 'docs/hadoop-provided.md')
0 files changed, 0 insertions, 0 deletions