diff options
author | Cheng Lian <lian@databricks.com> | 2015-07-09 17:09:16 -0700 |
---|---|---|
committer | Cheng Lian <lian@databricks.com> | 2015-07-09 17:09:16 -0700 |
commit | 2d45571fcb002cc9f03056c5a3f14493b83315a4 (patch) | |
tree | 23bbda7882e7ae26cdd81a4817f97a5ed7b1f8f2 /pom.xml | |
parent | a0cc3e5aa3fcfd0fce6813c520152657d327aaf2 (diff) | |
download | spark-2d45571fcb002cc9f03056c5a3f14493b83315a4.tar.gz spark-2d45571fcb002cc9f03056c5a3f14493b83315a4.tar.bz2 spark-2d45571fcb002cc9f03056c5a3f14493b83315a4.zip |
[SPARK-8959] [SQL] [HOTFIX] Removes parquet-thrift and libthrift dependencies
These two dependencies were introduced in #7231 to help testing Parquet compatibility with `parquet-thrift`. However, they somehow crash the Scala compiler in Maven builds.
This PR fixes this issue by:
1. Removing these two dependencies, and
2. Instead of generating the testing Parquet file programmatically, checking in an actual testing Parquet file generated by `parquet-thrift` as a test resource.
This is just a quick fix to bring back Maven builds. Need to figure out the root case as binary Parquet files are harder to maintain.
Author: Cheng Lian <lian@databricks.com>
Closes #7330 from liancheng/spark-8959 and squashes the following commits:
cf69512 [Cheng Lian] Brings back Maven builds
Diffstat (limited to 'pom.xml')
-rw-r--r-- | pom.xml | 14 |
1 files changed, 0 insertions, 14 deletions
@@ -161,7 +161,6 @@ <fasterxml.jackson.version>2.4.4</fasterxml.jackson.version> <snappy.version>1.1.1.7</snappy.version> <netlib.java.version>1.1.2</netlib.java.version> - <thrift.version>0.9.2</thrift.version> <!-- For maven shade plugin (see SPARK-8819) --> <create.dependency.reduced.pom>false</create.dependency.reduced.pom> @@ -181,7 +180,6 @@ <hive.deps.scope>compile</hive.deps.scope> <parquet.deps.scope>compile</parquet.deps.scope> <parquet.test.deps.scope>test</parquet.test.deps.scope> - <thrift.test.deps.scope>test</thrift.test.deps.scope> <!-- Overridable test home. So that you can call individual pom files directly without @@ -1123,18 +1121,6 @@ <scope>${parquet.test.deps.scope}</scope> </dependency> <dependency> - <groupId>org.apache.parquet</groupId> - <artifactId>parquet-thrift</artifactId> - <version>${parquet.version}</version> - <scope>${parquet.test.deps.scope}</scope> - </dependency> - <dependency> - <groupId>org.apache.thrift</groupId> - <artifactId>libthrift</artifactId> - <version>${thrift.version}</version> - <scope>${thrift.test.deps.scope}</scope> - </dependency> - <dependency> <groupId>org.apache.flume</groupId> <artifactId>flume-ng-core</artifactId> <version>${flume.version}</version> |