diff options
| author | hyukjinkwon <gurwls223@gmail.com> | 2017-04-16 14:36:42 +0100 |
|---|---|---|
| committer | Sean Owen <sowen@cloudera.com> | 2017-04-16 14:36:42 +0100 |
| commit | ad935f526f57a9621c0a5ba082b85414c28282f4 (patch) | |
| tree | 8a5379f3ce73c7e1aad7af1ef032908a6502b510 /core/pom.xml | |
| parent | a888fed3099e84c2cf45e9419f684a3658ada19d (diff) | |
| download | spark-ad935f526f57a9621c0a5ba082b85414c28282f4.tar.gz spark-ad935f526f57a9621c0a5ba082b85414c28282f4.tar.bz2 spark-ad935f526f57a9621c0a5ba082b85414c28282f4.zip | |
[SPARK-20343][BUILD] Add avro dependency in core POM to resolve build failure in SBT Hadoop 2.6 master on Jenkins
## What changes were proposed in this pull request?
This PR proposes to add
```
<dependency>
<groupId>org.apache.avro</groupId>
<artifactId>avro</artifactId>
</dependency>
```
in core POM to see if it resolves the build failure as below:
```
[error] /home/jenkins/workspace/spark-master-test-sbt-hadoop-2.6/core/src/main/scala/org/apache/spark/serializer/GenericAvroSerializer.scala:123: value createDatumWriter is not a member of org.apache.avro.generic.GenericData
[error] writerCache.getOrElseUpdate(schema, GenericData.get.createDatumWriter(schema))
[error]
```
https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-master-test-sbt-hadoop-2.6/2770/consoleFull
## How was this patch tested?
I tried many ways but I was unable to reproduce this in my local. Sean also tried the way I did but he was also unable to reproduce this.
Please refer the comments in https://github.com/apache/spark/pull/17477#issuecomment-294094092
Author: hyukjinkwon <gurwls223@gmail.com>
Closes #17642 from HyukjinKwon/SPARK-20343.
Diffstat (limited to 'core/pom.xml')
| -rw-r--r-- | core/pom.xml | 4 |
1 files changed, 4 insertions, 0 deletions
diff --git a/core/pom.xml b/core/pom.xml index 97a463abbe..24ce36deeb 100644 --- a/core/pom.xml +++ b/core/pom.xml @@ -35,6 +35,10 @@ <dependencies> <dependency> <groupId>org.apache.avro</groupId> + <artifactId>avro</artifactId> + </dependency> + <dependency> + <groupId>org.apache.avro</groupId> <artifactId>avro-mapred</artifactId> <classifier>${avro.mapred.classifier}</classifier> </dependency> |