diff options
| author | cody koeninger <cody@koeninger.org> | 2017-04-19 18:58:58 +0100 |
|---|---|---|
| committer | Sean Owen <sowen@cloudera.com> | 2017-04-19 18:58:58 +0100 |
| commit | 71a8e9df12e547cb4716f954ecb762b358f862d5 (patch) | |
| tree | 0753532df8498c1b981b146627a110304a5c81b8 | |
| parent | 35378766ad7d3c494425a8781efe9cb9349732b7 (diff) | |
| download | spark-71a8e9df12e547cb4716f954ecb762b358f862d5.tar.gz spark-71a8e9df12e547cb4716f954ecb762b358f862d5.tar.bz2 spark-71a8e9df12e547cb4716f954ecb762b358f862d5.zip | |
[SPARK-20036][DOC] Note incompatible dependencies on org.apache.kafka artifacts
## What changes were proposed in this pull request?
Note that you shouldn't manually add dependencies on org.apache.kafka artifacts
## How was this patch tested?
Doc only change, did jekyll build and looked at the page.
Author: cody koeninger <cody@koeninger.org>
Closes #17675 from koeninger/SPARK-20036.
| -rw-r--r-- | docs/streaming-kafka-0-10-integration.md | 2 |
1 files changed, 2 insertions, 0 deletions
diff --git a/docs/streaming-kafka-0-10-integration.md b/docs/streaming-kafka-0-10-integration.md index e383701316..92c296a9e6 100644 --- a/docs/streaming-kafka-0-10-integration.md +++ b/docs/streaming-kafka-0-10-integration.md @@ -12,6 +12,8 @@ For Scala/Java applications using SBT/Maven project definitions, link your strea artifactId = spark-streaming-kafka-0-10_{{site.SCALA_BINARY_VERSION}} version = {{site.SPARK_VERSION_SHORT}} +**Do not** manually add dependencies on `org.apache.kafka` artifacts (e.g. `kafka-clients`). The `spark-streaming-kafka-0-10` artifact has the appropriate transitive dependencies already, and different versions may be incompatible in hard to diagnose ways. + ### Creating a Direct Stream Note that the namespace for the import includes the version, org.apache.spark.streaming.kafka010 |