diff options
| author | Sean Owen <sowen@cloudera.com> | 2016-11-03 17:27:23 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2016-11-03 17:27:23 -0700 |
| commit | dc4c60098641cf64007e2f0e36378f000ad5f6b1 (patch) | |
| tree | fad72496e3f06613484fdac6c8c13353c79eb838 /docs/building-spark.md | |
| parent | f22954ad49bf5a32c7b6d8487cd38ffe0da904ca (diff) | |
| download | spark-dc4c60098641cf64007e2f0e36378f000ad5f6b1.tar.gz spark-dc4c60098641cf64007e2f0e36378f000ad5f6b1.tar.bz2 spark-dc4c60098641cf64007e2f0e36378f000ad5f6b1.zip | |
[SPARK-18138][DOCS] Document that Java 7, Python 2.6, Scala 2.10, Hadoop < 2.6 are deprecated in Spark 2.1.0
## What changes were proposed in this pull request?
Document that Java 7, Python 2.6, Scala 2.10, Hadoop < 2.6 are deprecated in Spark 2.1.0. This does not actually implement any of the change in SPARK-18138, just peppers the documentation with notices about it.
## How was this patch tested?
Doc build
Author: Sean Owen <sowen@cloudera.com>
Closes #15733 from srowen/SPARK-18138.
Diffstat (limited to 'docs/building-spark.md')
| -rw-r--r-- | docs/building-spark.md | 6 |
1 files changed, 6 insertions, 0 deletions
diff --git a/docs/building-spark.md b/docs/building-spark.md index ebe46a42a1..2b404bd3e1 100644 --- a/docs/building-spark.md +++ b/docs/building-spark.md @@ -13,6 +13,7 @@ redirect_from: "building-with-maven.html" The Maven-based build is the build of reference for Apache Spark. Building Spark using Maven requires Maven 3.3.9 or newer and Java 7+. +Note that support for Java 7 is deprecated as of Spark 2.0.0 and may be removed in Spark 2.2.0. ### Setting up Maven's Memory Usage @@ -79,6 +80,9 @@ Because HDFS is not protocol-compatible across versions, if you want to read fro </tbody> </table> +Note that support for versions of Hadoop before 2.6 are deprecated as of Spark 2.1.0 and may be +removed in Spark 2.2.0. + You can enable the `yarn` profile and optionally set the `yarn.version` property if it is different from `hadoop.version`. Spark only supports YARN versions 2.2.0 and later. @@ -129,6 +133,8 @@ To produce a Spark package compiled with Scala 2.10, use the `-Dscala-2.10` prop ./dev/change-scala-version.sh 2.10 ./build/mvn -Pyarn -Phadoop-2.4 -Dscala-2.10 -DskipTests clean package + +Note that support for Scala 2.10 is deprecated as of Spark 2.1.0 and may be removed in Spark 2.2.0. ## Building submodules individually |