diff options
| author | Patrick Wendell <patrick@databricks.com> | 2015-06-09 16:14:21 -0700 |
|---|---|---|
| committer | Patrick Wendell <patrick@databricks.com> | 2015-06-09 16:14:21 -0700 |
| commit | 6e4fb0c9e8f03cf068c422777cfce82a89e8e738 (patch) | |
| tree | 1ecaaf3e938f3ec0e30e4d603b913bb594825ccf /docs/index.md | |
| parent | 0d5892dc723d203e7d892d3beacbaa97aedb1a24 (diff) | |
| download | spark-6e4fb0c9e8f03cf068c422777cfce82a89e8e738.tar.gz spark-6e4fb0c9e8f03cf068c422777cfce82a89e8e738.tar.bz2 spark-6e4fb0c9e8f03cf068c422777cfce82a89e8e738.zip | |
[SPARK-6511] [DOCUMENTATION] Explain how to use Hadoop provided builds
This provides preliminary documentation pointing out how to use the
Hadoop free builds. I am hoping over time this list can grow to
include most of the popular Hadoop distributions.
Getting more people using these builds will help us long term reduce
the number of binaries we build.
Author: Patrick Wendell <patrick@databricks.com>
Closes #6729 from pwendell/hadoop-provided and squashes the following commits:
1113b76 [Patrick Wendell] [SPARK-6511] [Documentation] Explain how to use Hadoop provided builds
Diffstat (limited to 'docs/index.md')
| -rw-r--r-- | docs/index.md | 10 |
1 files changed, 7 insertions, 3 deletions
diff --git a/docs/index.md b/docs/index.md index 7939657915..d85cf12def 100644 --- a/docs/index.md +++ b/docs/index.md @@ -12,9 +12,13 @@ It also supports a rich set of higher-level tools including [Spark SQL](sql-prog # Downloading -Get Spark from the [downloads page](http://spark.apache.org/downloads.html) of the project website. This documentation is for Spark version {{site.SPARK_VERSION}}. The downloads page -contains Spark packages for many popular HDFS versions. If you'd like to build Spark from -scratch, visit [Building Spark](building-spark.html). +Get Spark from the [downloads page](http://spark.apache.org/downloads.html) of the project website. This documentation is for Spark version {{site.SPARK_VERSION}}. Spark uses Hadoop's client libraries for HDFS and YARN. Downloads are pre-packaged for a handful of popular Hadoop versions. +Users can also download a "Hadoop free" binary and run Spark with any Hadoop version +[by augmenting Spark's classpath](hadoop-provided.html). + +If you'd like to build Spark from +source, visit [Building Spark](building-spark.html). + Spark runs on both Windows and UNIX-like systems (e.g. Linux, Mac OS). It's easy to run locally on one machine --- all you need is to have `java` installed on your system `PATH`, |