diff options
author | witgo <witgo@qq.com> | 2014-07-15 10:46:17 -0700 |
---|---|---|
committer | Patrick Wendell <pwendell@gmail.com> | 2014-07-15 10:46:17 -0700 |
commit | 9dd635eb5df52835b3b7f4f2b9c789da9e813c71 (patch) | |
tree | 32b0a1f4ff11e9a96d5fc2744827c764e239b017 /docs/sql-programming-guide.md | |
parent | cb09e93c1d7ef9c8f0a1abe4e659783c74993a4e (diff) | |
download | spark-9dd635eb5df52835b3b7f4f2b9c789da9e813c71.tar.gz spark-9dd635eb5df52835b3b7f4f2b9c789da9e813c71.tar.bz2 spark-9dd635eb5df52835b3b7f4f2b9c789da9e813c71.zip |
SPARK-2480: Resolve sbt warnings "NOTE: SPARK_YARN is deprecated, please use -Pyarn flag"
Author: witgo <witgo@qq.com>
Closes #1404 from witgo/run-tests and squashes the following commits:
f703aee [witgo] fix Note: implicit method fromPairDStream is not applicable here because it comes after the application point and it lacks an explicit result type
2944f51 [witgo] Remove "NOTE: SPARK_YARN is deprecated, please use -Pyarn flag"
ef59c70 [witgo] fix Note: implicit method fromPairDStream is not applicable here because it comes after the application point and it lacks an explicit result type
6cefee5 [witgo] Remove "NOTE: SPARK_YARN is deprecated, please use -Pyarn flag"
Diffstat (limited to 'docs/sql-programming-guide.md')
-rw-r--r-- | docs/sql-programming-guide.md | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/docs/sql-programming-guide.md b/docs/sql-programming-guide.md index 522c83884e..38728534a4 100644 --- a/docs/sql-programming-guide.md +++ b/docs/sql-programming-guide.md @@ -474,7 +474,7 @@ anotherPeople = sqlContext.jsonRDD(anotherPeopleRDD) Spark SQL also supports reading and writing data stored in [Apache Hive](http://hive.apache.org/). However, since Hive has a large number of dependencies, it is not included in the default Spark assembly. -In order to use Hive you must first run '`SPARK_HIVE=true sbt/sbt assembly/assembly`' (or use `-Phive` for maven). +In order to use Hive you must first run '`sbt/sbt -Phive assembly/assembly`' (or use `-Phive` for maven). This command builds a new assembly jar that includes Hive. Note that this Hive assembly jar must also be present on all of the worker nodes, as they will need access to the Hive serialization and deserialization libraries (SerDes) in order to acccess data stored in Hive. |