diff options
| -rw-r--r-- | docs/building-spark.md | 15 |
1 files changed, 15 insertions, 0 deletions
diff --git a/docs/building-spark.md b/docs/building-spark.md index 13c95e4fcb..63532c742e 100644 --- a/docs/building-spark.md +++ b/docs/building-spark.md @@ -123,6 +123,21 @@ To produce a Spark package compiled with Scala 2.10, use the `-Dscala-2.10` prop ./dev/change-scala-version.sh 2.10 mvn -Pyarn -Phadoop-2.4 -Dscala-2.10 -DskipTests clean package +# PySpark Tests with Maven + +If you are building PySpark and wish to run the PySpark tests you will need to build Spark with hive support. + +{% highlight bash %} +build/mvn -DskipTests clean package -Phive +./python/run-tests +{% endhighlight %} + +The run-tests script also can be limited to a specific Python version or a specific module + + ./python/run-tests --python-executables=python --modules=pyspark-sql + +**Note:** You can also run Python tests with an sbt build, provided you build Spark with hive support. + # Spark Tests in Maven Tests are run by default via the [ScalaTest Maven plugin](http://www.scalatest.org/user_guide/using_the_scalatest_maven_plugin). |