diff options
| author | Szul, Piotr <Piotr.Szul@csiro.au> | 2014-06-25 21:55:49 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@apache.org> | 2014-06-25 23:07:16 -0700 |
| commit | 441cdcca64ba0b3cbaae4d4f25ebe4c4ebd46aae (patch) | |
| tree | 88806b58dc527b4d35dbd246031752dbab5a90ae /mllib/pom.xml | |
| parent | 4a346e242c3f241c575f35536220df01ad724e23 (diff) | |
| download | spark-441cdcca64ba0b3cbaae4d4f25ebe4c4ebd46aae.tar.gz spark-441cdcca64ba0b3cbaae4d4f25ebe4c4ebd46aae.tar.bz2 spark-441cdcca64ba0b3cbaae4d4f25ebe4c4ebd46aae.zip | |
[SPARK-2172] PySpark cannot import mllib modules in YARN-client mode
Include pyspark/mllib python sources as resources in the mllib.jar.
This way they will be included in the final assembly
Author: Szul, Piotr <Piotr.Szul@csiro.au>
Closes #1223 from piotrszul/branch-1.0 and squashes the following commits:
69d5174 [Szul, Piotr] Removed unsed resource directory src/main/resource from mllib pom
f8c52a0 [Szul, Piotr] [SPARK-2172] PySpark cannot import mllib modules in YARN-client mode Include pyspark/mllib python sources as resources in the jar
(cherry picked from commit fa167194ce1b5898e4d7232346c9f86b2897a722)
Signed-off-by: Reynold Xin <rxin@apache.org>
Diffstat (limited to 'mllib/pom.xml')
| -rw-r--r-- | mllib/pom.xml | 8 |
1 files changed, 8 insertions, 0 deletions
diff --git a/mllib/pom.xml b/mllib/pom.xml index 878cb83dbf..b622f96dd7 100644 --- a/mllib/pom.xml +++ b/mllib/pom.xml @@ -84,5 +84,13 @@ <artifactId>scalatest-maven-plugin</artifactId> </plugin> </plugins> + <resources> + <resource> + <directory>../python</directory> + <includes> + <include>pyspark/mllib/*.py</include> + </includes> + </resource> + </resources> </build> </project> |