diff options
| author | Holden Karau <holden@us.ibm.com> | 2017-01-25 14:43:39 -0800 |
|---|---|---|
| committer | Holden Karau <holden@us.ibm.com> | 2017-01-25 14:43:39 -0800 |
| commit | 965c82d8c4b7f2d4dfbc45ec4d47d6b6588094c3 (patch) | |
| tree | 0a07423afcfc8501f4cdab1536de2e0af05c3623 /python | |
| parent | 92afaa93a0b67f561a790822ccdd2b814455edcc (diff) | |
| download | spark-965c82d8c4b7f2d4dfbc45ec4d47d6b6588094c3.tar.gz spark-965c82d8c4b7f2d4dfbc45ec4d47d6b6588094c3.tar.bz2 spark-965c82d8c4b7f2d4dfbc45ec4d47d6b6588094c3.zip | |
[SPARK-19064][PYSPARK] Fix pip installing of sub components
## What changes were proposed in this pull request?
Fix instalation of mllib and ml sub components, and more eagerly cleanup cache files during test script & make-distribution.
## How was this patch tested?
Updated sanity test script to import mllib and ml sub-components.
Author: Holden Karau <holden@us.ibm.com>
Closes #16465 from holdenk/SPARK-19064-fix-pip-install-sub-components.
Diffstat (limited to 'python')
| -rw-r--r-- | python/setup.py | 5 |
1 files changed, 5 insertions, 0 deletions
diff --git a/python/setup.py b/python/setup.py index bc2eb4ce9d..47eab98e0f 100644 --- a/python/setup.py +++ b/python/setup.py @@ -162,7 +162,12 @@ try: url='https://github.com/apache/spark/tree/master/python', packages=['pyspark', 'pyspark.mllib', + 'pyspark.mllib.linalg', + 'pyspark.mllib.stat', 'pyspark.ml', + 'pyspark.ml.linalg', + 'pyspark.ml.param', + 'pyspark.ml.stat', 'pyspark.sql', 'pyspark.streaming', 'pyspark.bin', |