diff options
| author | zero323 <zero323@users.noreply.github.com> | 2017-03-26 16:49:27 -0700 |
|---|---|---|
| committer | Joseph K. Bradley <joseph@databricks.com> | 2017-03-26 16:49:27 -0700 |
| commit | 0bc8847aa216497549c78ad49ec7ac066a059b15 (patch) | |
| tree | b49699bc182a8ed1201fd9e494d5d0c0d759b53f /dev/sparktestsupport | |
| parent | 617ab6445ea33d8297f0691723fd19bae19228dc (diff) | |
| download | spark-0bc8847aa216497549c78ad49ec7ac066a059b15.tar.gz spark-0bc8847aa216497549c78ad49ec7ac066a059b15.tar.bz2 spark-0bc8847aa216497549c78ad49ec7ac066a059b15.zip | |
[SPARK-19281][PYTHON][ML] spark.ml Python API for FPGrowth
## What changes were proposed in this pull request?
- Add `HasSupport` and `HasConfidence` `Params`.
- Add new module `pyspark.ml.fpm`.
- Add `FPGrowth` / `FPGrowthModel` wrappers.
- Provide tests for new features.
## How was this patch tested?
Unit tests.
Author: zero323 <zero323@users.noreply.github.com>
Closes #17218 from zero323/SPARK-19281.
Diffstat (limited to 'dev/sparktestsupport')
| -rw-r--r-- | dev/sparktestsupport/modules.py | 5 |
1 files changed, 3 insertions, 2 deletions
diff --git a/dev/sparktestsupport/modules.py b/dev/sparktestsupport/modules.py index 10ad1fe3aa..eaf1f3a1db 100644 --- a/dev/sparktestsupport/modules.py +++ b/dev/sparktestsupport/modules.py @@ -423,15 +423,16 @@ pyspark_ml = Module( "python/pyspark/ml/" ], python_test_goals=[ - "pyspark.ml.feature", "pyspark.ml.classification", "pyspark.ml.clustering", + "pyspark.ml.evaluation", + "pyspark.ml.feature", + "pyspark.ml.fpm", "pyspark.ml.linalg.__init__", "pyspark.ml.recommendation", "pyspark.ml.regression", "pyspark.ml.tuning", "pyspark.ml.tests", - "pyspark.ml.evaluation", ], blacklisted_python_implementations=[ "PyPy" # Skip these tests under PyPy since they require numpy and it isn't available there |