diff options
| author | freeman <the.freeman.lab@gmail.com> | 2014-08-19 13:28:57 -0700 |
|---|---|---|
| committer | Tathagata Das <tathagata.das1565@gmail.com> | 2014-08-19 13:28:57 -0700 |
| commit | 31f0b071efd0b63eb9d6a6a131e5c4fa28237583 (patch) | |
| tree | 2ce7834721e9296510c91673d67b54528709b2eb /mllib/pom.xml | |
| parent | cbfc26ba45f49559e64276c72e3054c6fe30ddd5 (diff) | |
| download | spark-31f0b071efd0b63eb9d6a6a131e5c4fa28237583.tar.gz spark-31f0b071efd0b63eb9d6a6a131e5c4fa28237583.tar.bz2 spark-31f0b071efd0b63eb9d6a6a131e5c4fa28237583.zip | |
[SPARK-3128][MLLIB] Use streaming test suite for StreamingLR
Refactored tests for streaming linear regression to use existing streaming test utilities. Summary of changes:
- Made ``mllib`` depend on tests from ``streaming``
- Rewrote accuracy and convergence tests to use ``setupStreams`` and ``runStreams``
- Added new test for the accuracy of predictions generated by ``predictOnValue``
These tests should run faster, be easier to extend/maintain, and provide a reference for new tests.
mengxr tdas
Author: freeman <the.freeman.lab@gmail.com>
Closes #2037 from freeman-lab/streamingLR-predict-tests and squashes the following commits:
e851ca7 [freeman] Fixed long lines
50eb0bf [freeman] Refactored tests to use streaming test tools
32c43c2 [freeman] Added test for prediction
Diffstat (limited to 'mllib/pom.xml')
| -rw-r--r-- | mllib/pom.xml | 7 |
1 files changed, 7 insertions, 0 deletions
diff --git a/mllib/pom.xml b/mllib/pom.xml index fc1ecfbea7..c7a1e2ae75 100644 --- a/mllib/pom.xml +++ b/mllib/pom.xml @@ -91,6 +91,13 @@ <artifactId>junit-interface</artifactId> <scope>test</scope> </dependency> + <dependency> + <groupId>org.apache.spark</groupId> + <artifactId>spark-streaming_${scala.binary.version}</artifactId> + <version>${project.version}</version> + <type>test-jar</type> + <scope>test</scope> + </dependency> </dependencies> <profiles> <profile> |