diff options
author | Liquan Pei <liquanpei@gmail.com> | 2014-10-07 16:43:34 -0700 |
---|---|---|
committer | Xiangrui Meng <meng@databricks.com> | 2014-10-07 16:43:34 -0700 |
commit | 098c7344e64e69dffdcf0d95fe1c9e65a54e98f3 (patch) | |
tree | f092d22cf1eb086f298ee3fa8a782fa3481bdf88 /python/docs/pyspark.mllib.rst | |
parent | 3d7b36e0de26049e8b36b6705d8ff4224bde9eb1 (diff) | |
download | spark-098c7344e64e69dffdcf0d95fe1c9e65a54e98f3.tar.gz spark-098c7344e64e69dffdcf0d95fe1c9e65a54e98f3.tar.bz2 spark-098c7344e64e69dffdcf0d95fe1c9e65a54e98f3.zip |
[SPARK-3486][MLlib][PySpark] PySpark support for Word2Vec
mengxr
Added PySpark support for Word2Vec
Change list
(1) PySpark support for Word2Vec
(2) SerDe support of string sequence both on python side and JVM side
(3) Test for SerDe of string sequence on JVM side
Author: Liquan Pei <liquanpei@gmail.com>
Closes #2356 from Ishiihara/Word2Vec-python and squashes the following commits:
476ea34 [Liquan Pei] style fixes
b13a0b9 [Liquan Pei] resolve merge conflicts and minor fixes
8671eba [Liquan Pei] Merge remote-tracking branch 'upstream/master' into Word2Vec-python
daf88a6 [Liquan Pei] modification according to feedback
a73fa19 [Liquan Pei] clean up
3d8007b [Liquan Pei] fix findSynonyms for vector
1bdcd2e [Liquan Pei] minor fixes
cdef9f4 [Liquan Pei] add missing comments
b7447eb [Liquan Pei] modify according to feedback
b9a7383 [Liquan Pei] cache words RDD in fit
89490bf [Liquan Pei] add tests and Word2VecModelWrapper
78bbb53 [Liquan Pei] use pickle for seq string SerDe
a264b08 [Liquan Pei] Merge remote-tracking branch 'upstream/master' into Word2Vec-python
ca1e5ff [Liquan Pei] fix test
68e7276 [Liquan Pei] minor style fixes
48d5e72 [Liquan Pei] Functionality improvement
0ad3ac1 [Liquan Pei] minor fix
c867fdf [Liquan Pei] add Word2Vec to pyspark
Diffstat (limited to 'python/docs/pyspark.mllib.rst')
-rw-r--r-- | python/docs/pyspark.mllib.rst | 8 |
1 files changed, 8 insertions, 0 deletions
diff --git a/python/docs/pyspark.mllib.rst b/python/docs/pyspark.mllib.rst index e95d19e97f..4548b8739e 100644 --- a/python/docs/pyspark.mllib.rst +++ b/python/docs/pyspark.mllib.rst @@ -20,6 +20,14 @@ pyspark.mllib.clustering module :undoc-members: :show-inheritance: +pyspark.mllib.feature module +------------------------------- + +.. automodule:: pyspark.mllib.feature + :members: + :undoc-members: + :show-inheritance: + pyspark.mllib.linalg module --------------------------- |