diff options
author | Yong Gang Cao <ygcao@amazon.com> | 2016-02-22 09:47:36 +0000 |
---|---|---|
committer | Sean Owen <sowen@cloudera.com> | 2016-02-22 09:47:36 +0000 |
commit | ef1047fca789e5470b7b12974f0435d6d1c4f2d5 (patch) | |
tree | 9c9e646565e0b7603b0da5b7f272406acf78a8a6 /python/pyspark/sql/functions.py | |
parent | 8f35d3eac9268127512851e52864e64b0bae2f33 (diff) | |
download | spark-ef1047fca789e5470b7b12974f0435d6d1c4f2d5.tar.gz spark-ef1047fca789e5470b7b12974f0435d6d1c4f2d5.tar.bz2 spark-ef1047fca789e5470b7b12974f0435d6d1c4f2d5.zip |
[SPARK-12153][SPARK-7617][MLLIB] add support of arbitrary length sentence and other tuning for Word2Vec
add support of arbitrary length sentence by using the nature representation of sentences in the input.
add new similarity functions and add normalization option for distances in synonym finding
add new accessor for internal structure(the vocabulary and wordindex) for convenience
need instructions about how to set value for the Since annotation for newly added public functions. 1.5.3?
jira link: https://issues.apache.org/jira/browse/SPARK-12153
Author: Yong Gang Cao <ygcao@amazon.com>
Author: Yong-Gang Cao <ygcao@users.noreply.github.com>
Closes #10152 from ygcao/improvementForSentenceBoundary.
Diffstat (limited to 'python/pyspark/sql/functions.py')
0 files changed, 0 insertions, 0 deletions