diff options
| author | Joseph K. Bradley <joseph@databricks.com> | 2016-03-25 16:00:09 -0700 |
|---|---|---|
| committer | Xiangrui Meng <meng@databricks.com> | 2016-03-25 16:00:09 -0700 |
| commit | 54d13bed87fcf2968f77e1f1153e85184ec91d78 (patch) | |
| tree | fe1aba5bcf9c5af86db892a6fd2facfa7114bab0 /external/flume-sink | |
| parent | ff7cc45f521c63ce40f955b8995d52a79dca17b4 (diff) | |
| download | spark-54d13bed87fcf2968f77e1f1153e85184ec91d78.tar.gz spark-54d13bed87fcf2968f77e1f1153e85184ec91d78.tar.bz2 spark-54d13bed87fcf2968f77e1f1153e85184ec91d78.zip | |
[SPARK-14159][ML] Fixed bug in StringIndexer + related issue in RFormula
## What changes were proposed in this pull request?
StringIndexerModel.transform sets the output column metadata to use name inputCol. It should not. Fixing this causes a problem with the metadata produced by RFormula.
Fix in RFormula: I added the StringIndexer columns to prefixesToRewrite, and I modified VectorAttributeRewriter to find and replace all "prefixes" since attributes collect multiple prefixes from StringIndexer + Interaction.
Note that "prefixes" is no longer accurate since internal strings may be replaced.
## How was this patch tested?
Unit test which failed before this fix.
Author: Joseph K. Bradley <joseph@databricks.com>
Closes #11965 from jkbradley/StringIndexer-fix.
Diffstat (limited to 'external/flume-sink')
0 files changed, 0 insertions, 0 deletions