diff options
| author | Burak Yavuz <brkyvz@gmail.com> | 2015-07-02 22:10:24 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2015-07-02 22:12:47 -0700 |
| commit | ff76b33b67cec0614143e60f8dc88435521cf3aa (patch) | |
| tree | 8feaa64e1e5be7ea98d321147c0280b8272f5f34 /repl | |
| parent | f142867ecee59a635df91aee888351bee5f29c0e (diff) | |
| download | spark-ff76b33b67cec0614143e60f8dc88435521cf3aa.tar.gz spark-ff76b33b67cec0614143e60f8dc88435521cf3aa.tar.bz2 spark-ff76b33b67cec0614143e60f8dc88435521cf3aa.zip | |
[SPARK-8803] handle special characters in elements in crosstab
cc rxin
Having back ticks or null as elements causes problems.
Since elements become column names, we have to drop them from the element as back ticks are special characters.
Having null throws exceptions, we could replace them with empty strings.
Handling back ticks should be improved for 1.5
Author: Burak Yavuz <brkyvz@gmail.com>
Closes #7201 from brkyvz/weird-ct-elements and squashes the following commits:
e06b840 [Burak Yavuz] fix scalastyle
93a0d3f [Burak Yavuz] added tests for NaN and Infinity
9dba6ce [Burak Yavuz] address cr1
db71dbd [Burak Yavuz] handle special characters in elements in crosstab
(cherry picked from commit 9b23e92c727881ff9038b4fe9643c49b96914159)
Signed-off-by: Reynold Xin <rxin@databricks.com>
Conflicts:
sql/core/src/main/scala/org/apache/spark/sql/execution/stat/StatFunctions.scala
Diffstat (limited to 'repl')
0 files changed, 0 insertions, 0 deletions