diff options
| author | gatorsmile <gatorsmile@gmail.com> | 2016-03-24 11:13:36 +0800 |
|---|---|---|
| committer | Wenchen Fan <wenchen@databricks.com> | 2016-03-24 11:13:36 +0800 |
| commit | f42eaf42bdca8bc6f390f1f31ee60faa1662489b (patch) | |
| tree | d5f84d22eb06d95fd4b20a79a6ccaaa34c911d89 /python/pyspark | |
| parent | de4e48b62b998d45d4a749234741a45534719497 (diff) | |
| download | spark-f42eaf42bdca8bc6f390f1f31ee60faa1662489b.tar.gz spark-f42eaf42bdca8bc6f390f1f31ee60faa1662489b.tar.bz2 spark-f42eaf42bdca8bc6f390f1f31ee60faa1662489b.zip | |
[SPARK-14085][SQL] Star Expansion for Hash
#### What changes were proposed in this pull request?
This PR is to support star expansion in hash. For example,
```SQL
val structDf = testData2.select("a", "b").as("record")
structDf.select(hash($"*")
```
In addition, it refactors the codes for the rule `ResolveStar` and fixes a regression for star expansion in group by when using SQL API. For example,
```SQL
SELECT * FROM testData2 group by a, b
```
cc cloud-fan Now, the code for star resolution is much cleaner. The coverage is better. Could you check if this refactoring is good? Thanks!
#### How was this patch tested?
Added a few test cases to cover it.
Author: gatorsmile <gatorsmile@gmail.com>
Closes #11904 from gatorsmile/starResolution.
Diffstat (limited to 'python/pyspark')
0 files changed, 0 insertions, 0 deletions