diff options
| author | Wenchen Fan <wenchen@databricks.com> | 2016-06-13 09:58:48 -0700 |
|---|---|---|
| committer | Herman van Hovell <hvanhovell@databricks.com> | 2016-06-13 09:58:48 -0700 |
| commit | cd47e233749f42b016264569a214cbf67f45f436 (patch) | |
| tree | 96fdef37e4746dc7e06535f9822538458536134a /repl | |
| parent | d681742b2d37bd68cf5d8d3161e0f48846f6f9d4 (diff) | |
| download | spark-cd47e233749f42b016264569a214cbf67f45f436.tar.gz spark-cd47e233749f42b016264569a214cbf67f45f436.tar.bz2 spark-cd47e233749f42b016264569a214cbf67f45f436.zip | |
[SPARK-15814][SQL] Aggregator can return null result
## What changes were proposed in this pull request?
It's similar to the bug fixed in https://github.com/apache/spark/pull/13425, we should consider null object and wrap the `CreateStruct` with `If` to do null check.
This PR also improves the test framework to test the objects of `Dataset[T]` directly, instead of calling `toDF` and compare the rows.
## How was this patch tested?
new test in `DatasetAggregatorSuite`
Author: Wenchen Fan <wenchen@databricks.com>
Closes #13553 from cloud-fan/agg-null.
Diffstat (limited to 'repl')
0 files changed, 0 insertions, 0 deletions