diff options
| author | Wenchen Fan <wenchen@databricks.com> | 2016-11-10 13:03:59 +0800 |
|---|---|---|
| committer | Wenchen Fan <wenchen@databricks.com> | 2016-11-10 13:03:59 +0800 |
| commit | 6021c95a3aa3858b0499782b23b08ef92c73245d (patch) | |
| tree | ba777f7f27014d67f90a1a7afb965e1848ebc2bf /python/pyspark/worker.py | |
| parent | 3f62e1b5d9e75dc07bac3aa4db3e8d0615cc3cc3 (diff) | |
| download | spark-6021c95a3aa3858b0499782b23b08ef92c73245d.tar.gz spark-6021c95a3aa3858b0499782b23b08ef92c73245d.tar.bz2 spark-6021c95a3aa3858b0499782b23b08ef92c73245d.zip | |
[SPARK-18147][SQL] do not fail for very complex aggregator result type
## What changes were proposed in this pull request?
~In `TypedAggregateExpression.evaluateExpression`, we may create `ReferenceToExpressions` with `CreateStruct`, and `CreateStruct` may generate too many codes and split them into several methods. `ReferenceToExpressions` will replace `BoundReference` in `CreateStruct` with `LambdaVariable`, which can only be used as local variables and doesn't work if we split the generated code.~
It's already fixed by #15693 , this pr adds regression test
## How was this patch tested?
new test in `DatasetAggregatorSuite`
Author: Wenchen Fan <wenchen@databricks.com>
Closes #15807 from cloud-fan/typed-agg.
Diffstat (limited to 'python/pyspark/worker.py')
0 files changed, 0 insertions, 0 deletions