diff options
author | Davies Liu <davies@databricks.com> | 2016-01-29 01:59:59 -0800 |
---|---|---|
committer | Reynold Xin <rxin@databricks.com> | 2016-01-29 01:59:59 -0800 |
commit | 55561e7693dd2a5bf3c7f8026c725421801fd0ec (patch) | |
tree | af8a0fbac09a1168e1a4088428a68ed7a5ebd66c /bin/pyspark2.cmd | |
parent | 8d3cc3de7d116190911e7943ef3233fe3b7db1bf (diff) | |
download | spark-55561e7693dd2a5bf3c7f8026c725421801fd0ec.tar.gz spark-55561e7693dd2a5bf3c7f8026c725421801fd0ec.tar.bz2 spark-55561e7693dd2a5bf3c7f8026c725421801fd0ec.zip |
[SPARK-13031][SQL] cleanup codegen and improve test coverage
1. enable whole stage codegen during tests even there is only one operator supports that.
2. split doProduce() into two APIs: upstream() and doProduce()
3. generate prefix for fresh names of each operator
4. pass UnsafeRow to parent directly (avoid getters and create UnsafeRow again)
5. fix bugs and tests.
This PR re-open #10944 and fix the bug.
Author: Davies Liu <davies@databricks.com>
Closes #10977 from davies/gen_refactor.
Diffstat (limited to 'bin/pyspark2.cmd')
0 files changed, 0 insertions, 0 deletions