diff options
| author | Wenchen Fan <cloud0fan@outlook.com> | 2015-07-28 21:37:50 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2015-07-28 21:37:50 -0700 |
| commit | 429b2f0df4ef97a3b94cead06a7eb51581eabb18 (patch) | |
| tree | f27883db71a163d4e13953cd66a363b730fa8a19 /core | |
| parent | 3744b7fd42e52011af60cc205fcb4e4b23b35c68 (diff) | |
| download | spark-429b2f0df4ef97a3b94cead06a7eb51581eabb18.tar.gz spark-429b2f0df4ef97a3b94cead06a7eb51581eabb18.tar.bz2 spark-429b2f0df4ef97a3b94cead06a7eb51581eabb18.zip | |
[SPARK-8608][SPARK-8609][SPARK-9083][SQL] reset mutable states of nondeterministic expression before evaluation and fix PullOutNondeterministic
We will do local projection for LocalRelation, and thus reuse the same Expression object among multiply evaluations. We should reset the mutable states of Expression before evaluate it.
Fix `PullOutNondeterministic` rule to make it work for `Sort`.
Also got a chance to cleanup the dataframe test suite.
Author: Wenchen Fan <cloud0fan@outlook.com>
Closes #7674 from cloud-fan/show and squashes the following commits:
888934f [Wenchen Fan] fix sort
c0e93e8 [Wenchen Fan] local DataFrame with random columns should return same value when call `show`
Diffstat (limited to 'core')
0 files changed, 0 insertions, 0 deletions