diff options
| author | Wenchen Fan <wenchen@databricks.com> | 2015-10-25 22:47:39 -0700 |
|---|---|---|
| committer | Yin Huai <yhuai@databricks.com> | 2015-10-25 22:47:39 -0700 |
| commit | 07ced43424447699e47106de9ca2fa714756bdeb (patch) | |
| tree | d28370254704b04b7e742b8c2f4985c2b6e03f2f /python/pyspark/sql/dataframe.py | |
| parent | 87f82a5fb9c4350a97c761411069245f07aad46f (diff) | |
| download | spark-07ced43424447699e47106de9ca2fa714756bdeb.tar.gz spark-07ced43424447699e47106de9ca2fa714756bdeb.tar.bz2 spark-07ced43424447699e47106de9ca2fa714756bdeb.zip | |
[SPARK-11253] [SQL] reset all accumulators in physical operators before execute an action
With this change, our query execution listener can get the metrics correctly.
The UI still looks good after this change.
<img width="257" alt="screen shot 2015-10-23 at 11 25 14 am" src="https://cloud.githubusercontent.com/assets/3182036/10683834/d516f37e-7978-11e5-8118-343ed40eb824.png">
<img width="494" alt="screen shot 2015-10-23 at 11 25 01 am" src="https://cloud.githubusercontent.com/assets/3182036/10683837/e1fa60da-7978-11e5-8ec8-178b88f27764.png">
Author: Wenchen Fan <wenchen@databricks.com>
Closes #9215 from cloud-fan/metric.
Diffstat (limited to 'python/pyspark/sql/dataframe.py')
0 files changed, 0 insertions, 0 deletions