diff options
author | Kay Ousterhout <kayousterhout@gmail.com> | 2015-02-25 14:55:24 -0800 |
---|---|---|
committer | Kay Ousterhout <kayousterhout@gmail.com> | 2015-02-25 14:55:24 -0800 |
commit | 838a48036c050cef03b8c3620e16b5495cd7beab (patch) | |
tree | 9525375a6711283a1c4b302360b777fa11296463 /python/docs/pyspark.sql.rst | |
parent | 9f603fce78fcc997926e9a72dec44d48cbc396fc (diff) | |
download | spark-838a48036c050cef03b8c3620e16b5495cd7beab.tar.gz spark-838a48036c050cef03b8c3620e16b5495cd7beab.tar.bz2 spark-838a48036c050cef03b8c3620e16b5495cd7beab.zip |
[SPARK-5982] Remove incorrect Local Read Time Metric
This metric is incomplete, because the files are memory mapped, so much of the read from disk occurs later as tasks actually read the file's data.
This should be merged into 1.3, so that we never expose this incorrect metric to users.
CC pwendell ksakellis sryza
Author: Kay Ousterhout <kayousterhout@gmail.com>
Closes #4749 from kayousterhout/SPARK-5982 and squashes the following commits:
9737b5e [Kay Ousterhout] More fixes
a1eb300 [Kay Ousterhout] Removed one more use of local read time
cf13497 [Kay Ousterhout] [SPARK-5982] Remove incorrectwq Local Read Time Metric
Diffstat (limited to 'python/docs/pyspark.sql.rst')
0 files changed, 0 insertions, 0 deletions