diff options
author | Reynold Xin <rxin@databricks.com> | 2015-10-21 15:33:13 -0700 |
---|---|---|
committer | Kay Ousterhout <kayousterhout@gmail.com> | 2015-10-21 15:33:13 -0700 |
commit | 555b2086a1ee432067de77032f1e3c64735481f0 (patch) | |
tree | 32a568413dae918a88145d1b847489f850af3978 /docker | |
parent | f481090a71940f06602a73f5bbd004980dea026f (diff) | |
download | spark-555b2086a1ee432067de77032f1e3c64735481f0.tar.gz spark-555b2086a1ee432067de77032f1e3c64735481f0.tar.bz2 spark-555b2086a1ee432067de77032f1e3c64735481f0.zip |
Minor cleanup of ShuffleMapStage.outputLocs code.
I was looking at this code and found the documentation to be insufficient. I added more documentation, and refactored some relevant code path slightly to improve encapsulation. There are more that I want to do, but I want to get these changes in before doing more work.
My goal is to reduce exposing internal fields directly in ShuffleMapStage to improve encapsulation. After this change, DAGScheduler no longer directly writes outputLocs. There are still 3 places that reads outputLocs directly, but we can change those later.
Author: Reynold Xin <rxin@databricks.com>
Closes #9175 from rxin/stage-cleanup.
Diffstat (limited to 'docker')
0 files changed, 0 insertions, 0 deletions