diff options
author | Patrick Wendell <pwendell@gmail.com> | 2014-03-10 16:28:41 -0700 |
---|---|---|
committer | Patrick Wendell <pwendell@gmail.com> | 2014-03-10 16:28:41 -0700 |
commit | 2a5161708f4d2f743c7bd69ed3d98bb7bff46460 (patch) | |
tree | a3c2a2531354e421480e8264b56e5e562e9d3dca /yarn | |
parent | a59419c27e45f06be5143c58d48affb0a5158bdf (diff) | |
download | spark-2a5161708f4d2f743c7bd69ed3d98bb7bff46460.tar.gz spark-2a5161708f4d2f743c7bd69ed3d98bb7bff46460.tar.bz2 spark-2a5161708f4d2f743c7bd69ed3d98bb7bff46460.zip |
SPARK-1205: Clean up callSite/origin/generator.
This patch removes the `generator` field and simplifies + documents
the tracking of callsites.
There are two places where we care about call sites, when a job is
run and when an RDD is created. This patch retains both of those
features but does a slight refactoring and renaming to make things
less confusing.
There was another feature of an rdd called the `generator` which was
by default the user class that in which the RDD was created. This is
used exclusively in the JobLogger. It been subsumed by the ability
to name a job group. The job logger can later be refectored to
read the job group directly (will require some work) but for now
this just preserves the default logged value of the user class.
I'm not sure any users ever used the ability to override this.
Author: Patrick Wendell <pwendell@gmail.com>
Closes #106 from pwendell/callsite and squashes the following commits:
fc1d009 [Patrick Wendell] Compile fix
e17fb76 [Patrick Wendell] Review feedback: callSite -> creationSite
62e77ef [Patrick Wendell] Review feedback
576e60b [Patrick Wendell] SPARK-1205: Clean up callSite/origin/generator.
Diffstat (limited to 'yarn')
0 files changed, 0 insertions, 0 deletions