| Commit message (Collapse) | Author | Age | Files | Lines |
|
|
|
| |
Signed-off-by: shane-huang <shengsheng.huang@intel.com>
|
|
|
|
| |
Signed-off-by: shane-huang <shengsheng.huang@intel.com>
|
| |
|
|
|
|
| |
spark-daemon
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
This commit makes Spark invocation saner by using an assembly JAR to
find all of Spark's dependencies instead of adding all the JARs in
lib_managed. It also packages the examples into an assembly and uses
that as SPARK_EXAMPLES_JAR. Finally, it replaces the old "run" script
with two better-named scripts: "run-examples" for examples, and
"spark-class" for Spark internal classes (e.g. REPL, master, etc). This
is also designed to minimize the confusion people have in trying to use
"run" to run their own classes; it's not meant to do that, but now at
least if they look at it, they can modify run-examples to do a decent
job for them.
As part of this, Bagel's examples are also now properly moved to the
examples package instead of bagel.
|
|
|
|
|
|
| |
For debugging and analysis purposes, it's nice to have the exact command
used to launch Spark contained within the logs. This adds the necessary
hooks to make that possible.
|
| |
|
|
|
|
| |
workers from overriding each other's logs
|
|
|
|
| |
instances/processes on every slave machine
|
| |
|
| |
|
|
Heavily inspired by Hadoop cluster scripts ;-)
|