aboutsummaryrefslogtreecommitdiff
path: root/bin/spark-daemon.sh
Commit message (Collapse)AuthorAgeFilesLines
* Change build and run instructions to use assembliesMatei Zaharia2013-08-291-4/+4
| | | | | | | | | | | | | | | | This commit makes Spark invocation saner by using an assembly JAR to find all of Spark's dependencies instead of adding all the JARs in lib_managed. It also packages the examples into an assembly and uses that as SPARK_EXAMPLES_JAR. Finally, it replaces the old "run" script with two better-named scripts: "run-examples" for examples, and "spark-class" for Spark internal classes (e.g. REPL, master, etc). This is also designed to minimize the confusion people have in trying to use "run" to run their own classes; it's not meant to do that, but now at least if they look at it, they can modify run-examples to do a decent job for them. As part of this, Bagel's examples are also now properly moved to the examples package instead of bagel.
* Log the launch command for Spark daemonsPatrick Wendell2013-08-021-1/+4
| | | | | | For debugging and analysis purposes, it's nice to have the exact command used to launch Spark contained within the logs. This adds the necessary hooks to make that possible.
* Add Apache license headers and LICENSE and NOTICE filesMatei Zaharia2013-07-161-3/+2
|
* spark instance number must be present in log filename to prevent multiple ↵kalpit2013-03-261-2/+2
| | | | workers from overriding each other's logs
* added SPARK_WORKER_INSTANCES : allows spawning multiple worker ↵kalpit2013-03-261-2/+4
| | | | instances/processes on every slave machine
* Update license info on deploy scriptsMatei Zaharia2012-09-251-0/+3
|
* Add Apache license to non-trivial scripts taken from Hadoop.Denny2012-08-041-0/+15
|
* Spark standalone mode cluster scripts.Denny2012-08-011-0/+135
Heavily inspired by Hadoop cluster scripts ;-)