Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Change build and run instructions to use assemblies | Matei Zaharia | 2013-08-29 | 1 | -4/+4 |
| | | | | | | | | | | | | | | | | This commit makes Spark invocation saner by using an assembly JAR to find all of Spark's dependencies instead of adding all the JARs in lib_managed. It also packages the examples into an assembly and uses that as SPARK_EXAMPLES_JAR. Finally, it replaces the old "run" script with two better-named scripts: "run-examples" for examples, and "spark-class" for Spark internal classes (e.g. REPL, master, etc). This is also designed to minimize the confusion people have in trying to use "run" to run their own classes; it's not meant to do that, but now at least if they look at it, they can modify run-examples to do a decent job for them. As part of this, Bagel's examples are also now properly moved to the examples package instead of bagel. | ||||
* | Log the launch command for Spark daemons | Patrick Wendell | 2013-08-02 | 1 | -1/+4 |
| | | | | | | For debugging and analysis purposes, it's nice to have the exact command used to launch Spark contained within the logs. This adds the necessary hooks to make that possible. | ||||
* | Add Apache license headers and LICENSE and NOTICE files | Matei Zaharia | 2013-07-16 | 1 | -3/+2 |
| | |||||
* | spark instance number must be present in log filename to prevent multiple ↵ | kalpit | 2013-03-26 | 1 | -2/+2 |
| | | | | workers from overriding each other's logs | ||||
* | added SPARK_WORKER_INSTANCES : allows spawning multiple worker ↵ | kalpit | 2013-03-26 | 1 | -2/+4 |
| | | | | instances/processes on every slave machine | ||||
* | Update license info on deploy scripts | Matei Zaharia | 2012-09-25 | 1 | -0/+3 |
| | |||||
* | Add Apache license to non-trivial scripts taken from Hadoop. | Denny | 2012-08-04 | 1 | -0/+15 |
| | |||||
* | Spark standalone mode cluster scripts. | Denny | 2012-08-01 | 1 | -0/+135 |
Heavily inspired by Hadoop cluster scripts ;-) |