aboutsummaryrefslogtreecommitdiff
path: root/bin
Commit message (Collapse)AuthorAgeFilesLines
* yarn supportJey Kottalam2013-08-152-0/+4
|
* Log the launch command for Spark daemonsPatrick Wendell2013-08-021-1/+4
| | | | | | For debugging and analysis purposes, it's nice to have the exact command used to launch Spark contained within the logs. This adds the necessary hooks to make that possible.
* Fix setting of SPARK_EXAMPLES_JARJey Kottalam2013-07-241-11/+0
|
* Add JavaAPICompletenessChecker.Josh Rosen2013-07-222-0/+4
| | | | | | | | | | | This is used to find methods in the Scala API that need to be ported to the Java API. To use it: ./run spark.tools.JavaAPICompletenessChecker Conflicts: project/SparkBuild.scala run run2.cmd
* Consistently invoke bash with /usr/bin/env bash in scripts to make code more ↵Ubuntu2013-07-181-1/+1
| | | | portable (JIRA Ticket SPARK-817)
* Some missing license headersMatei Zaharia2013-07-162-0/+34
|
* Add Apache license headers and LICENSE and NOTICE filesMatei Zaharia2013-07-1611-7/+158
|
* Merge remote-tracking branch 'origin/pr/662'Matei Zaharia2013-07-132-49/+65
|\ | | | | | | | | Conflicts: bin/compute-classpath.sh
| * Merge branch 'master' into 2013-06/assembly-jar-deployEvan Chan2013-06-282-0/+154
| |\ | | | | | | | | | | | | | | | | | | | | | Conflicts: run Previous changes that I made to run and set-dev-classpath.sh instead have been folded into compute-classpath.sh
| * | Add simple usage to start-slave scriptEvan Chan2013-06-241-0/+3
| | |
* | | Renamed ML package to MLlib and added it to classpathMatei Zaharia2013-07-052-0/+4
| |/ |/|
* | Fixes to compute-classpath on WindowsMatei Zaharia2013-06-261-2/+2
| |
* | Fix computation of classpath when we launch java directlyMatei Zaharia2013-06-252-0/+141
| | | | | | | | | | | | | | | | | | The previous version assumed that a CLASSPATH environment variable was set by the "run" script when launching the process that starts the ExecutorRunner, but unfortunately this is not true in tests. Instead, we factor the classpath calculation into an extenral script and call that. NOTE: This includes a Windows version but hasn't yet been tested there.
* | Revert "Fix start-slave not passing instance number to spark-daemon."Matei Zaharia2013-06-111-1/+1
| | | | | | | | This reverts commit a674d67c0aebb940e3b816e2307206115baec175.
* | Fix start-slave not passing instance number to spark-daemon.Stephen Haberman2013-05-281-1/+1
|/
* Use ec2-metadata in start-slave.sh.Josh Rosen2013-05-241-1/+2
| | | | | | | | PR #419 applied the same change, but only to start-master.sh, so some workers were still starting their web UI's using internal addresses. This should finally fix SPARK-613.
* spark instance number must be present in log filename to prevent multiple ↵kalpit2013-03-261-2/+2
| | | | workers from overriding each other's logs
* added SPARK_WORKER_INSTANCES : allows spawning multiple worker ↵kalpit2013-03-267-8/+29
| | | | instances/processes on every slave machine
* Detect whether we run on EC2 using ec2-metadata as wellShivaram Venkataraman2013-01-261-1/+2
|
* Use spark-env.sh to configure standalone master. See SPARK-638.Josh Rosen2012-12-143-5/+19
| | | | Also fixed a typo in the standalone mode documentation.
* Use external addresses in standalone WebUI on EC2.Josh Rosen2012-12-013-3/+28
|
* Use hostname instead of IP in deploy scripts to let Akka connect properlyMatei Zaharia2012-11-271-13/+2
|
* Use SPARK_MASTER_IP if it is set in start-slaves.sh.Reynold Xin2012-10-191-2/+16
|
* Update license info on deploy scriptsMatei Zaharia2012-09-252-0/+6
|
* Add Apache license to non-trivial scripts taken from Hadoop.Denny2012-08-042-0/+30
|
* Read config variables before to get the master portDenny2012-08-021-0/+4
|
* Settings variables and bugfix for stop script.Denny2012-08-022-2/+2
|
* Spark standalone mode cluster scripts.Denny2012-08-0110-0/+308
Heavily inspired by Hadoop cluster scripts ;-)