spark - Mirror of Apache Spark

	Commit message (Collapse)	Author	Age	Files	Lines
*	Fix finding of assembly JAR, as well as some pointers to ./run	Matei Zaharia	2013-08-29	1	-1/+1
\|
*	Change build and run instructions to use assemblies	Matei Zaharia	2013-08-29	1	-68/+14
\| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \|	This commit makes Spark invocation saner by using an assembly JAR to find all of Spark's dependencies instead of adding all the JARs in lib_managed. It also packages the examples into an assembly and uses that as SPARK_EXAMPLES_JAR. Finally, it replaces the old "run" script with two better-named scripts: "run-examples" for examples, and "spark-class" for Spark internal classes (e.g. REPL, master, etc). This is also designed to minimize the confusion people have in trying to use "run" to run their own classes; it's not meant to do that, but now at least if they look at it, they can modify run-examples to do a decent job for them. As part of this, Bagel's examples are also now properly moved to the examples package instead of bagel.
*	Don't assume spark-examples JAR always exists	Jey Kottalam	2013-08-18	1	-2/+3
\|
*	Maven build now also works with YARN	Jey Kottalam	2013-08-16	1	-1/+1
\|
*	yarn support	Jey Kottalam	2013-08-15	1	-0/+2
\|
*	Fix setting of SPARK_EXAMPLES_JAR	Jey Kottalam	2013-07-24	1	-11/+0
\|
*	Add JavaAPICompletenessChecker.	Josh Rosen	2013-07-22	1	-0/+2
\| \| \| \| \| \| \| \| \| \| \|	This is used to find methods in the Scala API that need to be ported to the Java API. To use it: ./run spark.tools.JavaAPICompletenessChecker Conflicts: project/SparkBuild.scala run run2.cmd
*	Consistently invoke bash with /usr/bin/env bash in scripts to make code more ↵	Ubuntu	2013-07-18	1	-1/+1
\| \| \| \|	portable (JIRA Ticket SPARK-817)
*	Some missing license headers	Matei Zaharia	2013-07-16	1	-0/+17
\|
*	Merge remote-tracking branch 'origin/pr/662'	Matei Zaharia	2013-07-13	1	-49/+62
\|\ \| \| \| \| \| \| \| \|	Conflicts: bin/compute-classpath.sh
\| *	Merge branch 'master' into 2013-06/assembly-jar-deploy	Evan Chan	2013-06-28	1	-48/+61
\| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \|	Conflicts: run Previous changes that I made to run and set-dev-classpath.sh instead have been folded into compute-classpath.sh
* \|	Renamed ML package to MLlib and added it to classpath	Matei Zaharia	2013-07-05	1	-0/+2
\|/
*	Fix computation of classpath when we launch java directly	Matei Zaharia	2013-06-25	1	-0/+89
	The previous version assumed that a CLASSPATH environment variable was set by the "run" script when launching the process that starts the ExecutorRunner, but unfortunately this is not true in tests. Instead, we factor the classpath calculation into an extenral script and call that. NOTE: This includes a Windows version but hasn't yet been tested there.