aboutsummaryrefslogtreecommitdiff
path: root/spark-class
Commit message (Collapse)AuthorAgeFilesLines
* Add spark-tools assembly to spark-class classpath.Josh Rosen2013-11-091-0/+13
| | | | | This allows the JavaAPICompletenessChecker to be run with Spark 0.8+.
* Adding improved error message when multiple assembly jars are present.Patrick Wendell2013-10-251-4/+11
| | | | This can happen easily if building different hadoop versions.
* Add "org.apache." prefix to packages in spark-classAaron Davidson2013-09-201-6/+6
| | | | Lacking this, the if/case statements never trigger on Spark 0.8.0+.
* Run script fixes for Windows after package & assembly changeMatei Zaharia2013-09-011-1/+1
|
* Merge pull request #880 from mateiz/ui-tweaksMatei Zaharia2013-08-311-7/+0
|\ | | | | Various UI tweaks
| * Delete some code that was added back in a merge and print less info inMatei Zaharia2013-08-311-7/+0
| | | | | | | | spark-daemon
* | More doc improvements + better warnings when you haven't built SparkMatei Zaharia2013-08-301-2/+2
|/
* Change build and run instructions to use assembliesMatei Zaharia2013-08-291-0/+124
This commit makes Spark invocation saner by using an assembly JAR to find all of Spark's dependencies instead of adding all the JARs in lib_managed. It also packages the examples into an assembly and uses that as SPARK_EXAMPLES_JAR. Finally, it replaces the old "run" script with two better-named scripts: "run-examples" for examples, and "spark-class" for Spark internal classes (e.g. REPL, master, etc). This is also designed to minimize the confusion people have in trying to use "run" to run their own classes; it's not meant to do that, but now at least if they look at it, they can modify run-examples to do a decent job for them. As part of this, Bagel's examples are also now properly moved to the examples package instead of bagel.