spark - Mirror of Apache Spark

	Commit message (Collapse)	Author	Age	Files	Lines
*	Change build and run instructions to use assemblies	Matei Zaharia	2013-08-29	7	-13/+13
\| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \|	This commit makes Spark invocation saner by using an assembly JAR to find all of Spark's dependencies instead of adding all the JARs in lib_managed. It also packages the examples into an assembly and uses that as SPARK_EXAMPLES_JAR. Finally, it replaces the old "run" script with two better-named scripts: "run-examples" for examples, and "spark-class" for Spark internal classes (e.g. REPL, master, etc). This is also designed to minimize the confusion people have in trying to use "run" to run their own classes; it's not meant to do that, but now at least if they look at it, they can modify run-examples to do a decent job for them. As part of this, Bagel's examples are also now properly moved to the examples package instead of bagel.
*	Merge pull request #865 from tgravescs/fixtmpdir	Matei Zaharia	2013-08-28	1	-3/+1
\|\ \| \| \| \|	Spark on Yarn should use yarn approved directories for spark.local.dir and tmp
\| *	Update docs and remove old reference to --user option	Y.CORP.YAHOO.COM\tgraves	2013-08-26	1	-3/+1
\| \|
* \|	fix typos	Y.CORP.YAHOO.COM\tgraves	2013-08-26	1	-1/+1
\| \|
* \|	Add ability for user to specify environment variables	Y.CORP.YAHOO.COM\tgraves	2013-08-26	1	-0/+6
\|/
*	Version bump for ec2 docs	Patrick Wendell	2013-08-24	1	-1/+1
\|
*	Merge remote-tracking branch 'mesos/master' into ec2-updates	Patrick Wendell	2013-08-24	6	-29/+84
\|\
\| *	Merge pull request #701 from ScrapCodes/documentation-suggestions	Matei Zaharia	2013-08-22	2	-3/+51
\| \|\ \| \| \| \| \| \|	Documentation suggestions for spark streaming.
\| \| *	Linking custom receiver guide	Prashant Sharma	2013-08-23	1	-0/+3
\| \| \|
\| \| *	Improved documentation for spark custom receiver	Prashant Sharma	2013-08-23	1	-3/+48
\| \| \|
\| * \|	Remove references to unsupported Hadoop versions	Jey Kottalam	2013-08-21	1	-1/+1
\| \| \|
\| * \|	Update build docs	Jey Kottalam	2013-08-21	2	-24/+31
\| \| \|
\| * \|	Update jekyll plugin to match docs/README.md	Jey Kottalam	2013-08-21	1	-1/+1
\| \| \|
\| * \|	Update docs for Spark UI port	Matei Zaharia	2013-08-20	1	-1/+1
\| \| \|
* \| \|	Merge branch 'master' into ec2-updates	Patrick Wendell	2013-08-21	7	-53/+90
\|\\| \| \| \| \| \| \| \| \| \| \| \| \| \|	Conflicts: ec2/spark_ec2.py
\| * \|	Merge remote-tracking branch 'jey/hadoop-agnostic'	Matei Zaharia	2013-08-20	1	-2/+2
\| \|\ \ \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \|	Conflicts: core/src/main/scala/spark/PairRDDFunctions.scala
\| \| * \|	update YARN docs	Jey Kottalam	2013-08-15	1	-2/+2
\| \| \| \|
\| * \| \|	Address some review comments:	Matei Zaharia	2013-08-18	1	-2/+28
\| \|/ / \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \|	- When a resourceOffers() call has multiple offers, force the TaskSets to consider them in increasing order of locality levels so that they get a chance to launch stuff locally across all offers - Simplify ClusterScheduler.prioritizeContainers - Add docs on the new configuration options
\| * \|	Merge pull request #809 from shivaram/sgd-cleanup	Evan Sparks	2013-08-12	2	-1/+2
\| \|\ \ \| \| \| \| \| \| \| \|	Clean up scaladoc in ML Lib.
\| \| * \|	Add ML Lib scaladoc to API dropdown	Shivaram Venkataraman	2013-08-11	1	-0/+1
\| \| \| \|
\| \| * \|	Clean up scaladoc in ML Lib.	Shivaram Venkataraman	2013-08-11	1	-1/+1
\| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \|	Also build and copy ML Lib scaladoc in Spark docs build. Some more minor cleanup with respect to naming, test locations etc.
\| * \| \|	Removing dead docs	Patrick Wendell	2013-08-11	1	-41/+0
\| \|/ /
\| * \|	Merge pull request #787 from ash211/master	Matei Zaharia	2013-08-06	1	-1/+1
\| \|\ \ \| \| \| \| \| \| \| \|	Update spark-standalone.md
\| \| * \|	Update spark-standalone.md	Andrew Ash	2013-08-07	1	-1/+1
\| \| \| \|
\| * \| \|	Merge remote-tracking branch 'dlyubimov/SPARK-827'	Matei Zaharia	2013-07-31	1	-0/+8
\| \|\ \ \ \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \|	Conflicts: docs/configuration.md
\| \| * \| \|	typo	Dmitriy Lyubimov	2013-07-27	1	-1/+1
\| \| \| \| \|
\| \| * \| \|	changes per comments.	Dmitriy Lyubimov	2013-07-27	1	-0/+8
\| \| \| \| \|
\| * \| \| \|	Documentation update for compression codec.	Reynold Xin	2013-07-30	1	-3/+18
\| \| \| \| \|
\| * \| \| \|	Add docs about ipython	Matei Zaharia	2013-07-29	1	-3/+31
\| \| \| \| \|
* \| \| \| \|	Merge branch 'master' into ec2-updates	Patrick Wendell	2013-07-31	9	-40/+120
\|\\| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \|	Conflicts: ec2/deploy.generic/root/mesos-ec2/ec2-variables.sh
\| * \| \| \|	Consistently invoke bash with /usr/bin/env bash in scripts to make code more ↵	Ubuntu	2013-07-18	1	-1/+1
\| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \|	portable (JIRA Ticket SPARK-817)
\| * \| \| \|	Add Apache license headers and LICENSE and NOTICE files	Matei Zaharia	2013-07-16	1	-0/+17
\| \| \|_\|/ \| \|/\| \|
\| * \| \|	Add an option to disable reference tracking in Kryo	Matei Zaharia	2013-07-15	1	-1/+11
\| \| \| \|
\| * \| \|	Fixes typos in Spark Streaming Programming Guide	Andy Konwinski	2013-07-12	1	-2/+2
\| \| \| \| \| \| \| \| \| \| \| \|	These typos were reported on the spark-users mailing list, see: https://groups.google.com/d/msg/spark-users/SyLGgJlKCrI/LpeBypOkSMUJ
\| * \| \|	Merge remote-tracking branch 'pwendell/ui-updates'	Matei Zaharia	2013-07-06	1	-2/+9
\| \|\ \ \ \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \|	Conflicts: core/src/main/scala/spark/scheduler/DAGScheduler.scala core/src/main/scala/spark/util/AkkaUtils.scala pom.xml
\| \| * \| \|	Adding config option for retained stages	Patrick Wendell	2013-06-26	1	-2/+9
\| \| \|/ /
\| * \| \|	Clarify that PySpark is not supported on Windows	root	2013-07-01	1	-3/+2
\| \| \| \|
\| * \| \|	Update docs on SCALA_LIBRARY_PATH	Matei Zaharia	2013-06-30	1	-1/+3
\| \| \| \|
\| * \| \|	Made use of spark.executor.memory setting consistent and documented it	Matei Zaharia	2013-06-30	3	-17/+25
\| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \|	Conflicts: core/src/main/scala/spark/SparkContext.scala
\| * \| \|	Simplify Python docs a little to do substring search	Matei Zaharia	2013-06-26	1	-4/+3
\| \| \| \|
\| * \| \|	Merge branch 'master' into streaming	Tathagata Das	2013-06-24	17	-108/+245
\| \|\ \ \ \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \|	Conflicts: .gitignore
\| \| * \| \|	ADD_JARS environment variable for spark-shell	Matei Zaharia	2013-06-22	1	-2/+8
\| \| \|/ /
\| \| * \|	Fixed a couple typos and formating problems in the YARN documentation.	Reynold Xin	2013-05-17	1	-9/+11
\| \| \| \|
\| \| * \|	Merge branch 'master' of https://github.com/mridulm/spark	Reynold Xin	2013-05-17	1	-1/+1
\| \| \|\ \
\| \| \| * \|	Fix example jar name	Mridul Muralidharan	2013-05-17	1	-1/+1
\| \| \| \| \|
\| \| * \| \|	Updated Scala version in docs generation ruby script.	Reynold Xin	2013-05-16	1	-1/+1
\| \| \|/ /
\| \| * \|	Fix documentation to use yarn-standalone as master	Mridul Muralidharan	2013-05-16	1	-2/+2
\| \| \| \|
\| \| * \|	Fix running on yarn documentation	Mridul Muralidharan	2013-05-16	1	-4/+22
\| \| \| \|
\| \| * \|	Docs: Mention spark shell's default for MASTER	Andrew Ash	2013-05-15	1	-0/+2
\| \| \| \|
\| \| * \|	1) Add support for HADOOP_CONF_DIR (and/or YARN_CONF_DIR - use either) : ↵	Mridul Muralidharan	2013-05-11	1	-0/+3
\| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \|	which is used to specify the client side configuration directory : which needs to be part of the CLASSPATH. 2) Move from var+=".." to var="$var.." : the former does not work on older bash shells unfortunately.