spark - Mirror of Apache Spark

	Commit message (Collapse)	Author	Age	Files	Lines
...
\| \| \| * \| \| \| \| \| \| \| \| \|	Add support for instance local in getPreferredLocations of ↵	Mridul Muralidharan	2013-05-04	2	-10/+38
\| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \|	ZippedPartitionsBaseRDD. Add comments to both ZippedPartitionsBaseRDD and ZippedRDD to better describe the potential problem with the approach
\| \| * \| \| \| \| \| \| \| \| \| \|	Merge from master	Mridul Muralidharan	2013-05-04	20	-102/+452
\| \| \|\ \ \ \ \ \ \ \ \ \ \ \| \| \| \|/ / / / / / / / / / \| \| \|/\| \| \| \| \| \| \| \| \| \|
\| \| * \| \| \| \| \| \| \| \| \| \|	pull from master	Mridul Muralidharan	2013-05-04	19	-131/+376
\| \| \|\ \ \ \ \ \ \ \ \ \ \ \| \| \| \| \|_\|_\|_\|_\|/ / / / / \| \| \| \|/\| \| \| \| \| \| \| \| \|
\| \| * \| \| \| \| \| \| \| \| \| \|	Fix ZippedRDD as part Matei's suggestion	Mridul Muralidharan	2013-05-03	1	-4/+15
\| \| \| \| \| \| \| \| \| \| \| \| \|
\| \| * \| \| \| \| \| \| \| \| \| \|	comment out debug versions of checkHost, etc from Utils - which were used to ↵	Mridul Muralidharan	2013-05-02	1	-2/+2
\| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \|	test
\| \| * \| \| \| \| \| \| \| \| \| \|	Integrate review comments 2	Mridul Muralidharan	2013-05-02	3	-77/+77
\| \| \| \| \| \| \| \| \| \| \| \| \|
\| \| * \| \| \| \| \| \| \| \| \| \|	Integrate review comments on pull request	Mridul Muralidharan	2013-05-02	6	-50/+47
\| \| \| \| \| \| \| \| \| \| \| \| \|
\| \| * \| \| \| \| \| \| \| \| \| \|	Fix some npe introduced accidentally	Mridul Muralidharan	2013-05-01	2	-9/+23
\| \| \| \| \| \| \| \| \| \| \| \| \|
\| \| * \| \| \| \| \| \| \| \| \| \|	a) Add support for hyper local scheduling - specific to a host + port - ↵	Mridul Muralidharan	2013-05-01	14	-99/+244
\| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \|	before trying host local scheduling. b) Add some fixes to test code to ensure it passes (and fixes some other issues). c) Fix bug in task scheduling which incorrectly used availableCores instead of all cores on the node.
\| * \| \| \| \| \| \| \| \| \| \| \|	Merge pull request #608 from pwendell/SPARK-738	Matei Zaharia	2013-05-12	5	-10/+42
\| \|\ \ \ \ \ \ \ \ \ \ \ \ \| \| \|_\|_\|_\|_\|_\|_\|_\|_\|_\|/ / \| \|/\| \| \| \| \| \| \| \| \| \| \|	SPARK-738: Spark should detect and wrap nonserializable exceptions
\| \| * \| \| \| \| \| \| \| \| \| \|	Capturing class name	Patrick Wendell	2013-05-12	4	-5/+8
\| \| \| \| \| \| \| \| \| \| \| \| \|
\| \| * \| \| \| \| \| \| \| \| \| \|	Small fix	Patrick Wendell	2013-05-11	1	-1/+1
\| \| \| \| \| \| \| \| \| \| \| \| \|
\| \| * \| \| \| \| \| \| \| \| \| \|	Removing import	Patrick Wendell	2013-05-11	1	-1/+1
\| \| \| \| \| \| \| \| \| \| \| \| \|
\| \| * \| \| \| \| \| \| \| \| \| \|	Changing technique to use same code path in all cases	Patrick Wendell	2013-05-11	4	-22/+18
\| \| \| \| \| \| \| \| \| \| \| \| \|
\| \| * \| \| \| \| \| \| \| \| \| \|	Removing unnecessary map	Patrick Wendell	2013-05-11	1	-1/+1
\| \| \| \| \| \| \| \| \| \| \| \| \|
\| \| * \| \| \| \| \| \| \| \| \| \|	SPARK-738: Spark should detect and squash nonserializable exceptions	Patrick Wendell	2013-05-11	2	-2/+35
\| \|/ / / / / / / / / / /
\| * \| \| \| \| \| \| \| \| \| \|	Merge pull request #606 from markhamstra/foreachPartition_fix	Reynold Xin	2013-05-10	1	-1/+1
\| \|\ \ \ \ \ \ \ \ \ \ \ \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \|	Actually use the cleaned closure in foreachPartition
\| \| * \| \| \| \| \| \| \| \| \| \|	Actually use the cleaned closure in foreachPartition	Mark Hamstra	2013-05-10	1	-1/+1
\| \|/ / / / / / / / / / /
\| * \| \| \| \| \| \| \| \| \| \|	Revert "Merge pull request #596 from esjewett/master" because the	Reynold Xin	2013-05-09	2	-40/+1
\| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \|	dependency on hbase introduces netty-3.2.2 which conflicts with netty-3.5.3 already in Spark. This caused multiple test failures. This reverts commit 0f1b7a06e1f6782711170234f105f1b277e3b04c, reversing changes made to aacca1b8a85bd073ce185a06d6470b070761b2f4.
\| * \| \| \| \| \| \| \| \| \| \|	Merge pull request #599 from JoshRosen/spark-670	Reynold Xin	2013-05-08	1	-1/+1
\| \|\ \ \ \ \ \ \ \ \ \ \ \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \|	Fix SPARK-670: EC2 'start' command should require -i option.
\| \| * \| \| \| \| \| \| \| \| \| \|	Fix SPARK-670: EC2 start command should require -i option.	Josh Rosen	2013-05-05	1	-1/+1
\| \| \| \|_\|_\|_\|_\|/ / / / / \| \| \|/\| \| \| \| \| \| \| \| \|
\| * \| \| \| \| \| \| \| \| \| \|	Merge pull request #596 from esjewett/master	Matei Zaharia	2013-05-08	2	-1/+40
\| \|\ \ \ \ \ \ \ \ \ \ \ \| \| \|_\|_\|_\|_\|_\|_\|_\|/ / / \| \|/\| \| \| \| \| \| \| \| \| \|	hBase example
\| \| * \| \| \| \| \| \| \| \| \|	Switch to using SparkContext method to create RDD	Ethan Jewett	2013-05-07	1	-2/+2
\| \| \| \| \| \| \| \| \| \| \| \|
\| \| * \| \| \| \| \| \| \| \| \|	Fix indents and mention other configuration options	Ethan Jewett	2013-05-04	1	-2/+5
\| \| \| \| \| \| \| \| \| \| \| \|
\| \| * \| \| \| \| \| \| \| \| \|	Remove unnecessary column family config	Ethan Jewett	2013-05-04	1	-4/+2
\| \| \| \| \| \| \| \| \| \| \| \|
\| \| * \| \| \| \| \| \| \| \| \|	HBase example	Ethan Jewett	2013-05-04	2	-1/+39
\| \| \| \|_\|_\|/ / / / / / \| \| \|/\| \| \| \| \| \| \| \|
* \| \| \| \| \| \| \| \| \| \|	Merge branch 'master' of github.com:mesos/spark	Matei Zaharia	2013-05-07	0	-0/+0
\|\\| \| \| \| \| \| \| \| \| \|
\| * \| \| \| \| \| \| \| \| \|	Update Maven build to Scala 2.9.3	Jey Kottalam	2013-05-07	2	-8/+7
\| \| \|/ / / / / / / / \| \|/\| \| \| \| \| \| \| \|
* / \| \| \| \| \| \| \| \|	Update Maven build to Scala 2.9.3	Jey Kottalam	2013-05-06	2	-8/+7
\|/ / / / / / / / /
* \| \| \| \| \| \| \| \|	Merge pull request #597 from JoshRosen/webui-fixes	Matei Zaharia	2013-05-04	7	-13/+11
\|\ \ \ \ \ \ \ \ \ \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \|	Two minor bug fixes for Spark Web UI
\| * \| \| \| \| \| \| \| \|	Fix SPARK-630: app details page shows finished executors as running.	Josh Rosen	2013-05-04	1	-0/+1
\| \| \| \| \| \| \| \| \| \|
\| * \| \| \| \| \| \| \| \|	Fix wrong closing tags in web UI HTML.	Josh Rosen	2013-05-04	2	-2/+2
\| \| \| \| \| \| \| \| \| \|
\| * \| \| \| \| \| \| \| \|	Fix SPARK-629: weird number of cores in job details page.	Josh Rosen	2013-05-04	4	-11/+8
\| \| \| \| \| \| \| \| \| \|
* \| \| \| \| \| \| \| \| \|	Merge pull request #598 from rxin/blockmanager	Matei Zaharia	2013-05-04	1	-4/+3
\|\ \ \ \ \ \ \ \ \ \ \| \|_\|/ / / / / / / / \|/\| \| \| \| \| \| \| \| \|	Fixed flaky unpersist test in DistributedSuite.
\| * \| \| \| \| \| \| \| \|	Fixed flaky unpersist test in DistributedSuite.	Reynold Xin	2013-05-04	1	-1/+0
\| \| \| \| \| \| \| \| \| \|
\| * \| \| \| \| \| \| \| \|	Merge branch 'unpersist-test' of github.com:shivaram/spark into blockmanager	Reynold Xin	2013-05-04	1	-4/+4
\|/\| \| \| \| \| \| \| \| \|
\| * \| \| \| \| \| \| \| \|	Fix flaky test by changing catch and adding sleep	Shivaram Venkataraman	2013-05-03	1	-4/+4
\| \| \|_\|/ / / / / / \| \|/\| \| \| \| \| \| \|
* \| \| \| \| \| \| \| \|	Merge pull request #594 from shivaram/master	Matei Zaharia	2013-05-03	3	-0/+52
\|\ \ \ \ \ \ \ \ \ \| \|_\|/ / / / / / / \|/\| \| \| \| \| \| \| \|	Add zip partitions to Java API
\| * \| \| \| \| \| \| \|	Add zipPartitions to Java API.	Shivaram Venkataraman	2013-05-03	3	-0/+52
\| \| \|_\|_\|/ / / / \| \|/\| \| \| \| \| \|
* \| \| \| \| \| \| \|	Merge pull request #587 from rxin/blockmanager	Matei Zaharia	2013-05-03	17	-104/+408
\|\ \ \ \ \ \ \ \ \| \|_\|/ / / / / / \|/\| \| \| \| \| \| \|	A set of shuffle map output related changes
\| * \| \| \| \| \| \|	Merge branch 'master' of github.com:mesos/spark into blockmanager	Reynold Xin	2013-05-03	13	-101/+302
\| \|\ \ \ \ \ \ \ \| \|/ / / / / / / \|/\| \| \| \| \| \| \|
* \| \| \| \| \| \| \|	Merge pull request #592 from woggling/localdir-fix	Matei Zaharia	2013-05-02	1	-2/+1
\|\ \ \ \ \ \ \ \ \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \|	Don't accept generated local directory names that can't be created
\| * \| \| \| \| \| \| \|	Don't accept generated temp directory names that can't be created successfully.	Charles Reiss	2013-05-01	1	-2/+1
\| \| \| \| \| \| \| \| \|
* \| \| \| \| \| \| \| \|	Merge pull request #581 from jerryshao/master	Matei Zaharia	2013-05-02	1	-12/+21
\|\ \ \ \ \ \ \ \ \ \| \|_\|_\|/ / / / / / \|/\| \| \| \| \| \| \| \|	fix [SPARK-740] block manage UI throws exception when enabling Spark Streaming
\| * \| \| \| \| \| \| \|	filter out Spark streaming block RDD and sort RDDInfo with id	jerryshao	2013-05-02	1	-12/+21
\| \| \| \| \| \| \| \| \|
* \| \| \| \| \| \| \| \|	Merge pull request #591 from rxin/removerdd	Matei Zaharia	2013-05-01	7	-34/+144
\|\ \ \ \ \ \ \ \ \ \| \|/ / / / / / / / \|/\| \| \| \| \| \| \| \|	RDD.unpersist: probably the most desired feature of Spark
\| * \| \| \| \| \| \| \|	Added the unpersist api to JavaRDD.	Reynold Xin	2013-05-01	1	-5/+11
\| \| \| \| \| \| \| \| \|
\| * \| \| \| \| \| \| \|	Added removeRdd function in BlockManager.	Reynold Xin	2013-05-01	5	-17/+51
\| \| \| \| \| \| \| \| \|
\| * \| \| \| \| \| \| \|	Changed the type of the persistentRdds hashmap back to	Reynold Xin	2013-05-01	1	-1/+1
\| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \|	TimeStampedHashMap.
\| * \| \| \| \| \| \| \|	Added SparkContext.cleanup back. Not sure why it was removed before ...	Reynold Xin	2013-05-01	1	-1/+1
\| \| \| \| \| \| \| \| \|