spark - Mirror of Apache Spark

	Commit message (Collapse)	Author	Age	Files	Lines
*	Added log4j.properties	Matei Zaharia	2010-09-28	3	-0/+6
\|
*	Removed Hadoop's SLF4J jars	Matei Zaharia	2010-09-28	2	-0/+0
\|
*	Added Logging trait	Matei Zaharia	2010-09-28	1	-0/+44
\|
*	Added log4j jars and paths	Matei Zaharia	2010-09-28	5	-0/+6
\|
*	Merge branch 'http-repl-class-serving'	Matei Zaharia	2010-09-28	8	-24/+135
\|\
\| *	More work on HTTP class loading	Matei Zaharia	2010-09-28	5	-24/+61
\| \|
\| *	Modified the interpreter to serve classes to the executors using a Jetty	Matei Zaharia	2010-09-28	3	-0/+74
\| \| \| \| \| \| \| \|	HTTP server instead of a shared (NFS) file system.
* \|	fixed typo in printing which task is already finished	Justin Ma	2010-09-28	1	-1/+1
\| \|
* \|	Let's use future instead of actors	Justin Ma	2010-09-13	2	-38/+24
\| \|
* \|	Added fork()/join() operations for SparkContext, as well as corresponding ↵	Justin Ma	2010-09-12	2	-49/+91
\| \| \| \| \| \| \| \|	changes to MesosScheduler to support multiple ParallelOperations.
* \|	round robin scheduling of tasks has been added	Justin Ma	2010-09-07	3	-13/+25
\| \|
* \|	now adding the Split object.	Justin Ma	2010-09-01	1	-0/+3
\| \|
* \|	- Got rid of 'Split' type parameter in RDD	Justin Ma	2010-08-31	7	-59/+104
\| \| \| \| \| \| \| \| \| \| \| \|	- Added SampledRDD, SplitRDD and CartesianRDD - Made Split a class rather than a type parameter - Added numCores() to Scheduler to help set default level of parallelism
* \|	now we have sampling with replacement (at least on a per-split basis)	Justin Ma	2010-08-18	1	-3/+17
\| \|
* \|	HdfsFile.scala: added a try/catch block to exit gracefully for correupted ↵	Justin Ma	2010-08-18	3	-2/+35
\|/ \| \| \| \| \| \| \|	gzip files MesosScheduler.scala: formatted the slaveOffer() output to include the serialized task size RDD.scala: added support for aggregating RDDs on a per-split basis (aggregateSplit()) as well as for sampling without replacement (sample())
*	Removed HOD from included Hadoop because it was making the project count	Matei Zaharia	2010-08-16	70	-15196/+0
\| \| \| \|	as Python on GitHub :\|.
*	Modified Scala interpreter to have it avoid computing string versions of	Matei Zaharia	2010-08-15	1	-1/+3
\| \| \| \| \| \|	all results when :silent is enabled, so that it is easier to work with large arrays in Spark. (The string version of an array of numbers might not fit in memory even though the array itself does.)
*	Added latest mesos.jar	Matei Zaharia	2010-08-13	1	-0/+0
\|
*	Improved README and added blank templates for config files.	Matei Zaharia	2010-08-13	4	-1/+20
\|
*	Bug fix from Justin	Matei Zaharia	2010-08-13	1	-1/+1
\|
*	Update to work with latest Mesos API changes	root	2010-08-13	3	-10/+15
\|
*	Fixed a bug where we would incorrectly decide we've finished a parallel ↵	Matei Zaharia	2010-08-09	1	-12/+20
\| \| \| \|	operation if Mesos tells us a task is finished twice
*	Change shell framework's name to "Spark shell"	Matei Zaharia	2010-08-06	1	-1/+1
\|
*	Add Mesos native library to .gitignore	Matei Zaharia	2010-07-25	1	-0/+2
\|
*	Updated code to work with Nexus->Mesos name change	Matei Zaharia	2010-07-25	11	-22/+22
\|
*	Removed Matei's old start on broadcast code	Matei Zaharia	2010-07-25	6	-248/+0
\|
*	Updated a bunch of libraries, and increased the default memory in run so	Matei Zaharia	2010-07-25	11	-7/+302
\| \| \| \|	that unit tests can run successfully.
*	Made it possible to set various Spark options and environment variables	Matei Zaharia	2010-07-19	2	-14/+48
\| \| \| \|	in general through a conf/spark-env.sh script.
*	Updated Spark to run with latest Mesos build and Scala-2.8.0.final.	Justin Ma	2010-07-19	3	-4/+4
\|
*	Merge branch 'dev'	Matei Zaharia	2010-06-27	12	-289/+1037
\|\ \| \| \| \| \| \| \| \| \| \| \| \|	Conflicts: src/scala/spark/HdfsFile.scala src/scala/spark/NexusScheduler.scala src/test/spark/repl/ReplSuite.scala
\| *	Imported changes from old repository (mostly Mosharaf's work,	Matei Zaharia	2010-04-03	11	-293/+1039
\| \| \| \| \| \| \| \|	plus some fault tolerance code).
* \|	Made Spark shell class directory configurable.	root	2010-06-18	2	-4/+5
\| \|
* \|	Initial work on union operation.	Matei Zaharia	2010-06-18	1	-0/+37
\| \|
* \|	Added appropriate hashCode, equals and toString to ParallelArraySplit.	Matei Zaharia	2010-06-17	1	-4/+24
\| \|
* \|	Created common RDD superclass for distributed files and parallel arrays.	Matei Zaharia	2010-06-17	5	-285/+250
\| \| \| \| \| \| \| \| \| \|	This also means that parallel arrays now get all the functionality files used to have (filter, map, reduce, cache, etc).
* \|	Fixed README	Matei Zaharia	2010-06-11	1	-2/+1
\| \|
* \|	Added back REPL tests	Matei Zaharia	2010-06-11	2	-16/+17
\| \|
* \|	Fix junk stripper	Matei Zaharia	2010-06-11	1	-1/+1
\| \|
* \|	New interpreter port for Scala 2.8 interpreter	Matei Zaharia	2010-06-11	11	-837/+2199
\| \|
* \|	New nexus.jar	Matei Zaharia	2010-06-10	1	-0/+0
\| \|
* \|	Fixed classpath for tests	Matei Zaharia	2010-06-10	1	-2/+2
\| \|
* \|	Use new Nexus API	Matei Zaharia	2010-06-10	1	-5/+6
\| \|
* \|	Initial work on 2.8 port	Matei Zaharia	2010-06-10	27	-404/+84
\| \|
* \|	Ignore .DS_Store	Matei Zaharia	2010-06-10	1	-0/+1
\| \|
* \|	Fix native build to use build directory	root	2010-04-30	1	-2/+2
\|/
*	Initial commit	Matei Zaharia	2010-03-29	315	-0/+354873