Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Merge branch 'master' of github.com:mesos/spark into dev | Reynold Xin | 2012-12-20 | 1 | -5/+10 |
|\ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/MapOutputTracker.scala core/src/main/scala/spark/PairRDDFunctions.scala core/src/main/scala/spark/ParallelCollection.scala core/src/main/scala/spark/RDD.scala core/src/main/scala/spark/rdd/BlockRDD.scala core/src/main/scala/spark/rdd/CartesianRDD.scala core/src/main/scala/spark/rdd/CoGroupedRDD.scala core/src/main/scala/spark/rdd/CoalescedRDD.scala core/src/main/scala/spark/rdd/FilteredRDD.scala core/src/main/scala/spark/rdd/FlatMappedRDD.scala core/src/main/scala/spark/rdd/GlommedRDD.scala core/src/main/scala/spark/rdd/HadoopRDD.scala core/src/main/scala/spark/rdd/MapPartitionsRDD.scala core/src/main/scala/spark/rdd/MapPartitionsWithSplitRDD.scala core/src/main/scala/spark/rdd/MappedRDD.scala core/src/main/scala/spark/rdd/PipedRDD.scala core/src/main/scala/spark/rdd/SampledRDD.scala core/src/main/scala/spark/rdd/ShuffledRDD.scala core/src/main/scala/spark/rdd/UnionRDD.scala core/src/main/scala/spark/storage/BlockManager.scala core/src/main/scala/spark/storage/BlockManagerId.scala core/src/main/scala/spark/storage/BlockManagerMaster.scala core/src/main/scala/spark/storage/StorageLevel.scala core/src/main/scala/spark/util/MetadataCleaner.scala core/src/main/scala/spark/util/TimeStampedHashMap.scala core/src/test/scala/spark/storage/BlockManagerSuite.scala run | ||||
| * | Make "run" script work with Maven builds | Matei Zaharia | 2012-12-10 | 1 | -5/+10 |
| | | |||||
* | | Fixed bugs in RawNetworkInputDStream and in its examples. Made the ↵ | Tathagata Das | 2012-11-12 | 1 | -0/+4 |
| | | | | | | | | ReducedWindowedDStream persist RDDs to MEMOERY_SER_ONLY by default. Removed unncessary examples. Added streaming-env.sh.template to add recommended setting for streaming. | ||||
* | | Merge remote-tracking branch 'public/master' into dev | Matei Zaharia | 2012-10-24 | 1 | -24/+34 |
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/BlockStoreShuffleFetcher.scala core/src/main/scala/spark/KryoSerializer.scala core/src/main/scala/spark/MapOutputTracker.scala core/src/main/scala/spark/RDD.scala core/src/main/scala/spark/SparkContext.scala core/src/main/scala/spark/executor/Executor.scala core/src/main/scala/spark/network/Connection.scala core/src/main/scala/spark/network/ConnectionManagerTest.scala core/src/main/scala/spark/rdd/BlockRDD.scala core/src/main/scala/spark/rdd/NewHadoopRDD.scala core/src/main/scala/spark/scheduler/ShuffleMapTask.scala core/src/main/scala/spark/scheduler/cluster/StandaloneSchedulerBackend.scala core/src/main/scala/spark/storage/BlockManager.scala core/src/main/scala/spark/storage/BlockMessage.scala core/src/main/scala/spark/storage/BlockStore.scala core/src/main/scala/spark/storage/StorageLevel.scala core/src/main/scala/spark/util/AkkaUtils.scala project/SparkBuild.scala run | ||||
| * | Tweaked run file to live more happily with typesafe's debian package | Thomas Dudziak | 2012-10-22 | 1 | -13/+30 |
| | | |||||
| * | Document how to configure SPARK_MEM & co on a per-job basis | Matei Zaharia | 2012-10-13 | 1 | -7/+0 |
| | | |||||
| * | Made run script add test-classes onto the classpath only if SPARK_TESTING is ↵ | root | 2012-10-07 | 1 | -2/+4 |
| | | | | | | | | set; fixes #216 | ||||
| * | Don't check for JARs in core/lib anymore | Matei Zaharia | 2012-10-04 | 1 | -3/+0 |
| | | |||||
| * | Update Scala version dependency to 2.9.2 | Matei Zaharia | 2012-09-24 | 1 | -1/+1 |
| | | |||||
| * | Added a unit test for local-cluster mode and simplified some of the code ↵ | Matei Zaharia | 2012-09-07 | 1 | -0/+1 |
| | | | | | | | | involved in that | ||||
* | | Added the Spark Streaing code, ported to Akka 2 | Matei Zaharia | 2012-07-28 | 1 | -0/+2 |
|/ | |||||
* | Fixed SPARK_MEM not being passed when runner is java | Matei Zaharia | 2012-07-28 | 1 | -1/+4 |
| | |||||
* | More work to allow Spark to run on the standalone deploy cluster. | Matei Zaharia | 2012-07-08 | 1 | -7/+26 |
| | |||||
* | More work on deploy code (adding Worker class) | Matei Zaharia | 2012-06-30 | 1 | -0/+1 |
| | |||||
* | Further fixes to how Mesos is found and used | Matei Zaharia | 2012-03-17 | 1 | -21/+23 |
| | |||||
* | Set SCALA_VERSION to 2.9.1 (from 2.9.1.final) to match expectation of SBT 0.11.0 | Ismael Juma | 2011-09-26 | 1 | -1/+1 |
| | |||||
* | Upgrade to Scala 2.9.1. | Ismael Juma | 2011-08-31 | 1 | -1/+1 |
| | | | | | | | | | Interestingly, the version in Maven is 2.9.1, but SBT outputs file to the 2.9.1.final directory inside target. A couple of small changes in SparkIMain were also required. All tests pass and ./spark-shell launches successfully. | ||||
* | Removed a debugging line | Matei Zaharia | 2011-08-29 | 1 | -1/+0 |
| | |||||
* | Merge branch 'scala-2.9' | Matei Zaharia | 2011-08-01 | 1 | -8/+9 |
|\ | | | | | | | | | Conflicts: project/build/SparkProject.scala | ||||
| * | Initial work on converting build to SBT 0.10.1 | Ismael Juma | 2011-07-15 | 1 | -8/+9 |
| | | |||||
| * | Pass quoted arguments properly to run | Matei Zaharia | 2011-05-31 | 1 | -1/+1 |
| | | |||||
| * | SCALA_VERSION in run should be 2.9.0-1 | Ismael Juma | 2011-05-27 | 1 | -1/+1 |
| | | |||||
| * | Update to Scala 2.9.0-1 and disable repl module for now. | Ismael Juma | 2011-05-27 | 1 | -1/+1 |
| | | | | | | | | The repl module requires more complex work. | ||||
* | | Updated to newest Mesos API, which includes better memory accounting | Matei Zaharia | 2011-08-01 | 1 | -1/+2 |
| | | | | | | | | by specifying per-executor memory. | ||||
* | | Pass quoted arguments properly to run | Matei Zaharia | 2011-05-31 | 1 | -1/+1 |
|/ | |||||
* | Update run to work with SBT managed dependencies and the newly introduced ↵ | Ismael Juma | 2011-05-27 | 1 | -21/+17 |
| | | | | repl module. | ||||
* | Add Bagel classpath to run script | Ankur Dave | 2011-05-03 | 1 | -0/+2 |
| | |||||
* | Updated modified Kryo to use objenesis | Matei Zaharia | 2011-03-08 | 1 | -0/+1 |
| | |||||
* | Added pluggable serializers and Kryo serialization | Matei Zaharia | 2011-03-07 | 1 | -1/+4 |
| | |||||
* | Updated Hadoop to 0.20.2 to include some bug fixes | Matei Zaharia | 2011-03-01 | 1 | -2/+2 |
| | |||||
* | Merge branch 'master' into sbt | Matei Zaharia | 2011-02-02 | 1 | -0/+1 |
|\ | | | | | | | | | | | | | | | | | | | Conflicts: Makefile core/src/main/java/spark/compress/lzf/LZF.java core/src/main/java/spark/compress/lzf/LZFInputStream.java core/src/main/java/spark/compress/lzf/LZFOutputStream.java core/src/main/native/spark_compress_lzf_LZF.c run | ||||
| * | Replacing the native lzf compression code with the ning open-source ↵ | Joshua Hartman | 2010-12-05 | 1 | -0/+1 |
| | | | | | | | | compress-lzf library. (Apache 2.0 liscense) | ||||
* | | Made examples and core subprojects | Matei Zaharia | 2011-02-01 | 1 | -15/+19 |
| | | |||||
* | | Fixed some more stuff (Eclispe target and native build) | Matei Zaharia | 2010-11-13 | 1 | -1/+1 |
| | | |||||
* | | Initial work to get Spark compiling with SBT 0.7.5 RC0 | Matei Zaharia | 2010-11-13 | 1 | -15/+15 |
| | | |||||
* | | Modified project structure to work with buildr | Matei Zaharia | 2010-11-13 | 1 | -2/+2 |
|/ | |||||
* | Set absolute path for SPARK_HOME | Matei Zaharia | 2010-10-16 | 1 | -1/+1 |
| | |||||
* | Added code so that Spark jobs can be launched from outside the Spark | Matei Zaharia | 2010-10-15 | 1 | -4/+10 |
| | | | | | | directory by setting SPARK_HOME and locating the executor relative to that. Entries on SPARK_CLASSPATH and SPARK_LIBRARY_PATH are also passed along to worker nodes. | ||||
* | Updated guava to version r07 | Matei Zaharia | 2010-10-15 | 1 | -1/+1 |
| | |||||
* | Changed printlns to log statements and fixed a bug in run that was causing ↵ | Matei Zaharia | 2010-09-28 | 1 | -18/+17 |
| | | | | it to fail on a Mesos cluster | ||||
* | Added log4j.properties | Matei Zaharia | 2010-09-28 | 1 | -0/+1 |
| | |||||
* | Added log4j jars and paths | Matei Zaharia | 2010-09-28 | 1 | -0/+3 |
| | |||||
* | More work on HTTP class loading | Matei Zaharia | 2010-09-28 | 1 | -0/+2 |
| | |||||
* | Update to work with latest Mesos API changes | root | 2010-08-13 | 1 | -1/+6 |
| | |||||
* | Updated code to work with Nexus->Mesos name change | Matei Zaharia | 2010-07-25 | 1 | -1/+1 |
| | |||||
* | Updated a bunch of libraries, and increased the default memory in run so | Matei Zaharia | 2010-07-25 | 1 | -4/+4 |
| | | | | that unit tests can run successfully. | ||||
* | Made it possible to set various Spark options and environment variables | Matei Zaharia | 2010-07-19 | 1 | -13/+26 |
| | | | | in general through a conf/spark-env.sh script. | ||||
* | Merge branch 'dev' | Matei Zaharia | 2010-06-27 | 1 | -1/+1 |
|\ | | | | | | | | | | | | | Conflicts: src/scala/spark/HdfsFile.scala src/scala/spark/NexusScheduler.scala src/test/spark/repl/ReplSuite.scala | ||||
| * | Imported changes from old repository (mostly Mosharaf's work, | Matei Zaharia | 2010-04-03 | 1 | -1/+1 |
| | | | | | | | | plus some fault tolerance code). | ||||
* | | Fixed classpath for tests | Matei Zaharia | 2010-06-10 | 1 | -2/+2 |
|/ |