aboutsummaryrefslogtreecommitdiff
path: root/project
Commit message (Collapse)AuthorAgeFilesLines
* A very rough, early cut at some Java functionality for Streaming.Patrick Wendell2013-01-141-1/+2
|
* Merge branch 'streaming-merge' into dev-mergeTathagata Das2013-01-071-1/+4
|\
| * Merge pull request #8 from radlab/twitter-examplePatrick Wendell2012-12-291-1/+4
| |\ | | | | | | Adding a Twitter InputDStream with an example
| | * Adding a Twitter InputDStream with an examplePatrick Wendell2012-12-211-1/+4
| | |
* | | Moved Spark Streaming examples to examples sub-project.Tathagata Das2013-01-061-1/+1
| | |
* | | Merge branch 'mesos' into dev-mergeTathagata Das2012-12-261-1/+1
|\ \ \ | |/ / |/| |
| * | Merge pull request #341 from rxin/4a3fb06ac2d11125feb08acbbd4df76d1e91b677Matei Zaharia2012-12-211-1/+1
| |\ \ | | | | | | | | Kryo2 update against Spark master
| | * | Updated Kryo to 2.20.Reynold Xin2012-10-161-1/+1
| | | |
* | | | Merge branch 'master' of github.com:mesos/spark into devReynold Xin2012-12-201-1/+1
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/MapOutputTracker.scala core/src/main/scala/spark/PairRDDFunctions.scala core/src/main/scala/spark/ParallelCollection.scala core/src/main/scala/spark/RDD.scala core/src/main/scala/spark/rdd/BlockRDD.scala core/src/main/scala/spark/rdd/CartesianRDD.scala core/src/main/scala/spark/rdd/CoGroupedRDD.scala core/src/main/scala/spark/rdd/CoalescedRDD.scala core/src/main/scala/spark/rdd/FilteredRDD.scala core/src/main/scala/spark/rdd/FlatMappedRDD.scala core/src/main/scala/spark/rdd/GlommedRDD.scala core/src/main/scala/spark/rdd/HadoopRDD.scala core/src/main/scala/spark/rdd/MapPartitionsRDD.scala core/src/main/scala/spark/rdd/MapPartitionsWithSplitRDD.scala core/src/main/scala/spark/rdd/MappedRDD.scala core/src/main/scala/spark/rdd/PipedRDD.scala core/src/main/scala/spark/rdd/SampledRDD.scala core/src/main/scala/spark/rdd/ShuffledRDD.scala core/src/main/scala/spark/rdd/UnionRDD.scala core/src/main/scala/spark/storage/BlockManager.scala core/src/main/scala/spark/storage/BlockManagerId.scala core/src/main/scala/spark/storage/BlockManagerMaster.scala core/src/main/scala/spark/storage/StorageLevel.scala core/src/main/scala/spark/util/MetadataCleaner.scala core/src/main/scala/spark/util/TimeStampedHashMap.scala core/src/test/scala/spark/storage/BlockManagerSuite.scala run
| * | | Let the slave notify the master block removal.Reynold Xin2012-12-201-1/+1
| | | |
* | | | Adding Flume InputDStreamPatrick Wendell2012-12-071-1/+2
| |_|/ |/| |
* | | Added kafka JARDenny2012-12-051-1/+1
| | |
* | | Working on kafka.Denny2012-11-061-1/+3
| | |
* | | Merge remote-tracking branch 'public/master' into devMatei Zaharia2012-10-242-18/+93
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/BlockStoreShuffleFetcher.scala core/src/main/scala/spark/KryoSerializer.scala core/src/main/scala/spark/MapOutputTracker.scala core/src/main/scala/spark/RDD.scala core/src/main/scala/spark/SparkContext.scala core/src/main/scala/spark/executor/Executor.scala core/src/main/scala/spark/network/Connection.scala core/src/main/scala/spark/network/ConnectionManagerTest.scala core/src/main/scala/spark/rdd/BlockRDD.scala core/src/main/scala/spark/rdd/NewHadoopRDD.scala core/src/main/scala/spark/scheduler/ShuffleMapTask.scala core/src/main/scala/spark/scheduler/cluster/StandaloneSchedulerBackend.scala core/src/main/scala/spark/storage/BlockManager.scala core/src/main/scala/spark/storage/BlockMessage.scala core/src/main/scala/spark/storage/BlockStore.scala core/src/main/scala/spark/storage/StorageLevel.scala core/src/main/scala/spark/util/AkkaUtils.scala project/SparkBuild.scala run
| * | Bump up version to 0.7.0-SNAPSHOT for master branchMatei Zaharia2012-10-221-1/+1
| | |
| * | Update version to 0.6.1-SNAPSHOT to show this is in developmentMatei Zaharia2012-10-221-1/+1
| | |
| * | Support for Hadoop 2 distributions such as cdh4Thomas Dudziak2012-10-181-2/+8
| |/
| * Removing credentials line in build.Patrick Wendell2012-10-141-1/+0
| |
| * Comment out PGP stuff for publish-local to workMatei Zaharia2012-10-142-4/+6
| |
| * Changed default Hadoop version back to 0.20.205Matei Zaharia2012-10-141-1/+1
| |
| * Uncomment Maven publishing stuff and set version to 0.6.0Matei Zaharia2012-10-132-12/+12
| |
| * Changing tabs to spacesPatrick Wendell2012-10-101-17/+17
| |
| * Adding code for publishing to Sonatype.Patrick Wendell2012-10-102-3/+57
| | | | | | | | | | | | | | By default - I'm leaving this commented out. This is because there is a bug in the PGP signing plugin which causes it to active even duing a publish-local. So we'll just uncomment when we decide to publish.
| * Removes the included mesos-0.9.0.jar and adds a libraryDependency toAndy Konwinski2012-10-031-1/+2
| | | | | | | | | | | | the build file so that mesos-0.9.0-incubating.jar (which contains the same class files, but has a silightly different name) will be pulled down from Maven Central instead.
| * Don't build an assembly for the REPLMatei Zaharia2012-10-021-1/+1
| |
| * Place Spray in front of Cloudera in Maven search pathMatei Zaharia2012-10-021-2/+2
| |
| * Revert "Place Spray repo ahead of Cloudera in Maven search path"Matei Zaharia2012-10-021-2/+2
| | | | | | | | This reverts commit 42e0a68082327c78dbd0fd313145124d9b8a9d98.
| * Place Spray repo ahead of Cloudera in Maven search pathMatei Zaharia2012-10-021-2/+2
| |
| * publish-local should go to maven + ivy by defaultPatrick Wendell2012-10-011-1/+1
| |
| * Added a new command "pl" in sbt to publish to both Maven and Ivy.Reynold Xin2012-10-011-4/+17
| |
| * Update Akka to 2.0.3Matei Zaharia2012-09-241-3/+3
| |
| * Update Scala version dependency to 2.9.2Matei Zaharia2012-09-241-1/+1
| |
* | Added transformRDD DStream operation and TransformedDStream. Added sbt ↵Tathagata Das2012-09-021-1/+3
| | | | | | | | assembly option for streaming project.
* | Merge remote-tracking branch 'public/dev' into devMatei Zaharia2012-08-242-5/+10
|\|
| * merged dev branchDenny2012-08-022-57/+10
| |\
| | * Merge branch 'dev' of github.com:mesos/spark into devMatei Zaharia2012-08-021-55/+3
| | |\ | | | | | | | | | | | | | | | | Conflicts: project/SparkBuild.scala
| | | * Use sbt mergeStrategy for reference.conf files.Josh Rosen2012-08-021-55/+3
| | | | | | | | | | | | | | | | Cleans up #158 / 509b721.
| | * | Mostly stlyistic changes.Denny2012-08-021-1/+1
| | | |
| | * | merge dev branchDenny2012-08-011-2/+55
| | |\|
| | * | Spark WebUI Implementation.Denny2012-08-012-3/+8
| | | |
| * | | Spark standalone mode cluster scripts.Denny2012-08-011-1/+0
| | |/ | |/| | | | | | | Heavily inspired by Hadoop cluster scripts ;-)
| * | Fix Akka configuration in assembly jar.Josh Rosen2012-07-301-2/+55
| |/ | | | | | | | | | | | | | | | | This resolves an issue where running Spark from the assembly jar would cause a "No configuration setting found for key 'akka.version'" exception. This solution is from the Akka Team Blog: http://letitcrash.com/post/21025950392/
* / Added the Spark Streaing code, ported to Akka 2Matei Zaharia2012-07-281-1/+5
|/
* Add Java APIJosh Rosen2012-07-181-1/+2
| | | | | | Add distinct() method to RDD. Fix bug in DoubleRDDFunctions.
* Initial framework to get a master and web UI up.Matei Zaharia2012-06-301-2/+5
|
* Various code style fixes, mostly from IntelliJ IDEAMatei Zaharia2012-06-291-0/+2
|
* Scalacheck groupId has changed ↵rrmckinley2012-06-291-1/+1
| | | | https://github.com/rickynils/scalacheck/issues/24. Necessary to build with scalaVersion 2.9.2. Works with 2.9.1 too.
* Upgraded to Akka 2 and fixed test execution (which was still parallelMatei Zaharia2012-06-281-4/+4
| | | | across projects).
* Fixed issues duplicate class issues in sbt assembly.Tathagata Das2012-06-221-2/+10
|
* Update SBT and SBT-Eclipse versionMatei Zaharia2012-06-172-8/+5
|
generated by cgit v1.2.3 (git 2.39.1) at 2024-09-08 11:28:59 +0000