aboutsummaryrefslogtreecommitdiff
path: root/project/SparkBuild.scala
Commit message (Collapse)AuthorAgeFilesLines
* Add hBase exampleEthan Jewett2013-05-091-1/+5
|
* Revert "Merge pull request #596 from esjewett/master" because theReynold Xin2013-05-091-5/+1
| | | | | | | | dependency on hbase introduces netty-3.2.2 which conflicts with netty-3.5.3 already in Spark. This caused multiple test failures. This reverts commit 0f1b7a06e1f6782711170234f105f1b277e3b04c, reversing changes made to aacca1b8a85bd073ce185a06d6470b070761b2f4.
* HBase exampleEthan Jewett2013-05-041-1/+5
|
* Remove spark-repl's extraneous dependency on spark-streamingJey Kottalam2013-05-011-1/+1
|
* Build against Hadoop 1 by defaultMatei Zaharia2013-04-291-6/+6
|
* Exclude old versions of Netty, which had a different Maven organizationMatei Zaharia2013-04-251-16/+19
|
* Update unit test memory to 2 GBMatei Zaharia2013-04-251-1/+1
|
* Add back line removed during YARN mergeMatei Zaharia2013-04-251-0/+1
|
* Do not add signature files - results in validation errors when using ↵Mridul Muralidharan2013-04-241-0/+1
| | | | assembled file
* Pull latest SparkBuild.scala from master and merge conflictsMridul Muralidharan2013-04-241-18/+25
|
* Revert back to 2.0.2-alpha : 0.23.7 has protocol changes which break against ↵Mridul Muralidharan2013-04-241-1/+2
| | | | cloudera
* Patch from Thomas Graves to improve the YARN Client, and move to more ↵Mridul Muralidharan2013-04-241-2/+3
| | | | production ready hadoop yarn branch
* Fix review comments, add a new api to SparkHadoopUtil to create appropriate ↵Mridul Muralidharan2013-04-221-4/+6
| | | | Configuration. Modify an example to show how to use SplitInfo
* Move back to 2.0.2-alpha, since 2.0.3-alpha is not available in cloudera ↵Mridul Muralidharan2013-04-171-3/+7
| | | | yet. Also, add netty dependency explicitly to prevent resolving to older 2.3x version. Additionally, comment out retrievePattern to ensure correct netty is picked up
* Add support for building against hadoop2-yarn : adding new maven profile for itMridul Muralidharan2013-04-071-5/+29
|
* Re-enable deprecation warnings since there are only twoHolden Karau2013-03-241-1/+1
|
* Makes the syntax highlighting on the build file not broken in emacs.Holden Karau2013-03-241-1/+1
|
* Fix reference bug in Kryo serializer, add test, update versionHiral Patel2013-03-071-1/+1
|
* Change version to 0.7.1-SNAPSHOT for development branchMatei Zaharia2013-02-271-1/+1
|
* Change version number to 0.7.0Matei Zaharia2013-02-251-1/+1
|
* Update Hadoop dependency to 1.0.4Matei Zaharia2013-02-251-2/+2
|
* Moving akka dependency resolver to shared.Prashant Sharma2013-02-251-1/+3
|
* Fixed class paths and dependencies based on Matei's comments.Tathagata Das2013-02-241-4/+1
|
* Changed Algebird from 0.1.9 to 0.1.8Tathagata Das2013-02-241-1/+1
|
* Fixed resolver for akka-zeromqTathagata Das2013-02-221-0/+3
|
* Merge pull request #480 from MLnick/streaming-eg-algebirdTathagata Das2013-02-221-1/+2
|\ | | | | [Streaming] Examples using Twitter's Algebird library
| * Bumping Algebird to 0.1.9Nick Pentreath2013-02-211-1/+1
| |
| * Merge remote-tracking branch 'upstream/streaming' into streaming-eg-algebirdNick Pentreath2013-02-191-5/+3
| |\ | | | | | | | | | | | | Conflicts: project/SparkBuild.scala
| * | Adding streaming HyperLogLog example using AlgebirdNick Pentreath2013-02-191-1/+2
| | |
* | | fixes corresponding to review feedback at pull request #479Prashant Sharma2013-02-201-2/+2
| | |
* | | ZeroMQ stream as receiverPrashant Sharma2013-02-191-0/+1
| |/ |/|
* | Added TwitterInputDStream from example to StreamingContext. Renamed example ↵Tathagata Das2013-02-141-5/+3
|/ | | | TwitterBasic to TwitterPopularTags.
* Add easymock to SBT configuration.Charles Reiss2013-01-291-1/+2
|
* Add Maven build file for streaming, and fix some issues in SBT fileMatei Zaharia2013-01-201-7/+9
| | | | | | As part of this, changed our Scala 2.9.2 Kafka library to be available as a local Maven repository, following the example in (http://blog.dub.podval.org/2010/01/maven-in-project-repository.html)
* Merge branch 'master' into streamingTathagata Das2013-01-151-1/+3
|\ | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/rdd/CoGroupedRDD.scala core/src/main/scala/spark/rdd/FilteredRDD.scala docs/_layouts/global.html docs/index.md run
| * Merge pull request #357 from tysonjh/masterMatei Zaharia2013-01-101-0/+1
| |\ | | | | | | JSON support added to WebUI
| | * Removed io.spray spray-json dependency as it is not needed.Tyson2013-01-091-1/+0
| | |
| | * Added the spray implicit marshaller libraryTyson2013-01-091-0/+2
| | | | | | | | | | | | Added the io.spray JSON library
| * | Retrieve jars to a flat directory so * can be used for the classpath.Stephen Haberman2013-01-081-0/+1
| | |
| * | Update Hadoop dependency to 1.0.3 as 0.20 has Sun specific dependencies. AlsoShivaram Venkataraman2013-01-071-1/+1
| | | | | | | | | | | | | | | fix SequenceFileRDDFunctions to pick the right type conversion across Hadoop versions
* | | Merge branch 'streaming-merge' into dev-mergeTathagata Das2013-01-071-1/+4
|\ \ \
| * \ \ Merge pull request #8 from radlab/twitter-examplePatrick Wendell2012-12-291-1/+4
| |\ \ \ | | | | | | | | | | Adding a Twitter InputDStream with an example
| | * | | Adding a Twitter InputDStream with an examplePatrick Wendell2012-12-211-1/+4
| | | | |
* | | | | Moved Spark Streaming examples to examples sub-project.Tathagata Das2013-01-061-1/+1
| | | | |
* | | | | Merge branch 'mesos' into dev-mergeTathagata Das2012-12-261-1/+1
|\ \ \ \ \ | |/ / / / |/| | / / | | |/ / | |/| |
| * | | Merge pull request #341 from rxin/4a3fb06ac2d11125feb08acbbd4df76d1e91b677Matei Zaharia2012-12-211-1/+1
| |\ \ \ | | | | | | | | | | Kryo2 update against Spark master
| | * | | Updated Kryo to 2.20.Reynold Xin2012-10-161-1/+1
| | | | |
* | | | | Merge branch 'master' of github.com:mesos/spark into devReynold Xin2012-12-201-1/+1
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/MapOutputTracker.scala core/src/main/scala/spark/PairRDDFunctions.scala core/src/main/scala/spark/ParallelCollection.scala core/src/main/scala/spark/RDD.scala core/src/main/scala/spark/rdd/BlockRDD.scala core/src/main/scala/spark/rdd/CartesianRDD.scala core/src/main/scala/spark/rdd/CoGroupedRDD.scala core/src/main/scala/spark/rdd/CoalescedRDD.scala core/src/main/scala/spark/rdd/FilteredRDD.scala core/src/main/scala/spark/rdd/FlatMappedRDD.scala core/src/main/scala/spark/rdd/GlommedRDD.scala core/src/main/scala/spark/rdd/HadoopRDD.scala core/src/main/scala/spark/rdd/MapPartitionsRDD.scala core/src/main/scala/spark/rdd/MapPartitionsWithSplitRDD.scala core/src/main/scala/spark/rdd/MappedRDD.scala core/src/main/scala/spark/rdd/PipedRDD.scala core/src/main/scala/spark/rdd/SampledRDD.scala core/src/main/scala/spark/rdd/ShuffledRDD.scala core/src/main/scala/spark/rdd/UnionRDD.scala core/src/main/scala/spark/storage/BlockManager.scala core/src/main/scala/spark/storage/BlockManagerId.scala core/src/main/scala/spark/storage/BlockManagerMaster.scala core/src/main/scala/spark/storage/StorageLevel.scala core/src/main/scala/spark/util/MetadataCleaner.scala core/src/main/scala/spark/util/TimeStampedHashMap.scala core/src/test/scala/spark/storage/BlockManagerSuite.scala run
| * | | | Let the slave notify the master block removal.Reynold Xin2012-12-201-1/+1
| | |_|/ | |/| |
* | | | Adding Flume InputDStreamPatrick Wendell2012-12-071-1/+2
| |_|/ |/| |