Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Merge branch 'master' into streaming | Tathagata Das | 2013-06-24 | 14 | -75/+202 |
|\ | | | | | | | | | Conflicts: .gitignore | ||||
| * | Exclude old versions of Netty from Maven-based build | Jey Kottalam | 2013-05-18 | 1 | -0/+6 |
| | | |||||
| * | Merge branch 'shuffle-performance-fix-0.7' of github.com:shane-huang/spark ↵ | Reynold Xin | 2013-05-07 | 1 | -1/+1 |
| |\ | | | | | | | | | | | | | | | | | | | | | | | | | into shufflemerge Conflicts: core/src/main/scala/spark/storage/BlockManager.scala core/src/main/scala/spark/storage/DiskStore.scala project/SparkBuild.scala | ||||
| | * | Shuffle Performance fix: Use netty embeded OIO file server instead of ↵ | shane-huang | 2013-04-07 | 1 | -1/+1 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | ConnectionManager Shuffle Performance Optimization: do not send 0-byte block requests to reduce network messages change reference from io.Source to scala.io.Source to avoid looking into io.netty package Signed-off-by: shane-huang <shengsheng.huang@intel.com> | ||||
| * | | Remove debug statements | Mridul Muralidharan | 2013-04-29 | 2 | -3/+0 |
| | | | |||||
| * | | Make log message more descriptive to aid in debugging | Mridul Muralidharan | 2013-04-29 | 1 | -1/+3 |
| | | | |||||
| * | | Allow CheckpointWriter pending tasks to finish | Mridul Muralidharan | 2013-04-28 | 2 | -7/+8 |
| | | | |||||
| * | | Attempt to fix streaming test failures after yarn branch merge | Mridul Muralidharan | 2013-04-28 | 7 | -9/+38 |
| | | | |||||
| * | | Attempt at fixing merge conflict | Mridul Muralidharan | 2013-04-24 | 1 | -1/+1 |
| |\ \ | |||||
| | * \ | Merge remote-tracking branch 'jey/bump-development-version-to-0.8.0' | Matei Zaharia | 2013-04-08 | 1 | -1/+1 |
| | |\ \ | | | |/ | | |/| | | | | | | | | | | | | | Conflicts: docs/_config.yml project/SparkBuild.scala | ||||
| | | * | Bump development version to 0.8.0 | Jey Kottalam | 2013-03-28 | 1 | -1/+1 |
| | | | | |||||
| * | | | Add support for building against hadoop2-yarn : adding new maven profile for it | Mridul Muralidharan | 2013-04-07 | 1 | -0/+37 |
| |/ / | |||||
| * / | Move streaming test initialization into 'before' blocks | Jey Kottalam | 2013-03-28 | 2 | -4/+8 |
| |/ | |||||
| * | method first in trait IterableLike is deprecated: use `head' instead | Holden Karau | 2013-03-24 | 1 | -1/+1 |
| | | |||||
| * | Add a log4j compile dependency to fix build in IntelliJ | Mikhail Bautin | 2013-03-15 | 1 | -1/+1 |
| | | | | | | | | | | Also rename parent project to spark-parent (otherwise it shows up as "parent" in IntelliJ, which is very confusing). | ||||
| * | Forgot equals. | Stephen Haberman | 2013-03-12 | 1 | -1/+1 |
| | | |||||
| * | More quickly call close in HadoopRDD. | Stephen Haberman | 2013-03-11 | 1 | -35/+9 |
| | | | | | | | | | | This also refactors out the common "gotNext" iterator pattern into a shared utility class. | ||||
| * | Instead of failing to bind to a fixed, already-in-use port, let the OS ↵ | Mark Hamstra | 2013-03-01 | 1 | -8/+10 |
| | | | | | | | | choose an available port for TestServer. | ||||
| * | bump version to 0.7.1-SNAPSHOT in the subproject poms to keep the maven ↵ | Mark Hamstra | 2013-02-28 | 1 | -1/+1 |
| | | | | | | | | build building. | ||||
| * | Merge pull request #503 from pwendell/bug-fix | Matei Zaharia | 2013-02-25 | 1 | -1/+1 |
| |\ | | | | | | | createNewSparkContext should use sparkHome/jars/environment. | ||||
| | * | createNewSparkContext should use sparkHome/jars/environment. | Patrick Wendell | 2013-02-25 | 1 | -1/+1 |
| | | | | | | | | | | | | This fixes a bug introduced by Matei's recent change. | ||||
| * | | Pass a code JAR to SparkContext in our examples. Fixes SPARK-594. | Matei Zaharia | 2013-02-25 | 1 | -0/+17 |
| |/ | |||||
| * | Changed Flume test to use the same port as other tests, so that can be ↵ | Tathagata Das | 2013-02-25 | 1 | -2/+2 |
| | | | | | | | | controlled centrally. | ||||
| * | Fixed something that was reported as a compile error in ScalaDoc. | Matei Zaharia | 2013-02-25 | 2 | -3/+3 |
| | | | | | | | | | | | | For some reason, ScalaDoc complained about no such constructor for StreamingContext; it doesn't seem like an actual Scala error but it prevented sbt publish and from working because docs weren't built. | ||||
| * | Allow passing sparkHome and JARs to StreamingContext constructor | Matei Zaharia | 2013-02-25 | 4 | -10/+68 |
| | | | | | | | | | | Also warns if spark.cleaner.ttl is not set in the version where you pass your own SparkContext. | ||||
* | | Minor formatting fixes | Tathagata Das | 2013-06-24 | 3 | -19/+34 |
| | | |||||
* | | Merge pull request #572 from Reinvigorate/sm-block-interval | Tathagata Das | 2013-06-24 | 1 | -1/+1 |
|\ \ | | | | | | | Adding spark.streaming.blockInterval property | ||||
| * | | adding spark.streaming.blockInterval property | seanm | 2013-04-16 | 1 | -1/+1 |
| | | | |||||
* | | | Merge pull request #571 from Reinvigorate/sm-kafka-serializers | Tathagata Das | 2013-06-24 | 5 | -27/+67 |
|\ \ \ | | | | | | | | | Surfacing decoders on KafkaInputDStream | ||||
| * | | | fixing kafkaStream Java API and adding test | seanm | 2013-05-10 | 2 | -3/+13 |
| | | | | |||||
| * | | | fixing indentation | seanm | 2013-05-10 | 1 | -1/+1 |
| | | | | |||||
| * | | | adding kafkaStream API tests | seanm | 2013-05-10 | 2 | -2/+13 |
| | | | | |||||
| * | | | Surfacing decoders on KafkaInputDStream | seanm | 2013-04-16 | 4 | -24/+43 |
| |/ / | |||||
* | | | count() now uses a transform instead of ConstantInputDStream | seanm | 2013-05-10 | 1 | -4/+1 |
| | | | |||||
* | | | fixing Spark Streaming count() so that 0 will be emitted when there is ↵ | seanm | 2013-04-15 | 2 | -3/+6 |
|/ / | | | | | | | nothing to count | ||||
* | | fixing autooffset.reset behavior when set to 'largest' | seanm | 2013-03-26 | 1 | -4/+6 |
| | | |||||
* | | keeping JavaStreamingContext in sync with StreamingContext + adding comments ↵ | seanm | 2013-03-15 | 2 | -6/+7 |
| | | | | | | | | for better clarity | ||||
* | | removing dependency on ZookeeperConsumerConnector + purging last relic of ↵ | seanm | 2013-03-15 | 3 | -59/+6 |
| | | | | | | | | kafka reliability that never solidified (ie- setOffsets) | ||||
* | | fixing memory leak in kafka MessageHandler | seanm | 2013-03-14 | 1 | -4/+1 |
| | | |||||
* | | KafkaInputDStream improvements. Allows more Kafka configurability | seanm | 2013-03-14 | 2 | -19/+51 |
|/ | |||||
* | Fixed class paths and dependencies based on Matei's comments. | Tathagata Das | 2013-02-24 | 1 | -11/+0 |
| | |||||
* | Added back the initial spark job before starting streaming receivers | Tathagata Das | 2013-02-24 | 1 | -1/+1 |
| | |||||
* | Fixed missing dependencies in streaming/pom.xml | Tathagata Das | 2013-02-24 | 1 | -4/+14 |
| | |||||
* | Updated streaming programming guide with Java API info, and comments from ↵ | Tathagata Das | 2013-02-23 | 2 | -3/+2 |
| | | | | Patrick. | ||||
* | Fixed differences in APIs of StreamingContext and JavaStreamingContext. ↵ | Tathagata Das | 2013-02-23 | 4 | -25/+231 |
| | | | | Change rawNetworkStream to rawSocketStream, and added twitter, actor, zeroMQ streams to JavaStreamingContext. Also added them to JavaAPISuite. | ||||
* | Merge branch 'mesos-streaming' into streaming | Tathagata Das | 2013-02-22 | 3 | -2/+66 |
|\ | |||||
| * | Merge pull request #480 from MLnick/streaming-eg-algebird | Tathagata Das | 2013-02-22 | 1 | -0/+10 |
| |\ | | | | | | | [Streaming] Examples using Twitter's Algebird library | ||||
| | * | Merge remote-tracking branch 'upstream/streaming' into streaming-eg-algebird | Nick Pentreath | 2013-02-21 | 11 | -43/+306 |
| | |\ | |||||
| | * | | Dependencies and refactoring for streaming HLL example, and using ↵ | Nick Pentreath | 2013-02-19 | 1 | -0/+10 |
| | | | | | | | | | | | | | | | | context.twitterStream method | ||||
| * | | | Merge pull request #479 from ScrapCodes/zeromq-streaming | Tathagata Das | 2013-02-22 | 2 | -2/+56 |
| |\ \ \ | | |_|/ | |/| | | Zeromq streaming |