aboutsummaryrefslogtreecommitdiff
path: root/streaming/src
Commit message (Collapse)AuthorAgeFilesLines
* Move some classes to more appropriate packages:Matei Zaharia2013-09-0131-60/+70
| | | | | | * RDD, *RDDFunctions -> org.apache.spark.rdd * Utils, ClosureCleaner, SizeEstimator -> org.apache.spark.util * JavaSerializer, KryoSerializer -> org.apache.spark.serializer
* Initial work to rename package to org.apache.sparkMatei Zaharia2013-09-0158-258/+263
|
* Merge pull request #701 from ScrapCodes/documentation-suggestionsMatei Zaharia2013-08-223-3/+7
|\ | | | | Documentation suggestions for spark streaming.
| * Linking custom receiver guidePrashant Sharma2013-08-232-0/+4
| |
| * Corrections in documentation commentPrashant Sharma2013-08-231-3/+3
| |
* | Change scala.Option to Guava Optional in Java APIs.Josh Rosen2013-08-111-5/+2
| |
* | Changed other LZF uses to use the compression codec interface.Reynold Xin2013-07-311-9/+17
| |
* | Add Apache license headers and LICENSE and NOTICE filesMatei Zaharia2013-07-1659-6/+1009
|/
* Catch RejectedExecution exception in Checkpoint handler.Shivaram Venkataraman2013-07-071-2/+7
|
* Merge remote-tracking branch 'pwendell/ui-updates'Matei Zaharia2013-07-061-1/+5
|\ | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/scheduler/DAGScheduler.scala core/src/main/scala/spark/util/AkkaUtils.scala pom.xml
| * Handful of changes based on matei's reviewPatrick Wendell2013-06-271-1/+5
| | | | | | | | | | | | - Avoid exception when no tasks have finished for a stage - Adding DOCTYPE so css renders properly - Adding progress slider
* | Merge pull request #655 from tgravescs/masterMatei Zaharia2013-07-061-1/+2
|\ \ | | | | | | Add support for running Spark on Yarn on a secure Hadoop Cluster
| * | Rework from pull request. Removed --user option from Spark on Yarn Client, ↵Y.CORP.YAHOO.COM\tgraves2013-07-021-4/+0
| | | | | | | | | | | | | | | | | | | | | made the user of JAVA_HOME environment variable conditional on if its set, and created addCredentials in each of the SparkHadoopUtil classes to only add the credentials when the profile is hadoop2-yarn.
| * | Add support for Spark on Yarn on a secure Hadoop clusterThomas Graves2013-06-191-1/+6
| |/
* | Reduced the number of Iterator to ArrayBuffer copies in NetworkReceiver.Tathagata Das2013-07-052-14/+11
| |
* | Initialize Twitter4J OAuth from system properties instead of promptingMatei Zaharia2013-06-294-38/+23
| |
* | Merge remote-tracking branch 'mrpotes/master'Matei Zaharia2013-06-293-35/+85
|\ \
| * | Include a default OAuth implementation, and update examples and ↵James Phillpotts2013-06-253-25/+78
| | | | | | | | | | | | JavaStreamingContext
| * | Twitter API v1 is retired - username/password auth no longer possibleJames Phillpotts2013-06-241-15/+1
| | |
| * | Allow other twitter authorizations than username/passwordJames Phillpotts2013-06-212-9/+20
| |/
* | Merge branch 'master' into streamingTathagata Das2013-06-2413-73/+157
|\| | | | | | | | | Conflicts: .gitignore
| * Merge branch 'shuffle-performance-fix-0.7' of github.com:shane-huang/spark ↵Reynold Xin2013-05-071-1/+1
| |\ | | | | | | | | | | | | | | | | | | | | | | | | into shufflemerge Conflicts: core/src/main/scala/spark/storage/BlockManager.scala core/src/main/scala/spark/storage/DiskStore.scala project/SparkBuild.scala
| | * Shuffle Performance fix: Use netty embeded OIO file server instead of ↵shane-huang2013-04-071-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | ConnectionManager Shuffle Performance Optimization: do not send 0-byte block requests to reduce network messages change reference from io.Source to scala.io.Source to avoid looking into io.netty package Signed-off-by: shane-huang <shengsheng.huang@intel.com>
| * | Remove debug statementsMridul Muralidharan2013-04-292-3/+0
| | |
| * | Make log message more descriptive to aid in debuggingMridul Muralidharan2013-04-291-1/+3
| | |
| * | Allow CheckpointWriter pending tasks to finishMridul Muralidharan2013-04-282-7/+8
| | |
| * | Attempt to fix streaming test failures after yarn branch mergeMridul Muralidharan2013-04-287-9/+38
| |/
| * Move streaming test initialization into 'before' blocksJey Kottalam2013-03-282-4/+8
| |
| * method first in trait IterableLike is deprecated: use `head' insteadHolden Karau2013-03-241-1/+1
| |
| * Forgot equals.Stephen Haberman2013-03-121-1/+1
| |
| * More quickly call close in HadoopRDD.Stephen Haberman2013-03-111-35/+9
| | | | | | | | | | This also refactors out the common "gotNext" iterator pattern into a shared utility class.
| * Instead of failing to bind to a fixed, already-in-use port, let the OS ↵Mark Hamstra2013-03-011-8/+10
| | | | | | | | choose an available port for TestServer.
| * Merge pull request #503 from pwendell/bug-fixMatei Zaharia2013-02-251-1/+1
| |\ | | | | | | createNewSparkContext should use sparkHome/jars/environment.
| | * createNewSparkContext should use sparkHome/jars/environment.Patrick Wendell2013-02-251-1/+1
| | | | | | | | | | | | This fixes a bug introduced by Matei's recent change.
| * | Pass a code JAR to SparkContext in our examples. Fixes SPARK-594.Matei Zaharia2013-02-251-0/+17
| |/
| * Changed Flume test to use the same port as other tests, so that can be ↵Tathagata Das2013-02-251-2/+2
| | | | | | | | controlled centrally.
| * Fixed something that was reported as a compile error in ScalaDoc.Matei Zaharia2013-02-252-3/+3
| | | | | | | | | | | | For some reason, ScalaDoc complained about no such constructor for StreamingContext; it doesn't seem like an actual Scala error but it prevented sbt publish and from working because docs weren't built.
| * Allow passing sparkHome and JARs to StreamingContext constructorMatei Zaharia2013-02-254-10/+68
| | | | | | | | | | Also warns if spark.cleaner.ttl is not set in the version where you pass your own SparkContext.
* | Minor formatting fixesTathagata Das2013-06-243-19/+34
| |
* | Merge pull request #572 from Reinvigorate/sm-block-intervalTathagata Das2013-06-241-1/+1
|\ \ | | | | | | Adding spark.streaming.blockInterval property
| * | adding spark.streaming.blockInterval propertyseanm2013-04-161-1/+1
| | |
* | | Merge pull request #571 from Reinvigorate/sm-kafka-serializersTathagata Das2013-06-245-27/+67
|\ \ \ | | | | | | | | Surfacing decoders on KafkaInputDStream
| * | | fixing kafkaStream Java API and adding testseanm2013-05-102-3/+13
| | | |
| * | | fixing indentationseanm2013-05-101-1/+1
| | | |
| * | | adding kafkaStream API testsseanm2013-05-102-2/+13
| | | |
| * | | Surfacing decoders on KafkaInputDStreamseanm2013-04-164-24/+43
| |/ /
* | | count() now uses a transform instead of ConstantInputDStreamseanm2013-05-101-4/+1
| | |
* | | fixing Spark Streaming count() so that 0 will be emitted when there is ↵seanm2013-04-152-3/+6
|/ / | | | | | | nothing to count
* | fixing autooffset.reset behavior when set to 'largest'seanm2013-03-261-4/+6
| |
* | keeping JavaStreamingContext in sync with StreamingContext + adding comments ↵seanm2013-03-152-6/+7
| | | | | | | | for better clarity
generated by cgit v1.2.3 (git 2.39.1) at 2024-07-06 23:24:15 +0000