aboutsummaryrefslogtreecommitdiff
path: root/streaming
Commit message (Collapse)AuthorAgeFilesLines
...
| * Merge pull request #701 from ScrapCodes/documentation-suggestionsMatei Zaharia2013-08-223-3/+7
| |\ | | | | | | Documentation suggestions for spark streaming.
| | * Linking custom receiver guidePrashant Sharma2013-08-232-0/+4
| | |
| | * Corrections in documentation commentPrashant Sharma2013-08-231-3/+3
| | |
| * | Remove redundant dependencies from POMsJey Kottalam2013-08-181-5/+0
| | |
| * | Maven build now also works with YARNJey Kottalam2013-08-161-40/+0
| | |
| * | Maven build now works with CDH hadoop-2.0.0-mr1Jey Kottalam2013-08-161-27/+0
| | |
| * | Initial changes to make Maven build agnostic of hadoop versionJey Kottalam2013-08-161-32/+10
| | |
| * | Change scala.Option to Guava Optional in Java APIs.Josh Rosen2013-08-111-5/+2
| | |
| * | Changed other LZF uses to use the compression codec interface.Reynold Xin2013-07-311-9/+17
| | |
| * | Add Apache license headers and LICENSE and NOTICE filesMatei Zaharia2013-07-1660-6/+1026
| |/
* | code formatting, The warning related to scope exit and enter is not worth ↵Prashant Sharma2013-07-161-14/+14
| | | | | | | | fixing as it only affects debugging scopes and nothing else.
* | Fixed warning erasure -> runtimeClassPrashant Sharma2013-07-161-1/+1
| |
* | Fixed warning ThrowablesPrashant Sharma2013-07-161-1/+1
| |
* | Fixed warning ClassManifest -> ClassTagPrashant Sharma2013-07-161-1/+1
| |
* | Merge branch 'master' into master-mergePrashant Sharma2013-07-126-18/+29
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: README.md core/pom.xml core/src/main/scala/spark/deploy/JsonProtocol.scala core/src/main/scala/spark/deploy/LocalSparkCluster.scala core/src/main/scala/spark/deploy/master/Master.scala core/src/main/scala/spark/deploy/master/MasterWebUI.scala core/src/main/scala/spark/deploy/worker/Worker.scala core/src/main/scala/spark/deploy/worker/WorkerWebUI.scala core/src/main/scala/spark/storage/BlockManagerUI.scala core/src/main/scala/spark/util/AkkaUtils.scala pom.xml project/SparkBuild.scala streaming/src/main/scala/spark/streaming/receivers/ActorReceiver.scala
| * Merge pull request #688 from markhamstra/scalaDependenciesMatei Zaharia2013-07-081-0/+4
| |\ | | | | | | Fixed SPARK-795 with explicit dependencies
| | * pom cleanupMark Hamstra2013-07-081-1/+0
| | |
| | * Explicit dependencies for scala-library and scalap to prevent 2.9.2 vs. ↵Mark Hamstra2013-07-081-0/+5
| | | | | | | | | | | | 2.9.3 problems
| * | Catch RejectedExecution exception in Checkpoint handler.Shivaram Venkataraman2013-07-071-2/+7
| |/
| * Merge remote-tracking branch 'pwendell/ui-updates'Matei Zaharia2013-07-061-1/+5
| |\ | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/scheduler/DAGScheduler.scala core/src/main/scala/spark/util/AkkaUtils.scala pom.xml
| | * Handful of changes based on matei's reviewPatrick Wendell2013-06-271-1/+5
| | | | | | | | | | | | | | | | | | - Avoid exception when no tasks have finished for a stage - Adding DOCTYPE so css renders properly - Adding progress slider
| * | Merge pull request #655 from tgravescs/masterMatei Zaharia2013-07-061-1/+2
| |\ \ | | | | | | | | Add support for running Spark on Yarn on a secure Hadoop Cluster
| | * | Rework from pull request. Removed --user option from Spark on Yarn Client, ↵Y.CORP.YAHOO.COM\tgraves2013-07-021-4/+0
| | | | | | | | | | | | | | | | | | | | | | | | | | | | made the user of JAVA_HOME environment variable conditional on if its set, and created addCredentials in each of the SparkHadoopUtil classes to only add the credentials when the profile is hadoop2-yarn.
| | * | Add support for Spark on Yarn on a secure Hadoop clusterThomas Graves2013-06-191-1/+6
| | |/
| * | Reduced the number of Iterator to ArrayBuffer copies in NetworkReceiver.Tathagata Das2013-07-052-14/+11
| | |
* | | Merge branch 'master' into master-mergePrashant Sharma2013-07-0316-148/+292
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/pom.xml core/src/main/scala/spark/MapOutputTracker.scala core/src/main/scala/spark/RDD.scala core/src/main/scala/spark/RDDCheckpointData.scala core/src/main/scala/spark/SparkContext.scala core/src/main/scala/spark/Utils.scala core/src/main/scala/spark/api/python/PythonRDD.scala core/src/main/scala/spark/deploy/client/Client.scala core/src/main/scala/spark/deploy/master/MasterWebUI.scala core/src/main/scala/spark/deploy/worker/Worker.scala core/src/main/scala/spark/deploy/worker/WorkerWebUI.scala core/src/main/scala/spark/rdd/BlockRDD.scala core/src/main/scala/spark/rdd/ZippedRDD.scala core/src/main/scala/spark/scheduler/cluster/StandaloneSchedulerBackend.scala core/src/main/scala/spark/storage/BlockManager.scala core/src/main/scala/spark/storage/BlockManagerMaster.scala core/src/main/scala/spark/storage/BlockManagerMasterActor.scala core/src/main/scala/spark/storage/BlockManagerUI.scala core/src/main/scala/spark/util/AkkaUtils.scala core/src/test/scala/spark/SizeEstimatorSuite.scala pom.xml project/SparkBuild.scala repl/src/main/scala/spark/repl/SparkILoop.scala repl/src/test/scala/spark/repl/ReplSuite.scala streaming/src/main/scala/spark/streaming/StreamingContext.scala streaming/src/main/scala/spark/streaming/api/java/JavaStreamingContext.scala streaming/src/main/scala/spark/streaming/dstream/KafkaInputDStream.scala streaming/src/main/scala/spark/streaming/util/MasterFailureTest.scala
| * | Initialize Twitter4J OAuth from system properties instead of promptingMatei Zaharia2013-06-294-38/+23
| | |
| * | Merge remote-tracking branch 'mrpotes/master'Matei Zaharia2013-06-293-35/+85
| |\ \
| | * | Include a default OAuth implementation, and update examples and ↵James Phillpotts2013-06-253-25/+78
| | | | | | | | | | | | | | | | JavaStreamingContext
| | * | Twitter API v1 is retired - username/password auth no longer possibleJames Phillpotts2013-06-241-15/+1
| | | |
| | * | Allow other twitter authorizations than username/passwordJames Phillpotts2013-06-212-9/+20
| | |/
| * | Merge branch 'master' into streamingTathagata Das2013-06-2414-75/+202
| |\| | | | | | | | | | | | | Conflicts: .gitignore
| | * Exclude old versions of Netty from Maven-based buildJey Kottalam2013-05-181-0/+6
| | |
| | * Merge branch 'shuffle-performance-fix-0.7' of github.com:shane-huang/spark ↵Reynold Xin2013-05-071-1/+1
| | |\ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | into shufflemerge Conflicts: core/src/main/scala/spark/storage/BlockManager.scala core/src/main/scala/spark/storage/DiskStore.scala project/SparkBuild.scala
| | | * Shuffle Performance fix: Use netty embeded OIO file server instead of ↵shane-huang2013-04-071-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | ConnectionManager Shuffle Performance Optimization: do not send 0-byte block requests to reduce network messages change reference from io.Source to scala.io.Source to avoid looking into io.netty package Signed-off-by: shane-huang <shengsheng.huang@intel.com>
| | * | Remove debug statementsMridul Muralidharan2013-04-292-3/+0
| | | |
| | * | Make log message more descriptive to aid in debuggingMridul Muralidharan2013-04-291-1/+3
| | | |
| | * | Allow CheckpointWriter pending tasks to finishMridul Muralidharan2013-04-282-7/+8
| | | |
| | * | Attempt to fix streaming test failures after yarn branch mergeMridul Muralidharan2013-04-287-9/+38
| | | |
| | * | Attempt at fixing merge conflictMridul Muralidharan2013-04-241-1/+1
| | |\ \
| | * | | Add support for building against hadoop2-yarn : adding new maven profile for itMridul Muralidharan2013-04-071-0/+37
| | | |/ | | |/|
| * | | Minor formatting fixesTathagata Das2013-06-243-19/+34
| | | |
| * | | Merge pull request #572 from Reinvigorate/sm-block-intervalTathagata Das2013-06-241-1/+1
| |\ \ \ | | | | | | | | | | Adding spark.streaming.blockInterval property
| | * | | adding spark.streaming.blockInterval propertyseanm2013-04-161-1/+1
| | | | |
| * | | | Merge pull request #571 from Reinvigorate/sm-kafka-serializersTathagata Das2013-06-245-27/+67
| |\ \ \ \ | | | | | | | | | | | | Surfacing decoders on KafkaInputDStream
| | * | | | fixing kafkaStream Java API and adding testseanm2013-05-102-3/+13
| | | | | |
| | * | | | fixing indentationseanm2013-05-101-1/+1
| | | | | |
| | * | | | adding kafkaStream API testsseanm2013-05-102-2/+13
| | | | | |
| | * | | | Surfacing decoders on KafkaInputDStreamseanm2013-04-164-24/+43
| | |/ / /
| * | | | count() now uses a transform instead of ConstantInputDStreamseanm2013-05-101-4/+1
| | | | |