aboutsummaryrefslogtreecommitdiff
path: root/streaming
Commit message (Collapse)AuthorAgeFilesLines
* Add Apache license headers and LICENSE and NOTICE filesMatei Zaharia2013-07-1660-6/+1026
|
* Merge pull request #688 from markhamstra/scalaDependenciesMatei Zaharia2013-07-081-0/+4
|\ | | | | Fixed SPARK-795 with explicit dependencies
| * pom cleanupMark Hamstra2013-07-081-1/+0
| |
| * Explicit dependencies for scala-library and scalap to prevent 2.9.2 vs. ↵Mark Hamstra2013-07-081-0/+5
| | | | | | | | 2.9.3 problems
* | Catch RejectedExecution exception in Checkpoint handler.Shivaram Venkataraman2013-07-071-2/+7
|/
* Merge remote-tracking branch 'pwendell/ui-updates'Matei Zaharia2013-07-061-1/+5
|\ | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/scheduler/DAGScheduler.scala core/src/main/scala/spark/util/AkkaUtils.scala pom.xml
| * Handful of changes based on matei's reviewPatrick Wendell2013-06-271-1/+5
| | | | | | | | | | | | - Avoid exception when no tasks have finished for a stage - Adding DOCTYPE so css renders properly - Adding progress slider
* | Merge pull request #655 from tgravescs/masterMatei Zaharia2013-07-061-1/+2
|\ \ | | | | | | Add support for running Spark on Yarn on a secure Hadoop Cluster
| * | Rework from pull request. Removed --user option from Spark on Yarn Client, ↵Y.CORP.YAHOO.COM\tgraves2013-07-021-4/+0
| | | | | | | | | | | | | | | | | | | | | made the user of JAVA_HOME environment variable conditional on if its set, and created addCredentials in each of the SparkHadoopUtil classes to only add the credentials when the profile is hadoop2-yarn.
| * | Add support for Spark on Yarn on a secure Hadoop clusterThomas Graves2013-06-191-1/+6
| |/
* | Reduced the number of Iterator to ArrayBuffer copies in NetworkReceiver.Tathagata Das2013-07-052-14/+11
| |
* | Initialize Twitter4J OAuth from system properties instead of promptingMatei Zaharia2013-06-294-38/+23
| |
* | Merge remote-tracking branch 'mrpotes/master'Matei Zaharia2013-06-293-35/+85
|\ \
| * | Include a default OAuth implementation, and update examples and ↵James Phillpotts2013-06-253-25/+78
| | | | | | | | | | | | JavaStreamingContext
| * | Twitter API v1 is retired - username/password auth no longer possibleJames Phillpotts2013-06-241-15/+1
| | |
| * | Allow other twitter authorizations than username/passwordJames Phillpotts2013-06-212-9/+20
| |/
* | Merge branch 'master' into streamingTathagata Das2013-06-2414-75/+202
|\| | | | | | | | | Conflicts: .gitignore
| * Exclude old versions of Netty from Maven-based buildJey Kottalam2013-05-181-0/+6
| |
| * Merge branch 'shuffle-performance-fix-0.7' of github.com:shane-huang/spark ↵Reynold Xin2013-05-071-1/+1
| |\ | | | | | | | | | | | | | | | | | | | | | | | | into shufflemerge Conflicts: core/src/main/scala/spark/storage/BlockManager.scala core/src/main/scala/spark/storage/DiskStore.scala project/SparkBuild.scala
| | * Shuffle Performance fix: Use netty embeded OIO file server instead of ↵shane-huang2013-04-071-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | ConnectionManager Shuffle Performance Optimization: do not send 0-byte block requests to reduce network messages change reference from io.Source to scala.io.Source to avoid looking into io.netty package Signed-off-by: shane-huang <shengsheng.huang@intel.com>
| * | Remove debug statementsMridul Muralidharan2013-04-292-3/+0
| | |
| * | Make log message more descriptive to aid in debuggingMridul Muralidharan2013-04-291-1/+3
| | |
| * | Allow CheckpointWriter pending tasks to finishMridul Muralidharan2013-04-282-7/+8
| | |
| * | Attempt to fix streaming test failures after yarn branch mergeMridul Muralidharan2013-04-287-9/+38
| | |
| * | Attempt at fixing merge conflictMridul Muralidharan2013-04-241-1/+1
| |\ \
| | * \ Merge remote-tracking branch 'jey/bump-development-version-to-0.8.0'Matei Zaharia2013-04-081-1/+1
| | |\ \ | | | |/ | | |/| | | | | | | | | | | | | Conflicts: docs/_config.yml project/SparkBuild.scala
| | | * Bump development version to 0.8.0Jey Kottalam2013-03-281-1/+1
| | | |
| * | | Add support for building against hadoop2-yarn : adding new maven profile for itMridul Muralidharan2013-04-071-0/+37
| |/ /
| * / Move streaming test initialization into 'before' blocksJey Kottalam2013-03-282-4/+8
| |/
| * method first in trait IterableLike is deprecated: use `head' insteadHolden Karau2013-03-241-1/+1
| |
| * Add a log4j compile dependency to fix build in IntelliJMikhail Bautin2013-03-151-1/+1
| | | | | | | | | | Also rename parent project to spark-parent (otherwise it shows up as "parent" in IntelliJ, which is very confusing).
| * Forgot equals.Stephen Haberman2013-03-121-1/+1
| |
| * More quickly call close in HadoopRDD.Stephen Haberman2013-03-111-35/+9
| | | | | | | | | | This also refactors out the common "gotNext" iterator pattern into a shared utility class.
| * Instead of failing to bind to a fixed, already-in-use port, let the OS ↵Mark Hamstra2013-03-011-8/+10
| | | | | | | | choose an available port for TestServer.
| * bump version to 0.7.1-SNAPSHOT in the subproject poms to keep the maven ↵Mark Hamstra2013-02-281-1/+1
| | | | | | | | build building.
| * Merge pull request #503 from pwendell/bug-fixMatei Zaharia2013-02-251-1/+1
| |\ | | | | | | createNewSparkContext should use sparkHome/jars/environment.
| | * createNewSparkContext should use sparkHome/jars/environment.Patrick Wendell2013-02-251-1/+1
| | | | | | | | | | | | This fixes a bug introduced by Matei's recent change.
| * | Pass a code JAR to SparkContext in our examples. Fixes SPARK-594.Matei Zaharia2013-02-251-0/+17
| |/
| * Changed Flume test to use the same port as other tests, so that can be ↵Tathagata Das2013-02-251-2/+2
| | | | | | | | controlled centrally.
| * Fixed something that was reported as a compile error in ScalaDoc.Matei Zaharia2013-02-252-3/+3
| | | | | | | | | | | | For some reason, ScalaDoc complained about no such constructor for StreamingContext; it doesn't seem like an actual Scala error but it prevented sbt publish and from working because docs weren't built.
| * Allow passing sparkHome and JARs to StreamingContext constructorMatei Zaharia2013-02-254-10/+68
| | | | | | | | | | Also warns if spark.cleaner.ttl is not set in the version where you pass your own SparkContext.
* | Minor formatting fixesTathagata Das2013-06-243-19/+34
| |
* | Merge pull request #572 from Reinvigorate/sm-block-intervalTathagata Das2013-06-241-1/+1
|\ \ | | | | | | Adding spark.streaming.blockInterval property
| * | adding spark.streaming.blockInterval propertyseanm2013-04-161-1/+1
| | |
* | | Merge pull request #571 from Reinvigorate/sm-kafka-serializersTathagata Das2013-06-245-27/+67
|\ \ \ | | | | | | | | Surfacing decoders on KafkaInputDStream
| * | | fixing kafkaStream Java API and adding testseanm2013-05-102-3/+13
| | | |
| * | | fixing indentationseanm2013-05-101-1/+1
| | | |
| * | | adding kafkaStream API testsseanm2013-05-102-2/+13
| | | |
| * | | Surfacing decoders on KafkaInputDStreamseanm2013-04-164-24/+43
| |/ /
* | | count() now uses a transform instead of ConstantInputDStreamseanm2013-05-101-4/+1
| | |
generated by cgit v1.2.3 (git 2.39.1) at 2024-08-06 06:47:17 +0000