Commit message (Collapse) | Author | Age | Files | Lines | ||
---|---|---|---|---|---|---|
... | ||||||
* | Merge remote-tracking branch 'pwendell/ui-updates' | Matei Zaharia | 2013-07-06 | 1 | -1/+5 | |
|\ | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/scheduler/DAGScheduler.scala core/src/main/scala/spark/util/AkkaUtils.scala pom.xml | |||||
| * | Handful of changes based on matei's review | Patrick Wendell | 2013-06-27 | 1 | -1/+5 | |
| | | | | | | | | | | | | - Avoid exception when no tasks have finished for a stage - Adding DOCTYPE so css renders properly - Adding progress slider | |||||
* | | Merge pull request #655 from tgravescs/master | Matei Zaharia | 2013-07-06 | 1 | -1/+2 | |
|\ \ | | | | | | | Add support for running Spark on Yarn on a secure Hadoop Cluster | |||||
| * | | Rework from pull request. Removed --user option from Spark on Yarn Client, ↵ | Y.CORP.YAHOO.COM\tgraves | 2013-07-02 | 1 | -4/+0 | |
| | | | | | | | | | | | | | | | | | | | | | made the user of JAVA_HOME environment variable conditional on if its set, and created addCredentials in each of the SparkHadoopUtil classes to only add the credentials when the profile is hadoop2-yarn. | |||||
| * | | Add support for Spark on Yarn on a secure Hadoop cluster | Thomas Graves | 2013-06-19 | 1 | -1/+6 | |
| |/ | ||||||
* | | Reduced the number of Iterator to ArrayBuffer copies in NetworkReceiver. | Tathagata Das | 2013-07-05 | 2 | -14/+11 | |
| | | ||||||
* | | Initialize Twitter4J OAuth from system properties instead of prompting | Matei Zaharia | 2013-06-29 | 4 | -38/+23 | |
| | | ||||||
* | | Merge remote-tracking branch 'mrpotes/master' | Matei Zaharia | 2013-06-29 | 3 | -35/+85 | |
|\ \ | ||||||
| * | | Include a default OAuth implementation, and update examples and ↵ | James Phillpotts | 2013-06-25 | 3 | -25/+78 | |
| | | | | | | | | | | | | JavaStreamingContext | |||||
| * | | Twitter API v1 is retired - username/password auth no longer possible | James Phillpotts | 2013-06-24 | 1 | -15/+1 | |
| | | | ||||||
| * | | Allow other twitter authorizations than username/password | James Phillpotts | 2013-06-21 | 2 | -9/+20 | |
| |/ | ||||||
* | | Merge branch 'master' into streaming | Tathagata Das | 2013-06-24 | 14 | -75/+202 | |
|\| | | | | | | | | | Conflicts: .gitignore | |||||
| * | Exclude old versions of Netty from Maven-based build | Jey Kottalam | 2013-05-18 | 1 | -0/+6 | |
| | | ||||||
| * | Merge branch 'shuffle-performance-fix-0.7' of github.com:shane-huang/spark ↵ | Reynold Xin | 2013-05-07 | 1 | -1/+1 | |
| |\ | | | | | | | | | | | | | | | | | | | | | | | | | into shufflemerge Conflicts: core/src/main/scala/spark/storage/BlockManager.scala core/src/main/scala/spark/storage/DiskStore.scala project/SparkBuild.scala | |||||
| | * | Shuffle Performance fix: Use netty embeded OIO file server instead of ↵ | shane-huang | 2013-04-07 | 1 | -1/+1 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | ConnectionManager Shuffle Performance Optimization: do not send 0-byte block requests to reduce network messages change reference from io.Source to scala.io.Source to avoid looking into io.netty package Signed-off-by: shane-huang <shengsheng.huang@intel.com> | |||||
| * | | Remove debug statements | Mridul Muralidharan | 2013-04-29 | 2 | -3/+0 | |
| | | | ||||||
| * | | Make log message more descriptive to aid in debugging | Mridul Muralidharan | 2013-04-29 | 1 | -1/+3 | |
| | | | ||||||
| * | | Allow CheckpointWriter pending tasks to finish | Mridul Muralidharan | 2013-04-28 | 2 | -7/+8 | |
| | | | ||||||
| * | | Attempt to fix streaming test failures after yarn branch merge | Mridul Muralidharan | 2013-04-28 | 7 | -9/+38 | |
| | | | ||||||
| * | | Attempt at fixing merge conflict | Mridul Muralidharan | 2013-04-24 | 1 | -1/+1 | |
| |\ \ | ||||||
| | * \ | Merge remote-tracking branch 'jey/bump-development-version-to-0.8.0' | Matei Zaharia | 2013-04-08 | 1 | -1/+1 | |
| | |\ \ | | | |/ | | |/| | | | | | | | | | | | | | Conflicts: docs/_config.yml project/SparkBuild.scala | |||||
| | | * | Bump development version to 0.8.0 | Jey Kottalam | 2013-03-28 | 1 | -1/+1 | |
| | | | | ||||||
| * | | | Add support for building against hadoop2-yarn : adding new maven profile for it | Mridul Muralidharan | 2013-04-07 | 1 | -0/+37 | |
| |/ / | ||||||
| * / | Move streaming test initialization into 'before' blocks | Jey Kottalam | 2013-03-28 | 2 | -4/+8 | |
| |/ | ||||||
| * | method first in trait IterableLike is deprecated: use `head' instead | Holden Karau | 2013-03-24 | 1 | -1/+1 | |
| | | ||||||
| * | Add a log4j compile dependency to fix build in IntelliJ | Mikhail Bautin | 2013-03-15 | 1 | -1/+1 | |
| | | | | | | | | | | Also rename parent project to spark-parent (otherwise it shows up as "parent" in IntelliJ, which is very confusing). | |||||
| * | Forgot equals. | Stephen Haberman | 2013-03-12 | 1 | -1/+1 | |
| | | ||||||
| * | More quickly call close in HadoopRDD. | Stephen Haberman | 2013-03-11 | 1 | -35/+9 | |
| | | | | | | | | | | This also refactors out the common "gotNext" iterator pattern into a shared utility class. | |||||
| * | Instead of failing to bind to a fixed, already-in-use port, let the OS ↵ | Mark Hamstra | 2013-03-01 | 1 | -8/+10 | |
| | | | | | | | | choose an available port for TestServer. | |||||
| * | bump version to 0.7.1-SNAPSHOT in the subproject poms to keep the maven ↵ | Mark Hamstra | 2013-02-28 | 1 | -1/+1 | |
| | | | | | | | | build building. | |||||
| * | Merge pull request #503 from pwendell/bug-fix | Matei Zaharia | 2013-02-25 | 1 | -1/+1 | |
| |\ | | | | | | | createNewSparkContext should use sparkHome/jars/environment. | |||||
| | * | createNewSparkContext should use sparkHome/jars/environment. | Patrick Wendell | 2013-02-25 | 1 | -1/+1 | |
| | | | | | | | | | | | | This fixes a bug introduced by Matei's recent change. | |||||
| * | | Pass a code JAR to SparkContext in our examples. Fixes SPARK-594. | Matei Zaharia | 2013-02-25 | 1 | -0/+17 | |
| |/ | ||||||
| * | Changed Flume test to use the same port as other tests, so that can be ↵ | Tathagata Das | 2013-02-25 | 1 | -2/+2 | |
| | | | | | | | | controlled centrally. | |||||
| * | Fixed something that was reported as a compile error in ScalaDoc. | Matei Zaharia | 2013-02-25 | 2 | -3/+3 | |
| | | | | | | | | | | | | For some reason, ScalaDoc complained about no such constructor for StreamingContext; it doesn't seem like an actual Scala error but it prevented sbt publish and from working because docs weren't built. | |||||
| * | Allow passing sparkHome and JARs to StreamingContext constructor | Matei Zaharia | 2013-02-25 | 4 | -10/+68 | |
| | | | | | | | | | | Also warns if spark.cleaner.ttl is not set in the version where you pass your own SparkContext. | |||||
* | | Minor formatting fixes | Tathagata Das | 2013-06-24 | 3 | -19/+34 | |
| | | ||||||
* | | Merge pull request #572 from Reinvigorate/sm-block-interval | Tathagata Das | 2013-06-24 | 1 | -1/+1 | |
|\ \ | | | | | | | Adding spark.streaming.blockInterval property | |||||
| * | | adding spark.streaming.blockInterval property | seanm | 2013-04-16 | 1 | -1/+1 | |
| | | | ||||||
* | | | Merge pull request #571 from Reinvigorate/sm-kafka-serializers | Tathagata Das | 2013-06-24 | 5 | -27/+67 | |
|\ \ \ | | | | | | | | | Surfacing decoders on KafkaInputDStream | |||||
| * | | | fixing kafkaStream Java API and adding test | seanm | 2013-05-10 | 2 | -3/+13 | |
| | | | | ||||||
| * | | | fixing indentation | seanm | 2013-05-10 | 1 | -1/+1 | |
| | | | | ||||||
| * | | | adding kafkaStream API tests | seanm | 2013-05-10 | 2 | -2/+13 | |
| | | | | ||||||
| * | | | Surfacing decoders on KafkaInputDStream | seanm | 2013-04-16 | 4 | -24/+43 | |
| |/ / | ||||||
* | | | count() now uses a transform instead of ConstantInputDStream | seanm | 2013-05-10 | 1 | -4/+1 | |
| | | | ||||||
* | | | fixing Spark Streaming count() so that 0 will be emitted when there is ↵ | seanm | 2013-04-15 | 2 | -3/+6 | |
|/ / | | | | | | | nothing to count | |||||
* | | fixing autooffset.reset behavior when set to 'largest' | seanm | 2013-03-26 | 1 | -4/+6 | |
| | | ||||||
* | | keeping JavaStreamingContext in sync with StreamingContext + adding comments ↵ | seanm | 2013-03-15 | 2 | -6/+7 | |
| | | | | | | | | for better clarity | |||||
* | | removing dependency on ZookeeperConsumerConnector + purging last relic of ↵ | seanm | 2013-03-15 | 3 | -59/+6 | |
| | | | | | | | | kafka reliability that never solidified (ie- setOffsets) | |||||
* | | fixing memory leak in kafka MessageHandler | seanm | 2013-03-14 | 1 | -4/+1 | |
| | |