aboutsummaryrefslogtreecommitdiff
path: root/streaming
Commit message (Collapse)AuthorAgeFilesLines
* Merging build changes in from 0.8Patrick Wendell2013-10-051-4/+5
|
* Update build version in masterPatrick Wendell2013-09-241-1/+1
|
* Move some classes to more appropriate packages:Matei Zaharia2013-09-0131-60/+70
| | | | | | * RDD, *RDDFunctions -> org.apache.spark.rdd * Utils, ClosureCleaner, SizeEstimator -> org.apache.spark.util * JavaSerializer, KryoSerializer -> org.apache.spark.serializer
* Fix some URLsMatei Zaharia2013-09-011-1/+1
|
* Initial work to rename package to org.apache.sparkMatei Zaharia2013-09-0159-261/+266
|
* Merge pull request #701 from ScrapCodes/documentation-suggestionsMatei Zaharia2013-08-223-3/+7
|\ | | | | Documentation suggestions for spark streaming.
| * Linking custom receiver guidePrashant Sharma2013-08-232-0/+4
| |
| * Corrections in documentation commentPrashant Sharma2013-08-231-3/+3
| |
* | Remove redundant dependencies from POMsJey Kottalam2013-08-181-5/+0
| |
* | Maven build now also works with YARNJey Kottalam2013-08-161-40/+0
| |
* | Maven build now works with CDH hadoop-2.0.0-mr1Jey Kottalam2013-08-161-27/+0
| |
* | Initial changes to make Maven build agnostic of hadoop versionJey Kottalam2013-08-161-32/+10
| |
* | Change scala.Option to Guava Optional in Java APIs.Josh Rosen2013-08-111-5/+2
| |
* | Changed other LZF uses to use the compression codec interface.Reynold Xin2013-07-311-9/+17
| |
* | Add Apache license headers and LICENSE and NOTICE filesMatei Zaharia2013-07-1660-6/+1026
|/
* Merge pull request #688 from markhamstra/scalaDependenciesMatei Zaharia2013-07-081-0/+4
|\ | | | | Fixed SPARK-795 with explicit dependencies
| * pom cleanupMark Hamstra2013-07-081-1/+0
| |
| * Explicit dependencies for scala-library and scalap to prevent 2.9.2 vs. ↵Mark Hamstra2013-07-081-0/+5
| | | | | | | | 2.9.3 problems
* | Catch RejectedExecution exception in Checkpoint handler.Shivaram Venkataraman2013-07-071-2/+7
|/
* Merge remote-tracking branch 'pwendell/ui-updates'Matei Zaharia2013-07-061-1/+5
|\ | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/scheduler/DAGScheduler.scala core/src/main/scala/spark/util/AkkaUtils.scala pom.xml
| * Handful of changes based on matei's reviewPatrick Wendell2013-06-271-1/+5
| | | | | | | | | | | | - Avoid exception when no tasks have finished for a stage - Adding DOCTYPE so css renders properly - Adding progress slider
* | Merge pull request #655 from tgravescs/masterMatei Zaharia2013-07-061-1/+2
|\ \ | | | | | | Add support for running Spark on Yarn on a secure Hadoop Cluster
| * | Rework from pull request. Removed --user option from Spark on Yarn Client, ↵Y.CORP.YAHOO.COM\tgraves2013-07-021-4/+0
| | | | | | | | | | | | | | | | | | | | | made the user of JAVA_HOME environment variable conditional on if its set, and created addCredentials in each of the SparkHadoopUtil classes to only add the credentials when the profile is hadoop2-yarn.
| * | Add support for Spark on Yarn on a secure Hadoop clusterThomas Graves2013-06-191-1/+6
| |/
* | Reduced the number of Iterator to ArrayBuffer copies in NetworkReceiver.Tathagata Das2013-07-052-14/+11
| |
* | Initialize Twitter4J OAuth from system properties instead of promptingMatei Zaharia2013-06-294-38/+23
| |
* | Merge remote-tracking branch 'mrpotes/master'Matei Zaharia2013-06-293-35/+85
|\ \
| * | Include a default OAuth implementation, and update examples and ↵James Phillpotts2013-06-253-25/+78
| | | | | | | | | | | | JavaStreamingContext
| * | Twitter API v1 is retired - username/password auth no longer possibleJames Phillpotts2013-06-241-15/+1
| | |
| * | Allow other twitter authorizations than username/passwordJames Phillpotts2013-06-212-9/+20
| |/
* | Merge branch 'master' into streamingTathagata Das2013-06-2414-75/+202
|\| | | | | | | | | Conflicts: .gitignore
| * Exclude old versions of Netty from Maven-based buildJey Kottalam2013-05-181-0/+6
| |
| * Merge branch 'shuffle-performance-fix-0.7' of github.com:shane-huang/spark ↵Reynold Xin2013-05-071-1/+1
| |\ | | | | | | | | | | | | | | | | | | | | | | | | into shufflemerge Conflicts: core/src/main/scala/spark/storage/BlockManager.scala core/src/main/scala/spark/storage/DiskStore.scala project/SparkBuild.scala
| | * Shuffle Performance fix: Use netty embeded OIO file server instead of ↵shane-huang2013-04-071-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | ConnectionManager Shuffle Performance Optimization: do not send 0-byte block requests to reduce network messages change reference from io.Source to scala.io.Source to avoid looking into io.netty package Signed-off-by: shane-huang <shengsheng.huang@intel.com>
| * | Remove debug statementsMridul Muralidharan2013-04-292-3/+0
| | |
| * | Make log message more descriptive to aid in debuggingMridul Muralidharan2013-04-291-1/+3
| | |
| * | Allow CheckpointWriter pending tasks to finishMridul Muralidharan2013-04-282-7/+8
| | |
| * | Attempt to fix streaming test failures after yarn branch mergeMridul Muralidharan2013-04-287-9/+38
| | |
| * | Attempt at fixing merge conflictMridul Muralidharan2013-04-241-1/+1
| |\ \
| | * \ Merge remote-tracking branch 'jey/bump-development-version-to-0.8.0'Matei Zaharia2013-04-081-1/+1
| | |\ \ | | | |/ | | |/| | | | | | | | | | | | | Conflicts: docs/_config.yml project/SparkBuild.scala
| | | * Bump development version to 0.8.0Jey Kottalam2013-03-281-1/+1
| | | |
| * | | Add support for building against hadoop2-yarn : adding new maven profile for itMridul Muralidharan2013-04-071-0/+37
| |/ /
| * / Move streaming test initialization into 'before' blocksJey Kottalam2013-03-282-4/+8
| |/
| * method first in trait IterableLike is deprecated: use `head' insteadHolden Karau2013-03-241-1/+1
| |
| * Add a log4j compile dependency to fix build in IntelliJMikhail Bautin2013-03-151-1/+1
| | | | | | | | | | Also rename parent project to spark-parent (otherwise it shows up as "parent" in IntelliJ, which is very confusing).
| * Forgot equals.Stephen Haberman2013-03-121-1/+1
| |
| * More quickly call close in HadoopRDD.Stephen Haberman2013-03-111-35/+9
| | | | | | | | | | This also refactors out the common "gotNext" iterator pattern into a shared utility class.
| * Instead of failing to bind to a fixed, already-in-use port, let the OS ↵Mark Hamstra2013-03-011-8/+10
| | | | | | | | choose an available port for TestServer.
| * bump version to 0.7.1-SNAPSHOT in the subproject poms to keep the maven ↵Mark Hamstra2013-02-281-1/+1
| | | | | | | | build building.
| * Merge pull request #503 from pwendell/bug-fixMatei Zaharia2013-02-251-1/+1
| |\ | | | | | | createNewSparkContext should use sparkHome/jars/environment.