Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Merge pull request #701 from ScrapCodes/documentation-suggestions | Matei Zaharia | 2013-08-22 | 3 | -3/+7 |
|\ | | | | | Documentation suggestions for spark streaming. | ||||
| * | Linking custom receiver guide | Prashant Sharma | 2013-08-23 | 2 | -0/+4 |
| | | |||||
| * | Corrections in documentation comment | Prashant Sharma | 2013-08-23 | 1 | -3/+3 |
| | | |||||
* | | Remove redundant dependencies from POMs | Jey Kottalam | 2013-08-18 | 1 | -5/+0 |
| | | |||||
* | | Maven build now also works with YARN | Jey Kottalam | 2013-08-16 | 1 | -40/+0 |
| | | |||||
* | | Maven build now works with CDH hadoop-2.0.0-mr1 | Jey Kottalam | 2013-08-16 | 1 | -27/+0 |
| | | |||||
* | | Initial changes to make Maven build agnostic of hadoop version | Jey Kottalam | 2013-08-16 | 1 | -32/+10 |
| | | |||||
* | | Change scala.Option to Guava Optional in Java APIs. | Josh Rosen | 2013-08-11 | 1 | -5/+2 |
| | | |||||
* | | Changed other LZF uses to use the compression codec interface. | Reynold Xin | 2013-07-31 | 1 | -9/+17 |
| | | |||||
* | | Add Apache license headers and LICENSE and NOTICE files | Matei Zaharia | 2013-07-16 | 60 | -6/+1026 |
|/ | |||||
* | Merge pull request #688 from markhamstra/scalaDependencies | Matei Zaharia | 2013-07-08 | 1 | -0/+4 |
|\ | | | | | Fixed SPARK-795 with explicit dependencies | ||||
| * | pom cleanup | Mark Hamstra | 2013-07-08 | 1 | -1/+0 |
| | | |||||
| * | Explicit dependencies for scala-library and scalap to prevent 2.9.2 vs. ↵ | Mark Hamstra | 2013-07-08 | 1 | -0/+5 |
| | | | | | | | | 2.9.3 problems | ||||
* | | Catch RejectedExecution exception in Checkpoint handler. | Shivaram Venkataraman | 2013-07-07 | 1 | -2/+7 |
|/ | |||||
* | Merge remote-tracking branch 'pwendell/ui-updates' | Matei Zaharia | 2013-07-06 | 1 | -1/+5 |
|\ | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/scheduler/DAGScheduler.scala core/src/main/scala/spark/util/AkkaUtils.scala pom.xml | ||||
| * | Handful of changes based on matei's review | Patrick Wendell | 2013-06-27 | 1 | -1/+5 |
| | | | | | | | | | | | | - Avoid exception when no tasks have finished for a stage - Adding DOCTYPE so css renders properly - Adding progress slider | ||||
* | | Merge pull request #655 from tgravescs/master | Matei Zaharia | 2013-07-06 | 1 | -1/+2 |
|\ \ | | | | | | | Add support for running Spark on Yarn on a secure Hadoop Cluster | ||||
| * | | Rework from pull request. Removed --user option from Spark on Yarn Client, ↵ | Y.CORP.YAHOO.COM\tgraves | 2013-07-02 | 1 | -4/+0 |
| | | | | | | | | | | | | | | | | | | | | | made the user of JAVA_HOME environment variable conditional on if its set, and created addCredentials in each of the SparkHadoopUtil classes to only add the credentials when the profile is hadoop2-yarn. | ||||
| * | | Add support for Spark on Yarn on a secure Hadoop cluster | Thomas Graves | 2013-06-19 | 1 | -1/+6 |
| |/ | |||||
* | | Reduced the number of Iterator to ArrayBuffer copies in NetworkReceiver. | Tathagata Das | 2013-07-05 | 2 | -14/+11 |
| | | |||||
* | | Initialize Twitter4J OAuth from system properties instead of prompting | Matei Zaharia | 2013-06-29 | 4 | -38/+23 |
| | | |||||
* | | Merge remote-tracking branch 'mrpotes/master' | Matei Zaharia | 2013-06-29 | 3 | -35/+85 |
|\ \ | |||||
| * | | Include a default OAuth implementation, and update examples and ↵ | James Phillpotts | 2013-06-25 | 3 | -25/+78 |
| | | | | | | | | | | | | JavaStreamingContext | ||||
| * | | Twitter API v1 is retired - username/password auth no longer possible | James Phillpotts | 2013-06-24 | 1 | -15/+1 |
| | | | |||||
| * | | Allow other twitter authorizations than username/password | James Phillpotts | 2013-06-21 | 2 | -9/+20 |
| |/ | |||||
* | | Merge branch 'master' into streaming | Tathagata Das | 2013-06-24 | 14 | -75/+202 |
|\| | | | | | | | | | Conflicts: .gitignore | ||||
| * | Exclude old versions of Netty from Maven-based build | Jey Kottalam | 2013-05-18 | 1 | -0/+6 |
| | | |||||
| * | Merge branch 'shuffle-performance-fix-0.7' of github.com:shane-huang/spark ↵ | Reynold Xin | 2013-05-07 | 1 | -1/+1 |
| |\ | | | | | | | | | | | | | | | | | | | | | | | | | into shufflemerge Conflicts: core/src/main/scala/spark/storage/BlockManager.scala core/src/main/scala/spark/storage/DiskStore.scala project/SparkBuild.scala | ||||
| | * | Shuffle Performance fix: Use netty embeded OIO file server instead of ↵ | shane-huang | 2013-04-07 | 1 | -1/+1 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | ConnectionManager Shuffle Performance Optimization: do not send 0-byte block requests to reduce network messages change reference from io.Source to scala.io.Source to avoid looking into io.netty package Signed-off-by: shane-huang <shengsheng.huang@intel.com> | ||||
| * | | Remove debug statements | Mridul Muralidharan | 2013-04-29 | 2 | -3/+0 |
| | | | |||||
| * | | Make log message more descriptive to aid in debugging | Mridul Muralidharan | 2013-04-29 | 1 | -1/+3 |
| | | | |||||
| * | | Allow CheckpointWriter pending tasks to finish | Mridul Muralidharan | 2013-04-28 | 2 | -7/+8 |
| | | | |||||
| * | | Attempt to fix streaming test failures after yarn branch merge | Mridul Muralidharan | 2013-04-28 | 7 | -9/+38 |
| | | | |||||
| * | | Attempt at fixing merge conflict | Mridul Muralidharan | 2013-04-24 | 1 | -1/+1 |
| |\ \ | |||||
| | * \ | Merge remote-tracking branch 'jey/bump-development-version-to-0.8.0' | Matei Zaharia | 2013-04-08 | 1 | -1/+1 |
| | |\ \ | | | |/ | | |/| | | | | | | | | | | | | | Conflicts: docs/_config.yml project/SparkBuild.scala | ||||
| | | * | Bump development version to 0.8.0 | Jey Kottalam | 2013-03-28 | 1 | -1/+1 |
| | | | | |||||
| * | | | Add support for building against hadoop2-yarn : adding new maven profile for it | Mridul Muralidharan | 2013-04-07 | 1 | -0/+37 |
| |/ / | |||||
| * / | Move streaming test initialization into 'before' blocks | Jey Kottalam | 2013-03-28 | 2 | -4/+8 |
| |/ | |||||
| * | method first in trait IterableLike is deprecated: use `head' instead | Holden Karau | 2013-03-24 | 1 | -1/+1 |
| | | |||||
| * | Add a log4j compile dependency to fix build in IntelliJ | Mikhail Bautin | 2013-03-15 | 1 | -1/+1 |
| | | | | | | | | | | Also rename parent project to spark-parent (otherwise it shows up as "parent" in IntelliJ, which is very confusing). | ||||
| * | Forgot equals. | Stephen Haberman | 2013-03-12 | 1 | -1/+1 |
| | | |||||
| * | More quickly call close in HadoopRDD. | Stephen Haberman | 2013-03-11 | 1 | -35/+9 |
| | | | | | | | | | | This also refactors out the common "gotNext" iterator pattern into a shared utility class. | ||||
| * | Instead of failing to bind to a fixed, already-in-use port, let the OS ↵ | Mark Hamstra | 2013-03-01 | 1 | -8/+10 |
| | | | | | | | | choose an available port for TestServer. | ||||
| * | bump version to 0.7.1-SNAPSHOT in the subproject poms to keep the maven ↵ | Mark Hamstra | 2013-02-28 | 1 | -1/+1 |
| | | | | | | | | build building. | ||||
| * | Merge pull request #503 from pwendell/bug-fix | Matei Zaharia | 2013-02-25 | 1 | -1/+1 |
| |\ | | | | | | | createNewSparkContext should use sparkHome/jars/environment. | ||||
| | * | createNewSparkContext should use sparkHome/jars/environment. | Patrick Wendell | 2013-02-25 | 1 | -1/+1 |
| | | | | | | | | | | | | This fixes a bug introduced by Matei's recent change. | ||||
| * | | Pass a code JAR to SparkContext in our examples. Fixes SPARK-594. | Matei Zaharia | 2013-02-25 | 1 | -0/+17 |
| |/ | |||||
| * | Changed Flume test to use the same port as other tests, so that can be ↵ | Tathagata Das | 2013-02-25 | 1 | -2/+2 |
| | | | | | | | | controlled centrally. | ||||
| * | Fixed something that was reported as a compile error in ScalaDoc. | Matei Zaharia | 2013-02-25 | 2 | -3/+3 |
| | | | | | | | | | | | | For some reason, ScalaDoc complained about no such constructor for StreamingContext; it doesn't seem like an actual Scala error but it prevented sbt publish and from working because docs weren't built. | ||||
| * | Allow passing sparkHome and JARs to StreamingContext constructor | Matei Zaharia | 2013-02-25 | 4 | -10/+68 |
| | | | | | | | | | | Also warns if spark.cleaner.ttl is not set in the version where you pass your own SparkContext. |