Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Some tweaks to docs | Matei Zaharia | 2013-02-25 | 3 | -9/+9 |
| | |||||
* | Add a config property for Akka lifecycle event logging | Matei Zaharia | 2013-02-25 | 1 | -2/+4 |
| | |||||
* | Fix compile error | Matei Zaharia | 2013-02-25 | 2 | -2/+2 |
| | |||||
* | Use public method sparkContext instead of protected sc in streaming examples | Matei Zaharia | 2013-02-25 | 3 | -4/+4 |
| | |||||
* | Change doc color scheme slightly for Spark 0.7 (to differ from 0.6) | Matei Zaharia | 2013-02-25 | 2 | -16/+16 |
| | |||||
* | Use a single setting for disabling API doc build | Matei Zaharia | 2013-02-25 | 2 | -4/+4 |
| | |||||
* | Merge branch 'master' of github.com:mesos/spark | Matei Zaharia | 2013-02-25 | 1 | -1/+1 |
|\ | |||||
| * | Merge pull request #498 from pwendell/shutup-akka | Matei Zaharia | 2013-02-25 | 1 | -1/+1 |
| |\ | | | | | | | Disable remote lifecycle logging from Akka. | ||||
| | * | Disable remote lifecycle logging from Akka. | Patrick Wendell | 2013-02-25 | 1 | -1/+1 |
| | | | | | | | | | | | | This changes the default setting to `off` for remote lifecycle events. When this is on, it is very chatty at the INFO level. It also prints out several ERROR messages sometimes when sc.stop() is called. | ||||
* | | | Change tabs to spaces | Matei Zaharia | 2013-02-25 | 1 | -15/+15 |
|/ / | |||||
* | | Get spark.default.paralellism on each call to defaultPartitioner, | Matei Zaharia | 2013-02-25 | 1 | -4/+1 |
| | | | | | | | | instead of only once, in case the user changes it across Spark uses | ||||
* | | Merge pull request #459 from stephenh/bettersplits | Matei Zaharia | 2013-02-25 | 9 | -42/+94 |
|\ \ | |/ |/| | Change defaultPartitioner to use upstream split size. | ||||
| * | Use default parallelism if its set. | Stephen Haberman | 2013-02-24 | 2 | -6/+19 |
| | | |||||
| * | Merge branch 'master' into bettersplits | Stephen Haberman | 2013-02-24 | 117 | -879/+1755 |
| |\ | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/RDD.scala core/src/main/scala/spark/scheduler/cluster/StandaloneSchedulerBackend.scala core/src/test/scala/spark/ShuffleSuite.scala | ||||
| * | | Update more javadocs. | Stephen Haberman | 2013-02-16 | 2 | -15/+17 |
| | | | |||||
| * | | Tweak test names. | Stephen Haberman | 2013-02-16 | 1 | -2/+2 |
| | | | |||||
| * | | Remove fileServerSuite.txt. | Stephen Haberman | 2013-02-16 | 1 | -1/+0 |
| | | | |||||
| * | | Update default.parallelism docs, have StandaloneSchedulerBackend use it. | Stephen Haberman | 2013-02-16 | 8 | -28/+43 |
| | | | | | | | | | | | | | | | | | | Only brand new RDDs (e.g. parallelize and makeRDD) now use default parallelism, everything else uses their largest parent's partitioner or partition size. | ||||
| * | | Change defaultPartitioner to use upstream split size. | Stephen Haberman | 2013-02-10 | 3 | -6/+29 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Previously it used the SparkContext.defaultParallelism, which occassionally ended up being a very bad guess. Looking at upstream RDDs seems to make better use of the context. Also sorted the upstream RDDs by partition size first, as if we have a hugely-partitioned RDD and tiny-partitioned RDD, it is unlikely we want the resulting RDD to be tiny-partitioned. | ||||
* | | | Merge pull request #497 from ScrapCodes/dep-resolution-fix | Matei Zaharia | 2013-02-25 | 1 | -1/+3 |
|\ \ \ | | | | | | | | | Moving akka dependency resolver to shared. | ||||
| * | | | Moving akka dependency resolver to shared. | Prashant Sharma | 2013-02-25 | 1 | -1/+3 |
| | | | | |||||
* | | | | Merge pull request #494 from mesos/streaming | Matei Zaharia | 2013-02-24 | 66 | -1227/+3254 |
|\| | | | | | | | | | | | Final set of Spark Streaming changes | ||||
| * | | | Merge pull request #495 from tdas/streaming | Tathagata Das | 2013-02-24 | 7 | -26/+14 |
| |\ \ \ | | | | | | | | | | | Changed class paths and dependencies based on Matei's comments | ||||
| | * | | | Removing duplicate doc. | Tathagata Das | 2013-02-24 | 2 | -103/+2 |
| | | | | | |||||
| | * | | | Fixed class paths and dependencies based on Matei's comments. | Tathagata Das | 2013-02-24 | 8 | -24/+113 |
| | | | | | |||||
| * | | | | Merge pull request #493 from tdas/streaming | Tathagata Das | 2013-02-24 | 36 | -105/+696 |
| |\| | | | | | | | | | | | | | Streaming bug fixes | ||||
| | * | | | Added back the initial spark job before starting streaming receivers | Tathagata Das | 2013-02-24 | 1 | -1/+1 |
| | | | | | |||||
| | * | | | Changed Algebird from 0.1.9 to 0.1.8 | Tathagata Das | 2013-02-24 | 2 | -2/+2 |
| | | | | | |||||
| | * | | | Merge branch 'mesos-master' into streaming | Tathagata Das | 2013-02-24 | 18 | -47/+361 |
| | |\ \ \ | | | | |/ | | | |/| | |||||
| | * | | | Fixed missing dependencies in streaming/pom.xml | Tathagata Das | 2013-02-24 | 1 | -4/+14 |
| | | | | | |||||
| | * | | | Fixed bugs in examples. | Tathagata Das | 2013-02-24 | 3 | -4/+3 |
| | | | | | |||||
| | * | | | Updated streaming programming guide with Java API info, and comments from ↵ | Tathagata Das | 2013-02-23 | 3 | -14/+76 |
| | | | | | | | | | | | | | | | | | | | | Patrick. | ||||
| | * | | | Change spark.cleaner.delay to spark.cleaner.ttl. Updated docs. | Tathagata Das | 2013-02-23 | 3 | -6/+6 |
| | | | | | |||||
| | * | | | Fixed differences in APIs of StreamingContext and JavaStreamingContext. ↵ | Tathagata Das | 2013-02-23 | 5 | -26/+232 |
| | | | | | | | | | | | | | | | | | | | | Change rawNetworkStream to rawSocketStream, and added twitter, actor, zeroMQ streams to JavaStreamingContext. Also added them to JavaAPISuite. | ||||
| | * | | | Merge branch 'mesos-streaming' into streaming | Tathagata Das | 2013-02-22 | 8 | -8/+313 |
| | |\ \ \ | | |/ / / | |/| | | | |||||
| * | | | | Fixed resolver for akka-zeromq | Tathagata Das | 2013-02-22 | 1 | -0/+3 |
| | | | | | |||||
| * | | | | Merge pull request #480 from MLnick/streaming-eg-algebird | Tathagata Das | 2013-02-22 | 5 | -5/+179 |
| |\ \ \ \ | | | | | | | | | | | | | [Streaming] Examples using Twitter's Algebird library | ||||
| | * | | | | Adding documentation for HLL and CMS examples. More efficient and clear use ↵ | Nick Pentreath | 2013-02-21 | 2 | -12/+36 |
| | | | | | | | | | | | | | | | | | | | | | | | | of the monoids. | ||||
| | * | | | | Bumping Algebird to 0.1.9 | Nick Pentreath | 2013-02-21 | 2 | -2/+2 |
| | | | | | | |||||
| | * | | | | Merge remote-tracking branch 'upstream/streaming' into streaming-eg-algebird | Nick Pentreath | 2013-02-21 | 115 | -922/+1528 |
| | |\ \ \ \ | |||||
| | * | | | | | Streaming example using Twitter Algebird's Count Min Sketch monoid | Nick Pentreath | 2013-02-19 | 1 | -0/+78 |
| | | | | | | | |||||
| | * | | | | | Dependencies and refactoring for streaming HLL example, and using ↵ | Nick Pentreath | 2013-02-19 | 3 | -21/+24 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | context.twitterStream method | ||||
| | * | | | | | Merge remote-tracking branch 'upstream/streaming' into streaming-eg-algebird | Nick Pentreath | 2013-02-19 | 55 | -1138/+2543 |
| | |\ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: project/SparkBuild.scala | ||||
| | * | | | | | | Adding streaming HyperLogLog example using Algebird | Nick Pentreath | 2013-02-19 | 3 | -1/+69 |
| | | | | | | | | |||||
| * | | | | | | | Merge pull request #479 from ScrapCodes/zeromq-streaming | Tathagata Das | 2013-02-22 | 4 | -3/+131 |
| |\ \ \ \ \ \ \ | | |_|_|/ / / / | |/| | | | | | | Zeromq streaming | ||||
| | * | | | | | | removed document on zeromq | Prashant Sharma | 2013-02-20 | 1 | -59/+0 |
| | | | | | | | | |||||
| | * | | | | | | fixes corresponding to review feedback at pull request #479 | Prashant Sharma | 2013-02-20 | 3 | -6/+9 |
| | | | | | | | | |||||
| | * | | | | | | example for demonstrating ZeroMQ stream | Prashant Sharma | 2013-02-19 | 2 | -8/+77 |
| | | | | | | | | |||||
| | * | | | | | | ZeroMQ stream as receiver | Prashant Sharma | 2013-02-19 | 4 | -0/+115 |
| | | |/ / / / | | |/| | | | | |||||
| * | | | | | | Merge pull request #487 from tdas/streaming | Tathagata Das | 2013-02-20 | 113 | -903/+1387 |
| |\ \ \ \ \ \ | | | | | | | | | | | | | | | | | Merged latest master changes to streaming |