Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Merge remote-tracking branch 'milliondreams/casdemo' | Matei Zaharia | 2013-06-18 | 3 | -1/+242 |
|\ | | | | | | | | | Conflicts: project/SparkBuild.scala | ||||
| * | Fixing the style as per feedback | Rohit Rai | 2013-06-13 | 1 | -35/+37 |
| | | |||||
| * | Example to write the output to cassandra | Rohit Rai | 2013-06-03 | 1 | -5/+43 |
| | | |||||
| * | A better way to read column value if you are sure the column exists in every ↵ | Rohit Rai | 2013-06-03 | 1 | -2/+4 |
| | | | | | | | | row. | ||||
| * | Adding deps to examples/pom.xml | Rohit Rai | 2013-06-02 | 2 | -1/+36 |
| | | | | | | | | Fixing exclusion in examples deps in SparkBuild.scala | ||||
| * | Removing infix call | Rohit Rai | 2013-06-02 | 1 | -3/+3 |
| | | |||||
| * | Adding example to make Spark RDD from Cassandra | Rohit Rai | 2013-06-01 | 2 | -2/+156 |
| | | |||||
* | | Merge pull request #605 from esjewett/SPARK-699 | Matei Zaharia | 2013-06-18 | 3 | -1/+50 |
|\ \ | | | | | | | Add hBase example (retry of pull request #596) | ||||
| * | | Add hBase dependency to examples POM | Ethan Jewett | 2013-05-20 | 1 | -0/+10 |
| | | | |||||
| * | | Add hBase example | Ethan Jewett | 2013-05-09 | 2 | -1/+40 |
| | | | |||||
* | | | Merge pull request #647 from jerryshao/master | Matei Zaharia | 2013-06-18 | 1 | -8/+4 |
|\ \ \ | | | | | | | | | Reduce ZippedPartitionsRDD's getPreferredLocations complexity from O(2^2n) to O(2^n) | ||||
| * | | | reduce ZippedPartitionsRDD's getPreferredLocations complexity | jerryshao | 2013-06-18 | 1 | -8/+4 |
|/ / / | |||||
* | | | Removed second version of junit test plugin from plugins.sbt | Matei Zaharia | 2013-06-18 | 1 | -2/+0 |
| | | | |||||
* | | | Merge pull request #643 from adatao/master | Matei Zaharia | 2013-06-17 | 3 | -12/+37 |
|\ \ \ | | | | | | | | | Bug fix: Zero-length partitions result in NaN for overall mean & variance | ||||
| * | | | Import just scala.math.abs rather than scala.math._ | Christopher Nguyen | 2013-06-16 | 1 | -1/+1 |
| | | | | |||||
| * | | | Move zero-length partition testing from JavaAPISuite.java to ↵ | Christopher Nguyen | 2013-06-16 | 2 | -24/+19 |
| | | | | | | | | | | | | | | | | PartitioningSuite.scala | ||||
| * | | | Add zeroLengthPartitions() test to make sure, e.g., StatCounter.scala can ↵ | Christopher Nguyen | 2013-06-15 | 2 | -0/+24 |
| | | | | | | | | | | | | | | | | handle empty partitions without incorrectly returning NaN | ||||
| * | | | In the current code, when both partitions happen to have zero-length, the ↵ | Christopher Nguyen | 2013-06-04 | 1 | -10/+16 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | return mean will be NaN. Consequently, the result of mean after reducing over all partitions will also be NaN, which is not correct if there are partitions with non-zero length. This patch fixes this issue. | ||||
* | | | | Merge pull request #653 from rxin/logging | Matei Zaharia | 2013-06-17 | 2 | -19/+19 |
|\ \ \ \ | | | | | | | | | | | SPARK-781: Log the temp directory path when Spark says "Failed to create temp directory." | ||||
| * | | | | Fixed the typo pointed out by Matei. | Reynold Xin | 2013-06-17 | 1 | -1/+1 |
| | | | | | |||||
| * | | | | SPARK-781: Log the temp directory path when Spark says "Failed to create | Reynold Xin | 2013-06-17 | 2 | -19/+19 |
| | | | | | | | | | | | | | | | | | | | | temp directory". | ||||
* | | | | | Merge remote-tracking branch 'xiajunluan/xiajunluan' | Matei Zaharia | 2013-06-18 | 7 | -815/+1289 |
|\ \ \ \ \ | |/ / / / |/| | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/scheduler/cluster/TaskSetManager.scala | ||||
| * | | | | Update LocalSchedulerSuite to avoid using sleep for task launch | Andrew xia | 2013-06-15 | 1 | -24/+59 |
| | | | | | |||||
| * | | | | change code style and debug info | Andrew xia | 2013-06-10 | 2 | -6/+3 |
| | | | | | |||||
| * | | | | 1. Add unit test for local scheduler | Andrew xia | 2013-05-30 | 3 | -200/+385 |
| | | | | | | | | | | | | | | | | | | | | 2. Move localTaskSetManager to a new file | ||||
| * | | | | implement FIFO and fair scheduler for spark local mode | Andrew xia | 2013-05-30 | 5 | -800/+1057 |
| | | | | | |||||
* | | | | | Merge pull request #638 from lyogavin/enhance_pipe | Matei Zaharia | 2013-06-17 | 3 | -9/+89 |
|\ \ \ \ \ | | | | | | | | | | | | | Enhance pipe to support more features we can do in hadoop streaming | ||||
| * | | | | | refine comments and add sc.clean | Gavin Li | 2013-06-17 | 1 | -12/+18 |
| | | | | | | |||||
| * | | | | | Merge branch 'enhance_pipe' of ssh://github.com/lyogavin/spark into enhance_pipe | Gavin Li | 2013-06-17 | 0 | -0/+0 |
| |\ \ \ \ \ | |||||
| | * \ \ \ \ | Merge remote branch 'upstream/master' into enhance_pipe | Yu L Li | 2013-06-17 | 28 | -318/+625 |
| | |\ \ \ \ \ | |_|/ / / / / |/| | | | | | | |||||
| * | | | | | | Merge remote-tracking branch 'upstream1/master' into enhance_pipe | Gavin Li | 2013-06-16 | 28 | -318/+625 |
| |\ \ \ \ \ \ | |/ / / / / / |/| / / / / / | |/ / / / / | |||||
* | | | | | | Merge pull request #649 from ryanlecompte/master | Matei Zaharia | 2013-06-15 | 5 | -2/+109 |
|\ \ \ \ \ \ | | | | | | | | | | | | | | | Add top K method to RDD using a bounded priority queue | ||||
| * | | | | | | use delegation for BoundedPriorityQueue, add Java API | ryanlecompte | 2013-06-14 | 4 | -28/+44 |
| | | | | | | | |||||
| * | | | | | | drop unneeded ClassManifest implicit | ryanlecompte | 2013-06-13 | 1 | -1/+1 |
| | | | | | | | |||||
| * | | | | | | use Iterator.single(elem) instead of Iterator(elem) for improved performance ↵ | ryanlecompte | 2013-06-13 | 1 | -1/+1 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | based on scaladocs | ||||
| * | | | | | | add a new top K method to RDD using a bounded priority queue | ryanlecompte | 2013-06-12 | 3 | -0/+91 |
| | | | | | | | |||||
* | | | | | | | Merge pull request #651 from rxin/groupbykey | Matei Zaharia | 2013-06-14 | 2 | -6/+12 |
|\ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | SPARK-772 / SPARK-774: groupByKey and cogroup should disable map side combine | ||||
| * | | | | | | | SPARK-774: cogroup should also disable map side combine by default | Reynold Xin | 2013-06-14 | 1 | -3/+7 |
| | | | | | | | | |||||
| * | | | | | | | SPARK-772: groupByKey should disable map side combine. | Reynold Xin | 2013-06-13 | 1 | -3/+5 |
|/ / / / / / / | |||||
* | | | | | | | Merge pull request #645 from pwendell/compression | Matei Zaharia | 2013-06-13 | 7 | -6/+164 |
|\ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | Adding compression to Hadoop save functions | ||||
| * | | | | | | | Removing print statement | Patrick Wendell | 2013-06-10 | 1 | -1/+0 |
| | | | | | | | | |||||
| * | | | | | | | Adding Java-API version of compression codec | Patrick Wendell | 2013-06-09 | 3 | -0/+65 |
| | | | | | | | | |||||
| * | | | | | | | Monads FTW | Patrick Wendell | 2013-06-09 | 1 | -9/+6 |
| | | | | | | | | |||||
| * | | | | | | | Clean extra whitespace | Patrick Wendell | 2013-06-09 | 1 | -2/+0 |
| | | | | | | | | |||||
| * | | | | | | | Adding compression to Hadoop save functions | Patrick Wendell | 2013-06-09 | 4 | -6/+105 |
| | | | | | | | | |||||
* | | | | | | | | Merge pull request #646 from markhamstra/jvmArgs | Matei Zaharia | 2013-06-12 | 1 | -5/+3 |
|\ \ \ \ \ \ \ \ | |_|/ / / / / / |/| | | | | | | | Fixed jvmArgs in maven build. | ||||
| * | | | | | | | Fixed jvmArgs in maven build. | Mark Hamstra | 2013-06-12 | 1 | -5/+3 |
|/ / / / / / / | |||||
* | | | | | | | Revert "Fix start-slave not passing instance number to spark-daemon." | Matei Zaharia | 2013-06-11 | 1 | -1/+1 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | This reverts commit a674d67c0aebb940e3b816e2307206115baec175. | ||||
* | | | | | | | Merge pull request #625 from stephenh/fix-start-slave | Matei Zaharia | 2013-06-10 | 1 | -1/+1 |
|\ \ \ \ \ \ \ | |/ / / / / / |/| | | | | | | Fix start-slave not passing instance number to spark-daemon. | ||||
| * | | | | | | Fix start-slave not passing instance number to spark-daemon. | Stephen Haberman | 2013-05-28 | 1 | -1/+1 |
| | | | | | | |