aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Merge remote-tracking branch 'milliondreams/casdemo'Matei Zaharia2013-06-183-1/+242
|\ | | | | | | | | Conflicts: project/SparkBuild.scala
| * Fixing the style as per feedbackRohit Rai2013-06-131-35/+37
| |
| * Example to write the output to cassandraRohit Rai2013-06-031-5/+43
| |
| * A better way to read column value if you are sure the column exists in every ↵Rohit Rai2013-06-031-2/+4
| | | | | | | | row.
| * Adding deps to examples/pom.xmlRohit Rai2013-06-022-1/+36
| | | | | | | | Fixing exclusion in examples deps in SparkBuild.scala
| * Removing infix callRohit Rai2013-06-021-3/+3
| |
| * Adding example to make Spark RDD from CassandraRohit Rai2013-06-012-2/+156
| |
* | Merge pull request #605 from esjewett/SPARK-699Matei Zaharia2013-06-183-1/+50
|\ \ | | | | | | Add hBase example (retry of pull request #596)
| * | Add hBase dependency to examples POMEthan Jewett2013-05-201-0/+10
| | |
| * | Add hBase exampleEthan Jewett2013-05-092-1/+40
| | |
* | | Merge pull request #647 from jerryshao/masterMatei Zaharia2013-06-181-8/+4
|\ \ \ | | | | | | | | Reduce ZippedPartitionsRDD's getPreferredLocations complexity from O(2^2n) to O(2^n)
| * | | reduce ZippedPartitionsRDD's getPreferredLocations complexityjerryshao2013-06-181-8/+4
|/ / /
* | | Removed second version of junit test plugin from plugins.sbtMatei Zaharia2013-06-181-2/+0
| | |
* | | Merge pull request #643 from adatao/masterMatei Zaharia2013-06-173-12/+37
|\ \ \ | | | | | | | | Bug fix: Zero-length partitions result in NaN for overall mean & variance
| * | | Import just scala.math.abs rather than scala.math._Christopher Nguyen2013-06-161-1/+1
| | | |
| * | | Move zero-length partition testing from JavaAPISuite.java to ↵Christopher Nguyen2013-06-162-24/+19
| | | | | | | | | | | | | | | | PartitioningSuite.scala
| * | | Add zeroLengthPartitions() test to make sure, e.g., StatCounter.scala can ↵Christopher Nguyen2013-06-152-0/+24
| | | | | | | | | | | | | | | | handle empty partitions without incorrectly returning NaN
| * | | In the current code, when both partitions happen to have zero-length, the ↵Christopher Nguyen2013-06-041-10/+16
| | | | | | | | | | | | | | | | | | | | | | | | | | | | return mean will be NaN. Consequently, the result of mean after reducing over all partitions will also be NaN, which is not correct if there are partitions with non-zero length. This patch fixes this issue.
* | | | Merge pull request #653 from rxin/loggingMatei Zaharia2013-06-172-19/+19
|\ \ \ \ | | | | | | | | | | SPARK-781: Log the temp directory path when Spark says "Failed to create temp directory."
| * | | | Fixed the typo pointed out by Matei.Reynold Xin2013-06-171-1/+1
| | | | |
| * | | | SPARK-781: Log the temp directory path when Spark says "Failed to createReynold Xin2013-06-172-19/+19
| | | | | | | | | | | | | | | | | | | | temp directory".
* | | | | Merge remote-tracking branch 'xiajunluan/xiajunluan'Matei Zaharia2013-06-187-815/+1289
|\ \ \ \ \ | |/ / / / |/| | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/scheduler/cluster/TaskSetManager.scala
| * | | | Update LocalSchedulerSuite to avoid using sleep for task launchAndrew xia2013-06-151-24/+59
| | | | |
| * | | | change code style and debug infoAndrew xia2013-06-102-6/+3
| | | | |
| * | | | 1. Add unit test for local schedulerAndrew xia2013-05-303-200/+385
| | | | | | | | | | | | | | | | | | | | 2. Move localTaskSetManager to a new file
| * | | | implement FIFO and fair scheduler for spark local modeAndrew xia2013-05-305-800/+1057
| | | | |
* | | | | Merge pull request #638 from lyogavin/enhance_pipeMatei Zaharia2013-06-173-9/+89
|\ \ \ \ \ | | | | | | | | | | | | Enhance pipe to support more features we can do in hadoop streaming
| * | | | | refine comments and add sc.cleanGavin Li2013-06-171-12/+18
| | | | | |
| * | | | | Merge branch 'enhance_pipe' of ssh://github.com/lyogavin/spark into enhance_pipeGavin Li2013-06-170-0/+0
| |\ \ \ \ \
| | * \ \ \ \ Merge remote branch 'upstream/master' into enhance_pipeYu L Li2013-06-1728-318/+625
| | |\ \ \ \ \ | |_|/ / / / / |/| | | | | |
| * | | | | | Merge remote-tracking branch 'upstream1/master' into enhance_pipeGavin Li2013-06-1628-318/+625
| |\ \ \ \ \ \ | |/ / / / / / |/| / / / / / | |/ / / / /
* | | | | | Merge pull request #649 from ryanlecompte/masterMatei Zaharia2013-06-155-2/+109
|\ \ \ \ \ \ | | | | | | | | | | | | | | Add top K method to RDD using a bounded priority queue
| * | | | | | use delegation for BoundedPriorityQueue, add Java APIryanlecompte2013-06-144-28/+44
| | | | | | |
| * | | | | | drop unneeded ClassManifest implicitryanlecompte2013-06-131-1/+1
| | | | | | |
| * | | | | | use Iterator.single(elem) instead of Iterator(elem) for improved performance ↵ryanlecompte2013-06-131-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | based on scaladocs
| * | | | | | add a new top K method to RDD using a bounded priority queueryanlecompte2013-06-123-0/+91
| | | | | | |
* | | | | | | Merge pull request #651 from rxin/groupbykeyMatei Zaharia2013-06-142-6/+12
|\ \ \ \ \ \ \ | | | | | | | | | | | | | | | | SPARK-772 / SPARK-774: groupByKey and cogroup should disable map side combine
| * | | | | | | SPARK-774: cogroup should also disable map side combine by defaultReynold Xin2013-06-141-3/+7
| | | | | | | |
| * | | | | | | SPARK-772: groupByKey should disable map side combine.Reynold Xin2013-06-131-3/+5
|/ / / / / / /
* | | | | | | Merge pull request #645 from pwendell/compressionMatei Zaharia2013-06-137-6/+164
|\ \ \ \ \ \ \ | | | | | | | | | | | | | | | | Adding compression to Hadoop save functions
| * | | | | | | Removing print statementPatrick Wendell2013-06-101-1/+0
| | | | | | | |
| * | | | | | | Adding Java-API version of compression codecPatrick Wendell2013-06-093-0/+65
| | | | | | | |
| * | | | | | | Monads FTWPatrick Wendell2013-06-091-9/+6
| | | | | | | |
| * | | | | | | Clean extra whitespacePatrick Wendell2013-06-091-2/+0
| | | | | | | |
| * | | | | | | Adding compression to Hadoop save functionsPatrick Wendell2013-06-094-6/+105
| | | | | | | |
* | | | | | | | Merge pull request #646 from markhamstra/jvmArgsMatei Zaharia2013-06-121-5/+3
|\ \ \ \ \ \ \ \ | |_|/ / / / / / |/| | | | | | | Fixed jvmArgs in maven build.
| * | | | | | | Fixed jvmArgs in maven build.Mark Hamstra2013-06-121-5/+3
|/ / / / / / /
* | | | | | | Revert "Fix start-slave not passing instance number to spark-daemon."Matei Zaharia2013-06-111-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | This reverts commit a674d67c0aebb940e3b816e2307206115baec175.
* | | | | | | Merge pull request #625 from stephenh/fix-start-slaveMatei Zaharia2013-06-101-1/+1
|\ \ \ \ \ \ \ | |/ / / / / / |/| | | | | | Fix start-slave not passing instance number to spark-daemon.
| * | | | | | Fix start-slave not passing instance number to spark-daemon.Stephen Haberman2013-05-281-1/+1
| | | | | | |