aboutsummaryrefslogtreecommitdiff
path: root/core
Commit message (Collapse)AuthorAgeFilesLines
...
| | * | | | | | Move zero-length partition testing from JavaAPISuite.java to ↵Christopher Nguyen2013-06-162-24/+19
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | PartitioningSuite.scala
| | * | | | | | Add zeroLengthPartitions() test to make sure, e.g., StatCounter.scala can ↵Christopher Nguyen2013-06-151-0/+22
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | handle empty partitions without incorrectly returning NaN
| | * | | | | | In the current code, when both partitions happen to have zero-length, the ↵Christopher Nguyen2013-06-041-10/+16
| | | |/ / / / | | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | return mean will be NaN. Consequently, the result of mean after reducing over all partitions will also be NaN, which is not correct if there are partitions with non-zero length. This patch fixes this issue.
| * | | | | | Merge pull request #653 from rxin/loggingMatei Zaharia2013-06-172-19/+19
| |\ \ \ \ \ \ | | | | | | | | | | | | | | | | SPARK-781: Log the temp directory path when Spark says "Failed to create temp directory."
| | * | | | | | Fixed the typo pointed out by Matei.Reynold Xin2013-06-171-1/+1
| | | | | | | |
| | * | | | | | SPARK-781: Log the temp directory path when Spark says "Failed to createReynold Xin2013-06-172-19/+19
| | | |/ / / / | | |/| | | | | | | | | | | | | | | | | | temp directory".
| * | | | | | Merge remote-tracking branch 'xiajunluan/xiajunluan'Matei Zaharia2013-06-187-815/+1289
| |\ \ \ \ \ \ | | |/ / / / / | |/| | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/scheduler/cluster/TaskSetManager.scala
| | * | | | | Update LocalSchedulerSuite to avoid using sleep for task launchAndrew xia2013-06-151-24/+59
| | | | | | |
| | * | | | | change code style and debug infoAndrew xia2013-06-102-6/+3
| | | | | | |
| | * | | | | 1. Add unit test for local schedulerAndrew xia2013-05-303-200/+385
| | | | | | | | | | | | | | | | | | | | | | | | | | | | 2. Move localTaskSetManager to a new file
| | * | | | | implement FIFO and fair scheduler for spark local modeAndrew xia2013-05-305-800/+1057
| | | | | | |
| * | | | | | refine comments and add sc.cleanGavin Li2013-06-171-12/+18
| | | | | | |
| * | | | | | Merge remote-tracking branch 'upstream1/master' into enhance_pipeGavin Li2013-06-1627-318/+620
| |\ \ \ \ \ \
| | * \ \ \ \ \ Merge pull request #649 from ryanlecompte/masterMatei Zaharia2013-06-155-2/+109
| | |\ \ \ \ \ \ | | | | | | | | | | | | | | | | | | Add top K method to RDD using a bounded priority queue
| | | * | | | | | use delegation for BoundedPriorityQueue, add Java APIryanlecompte2013-06-144-28/+44
| | | | | | | | |
| | | * | | | | | drop unneeded ClassManifest implicitryanlecompte2013-06-131-1/+1
| | | | | | | | |
| | | * | | | | | use Iterator.single(elem) instead of Iterator(elem) for improved performance ↵ryanlecompte2013-06-131-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | based on scaladocs
| | | * | | | | | add a new top K method to RDD using a bounded priority queueryanlecompte2013-06-123-0/+91
| | | | |_|/ / / | | | |/| | | |
| | * | | | | | SPARK-774: cogroup should also disable map side combine by defaultReynold Xin2013-06-141-3/+7
| | | | | | | |
| | * | | | | | SPARK-772: groupByKey should disable map side combine.Reynold Xin2013-06-131-3/+5
| | | | | | | |
| | * | | | | | Removing print statementPatrick Wendell2013-06-101-1/+0
| | | | | | | |
| | * | | | | | Adding Java-API version of compression codecPatrick Wendell2013-06-093-0/+65
| | | | | | | |
| | * | | | | | Monads FTWPatrick Wendell2013-06-091-9/+6
| | | | | | | |
| | * | | | | | Clean extra whitespacePatrick Wendell2013-06-091-2/+0
| | | | | | | |
| | * | | | | | Adding compression to Hadoop save functionsPatrick Wendell2013-06-094-6/+105
| | |/ / / / /
| | * | | | | Small formatting and style fixesMatei Zaharia2013-06-072-11/+11
| | | | | | |
| | * | | | | Merge pull request #631 from jerryshao/masterMatei Zaharia2013-06-071-6/+6
| | |\ \ \ \ \ | | | | | | | | | | | | | | | | Fix block manager UI display issue when enable spark.cleaner.ttl
| | | * | | | | fix block manager UI display issue when enable spark.cleaner.ttljerryshao2013-05-311-6/+6
| | | | | | | |
| | * | | | | | Small code style fix to SchedulingAlgorithm.scalaMatei Zaharia2013-06-071-3/+2
| | | | | | | |
| | * | | | | | Merge pull request #634 from xiajunluan/masterMatei Zaharia2013-06-072-7/+19
| | |\ \ \ \ \ \ | | | |_|_|/ / / | | |/| | | | | [Spark-753] Fix ClusterSchedulSuite unit test failed
| | | * | | | | Fix schedulingAlgorithm bugs for unit testAndrew xia2013-06-032-7/+19
| | | | |/ / / | | | |/| | |
| | * | | | | Merge pull request #640 from pwendell/timeout-updateMatei Zaharia2013-06-042-2/+2
| | |\ \ \ \ \ | | | | | | | | | | | | | | | | Fixing bug in BlockManager timeout
| | | * | | | | Fixing bug in BlockManager timeoutPatrick Wendell2013-06-042-2/+2
| | | | | | | |
| | * | | | | | Merge pull request #639 from pwendell/timeout-updateMatei Zaharia2013-06-042-2/+2
| | |\| | | | | | | | |_|_|/ / | | |/| | | | Bump akka and blockmanager timeouts to 60 seconds
| | | * | | | Bump akka and blockmanager timeouts to 60 secondsPatrick Wendell2013-06-042-2/+2
| | | | | | |
| | * | | | | Incorporated Charles' feedback to put rdd metadata removal inReynold Xin2013-05-313-33/+13
| | | | | | | | | | | | | | | | | | | | | | | | | | | | BlockManagerMasterActor.
| | * | | | | More block manager cleanup.Reynold Xin2013-05-318-166/+187
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Implemented a removeRdd method in BlockManager, and use that to implement RDD.unpersist. Previously, unpersist needs to send B akka messages, where B = number of blocks. Now unpersist only needs to send W akka messages, where W = the number of workers.
| | * | | | | Fixed the flaky unpersist test in RDDSuite.Reynold Xin2013-05-301-4/+4
| | | | | | |
| | * | | | | Do not create symlink for local add file. Instead, copy the file.Reynold Xin2013-05-301-39/+39
| | | |_|/ / | | |/| | | | | | | | | | | | | | | | | | | | | This prevents Spark from changing the original file's permission, and also allow add file to work on non-posix operating systems.
| | * | | | Merge branch 'master' of git://github.com/mesos/sparkShivaram Venkataraman2013-05-305-64/+49
| | |\ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/test/scala/spark/ShuffleSuite.scala
| | | * | | | Skip fetching zero-sized blocks in OIO.Shivaram Venkataraman2013-05-292-49/+39
| | | | | | | | | | | | | | | | | | | | | | | | | | | | Also unify splitLocalRemoteBlocks for netty/nio and add a test case
| | * | | | | Also flush serializer in revertPartialWritesShivaram Venkataraman2013-05-291-0/+1
| | | | | | |
| | * | | | | Flush serializer to fix zero-size kryo blocks bug.Shivaram Venkataraman2013-05-292-5/+19
| | | | | | | | | | | | | | | | | | | | | | | | | | | | Also convert the local-cluster test case to check for non-zero block sizes
| | * | | | | Couple of Netty fixesShivaram Venkataraman2013-05-282-22/+37
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | a. Fix the port number by reading it from the bound channel b. Fix the shutdown sequence to make sure we actually block on the channel c. Fix the unit test to use two JVMs.
| * | | | | | update according to commentsGavin Li2013-06-163-89/+24
| | | | | | |
| * | | | | | update according to commentsGavin Li2013-06-053-30/+99
| | | | | | |
| * | | | | | add ut for pipe enhancementGavin Li2013-06-021-0/+31
| | | | | | |
| * | | | | | enhance pipe to support what we can do in hadoop streamingGavin Li2013-06-012-2/+41
| | |/ / / / | |/| | | |
| * | | | | Merge pull request #626 from stephenh/remove-add-if-no-portMatei Zaharia2013-05-291-11/+0
| |\ \ \ \ \ | | | | | | | | | | | | | | Remove unused addIfNoPort.
| | * | | | | Remove unused addIfNoPort.Stephen Haberman2013-05-281-11/+0
| | |/ / / /
generated by cgit v1.2.3 (git 2.39.1) at 2024-09-19 15:23:48 +0000