aboutsummaryrefslogtreecommitdiff
path: root/core
Commit message (Collapse)AuthorAgeFilesLines
* Prefork Python worker processesJey Kottalam2013-06-213-41/+125
|
* Add Python timing instrumentationJey Kottalam2013-06-211-0/+12
|
* Merge pull request #654 from lyogavin/enhance_pipeMatei Zaharia2013-06-192-8/+8
|\ | | | | fix typo and coding style in #638
| * fix typo and coding styleGavin Li2013-06-182-8/+8
| |
* | Update ASM to version 4.0Matei Zaharia2013-06-192-8/+7
| |
* | reduce ZippedPartitionsRDD's getPreferredLocations complexityjerryshao2013-06-181-8/+4
| |
* | Merge pull request #643 from adatao/masterMatei Zaharia2013-06-172-12/+35
|\ \ | | | | | | Bug fix: Zero-length partitions result in NaN for overall mean & variance
| * | Import just scala.math.abs rather than scala.math._Christopher Nguyen2013-06-161-1/+1
| | |
| * | Move zero-length partition testing from JavaAPISuite.java to ↵Christopher Nguyen2013-06-162-24/+19
| | | | | | | | | | | | PartitioningSuite.scala
| * | Add zeroLengthPartitions() test to make sure, e.g., StatCounter.scala can ↵Christopher Nguyen2013-06-151-0/+22
| | | | | | | | | | | | handle empty partitions without incorrectly returning NaN
| * | In the current code, when both partitions happen to have zero-length, the ↵Christopher Nguyen2013-06-041-10/+16
| | | | | | | | | | | | | | | | | | | | | return mean will be NaN. Consequently, the result of mean after reducing over all partitions will also be NaN, which is not correct if there are partitions with non-zero length. This patch fixes this issue.
* | | Merge pull request #653 from rxin/loggingMatei Zaharia2013-06-172-19/+19
|\ \ \ | | | | | | | | SPARK-781: Log the temp directory path when Spark says "Failed to create temp directory."
| * | | Fixed the typo pointed out by Matei.Reynold Xin2013-06-171-1/+1
| | | |
| * | | SPARK-781: Log the temp directory path when Spark says "Failed to createReynold Xin2013-06-172-19/+19
| | |/ | |/| | | | | | | temp directory".
* | | Merge remote-tracking branch 'xiajunluan/xiajunluan'Matei Zaharia2013-06-187-815/+1289
|\ \ \ | |/ / |/| | | | | | | | Conflicts: core/src/main/scala/spark/scheduler/cluster/TaskSetManager.scala
| * | Update LocalSchedulerSuite to avoid using sleep for task launchAndrew xia2013-06-151-24/+59
| | |
| * | change code style and debug infoAndrew xia2013-06-102-6/+3
| | |
| * | 1. Add unit test for local schedulerAndrew xia2013-05-303-200/+385
| | | | | | | | | | | | 2. Move localTaskSetManager to a new file
| * | implement FIFO and fair scheduler for spark local modeAndrew xia2013-05-305-800/+1057
| | |
* | | refine comments and add sc.cleanGavin Li2013-06-171-12/+18
| | |
* | | Merge remote-tracking branch 'upstream1/master' into enhance_pipeGavin Li2013-06-1627-318/+620
|\ \ \
| * \ \ Merge pull request #649 from ryanlecompte/masterMatei Zaharia2013-06-155-2/+109
| |\ \ \ | | | | | | | | | | Add top K method to RDD using a bounded priority queue
| | * | | use delegation for BoundedPriorityQueue, add Java APIryanlecompte2013-06-144-28/+44
| | | | |
| | * | | drop unneeded ClassManifest implicitryanlecompte2013-06-131-1/+1
| | | | |
| | * | | use Iterator.single(elem) instead of Iterator(elem) for improved performance ↵ryanlecompte2013-06-131-1/+1
| | | | | | | | | | | | | | | | | | | | based on scaladocs
| | * | | add a new top K method to RDD using a bounded priority queueryanlecompte2013-06-123-0/+91
| | | | |
| * | | | SPARK-774: cogroup should also disable map side combine by defaultReynold Xin2013-06-141-3/+7
| | | | |
| * | | | SPARK-772: groupByKey should disable map side combine.Reynold Xin2013-06-131-3/+5
| | | | |
| * | | | Removing print statementPatrick Wendell2013-06-101-1/+0
| | | | |
| * | | | Adding Java-API version of compression codecPatrick Wendell2013-06-093-0/+65
| | | | |
| * | | | Monads FTWPatrick Wendell2013-06-091-9/+6
| | | | |
| * | | | Clean extra whitespacePatrick Wendell2013-06-091-2/+0
| | | | |
| * | | | Adding compression to Hadoop save functionsPatrick Wendell2013-06-094-6/+105
| |/ / /
| * | | Small formatting and style fixesMatei Zaharia2013-06-072-11/+11
| | | |
| * | | Merge pull request #631 from jerryshao/masterMatei Zaharia2013-06-071-6/+6
| |\ \ \ | | | | | | | | | | Fix block manager UI display issue when enable spark.cleaner.ttl
| | * | | fix block manager UI display issue when enable spark.cleaner.ttljerryshao2013-05-311-6/+6
| | | | |
| * | | | Small code style fix to SchedulingAlgorithm.scalaMatei Zaharia2013-06-071-3/+2
| | | | |
| * | | | Merge pull request #634 from xiajunluan/masterMatei Zaharia2013-06-072-7/+19
| |\ \ \ \ | | |_|_|/ | |/| | | [Spark-753] Fix ClusterSchedulSuite unit test failed
| | * | | Fix schedulingAlgorithm bugs for unit testAndrew xia2013-06-032-7/+19
| | | |/ | | |/|
| * | | Merge pull request #640 from pwendell/timeout-updateMatei Zaharia2013-06-042-2/+2
| |\ \ \ | | | | | | | | | | Fixing bug in BlockManager timeout
| | * | | Fixing bug in BlockManager timeoutPatrick Wendell2013-06-042-2/+2
| | | | |
| * | | | Merge pull request #639 from pwendell/timeout-updateMatei Zaharia2013-06-042-2/+2
| |\| | | | | | | | | | | | | Bump akka and blockmanager timeouts to 60 seconds
| | * | | Bump akka and blockmanager timeouts to 60 secondsPatrick Wendell2013-06-042-2/+2
| | | | |
| * | | | Incorporated Charles' feedback to put rdd metadata removal inReynold Xin2013-05-313-33/+13
| | | | | | | | | | | | | | | | | | | | BlockManagerMasterActor.
| * | | | More block manager cleanup.Reynold Xin2013-05-318-166/+187
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Implemented a removeRdd method in BlockManager, and use that to implement RDD.unpersist. Previously, unpersist needs to send B akka messages, where B = number of blocks. Now unpersist only needs to send W akka messages, where W = the number of workers.
| * | | | Fixed the flaky unpersist test in RDDSuite.Reynold Xin2013-05-301-4/+4
| | | | |
| * | | | Do not create symlink for local add file. Instead, copy the file.Reynold Xin2013-05-301-39/+39
| | |_|/ | |/| | | | | | | | | | | | | | This prevents Spark from changing the original file's permission, and also allow add file to work on non-posix operating systems.
| * | | Merge branch 'master' of git://github.com/mesos/sparkShivaram Venkataraman2013-05-305-64/+49
| |\ \ \ | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/test/scala/spark/ShuffleSuite.scala
| | * | | Skip fetching zero-sized blocks in OIO.Shivaram Venkataraman2013-05-292-49/+39
| | | | | | | | | | | | | | | | | | | | Also unify splitLocalRemoteBlocks for netty/nio and add a test case
| * | | | Also flush serializer in revertPartialWritesShivaram Venkataraman2013-05-291-0/+1
| | | | |
generated by cgit v1.2.3 (git 2.39.1) at 2024-09-09 21:42:54 +0000