aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Removing print statementPatrick Wendell2013-06-101-1/+0
|
* Adding Java-API version of compression codecPatrick Wendell2013-06-093-0/+65
|
* Monads FTWPatrick Wendell2013-06-091-9/+6
|
* Clean extra whitespacePatrick Wendell2013-06-091-2/+0
|
* Adding compression to Hadoop save functionsPatrick Wendell2013-06-094-6/+105
|
* Merge pull request #629 from c0s/masterMatei Zaharia2013-06-081-0/+7
|\ | | | | Sometime Maven build runs out of PermGen space.
| * Sometime Maven build runs out of PermGen space.Konstantin Boudnik2013-06-031-0/+7
| |
* | Small formatting and style fixesMatei Zaharia2013-06-072-11/+11
| |
* | Merge pull request #631 from jerryshao/masterMatei Zaharia2013-06-071-6/+6
|\ \ | | | | | | Fix block manager UI display issue when enable spark.cleaner.ttl
| * | fix block manager UI display issue when enable spark.cleaner.ttljerryshao2013-05-311-6/+6
| | |
* | | Small code style fix to SchedulingAlgorithm.scalaMatei Zaharia2013-06-071-3/+2
| | |
* | | Merge pull request #634 from xiajunluan/masterMatei Zaharia2013-06-072-7/+19
|\ \ \ | | | | | | | | [Spark-753] Fix ClusterSchedulSuite unit test failed
| * | | Fix schedulingAlgorithm bugs for unit testAndrew xia2013-06-032-7/+19
| | | |
* | | | Merge pull request #640 from pwendell/timeout-updateMatei Zaharia2013-06-042-2/+2
|\ \ \ \ | | | | | | | | | | Fixing bug in BlockManager timeout
| * | | | Fixing bug in BlockManager timeoutPatrick Wendell2013-06-042-2/+2
| | | | |
* | | | | Merge pull request #639 from pwendell/timeout-updateMatei Zaharia2013-06-042-2/+2
|\| | | | | |_|_|/ |/| | | Bump akka and blockmanager timeouts to 60 seconds
| * | | Bump akka and blockmanager timeouts to 60 secondsPatrick Wendell2013-06-042-2/+2
| | | |
* | | | Merge pull request #636 from rxin/unpersistMatei Zaharia2013-05-3110-210/+211
|\ \ \ \ | |_|_|/ |/| | | Unpersist More block manager cleanup.
| * | | Incorporated Charles' feedback to put rdd metadata removal inReynold Xin2013-05-313-33/+13
| | | | | | | | | | | | | | | | BlockManagerMasterActor.
| * | | More block manager cleanup.Reynold Xin2013-05-318-166/+187
| | | | | | | | | | | | | | | | | | | | | | | | | | | | Implemented a removeRdd method in BlockManager, and use that to implement RDD.unpersist. Previously, unpersist needs to send B akka messages, where B = number of blocks. Now unpersist only needs to send W akka messages, where W = the number of workers.
| * | | Fixed the flaky unpersist test in RDDSuite.Reynold Xin2013-05-301-4/+4
| | | |
| * | | Do not create symlink for local add file. Instead, copy the file.Reynold Xin2013-05-301-39/+39
|/ / / | | | | | | | | | | | | This prevents Spark from changing the original file's permission, and also allow add file to work on non-posix operating systems.
* | | Merge pull request #627 from shivaram/masterReynold Xin2013-05-303-22/+51
|\ \ \ | | | | | | | | Netty and shuffle bug fixes
| * \ \ Merge branch 'master' of git://github.com/mesos/sparkShivaram Venkataraman2013-05-305-64/+49
| |\ \ \ | |/ / / |/| | | | | | | | | | | Conflicts: core/src/test/scala/spark/ShuffleSuite.scala
* | | | Merge pull request #628 from shivaram/zero-block-sizeReynold Xin2013-05-302-49/+39
|\ \ \ \ | | | | | | | | | | Skip fetching zero-sized blocks in NIO.
| * | | | Skip fetching zero-sized blocks in OIO.Shivaram Venkataraman2013-05-292-49/+39
|/ / / / | | | | | | | | | | | | Also unify splitLocalRemoteBlocks for netty/nio and add a test case
* | | | Merge pull request #626 from stephenh/remove-add-if-no-portMatei Zaharia2013-05-291-11/+0
|\ \ \ \ | | | | | | | | | | Remove unused addIfNoPort.
| * | | | Remove unused addIfNoPort.Stephen Haberman2013-05-281-11/+0
| | | | |
* | | | | Merge pull request #611 from squito/classloaderMatei Zaharia2013-05-282-4/+11
|\ \ \ \ \ | |/ / / / |/| | | | Use default classloaders for akka & deserializing task results
| * | | | use threads classloader when deserializing task results; ↵Imran Rashid2013-05-141-3/+10
| | | | | | | | | | | | | | | | | | | | classnotfoundexception includes classloader
| * | | | when akka starts, use akkas default classloader (current thread)Imran Rashid2013-05-141-1/+1
| | | | |
| | * | | Also flush serializer in revertPartialWritesShivaram Venkataraman2013-05-291-0/+1
| | | | |
| | * | | Flush serializer to fix zero-size kryo blocks bug.Shivaram Venkataraman2013-05-292-5/+19
| | | | | | | | | | | | | | | | | | | | Also convert the local-cluster test case to check for non-zero block sizes
| | * | | Couple of Netty fixesShivaram Venkataraman2013-05-282-22/+37
| |/ / / |/| | | | | | | | | | | | | | | | | | | a. Fix the port number by reading it from the bound channel b. Fix the shutdown sequence to make sure we actually block on the channel c. Fix the unit test to use two JVMs.
* | | | Merge pull request #620 from jerryshao/masterMatei Zaharia2013-05-271-1/+1
|\ \ \ \ | | | | | | | | | | Fix CheckpointRDD java.io.FileNotFoundException when calling getPreferredLocations
| * | | | fix CheckpointRDD getPreferredLocations java.io.FileNotFoundExceptionjerryshao2013-05-241-1/+1
| | | | |
* | | | | Merge pull request #621 from JoshRosen/spark-613Josh Rosen2013-05-251-1/+2
|\ \ \ \ \ | | | | | | | | | | | | Use ec2-metadata in start-slave.sh to detect if running on EC2
| * | | | | Use ec2-metadata in start-slave.sh.Josh Rosen2013-05-241-1/+2
| |/ / / / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | PR #419 applied the same change, but only to start-master.sh, so some workers were still starting their web UI's using internal addresses. This should finally fix SPARK-613.
* | | | | Merge pull request #529 from xiajunluan/masterMatei Zaharia2013-05-2515-41/+716
|\ \ \ \ \ | | |_|_|/ | |/| | | [SPARK-663]Implement Fair Scheduler in Spark Cluster Scheduler
| * | | | fix bug of unit testsAndrew xia2013-05-212-35/+43
| | | | |
| * | | | Merge branch 'master' into xiajunluanAndrew xia2013-05-18212-1686/+8124
| |\ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/SparkContext.scala core/src/main/scala/spark/scheduler/cluster/ClusterScheduler.scala core/src/main/scala/spark/scheduler/cluster/TaskSetManager.scala
| * | | | | expose TaskSetManager type to resourceOffer function in ClusterSchedulerAndrew xia2013-05-186-70/+84
| | | | | |
| * | | | | Fix ClusterScheduler bug to avoid allocating tasks to same slaveAndrew xia2013-05-175-50/+75
| | | | | |
| * | | | | remove TaskSetQueueManager and update code styleAndrew xia2013-04-194-32/+9
| | | | | |
| * | | | | refactor the Schedulable interface and add unit test for SchedulingAlgorithmAndrew xia2013-04-1811-316/+525
| | | | | |
| * | | | | Contiue to update codes for scala code styleAndrew xia2013-04-0911-147/+122
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | 1.refactor braces for "class" "if" "while" "for" "match" 2.make code lines less than 100 3.refactor class parameter and extends defination
| * | | | | add properties default value null to fix sbt/sbt test errorsAndrew xia2013-04-021-1/+1
| | | | | |
| * | | | | change some typo and some spacingAndrew xia2013-03-293-11/+10
| | | | | |
| * | | | | 1.remove redundant spacing in source codeAndrew xia2013-03-2911-144/+91
| | | | | | | | | | | | | | | | | | | | | | | | 2.replace get/set functions with val and var defination
| * | | | | Just update typo and commentsAndrew xia2013-03-232-4/+3
| | | | | |
generated by cgit v1.2.3 (git 2.39.1) at 2024-08-22 22:11:53 +0000