| Commit message (Collapse) | Author | Age | Files | Lines | ||
|---|---|---|---|---|---|---|
| ... | ||||||
| | * | | | | | Merge pull request #611 from squito/classloader | Matei Zaharia | 2013-05-28 | 2 | -4/+11 | |
| | |\ \ \ \ \ | | |/ / / / | |/| | | | | Use default classloaders for akka & deserializing task results | |||||
| | | * | | | | use threads classloader when deserializing task results; ↵ | Imran Rashid | 2013-05-14 | 1 | -3/+10 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | classnotfoundexception includes classloader | |||||
| | | * | | | | when akka starts, use akkas default classloader (current thread) | Imran Rashid | 2013-05-14 | 1 | -1/+1 | |
| | | | | | | | ||||||
| | * | | | | | Merge pull request #620 from jerryshao/master | Matei Zaharia | 2013-05-27 | 1 | -1/+1 | |
| | |\ \ \ \ \ | | | | | | | | | | | | | | | Fix CheckpointRDD java.io.FileNotFoundException when calling getPreferredLocations | |||||
| | | * | | | | | fix CheckpointRDD getPreferredLocations java.io.FileNotFoundException | jerryshao | 2013-05-24 | 1 | -1/+1 | |
| | | | | | | | | ||||||
| | * | | | | | | Merge pull request #529 from xiajunluan/master | Matei Zaharia | 2013-05-25 | 15 | -41/+716 | |
| | |\ \ \ \ \ \ | | | |_|_|/ / | | |/| | | | | [SPARK-663]Implement Fair Scheduler in Spark Cluster Scheduler | |||||
| | | * | | | | | fix bug of unit tests | Andrew xia | 2013-05-21 | 2 | -35/+43 | |
| | | | | | | | | ||||||
| | | * | | | | | Merge branch 'master' into xiajunluan | Andrew xia | 2013-05-18 | 152 | -1396/+7022 | |
| | | |\ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/SparkContext.scala core/src/main/scala/spark/scheduler/cluster/ClusterScheduler.scala core/src/main/scala/spark/scheduler/cluster/TaskSetManager.scala | |||||
| | | * | | | | | | expose TaskSetManager type to resourceOffer function in ClusterScheduler | Andrew xia | 2013-05-18 | 6 | -70/+84 | |
| | | | | | | | | | ||||||
| | | * | | | | | | Fix ClusterScheduler bug to avoid allocating tasks to same slave | Andrew xia | 2013-05-17 | 5 | -50/+75 | |
| | | | | | | | | | ||||||
| | | * | | | | | | remove TaskSetQueueManager and update code style | Andrew xia | 2013-04-19 | 4 | -32/+9 | |
| | | | | | | | | | ||||||
| | | * | | | | | | refactor the Schedulable interface and add unit test for SchedulingAlgorithm | Andrew xia | 2013-04-18 | 11 | -316/+525 | |
| | | | | | | | | | ||||||
| | | * | | | | | | Contiue to update codes for scala code style | Andrew xia | 2013-04-09 | 11 | -147/+122 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | 1.refactor braces for "class" "if" "while" "for" "match" 2.make code lines less than 100 3.refactor class parameter and extends defination | |||||
| | | * | | | | | | add properties default value null to fix sbt/sbt test errors | Andrew xia | 2013-04-02 | 1 | -1/+1 | |
| | | | | | | | | | ||||||
| | | * | | | | | | change some typo and some spacing | Andrew xia | 2013-03-29 | 3 | -11/+10 | |
| | | | | | | | | | ||||||
| | | * | | | | | | 1.remove redundant spacing in source code | Andrew xia | 2013-03-29 | 11 | -144/+91 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | 2.replace get/set functions with val and var defination | |||||
| | | * | | | | | | Just update typo and comments | Andrew xia | 2013-03-23 | 2 | -4/+3 | |
| | | | | | | | | | ||||||
| | | * | | | | | | refactor fair scheduler implementation | Andrew xia | 2013-03-16 | 13 | -194/+415 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | 1.Chage "pool" properties to be the memeber of ActiveJob 2.Abstract the Schedulable of Pool and TaskSetManager 3.Abstract the FIFO and FS comparator algorithm 4.Miscellaneous changing of class define and construction | |||||
| | | * | | | | | | Removed some commented code | Harold Lim | 2013-03-12 | 1 | -3/+3 | |
| | | | | | | | | | ||||||
| | | * | | | | | | Cleaned up the code | Harold Lim | 2013-03-12 | 1 | -28/+1 | |
| | | | | | | | | | ||||||
| | | * | | | | | | Updated/Refactored the Fair Task Scheduler. It does not inherit ↵ | Harold Lim | 2013-03-12 | 8 | -488/+312 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | ClusterScheduler anymore. Rather, ClusterScheduler internally uses TaskSetQueuesManager that handles the scheduling of taskset queues. This is the class that should be extended to support other scheduling policies | |||||
| | | * | | | | | | Changed the name of the system property to set the allocation xml | Harold Lim | 2013-03-12 | 1 | -1/+1 | |
| | | | | | | | | | ||||||
| | | * | | | | | | Made changes to the SparkContext to have a DynamicVariable for setting local ↵ | Harold Lim | 2013-03-12 | 7 | -29/+530 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | properties that can be passed down the stack. Added an implementation of the fair scheduler | |||||
| | * | | | | | | | Fixed a stupid mistake that NonJavaSerializableClass was made Java | Reynold Xin | 2013-05-24 | 1 | -1/+1 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | serializable. | |||||
| | * | | | | | | | Automatically configure Netty port. This makes unit tests using | Reynold Xin | 2013-05-24 | 10 | -112/+129 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | local-cluster pass. Previously they were failing because Netty was trying to bind to the same port for all processes. Pair programmed with @shivaram. | |||||
| | * | | | | | | | Fixed the bug that shuffle serializer is ignored by the new shuffle | Reynold Xin | 2013-05-24 | 2 | -4/+19 | |
| | | |_|/ / / / | |/| | | | | | | | | | | | | | | | | | | | block iterators for local blocks. Also added a unit test for that. | |||||
| | * | | | | | | Merge pull request #619 from woggling/adjust-sampling | Matei Zaharia | 2013-05-21 | 1 | -1/+1 | |
| | |\ \ \ \ \ \ | | | | | | | | | | | | | | | | | Use ARRAY_SAMPLE_SIZE constant instead of hard-coded 100.0 in SizeEstimator | |||||
| | | * | | | | | | Use ARRAY_SAMPLE_SIZE constant instead of 100.0 | Charles Reiss | 2013-05-21 | 1 | -1/+1 | |
| | | | | | | | | | ||||||
| | * | | | | | | | DistributedSuite: remove dead test code | Charles Reiss | 2013-05-21 | 1 | -1/+0 | |
| | |/ / / / / / | ||||||
| | * | | | | | | Merge pull request #610 from JoshRosen/spark-747 | Reynold Xin | 2013-05-17 | 4 | -0/+26 | |
| | |\ \ \ \ \ \ | | | | | | | | | | | | | | | | | Throw exception if TaskResult exceeds Akka frame size | |||||
| | | * | | | | | | Abort job if result exceeds Akka frame size; add test. | Josh Rosen | 2013-05-16 | 4 | -1/+23 | |
| | | | | | | | | | ||||||
| | | * | | | | | | Throw exception if task result exceeds Akka frame size. | Josh Rosen | 2013-05-11 | 1 | -0/+4 | |
| | | | |_|_|/ / | | |/| | | | | | | | | | | | | | | | | | | This partially addresses SPARK-747. | |||||
| | * | | | | | | Changed the logging level from info to warning when addJar(null) is | Reynold Xin | 2013-05-17 | 1 | -9/+10 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | called. | |||||
| | * | | | | | | Merge branch 'master' of github.com:mesos/spark | Reynold Xin | 2013-05-17 | 1 | -0/+4 | |
| | |\ \ \ \ \ \ | | | |_|/ / / | | |/| | | | | ||||||
| | | * | | | | | Added dependency on netty-all in Maven. | Reynold Xin | 2013-05-16 | 1 | -0/+4 | |
| | | | | | | | | ||||||
| | * | | | | | | Hope this does not turn into a bike shed change | Mridul Muralidharan | 2013-05-17 | 1 | -2/+4 | |
| | | | | | | | | ||||||
| | * | | | | | | Filter out nulls - prevent NPE | Mridul Muralidharan | 2013-05-16 | 1 | -0/+2 | |
| | |/ / / / / | ||||||
| | * | | | | | Merge pull request #602 from rxin/shufflemerge | Matei Zaharia | 2013-05-15 | 23 | -440/+1258 | |
| | |\ \ \ \ \ | | | | | | | | | | | | | | | Manual merge & cleanup of Shane's Shuffle Performance Optimization | |||||
| | | * \ \ \ \ | Merge branch 'master' of github.com:mesos/spark into shufflemerge | Reynold Xin | 2013-05-15 | 28 | -178/+585 | |
| | | |\ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/storage/BlockManager.scala core/src/test/scala/spark/DistributedSuite.scala project/SparkBuild.scala | |||||
| | | * | | | | | | Added test for Netty suite. | Reynold Xin | 2013-05-07 | 2 | -1/+19 | |
| | | | | | | | | | ||||||
| | | * | | | | | | Cleaned up connection manager (moved many classes to their own files). | Reynold Xin | 2013-05-07 | 7 | -252/+315 | |
| | | | | | | | | | ||||||
| | | * | | | | | | Minor style fix in DiskStore... | Reynold Xin | 2013-05-07 | 1 | -2/+2 | |
| | | | | | | | | | ||||||
| | | * | | | | | | Cleaned up Scala files in network/netty from Shane's PR. | Reynold Xin | 2013-05-07 | 2 | -33/+35 | |
| | | | | | | | | | ||||||
| | | * | | | | | | Cleaned up the Java files from Shane's PR. | Reynold Xin | 2013-05-07 | 8 | -118/+85 | |
| | | | | | | | | | ||||||
| | | * | | | | | | Cleaned up BlockManager and BlockFetcherIterator from Shane's PR. | Reynold Xin | 2013-05-07 | 3 | -99/+102 | |
| | | | | | | | | | ||||||
| | | * | | | | | | Moved BlockFetcherIterator to its own file. | Reynold Xin | 2013-05-07 | 2 | -339/+362 | |
| | | | | | | | | | ||||||
| | | * | | | | | | Merge branch 'shuffle-performance-fix-0.7' of github.com:shane-huang/spark ↵ | Reynold Xin | 2013-05-07 | 12 | -68/+808 | |
| | | |\ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | into shufflemerge Conflicts: core/src/main/scala/spark/storage/BlockManager.scala core/src/main/scala/spark/storage/DiskStore.scala project/SparkBuild.scala | |||||
| | | | * | | | | | | fix a bug in netty Block Fetcher | shane-huang | 2013-04-16 | 3 | -37/+37 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Signed-off-by: shane-huang <shengsheng.huang@intel.com> | |||||
| | | | * | | | | | | Shuffle Performance fix: Use netty embeded OIO file server instead of ↵ | shane-huang | 2013-04-07 | 12 | -54/+792 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | ConnectionManager Shuffle Performance Optimization: do not send 0-byte block requests to reduce network messages change reference from io.Source to scala.io.Source to avoid looking into io.netty package Signed-off-by: shane-huang <shengsheng.huang@intel.com> | |||||
| | * | | | | | | | | Merge pull request #593 from squito/driver_ui_link | Reynold Xin | 2013-05-15 | 7 | -13/+21 | |
| | |\ \ \ \ \ \ \ \ | | |_|_|/ / / / / | |/| | | | | | | | Master UI has link to Application UI | |||||
 |
index : spark | |
| Mirror of Apache Spark |
| aboutsummaryrefslogtreecommitdiff |