| Commit message (Collapse) | Author | Age | Files | Lines | |
|---|---|---|---|---|---|
| * | Merge pull request #854 from markhamstra/pomUpdate | Matei Zaharia | 2013-08-22 | 1 | -0/+4 |
| |\ | | | | | Synced sbt and maven builds to use the same dependencies, etc. | ||||
| | * | Synced sbt and maven builds | Mark Hamstra | 2013-08-21 | 1 | -0/+4 |
| | | | |||||
| * | | Merge pull request #832 from alig/coalesce | Matei Zaharia | 2013-08-22 | 4 | -46/+389 |
| |\ \ | |/ |/| | Coalesced RDD with locality | ||||
| | * | Merged in from upstream to use TaskLocation instead of strings | Ali Ghodsi | 2013-08-20 | 2 | -8/+11 |
| | | | |||||
| | * | added curly braces to make the code more consistent | Ali Ghodsi | 2013-08-20 | 1 | -1/+2 |
| | | | |||||
| | * | indent | Ali Ghodsi | 2013-08-20 | 1 | -1/+1 |
| | | | |||||
| | * | Bug in test fixed | Ali Ghodsi | 2013-08-20 | 1 | -3/+3 |
| | | | |||||
| | * | Added a test to make sure no locality preferences are ignored | Ali Ghodsi | 2013-08-20 | 1 | -0/+5 |
| | | | |||||
| | * | Simpler code | Ali Ghodsi | 2013-08-20 | 2 | -5/+4 |
| | | | |||||
| | * | simpler code | Ali Ghodsi | 2013-08-20 | 1 | -16/+7 |
| | | | |||||
| | * | Fixed almost all of Matei's feedback | Ali Ghodsi | 2013-08-20 | 2 | -31/+26 |
| | | | |||||
| | * | fixed Matei's comments | Ali Ghodsi | 2013-08-20 | 3 | -73/+99 |
| | | | |||||
| | * | making CoalescedRDDPartition public | Ali Ghodsi | 2013-08-20 | 1 | -2/+1 |
| | | | |||||
| | * | comment in the test to make it more understandable | Ali Ghodsi | 2013-08-20 | 1 | -1/+1 |
| | | | |||||
| | * | Coalescer now uses current preferred locations for derived RDDs. Made run() ↵ | Ali Ghodsi | 2013-08-20 | 4 | -34/+59 |
| | | | | | | | | | in DAGScheduler thread safe and added a method to be able to ask it for preferred locations. Added a similar method that wraps the former inside SparkContext. | ||||
| | * | added one test that will test a future functionality | Ali Ghodsi | 2013-08-20 | 1 | -1/+10 |
| | | | |||||
| | * | Added error messages to the tests to make failed tests less cryptic | Ali Ghodsi | 2013-08-20 | 1 | -7/+7 |
| | | | |||||
| | * | fixed matei's comments | Ali Ghodsi | 2013-08-20 | 1 | -15/+16 |
| | | | |||||
| | * | Made a function object that returns the coalesced groups | Ali Ghodsi | 2013-08-20 | 1 | -30/+35 |
| | | | |||||
| | * | several of Reynold's suggestions implemented | Ali Ghodsi | 2013-08-20 | 1 | -15/+14 |
| | | | |||||
| | * | space removed | Ali Ghodsi | 2013-08-20 | 1 | -1/+1 |
| | | | |||||
| | * | use count rather than foreach | Ali Ghodsi | 2013-08-20 | 1 | -2/+1 |
| | | | |||||
| | * | made preferredLocation a val of the surrounding case class | Ali Ghodsi | 2013-08-20 | 1 | -10/+3 |
| | | | |||||
| | * | Fix bug in tests | Ali Ghodsi | 2013-08-20 | 2 | -6/+6 |
| | | | |||||
| | * | Renamed split to partition | Ali Ghodsi | 2013-08-20 | 1 | -11/+11 |
| | | | |||||
| | * | word wrap before 100 chars per line | Ali Ghodsi | 2013-08-20 | 2 | -41/+51 |
| | | | |||||
| | * | added goals inline as comment | Ali Ghodsi | 2013-08-20 | 1 | -0/+21 |
| | | | |||||
| | * | Large scale load and locality tests for the coalesced partitions added | Ali Ghodsi | 2013-08-20 | 2 | -63/+118 |
| | | | |||||
| | * | Bug, should compute slack wrt parent partition size, not number of bins | Ali Ghodsi | 2013-08-20 | 1 | -2/+2 |
| | | | |||||
| | * | load balancing coalescer | Ali Ghodsi | 2013-08-20 | 2 | -11/+218 |
| | | | |||||
| * | | Removed meaningless types | Mark Hamstra | 2013-08-20 | 1 | -1/+1 |
| |/ | |||||
| * | Merge remote-tracking branch 'jey/hadoop-agnostic' | Matei Zaharia | 2013-08-20 | 29 | -2255/+178 |
| |\ | | | | | | | | | Conflicts: core/src/main/scala/spark/PairRDDFunctions.scala | ||||
| | * | Fix Maven build with Hadoop 0.23.9 | Jey Kottalam | 2013-08-18 | 1 | -0/+8 |
| | | | |||||
| | * | Maven build now also works with YARN | Jey Kottalam | 2013-08-16 | 1 | -70/+0 |
| | | | |||||
| | * | Don't mark hadoop-client as 'provided' | Jey Kottalam | 2013-08-16 | 1 | -1/+0 |
| | | | |||||
| | * | Maven build now works with CDH hadoop-2.0.0-mr1 | Jey Kottalam | 2013-08-16 | 1 | -52/+0 |
| | | | |||||
| | * | Initial changes to make Maven build agnostic of hadoop version | Jey Kottalam | 2013-08-16 | 1 | -58/+5 |
| | | | |||||
| | * | Rename HadoopWriter to SparkHadoopWriter since it's outside of our package | Jey Kottalam | 2013-08-15 | 2 | -6/+6 |
| | | | |||||
| | * | Fix newTaskAttemptID to work under YARN | Jey Kottalam | 2013-08-15 | 1 | -1/+19 |
| | | | |||||
| | * | re-enable YARN support | Jey Kottalam | 2013-08-15 | 1 | -1/+13 |
| | | | |||||
| | * | SparkEnv isn't available this early, and not needed anyway | Jey Kottalam | 2013-08-15 | 2 | -25/+0 |
| | | | |||||
| | * | make SparkHadoopUtil a member of SparkEnv | Jey Kottalam | 2013-08-15 | 8 | -26/+31 |
| | | | |||||
| | * | rename HadoopMapRedUtil => SparkHadoopMapRedUtil, HadoopMapReduceUtil => ↵ | Jey Kottalam | 2013-08-15 | 5 | -6/+7 |
| | | | | | | | | | SparkHadoopMapReduceUtil | ||||
| | * | add comment | Jey Kottalam | 2013-08-15 | 1 | -4/+4 |
| | | | |||||
| | * | dynamically detect hadoop version | Jey Kottalam | 2013-08-15 | 2 | -8/+48 |
| | | | |||||
| | * | remove core/src/hadoop{1,2} dirs | Jey Kottalam | 2013-08-15 | 6 | -104/+0 |
| | | | |||||
| | * | move yarn to its own directory | Jey Kottalam | 2013-08-15 | 10 | -1864/+0 |
| | | | |||||
| * | | changeGeneration --> changeEpoch renaming | Mark Hamstra | 2013-08-20 | 1 | -2/+2 |
| | | | |||||
| * | | Renamed 'priority' to 'jobId' and assorted minor changes | Mark Hamstra | 2013-08-20 | 5 | -59/+60 |
| | | | |||||
| * | | Merge pull request #828 from mateiz/sched-improvements | Matei Zaharia | 2013-08-19 | 41 | -965/+1034 |
| |\ \ | | | | | | | Scheduler fixes and improvements | ||||
 |
index : spark | |
| Mirror of Apache Spark |
| aboutsummaryrefslogtreecommitdiff |