Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Added the ability in block manager to remove blocks. | Reynold Xin | 2012-12-13 | 9 | -170/+361 |
| | |||||
* | Suppress shuffle block updates when a slave node comes back. | Reynold Xin | 2012-12-10 | 2 | -12/+17 |
| | |||||
* | Merge pull request #319 from mbautin/cdh4.1.2 | Matei Zaharia | 2012-12-10 | 1 | -2/+3 |
|\ | | | | | Bump CDH version for the Hadoop 2 profile to 4.1.2 | ||||
| * | Bump CDH version for the Hadoop 2 profile to 4.1.2 | Mikhail Bautin | 2012-12-10 | 1 | -2/+3 |
| | | |||||
* | | Merge pull request #320 from tomdz/master | Matei Zaharia | 2012-12-10 | 2 | -1/+3 |
|\ \ | | | | | | | Shaded repl jar for hadoop1 profile needs to include hadoop classes | ||||
| * | | Shaded repl jar for hadoop1 profile needs to include hadoop classes | Thomas Dudziak | 2012-12-10 | 2 | -1/+3 |
| |/ | |||||
* | | Make "run" script work with Maven builds | Matei Zaharia | 2012-12-10 | 1 | -5/+10 |
| | | |||||
* | | Make sure the SSH key we copy to EC2 has permissions 600. | Matei Zaharia | 2012-12-10 | 1 | -0/+1 |
|/ | | | | SPARK-539 #resolve | ||||
* | Merge pull request #317 from woggling/block-manager-heartbeat | Matei Zaharia | 2012-12-10 | 6 | -62/+318 |
|\ | | | | | Implement block manager heartbeat | ||||
| * | Decrease BlockManagerMaster logging verbosity | Charles Reiss | 2012-12-10 | 1 | -1/+2 |
| | | |||||
| * | Use Akka scheduler for BlockManager heart beats. | Charles Reiss | 2012-12-10 | 4 | -49/+41 |
| | | | | | | | | Adds required ActorSystem argument to BlockManager constructors. | ||||
| * | Changed default block manager heartbeat interval to 5 s | Charles Reiss | 2012-12-09 | 1 | -1/+1 |
| | | |||||
| * | Don't divide by milliseconds by 1000 more. | Charles Reiss | 2012-12-06 | 1 | -1/+1 |
| | | |||||
| * | map -> foreach | Charles Reiss | 2012-12-06 | 1 | -1/+1 |
| | | |||||
| * | Make LocalSparkCluster use distinct IPs | Charles Reiss | 2012-12-06 | 1 | -2/+6 |
| | | |||||
| * | Tests for block manager heartbeats. | Charles Reiss | 2012-12-05 | 1 | -0/+68 |
| | | |||||
| * | Add block manager heart beats. | Charles Reiss | 2012-12-05 | 2 | -25/+193 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | Renames old message called 'HeartBeat' to 'BlockUpdate'. The BlockManager periodically sends a heart beat message to the master. If the manager is currently not registered. The master responds to the heart beat by indicating whether the BlockManager is currently registered with the master. Additionally, the master now also responds to block updates by indicating whether the BlockManager in question is registered. When the BlockManager detects (by heart beat or failed block update) that it stopped being registered, it reregisters and sends block updates for all its blocks. | ||||
| * | Track block managers by hostname; handle manager removal. | Charles Reiss | 2012-12-05 | 1 | -3/+27 |
| | | |||||
| * | Actually put millis in _lastSeenMs | Charles Reiss | 2012-12-05 | 1 | -1/+1 |
| | | |||||
| * | Don't use bogus port number in notifyADeadHost(). | Charles Reiss | 2012-12-05 | 1 | -2/+1 |
| | | |||||
* | | Merge pull request #318 from tomdz/master | Matei Zaharia | 2012-12-10 | 1 | -1/+3 |
|\ \ | | | | | | | Minor tweaks to the debian build | ||||
| * | | Minor tweaks to the debian build | Thomas Dudziak | 2012-12-10 | 1 | -1/+3 |
| | | | |||||
* | | | Use the same output directories that SBT had in subprojects | Matei Zaharia | 2012-12-10 | 4 | -3/+9 |
|/ / | | | | | | | This will make it easier to make the "run" script work with a Maven build | ||||
* | | Merge pull request #310 from tomdz/master-mavenized | Matei Zaharia | 2012-12-09 | 9 | -0/+1340 |
|\ \ | | | | | | | Maven build setup | ||||
| * | | Code review feedback fix | Thomas Dudziak | 2012-11-28 | 1 | -1/+12 |
| | | | |||||
| * | | Updated versions in the pom.xml files to match current master | Thomas Dudziak | 2012-11-27 | 5 | -6/+6 |
| | | | |||||
| * | | Addressed code review comments | Thomas Dudziak | 2012-11-27 | 5 | -6/+17 |
| | | | |||||
| * | | Include the configuration templates in the debian package | Thomas Dudziak | 2012-11-20 | 1 | -0/+11 |
| | | | |||||
| * | | Added maven and debian build files | Thomas Dudziak | 2012-11-20 | 9 | -0/+1307 |
| | | | |||||
* | | | Search for a non-loopback address in Utils.getLocalIpAddress | Matei Zaharia | 2012-12-08 | 5 | -10/+33 |
| |/ |/| | |||||
* | | Merge pull request #316 from JoshRosen/fix/ec2-web-ui-links | Matei Zaharia | 2012-12-04 | 8 | -15/+58 |
|\ \ | | | | | | | Use external addresses in standalone web UI when running on EC2 | ||||
| * | | Use external addresses in standalone WebUI on EC2. | Josh Rosen | 2012-12-01 | 8 | -15/+58 |
|/ / | |||||
* | | Merge pull request #314 from pwendell/quickstart-bugfix | Matei Zaharia | 2012-11-28 | 1 | -2/+2 |
|\ \ | | | | | | | Adding multi-jar constructor in quickstart | ||||
| * | | Adding multi-jar constructor in quickstart | Patrick Wendell | 2012-11-27 | 1 | -2/+2 |
|/ / | |||||
* | | Merge pull request #313 from rxin/pde_size_compress | Matei Zaharia | 2012-11-27 | 2 | -33/+37 |
|\ \ | | | | | | | Added a partition preserving flag to MapPartitionsWithSplitRDD. | ||||
| * | | Added a partition preserving flag to MapPartitionsWithSplitRDD. | Reynold Xin | 2012-11-27 | 2 | -33/+37 |
| | | | |||||
* | | | Added zip to Java API | Matei Zaharia | 2012-11-27 | 2 | -0/+25 |
| | | | |||||
* | | | Added a zip() operation for RDDs with the same shape (number of | Matei Zaharia | 2012-11-27 | 3 | -0/+75 |
| | | | | | | | | | | | | partitions and number of elements in each partition) | ||||
* | | | Use hostname instead of IP in deploy scripts to let Akka connect properly | Matei Zaharia | 2012-11-27 | 1 | -13/+2 |
| | | | |||||
* | | | Merge branch 'master' of github.com:mesos/spark | Matei Zaharia | 2012-11-27 | 6 | -51/+185 |
|\ \ \ | |||||
| * \ \ | Merge pull request #311 from woggling/map-output-npe | Matei Zaharia | 2012-11-27 | 2 | -1/+52 |
| |\ \ \ | | | | | | | | | | | Fix NullPointerException when map output unregistered from MapOutputTracker twice | ||||
| | * | | | Fix NullPointerException when unregistering a map output twice. | Charles Reiss | 2012-11-27 | 1 | -1/+1 |
| | | | | | |||||
| | * | | | Tests for MapOutputTracker. | Charles Reiss | 2012-11-27 | 1 | -0/+51 |
| | | |/ | | |/| | |||||
| * | | | Merge pull request #312 from rxin/pde_size_compress | Matei Zaharia | 2012-11-27 | 2 | -15/+18 |
| |\ \ \ | | |/ / | |/| / | | |/ | For size compression, compress non zero values into non zero values. | ||||
| | * | For size compression, compress non zero values into non zero values. | Reynold Xin | 2012-11-27 | 2 | -15/+18 |
| |/ | |||||
| * | Merge pull request #309 from admobius/use-boto-config-file | Matei Zaharia | 2012-11-19 | 1 | -11/+20 |
| |\ | | | | | | | Improved use of Boto | ||||
| | * | Allow Boto to use the other config options it supports, and gracefully | Peter Sankauskas | 2012-11-19 | 1 | -11/+20 |
| | | | | | | | | | handling Boto connection exceptions (like AuthFailure) | ||||
| * | | Merge pull request #308 from admobius/multi-zone | Matei Zaharia | 2012-11-19 | 1 | -22/+59 |
| |\ \ | | | | | | | | | Let EC2 script launch slaves in multiple availability zones | ||||
| | * | | Adding comment about additional bandwidth charges | Peter Sankauskas | 2012-11-17 | 1 | -1/+2 |
| | | | | |||||
| | * | | Giving the Spark EC2 script the ability to launch instances spread | Peter Sankauskas | 2012-11-16 | 1 | -22/+58 |
| | | | | | | | | | | | | | | | | | | | | across multiple availability zones in order to make the cluster more resilient to failure |