aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Fixed repl maven build to produce artifacts with the appropriate hadoop ↵Thomas Dudziak2012-12-188-142/+243
| | | | classifier and extracted repl fat-jar and debian packaging into a separate project to make Maven happy
* Merge pull request #332 from JoshRosen/spark-607Matei Zaharia2012-12-141-12/+17
|\ | | | | Add try-finally to handle MapOutputTracker timeouts
| * Add try-finally to handle MapOutputTracker timeouts.Josh Rosen2012-12-131-12/+17
| |
* | Merge pull request #331 from woggling/deploy-exit-statusMatei Zaharia2012-12-138-23/+22
|\ \ | | | | | | Have standalone cluster report exit codes to clients
| * | Code review cleanup.Charles Reiss2012-12-131-1/+4
| | |
| * | Have standalone cluster report exit codes to clients. Addresses SPARK-639.Charles Reiss2012-12-138-24/+20
|/ /
* | Merge pull request #333 from rxin/masterMatei Zaharia2012-12-131-7/+9
|\ \ | | | | | | Fixed the broken Java unit test from SPARK-635.
| * | Fixed the broken Java unit test from SPARK-635.Reynold Xin2012-12-131-7/+9
|/ /
* | Merge pull request #329 from woggling/executor-status-codesMatei Zaharia2012-12-138-15/+118
|\ \ | | | | | | Executor exit status codes
| * | ExecutorLostReason -> ExecutorLossReasonCharles Reiss2012-12-134-6/+6
| | |
| * | Extra whitespace in ExecutorExitCodeCharles Reiss2012-12-131-0/+3
| | |
| * | Explain slaveLost calls made by StandaloneSchedulerBackendCharles Reiss2012-12-131-5/+5
| | |
| * | Log duplicate slaveLost() calls in ClusterScheduler.Charles Reiss2012-12-131-1/+7
| | |
| * | Normalize executor exit statuses and report them to the user.Charles Reiss2012-12-138-11/+94
| | |
| * | Call slaveLost on executor death for standalone clusters.Charles Reiss2012-12-121-1/+12
| | |
* | | Merge pull request #330 from JoshRosen/spark-638Matei Zaharia2012-12-134-6/+20
|\ \ \ | | | | | | | | Use spark-env.sh to configure standalone master
| * | | Use spark-env.sh to configure standalone master. See SPARK-638.Josh Rosen2012-12-144-6/+20
| | |/ | |/| | | | | | | Also fixed a typo in the standalone mode documentation.
* | | Merge pull request #328 from rxin/spark-635Matei Zaharia2012-12-1326-208/+207
|\ \ \ | |/ / |/| | SPARK-635: Pass a TaskContext object to compute() interface and use that to close Hadoop input stream.
| * | SPARK-635: Pass a TaskContext object to compute() interface and useReynold Xin2012-12-1320-49/+46
| | | | | | | | | | | | that to close Hadoop input stream. Incorporated Matei's command.
| * | SPARK-635: Pass a TaskContext object to compute() interface and use thatReynold Xin2012-12-1326-205/+207
| |/ | | | | | | to close Hadoop input stream.
* | Merge pull request #325 from tomdz/masterMatei Zaharia2012-12-132-0/+6
|\ \ | |/ |/| Mark hadoop dependencies provided in all library artifacts
| * Mark hadoop dependencies provided in all library artifactsThomas Dudziak2012-12-102-0/+6
| |
* | Merge pull request #323 from admobius/masterMatei Zaharia2012-12-111-23/+55
|\ \ | | | | | | SPARK-626: Remove security groups properly
| * | SPARK-626: Making security group deletion optional, handling retriedPeter Sankauskas2012-12-111-27/+55
| | | | | | | | | | | | when deleting security groups fails, fixing bug when using all zones but only 1 slave.
| * | SPARK-626: Remove rules before removing security groups, with a pause inPeter Sankauskas2012-12-101-11/+15
| | | | | | | | | between so wait for AWS eventual consistency to catch up.
* | | Merge pull request #324 from rxin/masterMatei Zaharia2012-12-102-12/+17
|\ \ \ | | | | | | | | Suppress shuffle block updates when a slave node comes back.
| * | | Suppress shuffle block updates when a slave node comes back.Reynold Xin2012-12-102-12/+17
|/ / /
* | | Merge pull request #319 from mbautin/cdh4.1.2Matei Zaharia2012-12-101-2/+3
|\ \ \ | | | | | | | | Bump CDH version for the Hadoop 2 profile to 4.1.2
| * | | Bump CDH version for the Hadoop 2 profile to 4.1.2Mikhail Bautin2012-12-101-2/+3
| | | |
* | | | Merge pull request #320 from tomdz/masterMatei Zaharia2012-12-102-1/+3
|\ \ \ \ | | |_|/ | |/| | Shaded repl jar for hadoop1 profile needs to include hadoop classes
| * | | Shaded repl jar for hadoop1 profile needs to include hadoop classesThomas Dudziak2012-12-102-1/+3
| |/ /
* | | Make "run" script work with Maven buildsMatei Zaharia2012-12-101-5/+10
| | |
* | | Make sure the SSH key we copy to EC2 has permissions 600.Matei Zaharia2012-12-101-0/+1
|/ / | | | | | | SPARK-539 #resolve
* | Merge pull request #317 from woggling/block-manager-heartbeatMatei Zaharia2012-12-106-62/+318
|\ \ | | | | | | Implement block manager heartbeat
| * | Decrease BlockManagerMaster logging verbosityCharles Reiss2012-12-101-1/+2
| | |
| * | Use Akka scheduler for BlockManager heart beats.Charles Reiss2012-12-104-49/+41
| | | | | | | | | | | | Adds required ActorSystem argument to BlockManager constructors.
| * | Changed default block manager heartbeat interval to 5 sCharles Reiss2012-12-091-1/+1
| | |
| * | Don't divide by milliseconds by 1000 more.Charles Reiss2012-12-061-1/+1
| | |
| * | map -> foreachCharles Reiss2012-12-061-1/+1
| | |
| * | Make LocalSparkCluster use distinct IPsCharles Reiss2012-12-061-2/+6
| | |
| * | Tests for block manager heartbeats.Charles Reiss2012-12-051-0/+68
| | |
| * | Add block manager heart beats.Charles Reiss2012-12-052-25/+193
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Renames old message called 'HeartBeat' to 'BlockUpdate'. The BlockManager periodically sends a heart beat message to the master. If the manager is currently not registered. The master responds to the heart beat by indicating whether the BlockManager is currently registered with the master. Additionally, the master now also responds to block updates by indicating whether the BlockManager in question is registered. When the BlockManager detects (by heart beat or failed block update) that it stopped being registered, it reregisters and sends block updates for all its blocks.
| * | Track block managers by hostname; handle manager removal.Charles Reiss2012-12-051-3/+27
| | |
| * | Actually put millis in _lastSeenMsCharles Reiss2012-12-051-1/+1
| | |
| * | Don't use bogus port number in notifyADeadHost().Charles Reiss2012-12-051-2/+1
| | |
* | | Merge pull request #318 from tomdz/masterMatei Zaharia2012-12-101-1/+3
|\ \ \ | | | | | | | | Minor tweaks to the debian build
| * | | Minor tweaks to the debian buildThomas Dudziak2012-12-101-1/+3
| | |/ | |/|
* / | Use the same output directories that SBT had in subprojectsMatei Zaharia2012-12-104-3/+9
|/ / | | | | | | This will make it easier to make the "run" script work with a Maven build
* | Merge pull request #310 from tomdz/master-mavenizedMatei Zaharia2012-12-099-0/+1340
|\ \ | | | | | | Maven build setup
| * | Code review feedback fixThomas Dudziak2012-11-281-1/+12
| | |
generated by cgit v1.2.3 (git 2.39.1) at 2024-08-23 00:42:26 +0000