Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Fix SPARK-670: EC2 start command should require -i option. | Josh Rosen | 2013-05-05 | 1 | -1/+1 |
| | |||||
* | Just use a loop for retries | Holden Karau | 2013-04-09 | 2 | -50/+17 |
| | |||||
* | Retry failed ssh commands. This is especially useful during system startup ↵ | Holden Karau | 2013-04-06 | 2 | -0/+46 |
| | | | | when the hosts may not have yet come on-line but can be useful at other points for people with flakey connections | ||||
* | Use new Spark EC2 scripts by defaultv0.7.0 | Matei Zaharia | 2013-02-26 | 2 | -8/+8 |
| | |||||
* | Print cluster url after setup completes | Shivaram Venkataraman | 2013-02-18 | 1 | -0/+5 |
| | |||||
* | Print ganglia url after setup | Shivaram Venkataraman | 2013-02-18 | 1 | -0/+2 |
| | |||||
* | Use port 5080 for httpd/ganglia | Shivaram Venkataraman | 2013-02-18 | 1 | -1/+1 |
| | |||||
* | Clean up EC2 script options a bit | Matei Zaharia | 2013-02-17 | 1 | -9/+12 |
| | |||||
* | Change EC2 script to use 0.6 AMIs by default, for now | Matei Zaharia | 2013-02-17 | 1 | -5/+5 |
| | |||||
* | Turn on ganglia by default | Shivaram Venkataraman | 2013-01-31 | 1 | -1/+1 |
| | |||||
* | Add an option to use the old scripts | Shivaram Venkataraman | 2013-01-28 | 1 | -13/+30 |
| | |||||
* | Add option to start ganglia. Also enable Hadoop ports even if cluster type is | Shivaram Venkataraman | 2013-01-27 | 1 | -8/+15 |
| | | | | not mesos | ||||
* | Fix swap variable name | Shivaram Venkataraman | 2013-01-27 | 1 | -1/+1 |
| | |||||
* | Update spark_ec2.py to use new spark-ec2 scripts | Shivaram Venkataraman | 2013-01-26 | 2 | -12/+32 |
| | |||||
* | Merge pull request #323 from admobius/master | Matei Zaharia | 2012-12-11 | 1 | -23/+55 |
|\ | | | | | SPARK-626: Remove security groups properly | ||||
| * | SPARK-626: Making security group deletion optional, handling retried | Peter Sankauskas | 2012-12-11 | 1 | -27/+55 |
| | | | | | | | | when deleting security groups fails, fixing bug when using all zones but only 1 slave. | ||||
| * | SPARK-626: Remove rules before removing security groups, with a pause in | Peter Sankauskas | 2012-12-10 | 1 | -11/+15 |
| | | | | | | between so wait for AWS eventual consistency to catch up. | ||||
* | | Make sure the SSH key we copy to EC2 has permissions 600. | Matei Zaharia | 2012-12-10 | 1 | -0/+1 |
|/ | | | | SPARK-539 #resolve | ||||
* | Merge pull request #309 from admobius/use-boto-config-file | Matei Zaharia | 2012-11-19 | 1 | -11/+20 |
|\ | | | | | Improved use of Boto | ||||
| * | Allow Boto to use the other config options it supports, and gracefully | Peter Sankauskas | 2012-11-19 | 1 | -11/+20 |
| | | | | | | handling Boto connection exceptions (like AuthFailure) | ||||
* | | Merge pull request #308 from admobius/multi-zone | Matei Zaharia | 2012-11-19 | 1 | -22/+59 |
|\ \ | |/ |/| | Let EC2 script launch slaves in multiple availability zones | ||||
| * | Adding comment about additional bandwidth charges | Peter Sankauskas | 2012-11-17 | 1 | -1/+2 |
| | | |||||
| * | Giving the Spark EC2 script the ability to launch instances spread | Peter Sankauskas | 2012-11-16 | 1 | -22/+58 |
| | | | | | | | | | | across multiple availability zones in order to make the cluster more resilient to failure | ||||
* | | Delete security groups when deleting the cluster. As many operations | Peter Sankauskas | 2012-11-16 | 1 | -0/+14 |
|/ | | | | are done on instances in specific security groups, this seems like a reasonable thing to clean up. | ||||
* | Fix check for existing instances during EC2 launch. | Josh Rosen | 2012-11-03 | 1 | -10/+6 |
| | |||||
* | Cancel spot instance requests when exiting spark-ec2. | Josh Rosen | 2012-10-30 | 1 | -21/+31 |
| | |||||
* | Allow EC2 script to stop/destroy cluster after master/slave failures. | Josh Rosen | 2012-10-18 | 1 | -4/+5 |
| | |||||
* | Update EC2 scripts for Spark 0.6 | Matei Zaharia | 2012-10-12 | 2 | -15/+12 |
| | |||||
* | Add m1.medium node option to cluster management script. | Ray Racine | 2012-10-09 | 1 | -0/+1 |
| | |||||
* | Made region used by spark-ec2 configurable. | Matei Zaharia | 2012-08-28 | 1 | -2/+4 |
| | |||||
* | Use root login in standalone AMI | Denny | 2012-08-14 | 1 | -1/+1 |
| | |||||
* | rsync root directory in EC2 script | Denny | 2012-08-14 | 1 | -1/+1 |
| | |||||
* | Removed separate launcher for EC2 standalone cluster | Matei Zaharia | 2012-08-09 | 1 | -20/+0 |
| | |||||
* | Merged standalone and mesos EC2 scripts | Denny | 2012-08-02 | 3 | -516/+57 |
| | |||||
* | Spark standalone mode cluster scripts. | Denny | 2012-08-01 | 2 | -0/+511 |
| | | | | Heavily inspired by Hadoop cluster scripts ;-) | ||||
* | Increase the default wait time for EC2 clusters to 2 minutes. | Matei Zaharia | 2012-06-29 | 1 | -2/+2 |
| | |||||
* | Added script for launching Spark on EC2 from Mesos, to make it easier | Matei Zaharia | 2012-06-10 | 5 | -0/+571 |
for new users to get up and running on EC2. |