Commit message (Collapse) | Author | Age | Files | Lines | ||
---|---|---|---|---|---|---|
... | ||||||
* | | Fixing syntax error | Patrick Wendell | 2013-06-07 | 1 | -2/+2 | |
| | | ||||||
* | | Adding spark shark modules | Patrick Wendell | 2013-06-07 | 1 | -3/+4 | |
| | | ||||||
* | | Decoupling spark version from ami | Patrick Wendell | 2013-06-07 | 1 | -7/+16 | |
| | | ||||||
* | | Some changes in response to Josh | Patrick Wendell | 2013-05-18 | 1 | -5/+4 | |
| | | ||||||
* | | Adding support for tag | Patrick Wendell | 2013-05-10 | 1 | -4/+4 | |
| | | ||||||
* | | Removing unnecessary parsing | Patrick Wendell | 2013-05-09 | 1 | -3/+1 | |
| | | ||||||
* | | Slight change to AMI versioning | Patrick Wendell | 2013-05-08 | 1 | -11/+13 | |
| | | ||||||
* | | Changing spark version and availability zone fix | Patrick Wendell | 2013-05-08 | 1 | -2/+3 | |
| | | ||||||
* | | Resolve AMI region automatically | Patrick Wendell | 2013-05-08 | 1 | -2/+4 | |
| | | ||||||
* | | Adding automatic resolve of AMI | Patrick Wendell | 2013-05-08 | 1 | -10/+49 | |
| | | ||||||
* | | Adding mapreduce module | Patrick Wendell | 2013-05-08 | 1 | -2/+3 | |
| | | ||||||
* | | Adding extra instance types | Patrick Wendell | 2013-05-08 | 1 | -1/+3 | |
| | | ||||||
* | | REVERT ME: Linking to Patrick's ec2 repo for now | Patrick Wendell | 2013-05-08 | 1 | -1/+1 | |
|/ | ||||||
* | Just use a loop for retries | Holden Karau | 2013-04-09 | 2 | -50/+17 | |
| | ||||||
* | Retry failed ssh commands. This is especially useful during system startup ↵ | Holden Karau | 2013-04-06 | 2 | -0/+46 | |
| | | | | when the hosts may not have yet come on-line but can be useful at other points for people with flakey connections | |||||
* | Use new Spark EC2 scripts by defaultv0.7.0 | Matei Zaharia | 2013-02-26 | 2 | -8/+8 | |
| | ||||||
* | Print cluster url after setup completes | Shivaram Venkataraman | 2013-02-18 | 1 | -0/+5 | |
| | ||||||
* | Print ganglia url after setup | Shivaram Venkataraman | 2013-02-18 | 1 | -0/+2 | |
| | ||||||
* | Use port 5080 for httpd/ganglia | Shivaram Venkataraman | 2013-02-18 | 1 | -1/+1 | |
| | ||||||
* | Clean up EC2 script options a bit | Matei Zaharia | 2013-02-17 | 1 | -9/+12 | |
| | ||||||
* | Change EC2 script to use 0.6 AMIs by default, for now | Matei Zaharia | 2013-02-17 | 1 | -5/+5 | |
| | ||||||
* | Turn on ganglia by default | Shivaram Venkataraman | 2013-01-31 | 1 | -1/+1 | |
| | ||||||
* | Add an option to use the old scripts | Shivaram Venkataraman | 2013-01-28 | 1 | -13/+30 | |
| | ||||||
* | Add option to start ganglia. Also enable Hadoop ports even if cluster type is | Shivaram Venkataraman | 2013-01-27 | 1 | -8/+15 | |
| | | | | not mesos | |||||
* | Fix swap variable name | Shivaram Venkataraman | 2013-01-27 | 1 | -1/+1 | |
| | ||||||
* | Update spark_ec2.py to use new spark-ec2 scripts | Shivaram Venkataraman | 2013-01-26 | 2 | -12/+32 | |
| | ||||||
* | Merge pull request #323 from admobius/master | Matei Zaharia | 2012-12-11 | 1 | -23/+55 | |
|\ | | | | | SPARK-626: Remove security groups properly | |||||
| * | SPARK-626: Making security group deletion optional, handling retried | Peter Sankauskas | 2012-12-11 | 1 | -27/+55 | |
| | | | | | | | | when deleting security groups fails, fixing bug when using all zones but only 1 slave. | |||||
| * | SPARK-626: Remove rules before removing security groups, with a pause in | Peter Sankauskas | 2012-12-10 | 1 | -11/+15 | |
| | | | | | | between so wait for AWS eventual consistency to catch up. | |||||
* | | Make sure the SSH key we copy to EC2 has permissions 600. | Matei Zaharia | 2012-12-10 | 1 | -0/+1 | |
|/ | | | | SPARK-539 #resolve | |||||
* | Merge pull request #309 from admobius/use-boto-config-file | Matei Zaharia | 2012-11-19 | 1 | -11/+20 | |
|\ | | | | | Improved use of Boto | |||||
| * | Allow Boto to use the other config options it supports, and gracefully | Peter Sankauskas | 2012-11-19 | 1 | -11/+20 | |
| | | | | | | handling Boto connection exceptions (like AuthFailure) | |||||
* | | Merge pull request #308 from admobius/multi-zone | Matei Zaharia | 2012-11-19 | 1 | -22/+59 | |
|\ \ | |/ |/| | Let EC2 script launch slaves in multiple availability zones | |||||
| * | Adding comment about additional bandwidth charges | Peter Sankauskas | 2012-11-17 | 1 | -1/+2 | |
| | | ||||||
| * | Giving the Spark EC2 script the ability to launch instances spread | Peter Sankauskas | 2012-11-16 | 1 | -22/+58 | |
| | | | | | | | | | | across multiple availability zones in order to make the cluster more resilient to failure | |||||
* | | Delete security groups when deleting the cluster. As many operations | Peter Sankauskas | 2012-11-16 | 1 | -0/+14 | |
|/ | | | | are done on instances in specific security groups, this seems like a reasonable thing to clean up. | |||||
* | Fix check for existing instances during EC2 launch. | Josh Rosen | 2012-11-03 | 1 | -10/+6 | |
| | ||||||
* | Cancel spot instance requests when exiting spark-ec2. | Josh Rosen | 2012-10-30 | 1 | -21/+31 | |
| | ||||||
* | Allow EC2 script to stop/destroy cluster after master/slave failures. | Josh Rosen | 2012-10-18 | 1 | -4/+5 | |
| | ||||||
* | Update EC2 scripts for Spark 0.6 | Matei Zaharia | 2012-10-12 | 2 | -15/+12 | |
| | ||||||
* | Add m1.medium node option to cluster management script. | Ray Racine | 2012-10-09 | 1 | -0/+1 | |
| | ||||||
* | Made region used by spark-ec2 configurable. | Matei Zaharia | 2012-08-28 | 1 | -2/+4 | |
| | ||||||
* | Use root login in standalone AMI | Denny | 2012-08-14 | 1 | -1/+1 | |
| | ||||||
* | rsync root directory in EC2 script | Denny | 2012-08-14 | 1 | -1/+1 | |
| | ||||||
* | Removed separate launcher for EC2 standalone cluster | Matei Zaharia | 2012-08-09 | 1 | -20/+0 | |
| | ||||||
* | Merged standalone and mesos EC2 scripts | Denny | 2012-08-02 | 3 | -516/+57 | |
| | ||||||
* | Spark standalone mode cluster scripts. | Denny | 2012-08-01 | 2 | -0/+511 | |
| | | | | Heavily inspired by Hadoop cluster scripts ;-) | |||||
* | Increase the default wait time for EC2 clusters to 2 minutes. | Matei Zaharia | 2012-06-29 | 1 | -2/+2 | |
| | ||||||
* | Added script for launching Spark on EC2 from Mesos, to make it easier | Matei Zaharia | 2012-06-10 | 5 | -0/+571 | |
for new users to get up and running on EC2. |