aboutsummaryrefslogtreecommitdiff
path: root/ec2
Commit message (Collapse)AuthorAgeFilesLines
* Consistently invoke bash with /usr/bin/env bash in scripts to make code more ↵Ubuntu2013-07-182-2/+2
| | | | portable (JIRA Ticket SPARK-817)
* Add Apache license headers and LICENSE and NOTICE filesMatei Zaharia2013-07-162-0/+4
|
* Fix SPARK-670: EC2 start command should require -i option.Josh Rosen2013-05-051-1/+1
|
* Just use a loop for retriesHolden Karau2013-04-092-50/+17
|
* Retry failed ssh commands. This is especially useful during system startup ↵Holden Karau2013-04-062-0/+46
| | | | when the hosts may not have yet come on-line but can be useful at other points for people with flakey connections
* Use new Spark EC2 scripts by defaultv0.7.0Matei Zaharia2013-02-262-8/+8
|
* Print cluster url after setup completesShivaram Venkataraman2013-02-181-0/+5
|
* Print ganglia url after setupShivaram Venkataraman2013-02-181-0/+2
|
* Use port 5080 for httpd/gangliaShivaram Venkataraman2013-02-181-1/+1
|
* Clean up EC2 script options a bitMatei Zaharia2013-02-171-9/+12
|
* Change EC2 script to use 0.6 AMIs by default, for nowMatei Zaharia2013-02-171-5/+5
|
* Turn on ganglia by defaultShivaram Venkataraman2013-01-311-1/+1
|
* Add an option to use the old scriptsShivaram Venkataraman2013-01-281-13/+30
|
* Add option to start ganglia. Also enable Hadoop ports even if cluster type isShivaram Venkataraman2013-01-271-8/+15
| | | | not mesos
* Fix swap variable nameShivaram Venkataraman2013-01-271-1/+1
|
* Update spark_ec2.py to use new spark-ec2 scriptsShivaram Venkataraman2013-01-262-12/+32
|
* Merge pull request #323 from admobius/masterMatei Zaharia2012-12-111-23/+55
|\ | | | | SPARK-626: Remove security groups properly
| * SPARK-626: Making security group deletion optional, handling retriedPeter Sankauskas2012-12-111-27/+55
| | | | | | | | when deleting security groups fails, fixing bug when using all zones but only 1 slave.
| * SPARK-626: Remove rules before removing security groups, with a pause inPeter Sankauskas2012-12-101-11/+15
| | | | | | between so wait for AWS eventual consistency to catch up.
* | Make sure the SSH key we copy to EC2 has permissions 600.Matei Zaharia2012-12-101-0/+1
|/ | | | SPARK-539 #resolve
* Merge pull request #309 from admobius/use-boto-config-fileMatei Zaharia2012-11-191-11/+20
|\ | | | | Improved use of Boto
| * Allow Boto to use the other config options it supports, and gracefullyPeter Sankauskas2012-11-191-11/+20
| | | | | | handling Boto connection exceptions (like AuthFailure)
* | Merge pull request #308 from admobius/multi-zoneMatei Zaharia2012-11-191-22/+59
|\ \ | |/ |/| Let EC2 script launch slaves in multiple availability zones
| * Adding comment about additional bandwidth chargesPeter Sankauskas2012-11-171-1/+2
| |
| * Giving the Spark EC2 script the ability to launch instances spreadPeter Sankauskas2012-11-161-22/+58
| | | | | | | | | | across multiple availability zones in order to make the cluster more resilient to failure
* | Delete security groups when deleting the cluster. As many operationsPeter Sankauskas2012-11-161-0/+14
|/ | | | are done on instances in specific security groups, this seems like a reasonable thing to clean up.
* Fix check for existing instances during EC2 launch.Josh Rosen2012-11-031-10/+6
|
* Cancel spot instance requests when exiting spark-ec2.Josh Rosen2012-10-301-21/+31
|
* Allow EC2 script to stop/destroy cluster after master/slave failures.Josh Rosen2012-10-181-4/+5
|
* Update EC2 scripts for Spark 0.6Matei Zaharia2012-10-122-15/+12
|
* Add m1.medium node option to cluster management script.Ray Racine2012-10-091-0/+1
|
* Made region used by spark-ec2 configurable.Matei Zaharia2012-08-281-2/+4
|
* Use root login in standalone AMIDenny2012-08-141-1/+1
|
* rsync root directory in EC2 scriptDenny2012-08-141-1/+1
|
* Removed separate launcher for EC2 standalone clusterMatei Zaharia2012-08-091-20/+0
|
* Merged standalone and mesos EC2 scriptsDenny2012-08-023-516/+57
|
* Spark standalone mode cluster scripts.Denny2012-08-012-0/+511
| | | | Heavily inspired by Hadoop cluster scripts ;-)
* Increase the default wait time for EC2 clusters to 2 minutes.Matei Zaharia2012-06-291-2/+2
|
* Added script for launching Spark on EC2 from Mesos, to make it easierMatei Zaharia2012-06-105-0/+571
for new users to get up and running on EC2.