diff options
| author | Vida Ha <vida@databricks.com> | 2014-08-19 13:35:05 -0700 |
|---|---|---|
| committer | Josh Rosen <joshrosen@apache.org> | 2014-08-19 13:35:05 -0700 |
| commit | 94053a7b766788bb62e2dbbf352ccbcc75f71fc0 (patch) | |
| tree | c18c3cee807527cee9e8d3985ca21dbf748cbd90 /docs/ec2-scripts.md | |
| parent | 31f0b071efd0b63eb9d6a6a131e5c4fa28237583 (diff) | |
| download | spark-94053a7b766788bb62e2dbbf352ccbcc75f71fc0.tar.gz spark-94053a7b766788bb62e2dbbf352ccbcc75f71fc0.tar.bz2 spark-94053a7b766788bb62e2dbbf352ccbcc75f71fc0.zip | |
SPARK-2333 - spark_ec2 script should allow option for existing security group
- Uses the name tag to identify machines in a cluster.
- Allows overriding the security group name so it doesn't need to coincide with the cluster name.
- Outputs the request id's of up to 10 pending spot instance requests.
Author: Vida Ha <vida@databricks.com>
Closes #1899 from vidaha/vida/ec2-reuse-security-group and squashes the following commits:
c80d5c3 [Vida Ha] wrap retries in a try catch block
b2989d5 [Vida Ha] SPARK-2333: spark_ec2 script should allow option for existing security group
Diffstat (limited to 'docs/ec2-scripts.md')
| -rw-r--r-- | docs/ec2-scripts.md | 14 |
1 files changed, 8 insertions, 6 deletions
diff --git a/docs/ec2-scripts.md b/docs/ec2-scripts.md index 156a727026..f5ac6d894e 100644 --- a/docs/ec2-scripts.md +++ b/docs/ec2-scripts.md @@ -12,14 +12,16 @@ on the [Amazon Web Services site](http://aws.amazon.com/). `spark-ec2` is designed to manage multiple named clusters. You can launch a new cluster (telling the script its size and giving it a name), -shutdown an existing cluster, or log into a cluster. Each cluster is -identified by placing its machines into EC2 security groups whose names -are derived from the name of the cluster. For example, a cluster named +shutdown an existing cluster, or log into a cluster. Each cluster +launches a set of instances, which are tagged with the cluster name, +and placed into EC2 security groups. If you don't specify a security +group, the `spark-ec2` script will create security groups based on the +cluster name you request. For example, a cluster named `test` will contain a master node in a security group called `test-master`, and a number of slave nodes in a security group called -`test-slaves`. The `spark-ec2` script will create these security groups -for you based on the cluster name you request. You can also use them to -identify machines belonging to each cluster in the Amazon EC2 Console. +`test-slaves`. You can also specify a security group prefix to be used +in place of the cluster name. Machines in a cluster can be identified +by looking for the "Name" tag of the instance in the Amazon EC2 Console. # Before You Start |