diff options
author | Vida Ha <vida@databricks.com> | 2014-08-19 13:35:05 -0700 |
---|---|---|
committer | Josh Rosen <joshrosen@apache.org> | 2014-08-19 13:35:22 -0700 |
commit | c3952b092a2f7fea4798f4cb7abac300b9dc9c29 (patch) | |
tree | a8cf3436d509f4c028f7b97d4d45b385d31c8a4f /docs | |
parent | 04a32086212452d3488e12dd64ffa18af0243345 (diff) | |
download | spark-c3952b092a2f7fea4798f4cb7abac300b9dc9c29.tar.gz spark-c3952b092a2f7fea4798f4cb7abac300b9dc9c29.tar.bz2 spark-c3952b092a2f7fea4798f4cb7abac300b9dc9c29.zip |
SPARK-2333 - spark_ec2 script should allow option for existing security group
- Uses the name tag to identify machines in a cluster.
- Allows overriding the security group name so it doesn't need to coincide with the cluster name.
- Outputs the request id's of up to 10 pending spot instance requests.
Author: Vida Ha <vida@databricks.com>
Closes #1899 from vidaha/vida/ec2-reuse-security-group and squashes the following commits:
c80d5c3 [Vida Ha] wrap retries in a try catch block
b2989d5 [Vida Ha] SPARK-2333: spark_ec2 script should allow option for existing security group
(cherry picked from commit 94053a7b766788bb62e2dbbf352ccbcc75f71fc0)
Signed-off-by: Josh Rosen <joshrosen@apache.org>
Diffstat (limited to 'docs')
-rw-r--r-- | docs/ec2-scripts.md | 14 |
1 files changed, 8 insertions, 6 deletions
diff --git a/docs/ec2-scripts.md b/docs/ec2-scripts.md index 156a727026..f5ac6d894e 100644 --- a/docs/ec2-scripts.md +++ b/docs/ec2-scripts.md @@ -12,14 +12,16 @@ on the [Amazon Web Services site](http://aws.amazon.com/). `spark-ec2` is designed to manage multiple named clusters. You can launch a new cluster (telling the script its size and giving it a name), -shutdown an existing cluster, or log into a cluster. Each cluster is -identified by placing its machines into EC2 security groups whose names -are derived from the name of the cluster. For example, a cluster named +shutdown an existing cluster, or log into a cluster. Each cluster +launches a set of instances, which are tagged with the cluster name, +and placed into EC2 security groups. If you don't specify a security +group, the `spark-ec2` script will create security groups based on the +cluster name you request. For example, a cluster named `test` will contain a master node in a security group called `test-master`, and a number of slave nodes in a security group called -`test-slaves`. The `spark-ec2` script will create these security groups -for you based on the cluster name you request. You can also use them to -identify machines belonging to each cluster in the Amazon EC2 Console. +`test-slaves`. You can also specify a security group prefix to be used +in place of the cluster name. Machines in a cluster can be identified +by looking for the "Name" tag of the instance in the Amazon EC2 Console. # Before You Start |