diff options
| author | GenTang <gen.tang86@gmail.com> | 2015-02-06 13:27:34 -0800 |
|---|---|---|
| committer | Josh Rosen <joshrosen@databricks.com> | 2015-02-06 13:27:40 -0800 |
| commit | 0f3a36071a44e986d97981032d5b192477b38bbd (patch) | |
| tree | 9033e18cbb62360305149393e2f1c53847e30bde /ec2/spark_ec2.py | |
| parent | 3d3ecd77411bfdd1c72be51616c46a6caf839be2 (diff) | |
| download | spark-0f3a36071a44e986d97981032d5b192477b38bbd.tar.gz spark-0f3a36071a44e986d97981032d5b192477b38bbd.tar.bz2 spark-0f3a36071a44e986d97981032d5b192477b38bbd.zip | |
[SPARK-4983] Insert waiting time before tagging EC2 instances
The boto API doesn't support tag EC2 instances in the same call that launches them.
We add a five-second wait so EC2 has enough time to propagate the information so that
the tagging can succeed.
Author: GenTang <gen.tang86@gmail.com>
Author: Gen TANG <gen.tang86@gmail.com>
Closes #3986 from GenTang/spark-4983 and squashes the following commits:
13e257d [Gen TANG] modification of comments
47f06755 [GenTang] print the information
ab7a931 [GenTang] solve the issus spark-4983 by inserting waiting time
3179737 [GenTang] Revert "handling exceptions about adding tags to ec2"
6a8b53b [GenTang] Revert "the improvement of exception handling"
13e97a6 [GenTang] Revert "typo"
63fd360 [GenTang] typo
692fc2b [GenTang] the improvement of exception handling
6adcf6d [GenTang] handling exceptions about adding tags to ec2
Diffstat (limited to 'ec2/spark_ec2.py')
| -rwxr-xr-x | ec2/spark_ec2.py | 3 |
1 files changed, 3 insertions, 0 deletions
diff --git a/ec2/spark_ec2.py b/ec2/spark_ec2.py index 0de4a62e20..7371558274 100755 --- a/ec2/spark_ec2.py +++ b/ec2/spark_ec2.py @@ -569,6 +569,9 @@ def launch_cluster(conn, opts, cluster_name): master_nodes = master_res.instances print "Launched master in %s, regid = %s" % (zone, master_res.id) + # This wait time corresponds to SPARK-4983 + print "Waiting for AWS to propagate instance metadata..." + time.sleep(5) # Give the instances descriptive names for master in master_nodes: master.add_tag( |