diff options
| author | Nicholas Chammas <nicholas.chammas@gmail.com> | 2015-02-10 15:45:38 +0000 |
|---|---|---|
| committer | Sean Owen <sowen@cloudera.com> | 2015-02-10 15:45:38 +0000 |
| commit | 50820f15277187e8522520a3ecae412abbdb4397 (patch) | |
| tree | fc0f85a31ff47102db35cbfda5434f3a04588708 /sbt | |
| parent | ba667935f8670293f10b8bbe1e317b28d00f9875 (diff) | |
| download | spark-50820f15277187e8522520a3ecae412abbdb4397.tar.gz spark-50820f15277187e8522520a3ecae412abbdb4397.tar.bz2 spark-50820f15277187e8522520a3ecae412abbdb4397.zip | |
[SPARK-1805] [EC2] Validate instance types
Addresses [SPARK-1805](https://issues.apache.org/jira/browse/SPARK-1805), though doesn't resolve it completely.
Error out quickly if the user asks for the master and slaves to have different AMI virtualization types, since we don't currently support that.
In addition to that, we print warnings if the inputted instance types are not recognized, though I would prefer if we errored out. Elsewhere in the script it seems [we allow unrecognized instance types](https://github.com/apache/spark/blob/5de14cc2763a8211f77eeb55940dec025822eb78/ec2/spark_ec2.py#L331), though I think we should remove that.
It's messy, but it should serve us until we enhance spark-ec2 to support clusters with mixed virtualization types.
Author: Nicholas Chammas <nicholas.chammas@gmail.com>
Closes #4455 from nchammas/ec2-master-slave-different-virtualization and squashes the following commits:
ce28609 [Nicholas Chammas] fix style
b0adba0 [Nicholas Chammas] validate input instance types
Diffstat (limited to 'sbt')
0 files changed, 0 insertions, 0 deletions