aboutsummaryrefslogtreecommitdiff
path: root/sbin/start-master.sh
diff options
context:
space:
mode:
authorCodingCat <zhunansjtu@gmail.com>2014-02-22 20:21:15 -0800
committerShivaram Venkataraman <shivaram@eecs.berkeley.edu>2014-02-22 20:21:15 -0800
commit437b62fcb03cc84c6581eb667ddbddd817f7f9f0 (patch)
treef3fb5bb510d8f1a71f04976aef1a153bff5867c1 /sbin/start-master.sh
parent29ac7ea52fbb0c6531e14305e2fb1ccba9678f7e (diff)
downloadspark-437b62fcb03cc84c6581eb667ddbddd817f7f9f0.tar.gz
spark-437b62fcb03cc84c6581eb667ddbddd817f7f9f0.tar.bz2
spark-437b62fcb03cc84c6581eb667ddbddd817f7f9f0.zip
[SPARK-1041] remove dead code in start script, remind user to set that in spark-env.sh
the lines in start-master.sh and start-slave.sh no longer work in ec2, the host name has changed, e.g. ubuntu@ip-172-31-36-93:~$ hostname ip-172-31-36-93 also, the URL to fetch public DNS name also changed, e.g. ubuntu@ip-172-31-36-93:~$ wget -q -O - http://instance-data.ec2.internal/latest/meta-data/public-hostname ubuntu@ip-172-31-36-93:~$ (returns nothing) since we have spark-ec2 project, we don't need to have such ec2-specific lines here, instead, user only need to set in spark-env.sh Author: CodingCat <zhunansjtu@gmail.com> Closes #588 from CodingCat/deadcode_in_sbin and squashes the following commits: e4236e0 [CodingCat] remove dead code in start script, remind user set that in spark-env.sh
Diffstat (limited to 'sbin/start-master.sh')
-rwxr-xr-xsbin/start-master.sh9
1 files changed, 0 insertions, 9 deletions
diff --git a/sbin/start-master.sh b/sbin/start-master.sh
index 3dcf7cc348..ec3dfdb419 100755
--- a/sbin/start-master.sh
+++ b/sbin/start-master.sh
@@ -40,13 +40,4 @@ if [ "$SPARK_MASTER_WEBUI_PORT" = "" ]; then
SPARK_MASTER_WEBUI_PORT=8080
fi
-# Set SPARK_PUBLIC_DNS so the master report the correct webUI address to the slaves
-if [ "$SPARK_PUBLIC_DNS" = "" ]; then
- # If we appear to be running on EC2, use the public address by default:
- # NOTE: ec2-metadata is installed on Amazon Linux AMI. Check based on that and hostname
- if command -v ec2-metadata > /dev/null || [[ `hostname` == *ec2.internal ]]; then
- export SPARK_PUBLIC_DNS=`wget -q -O - http://instance-data.ec2.internal/latest/meta-data/public-hostname`
- fi
-fi
-
"$sbin"/spark-daemon.sh start org.apache.spark.deploy.master.Master 1 --ip $SPARK_MASTER_IP --port $SPARK_MASTER_PORT --webui-port $SPARK_MASTER_WEBUI_PORT