diff options
author | Josh Rosen <joshrosen@apache.org> | 2014-09-29 23:36:10 -0700 |
---|---|---|
committer | Andrew Or <andrewor14@gmail.com> | 2014-09-29 23:36:10 -0700 |
commit | b167a8c7e75d9e816784bd655bce1feb6c447210 (patch) | |
tree | 2cb55f5434ab854814e8b3d044739b5de457407a /examples | |
parent | de700d31778eb68807183cf32be8034abdc0120e (diff) | |
download | spark-b167a8c7e75d9e816784bd655bce1feb6c447210.tar.gz spark-b167a8c7e75d9e816784bd655bce1feb6c447210.tar.bz2 spark-b167a8c7e75d9e816784bd655bce1feb6c447210.zip |
[SPARK-3734] DriverRunner should not read SPARK_HOME from submitter's environment
When using spark-submit in `cluster` mode to submit a job to a Spark Standalone
cluster, if the JAVA_HOME environment variable was set on the submitting
machine then DriverRunner would attempt to use the submitter's JAVA_HOME to
launch the driver process (instead of the worker's JAVA_HOME), causing the
driver to fail unless the submitter and worker had the same Java location.
This commit fixes this by reading JAVA_HOME from sys.env instead of
command.environment.
Author: Josh Rosen <joshrosen@apache.org>
Closes #2586 from JoshRosen/SPARK-3734 and squashes the following commits:
e9513d9 [Josh Rosen] [SPARK-3734] DriverRunner should not read SPARK_HOME from submitter's environment.
Diffstat (limited to 'examples')
0 files changed, 0 insertions, 0 deletions