diff options
| author | Josh Rosen <joshrosen@apache.org> | 2014-09-29 23:36:10 -0700 |
|---|---|---|
| committer | Andrew Or <andrewor14@gmail.com> | 2014-09-29 23:36:10 -0700 |
| commit | b167a8c7e75d9e816784bd655bce1feb6c447210 (patch) | |
| tree | 2cb55f5434ab854814e8b3d044739b5de457407a /sql | |
| parent | de700d31778eb68807183cf32be8034abdc0120e (diff) | |
| download | spark-b167a8c7e75d9e816784bd655bce1feb6c447210.tar.gz spark-b167a8c7e75d9e816784bd655bce1feb6c447210.tar.bz2 spark-b167a8c7e75d9e816784bd655bce1feb6c447210.zip | |
[SPARK-3734] DriverRunner should not read SPARK_HOME from submitter's environment
When using spark-submit in `cluster` mode to submit a job to a Spark Standalone
cluster, if the JAVA_HOME environment variable was set on the submitting
machine then DriverRunner would attempt to use the submitter's JAVA_HOME to
launch the driver process (instead of the worker's JAVA_HOME), causing the
driver to fail unless the submitter and worker had the same Java location.
This commit fixes this by reading JAVA_HOME from sys.env instead of
command.environment.
Author: Josh Rosen <joshrosen@apache.org>
Closes #2586 from JoshRosen/SPARK-3734 and squashes the following commits:
e9513d9 [Josh Rosen] [SPARK-3734] DriverRunner should not read SPARK_HOME from submitter's environment.
Diffstat (limited to 'sql')
0 files changed, 0 insertions, 0 deletions