diff options
| author | Patrick Wendell <pwendell@gmail.com> | 2014-04-28 17:29:22 -0700 |
|---|---|---|
| committer | Patrick Wendell <pwendell@gmail.com> | 2014-04-28 17:29:22 -0700 |
| commit | 949e393101e19cd00591a9930c4b364278e22609 (patch) | |
| tree | dcfa2c2337d25df917486f7f75771718a371055f /bin/spark-submit | |
| parent | cae054aaf41ca0ee585231896db67169b61af689 (diff) | |
| download | spark-949e393101e19cd00591a9930c4b364278e22609.tar.gz spark-949e393101e19cd00591a9930c4b364278e22609.tar.bz2 spark-949e393101e19cd00591a9930c4b364278e22609.zip | |
SPARK-1654 and SPARK-1653: Fixes in spark-submit.
Deals with two issues:
1. Spark shell didn't correctly pass quoted arguments to spark-submit.
```./bin/spark-shell --driver-java-options "-Dfoo=f -Dbar=b"```
2. Spark submit used deprecated environment variables (SPARK_CLASSPATH)
which triggered warnings. Now we use new, more narrowly scoped,
variables.
Author: Patrick Wendell <pwendell@gmail.com>
Closes #576 from pwendell/spark-submit and squashes the following commits:
67004c9 [Patrick Wendell] SPARK-1654 and SPARK-1653: Fixes in spark-submit.
Diffstat (limited to 'bin/spark-submit')
| -rwxr-xr-x | bin/spark-submit | 6 |
1 files changed, 3 insertions, 3 deletions
diff --git a/bin/spark-submit b/bin/spark-submit index b2a1dca721..dd0d95d9d4 100755 --- a/bin/spark-submit +++ b/bin/spark-submit @@ -26,11 +26,11 @@ while (($#)); do elif [ "$1" = "--driver-memory" ]; then DRIVER_MEMORY=$2 elif [ "$1" = "--driver-library-path" ]; then - export _SPARK_LIBRARY_PATH=$2 + export SPARK_SUBMIT_LIBRARY_PATH=$2 elif [ "$1" = "--driver-class-path" ]; then - export SPARK_CLASSPATH="$SPARK_CLASSPATH:$2" + export SPARK_SUBMIT_CLASSPATH=$2 elif [ "$1" = "--driver-java-options" ]; then - export SPARK_JAVA_OPTS="$SPARK_JAVA_OPTS $2" + export SPARK_SUBMIT_OPTS=$2 fi shift done |