diff options
| author | Jongyoul Lee <jongyoul@gmail.com> | 2015-01-19 02:01:56 -0800 |
|---|---|---|
| committer | Patrick Wendell <patrick@databricks.com> | 2015-01-19 02:01:56 -0800 |
| commit | 4a4f9ccba2b42b64356db7f94ed9019212fc7317 (patch) | |
| tree | 2e5d3fdec12850b5cc845018d1f416c560aae325 /bin | |
| parent | 3453d578ad9933be6881488c8ca3611e5b686af9 (diff) | |
| download | spark-4a4f9ccba2b42b64356db7f94ed9019212fc7317.tar.gz spark-4a4f9ccba2b42b64356db7f94ed9019212fc7317.tar.bz2 spark-4a4f9ccba2b42b64356db7f94ed9019212fc7317.zip | |
[SPARK-5088] Use spark-class for running executors directly
Author: Jongyoul Lee <jongyoul@gmail.com>
Closes #3897 from jongyoul/SPARK-5088 and squashes the following commits:
8232aa8 [Jongyoul Lee] [SPARK-5088] Use spark-class for running executors directly - Added a listenerBus for fixing test cases
932289f [Jongyoul Lee] [SPARK-5088] Use spark-class for running executors directly - Rebased from master
613cb47 [Jongyoul Lee] [SPARK-5088] Use spark-class for running executors directly - Fixed code if spark.executor.uri doesn't have any value - Added test cases
ff57bda [Jongyoul Lee] [SPARK-5088] Use spark-class for running executors directly - Adjusted orders of import
97e4bd4 [Jongyoul Lee] [SPARK-5088] Use spark-class for running executors directly - Changed command for using spark-class directly - Delete sbin/spark-executor and moved some codes into spark-class' case statement
Diffstat (limited to 'bin')
| -rwxr-xr-x | bin/spark-class | 2 |
1 files changed, 2 insertions, 0 deletions
diff --git a/bin/spark-class b/bin/spark-class index 79af42c72c..1b945461fa 100755 --- a/bin/spark-class +++ b/bin/spark-class @@ -71,6 +71,8 @@ case "$1" in 'org.apache.spark.executor.MesosExecutorBackend') OUR_JAVA_OPTS="$SPARK_JAVA_OPTS $SPARK_EXECUTOR_OPTS" OUR_JAVA_MEM=${SPARK_EXECUTOR_MEMORY:-$DEFAULT_MEM} + export PYTHONPATH="$FWDIR/python:$PYTHONPATH" + export PYTHONPATH="$FWDIR/python/lib/py4j-0.8.2.1-src.zip:$PYTHONPATH" ;; # Spark submit uses SPARK_JAVA_OPTS + SPARK_SUBMIT_OPTS + |