diff options
| author | Andrew Ash <andrew@andrewash.com> | 2014-11-14 13:33:35 -0800 |
|---|---|---|
| committer | Andrew Or <andrew@databricks.com> | 2014-11-14 13:33:35 -0800 |
| commit | 5c265ccde0c5594899ec61f9c1ea100ddff52da7 (patch) | |
| tree | 4490f9dd7900c980bf47bb7ad090e359fc57e4e8 /conf/spark-env.sh.template | |
| parent | 0c56a039a9c5b871422f0fc55ff4394bc077fb34 (diff) | |
| download | spark-5c265ccde0c5594899ec61f9c1ea100ddff52da7.tar.gz spark-5c265ccde0c5594899ec61f9c1ea100ddff52da7.tar.bz2 spark-5c265ccde0c5594899ec61f9c1ea100ddff52da7.zip | |
SPARK-3663 Document SPARK_LOG_DIR and SPARK_PID_DIR
These descriptions are from the header of spark-daemon.sh
Author: Andrew Ash <andrew@andrewash.com>
Closes #2518 from ash211/SPARK-3663 and squashes the following commits:
058b257 [Andrew Ash] Complete hanging clause in SPARK_PID_DIR description
a17cb4b [Andrew Ash] Update docs for default locations per SPARK-4110
af89096 [Andrew Ash] SPARK-3663 Document SPARK_LOG_DIR and SPARK_PID_DIR
Diffstat (limited to 'conf/spark-env.sh.template')
| -rwxr-xr-x | conf/spark-env.sh.template | 9 |
1 files changed, 8 insertions, 1 deletions
diff --git a/conf/spark-env.sh.template b/conf/spark-env.sh.template index f8ffbf6427..0886b0276f 100755 --- a/conf/spark-env.sh.template +++ b/conf/spark-env.sh.template @@ -28,7 +28,7 @@ # - SPARK_YARN_DIST_FILES, Comma separated list of files to be distributed with the job. # - SPARK_YARN_DIST_ARCHIVES, Comma separated list of archives to be distributed with the job. -# Options for the daemons used in the standalone deploy mode: +# Options for the daemons used in the standalone deploy mode # - SPARK_MASTER_IP, to bind the master to a different IP address or hostname # - SPARK_MASTER_PORT / SPARK_MASTER_WEBUI_PORT, to use non-default ports for the master # - SPARK_MASTER_OPTS, to set config properties only for the master (e.g. "-Dx=y") @@ -41,3 +41,10 @@ # - SPARK_HISTORY_OPTS, to set config properties only for the history server (e.g. "-Dx=y") # - SPARK_DAEMON_JAVA_OPTS, to set config properties for all daemons (e.g. "-Dx=y") # - SPARK_PUBLIC_DNS, to set the public dns name of the master or workers + +# Generic options for the daemons used in the standalone deploy mode +# - SPARK_CONF_DIR Alternate conf dir. (Default: ${SPARK_HOME}/conf) +# - SPARK_LOG_DIR Where log files are stored. (Default: ${SPARK_HOME}/logs) +# - SPARK_PID_DIR Where the pid file is stored. (Default: /tmp) +# - SPARK_IDENT_STRING A string representing this instance of spark. (Default: $USER) +# - SPARK_NICENESS The scheduling priority for daemons. (Default: 0) |