aboutsummaryrefslogtreecommitdiff
path: root/conf
diff options
context:
space:
mode:
authorkalpit <shahkalpit84@gmail.com>2013-03-06 18:06:32 -0800
committerkalpit <shahkalpit84@gmail.com>2013-03-26 17:49:30 -0700
commitf08db010d3ba4eff132f5c06a087b0c7c2e58576 (patch)
tree6b08dfbbcb05594b7ce2d712d33e105bf9bd214c /conf
parentf0164e5047f3a023768cdf0515a7a7d1c75ef7c3 (diff)
downloadspark-f08db010d3ba4eff132f5c06a087b0c7c2e58576.tar.gz
spark-f08db010d3ba4eff132f5c06a087b0c7c2e58576.tar.bz2
spark-f08db010d3ba4eff132f5c06a087b0c7c2e58576.zip
added SPARK_WORKER_INSTANCES : allows spawning multiple worker instances/processes on every slave machine
Diffstat (limited to 'conf')
-rwxr-xr-xconf/spark-env.sh.template1
1 files changed, 1 insertions, 0 deletions
diff --git a/conf/spark-env.sh.template b/conf/spark-env.sh.template
index 6d71ec5691..37565ca827 100755
--- a/conf/spark-env.sh.template
+++ b/conf/spark-env.sh.template
@@ -12,6 +12,7 @@
# - SPARK_WORKER_CORES, to set the number of cores to use on this machine
# - SPARK_WORKER_MEMORY, to set how much memory to use (e.g. 1000m, 2g)
# - SPARK_WORKER_PORT / SPARK_WORKER_WEBUI_PORT
+# - SPARK_WORKER_INSTANCES, to set the number of worker instances/processes to be spawned on every slave machine
#
# Finally, Spark also relies on the following variables, but these can be set
# on just the *master* (i.e. in your driver program), and will automatically