aboutsummaryrefslogtreecommitdiff
diff options
context:
space:
mode:
authorMaurus Cuelenaere <mcuelenaere@gmail.com>2017-01-15 11:14:50 +0000
committerSean Owen <sowen@cloudera.com>2017-01-15 11:14:50 +0000
commit3df2d93146a4609c1c4a25b635a898fe5c3be9b6 (patch)
treedc99561bbe1433a4ca1f16507c1cc36177f97386
parentc9d612f82c290fc955cae93150ca5c5d74f12217 (diff)
downloadspark-3df2d93146a4609c1c4a25b635a898fe5c3be9b6.tar.gz
spark-3df2d93146a4609c1c4a25b635a898fe5c3be9b6.tar.bz2
spark-3df2d93146a4609c1c4a25b635a898fe5c3be9b6.zip
[MINOR][DOC] Document local[*,F] master modes
## What changes were proposed in this pull request? core/src/main/scala/org/apache/spark/SparkContext.scala contains LOCAL_N_FAILURES_REGEX master mode, but this was never documented, so do so. ## How was this patch tested? By using the Github Markdown preview feature. Author: Maurus Cuelenaere <mcuelenaere@gmail.com> Closes #16562 from mcuelenaere/patch-1.
-rw-r--r--docs/submitting-applications.md2
1 files changed, 2 insertions, 0 deletions
diff --git a/docs/submitting-applications.md b/docs/submitting-applications.md
index b738194eac..b8b4cc3a53 100644
--- a/docs/submitting-applications.md
+++ b/docs/submitting-applications.md
@@ -137,7 +137,9 @@ The master URL passed to Spark can be in one of the following formats:
<tr><th>Master URL</th><th>Meaning</th></tr>
<tr><td> <code>local</code> </td><td> Run Spark locally with one worker thread (i.e. no parallelism at all). </td></tr>
<tr><td> <code>local[K]</code> </td><td> Run Spark locally with K worker threads (ideally, set this to the number of cores on your machine). </td></tr>
+<tr><td> <code>local[K,F]</code> </td><td> Run Spark locally with K worker threads and F maxFailures (see <a href="configuration.html#scheduling">spark.task.maxFailures</a> for an explanation of this variable) </td></tr>
<tr><td> <code>local[*]</code> </td><td> Run Spark locally with as many worker threads as logical cores on your machine.</td></tr>
+<tr><td> <code>local[*,F]</code> </td><td> Run Spark locally with as many worker threads as logical cores on your machine and F maxFailures.</td></tr>
<tr><td> <code>spark://HOST:PORT</code> </td><td> Connect to the given <a href="spark-standalone.html">Spark standalone
cluster</a> master. The port must be whichever one your master is configured to use, which is 7077 by default.
</td></tr>