aboutsummaryrefslogtreecommitdiff
path: root/docs/configuration.md
diff options
context:
space:
mode:
authorPatrick Wendell <pwendell@gmail.com>2014-01-13 13:24:04 -0800
committerPatrick Wendell <pwendell@gmail.com>2014-01-13 13:25:06 -0800
commitc3816de5040e3c48e58ed4762d2f4eb606812938 (patch)
tree9fe23220986be4ac1a404168f4839a4c6948e99b /docs/configuration.md
parent5d61e051c2ad5955f0101de6f0ecdf5d243e4f5e (diff)
downloadspark-c3816de5040e3c48e58ed4762d2f4eb606812938.tar.gz
spark-c3816de5040e3c48e58ed4762d2f4eb606812938.tar.bz2
spark-c3816de5040e3c48e58ed4762d2f4eb606812938.zip
Changing option wording per discussion with Andrew
Diffstat (limited to 'docs/configuration.md')
-rw-r--r--docs/configuration.md6
1 files changed, 3 insertions, 3 deletions
diff --git a/docs/configuration.md b/docs/configuration.md
index 350e3145c0..be06bd19be 100644
--- a/docs/configuration.md
+++ b/docs/configuration.md
@@ -116,7 +116,7 @@ Apart from these, the following properties are also available, and may be useful
<td>0.3</td>
<td>
Fraction of Java heap to use for aggregation and cogroups during shuffles, if
- <code>spark.shuffle.external</code> is true. At any given time, the collective size of
+ <code>spark.shuffle.spill</code> is true. At any given time, the collective size of
all in-memory maps used for shuffles is bounded by this limit, beyond which the contents will
begin to spill to disk. If spills are often, consider increasing this value at the expense of
<code>spark.storage.memoryFraction</code>.
@@ -155,7 +155,7 @@ Apart from these, the following properties are also available, and may be useful
</td>
</tr>
<tr>
- <td>spark.shuffle.external.compress</td>
+ <td>spark.shuffle.spill.compress</td>
<td>false</td>
<td>
Whether to compress data spilled during shuffles.
@@ -395,7 +395,7 @@ Apart from these, the following properties are also available, and may be useful
</td>
</tr>
<tr>
- <td>spark.shuffle.external</td>
+ <td>spark.shuffle.spill</td>
<td>true</td>
<td>
If set to "true", limits the amount of memory used during reduces by spilling data out to disk. This spilling