From c3816de5040e3c48e58ed4762d2f4eb606812938 Mon Sep 17 00:00:00 2001 From: Patrick Wendell Date: Mon, 13 Jan 2014 13:24:04 -0800 Subject: Changing option wording per discussion with Andrew --- docs/configuration.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) (limited to 'docs') diff --git a/docs/configuration.md b/docs/configuration.md index 350e3145c0..be06bd19be 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -116,7 +116,7 @@ Apart from these, the following properties are also available, and may be useful 0.3 Fraction of Java heap to use for aggregation and cogroups during shuffles, if - spark.shuffle.external is true. At any given time, the collective size of + spark.shuffle.spill is true. At any given time, the collective size of all in-memory maps used for shuffles is bounded by this limit, beyond which the contents will begin to spill to disk. If spills are often, consider increasing this value at the expense of spark.storage.memoryFraction. @@ -155,7 +155,7 @@ Apart from these, the following properties are also available, and may be useful - spark.shuffle.external.compress + spark.shuffle.spill.compress false Whether to compress data spilled during shuffles. @@ -395,7 +395,7 @@ Apart from these, the following properties are also available, and may be useful - spark.shuffle.external + spark.shuffle.spill true If set to "true", limits the amount of memory used during reduces by spilling data out to disk. This spilling -- cgit v1.2.3