diff options
Diffstat (limited to 'docs')
| -rw-r--r-- | docs/programming-guide.md | 2 | ||||
| -rw-r--r-- | docs/streaming-programming-guide.md | 4 |
2 files changed, 3 insertions, 3 deletions
diff --git a/docs/programming-guide.md b/docs/programming-guide.md index e45081464a..2d6f7767d9 100644 --- a/docs/programming-guide.md +++ b/docs/programming-guide.md @@ -1343,7 +1343,7 @@ value of the broadcast variable (e.g. if the variable is shipped to a new node l ## Accumulators -Accumulators are variables that are only "added" to through an associative operation and can +Accumulators are variables that are only "added" to through an associative and commutative operation and can therefore be efficiently supported in parallel. They can be used to implement counters (as in MapReduce) or sums. Spark natively supports accumulators of numeric types, and programmers can add support for new types. If accumulators are created with a name, they will be diff --git a/docs/streaming-programming-guide.md b/docs/streaming-programming-guide.md index 677f5ff7be..4d1932bc8c 100644 --- a/docs/streaming-programming-guide.md +++ b/docs/streaming-programming-guide.md @@ -798,7 +798,7 @@ Some of the common ones are as follows. <td> <b>reduce</b>(<i>func</i>) </td> <td> Return a new DStream of single-element RDDs by aggregating the elements in each RDD of the source DStream using a function <i>func</i> (which takes two arguments and returns one). - The function should be associative so that it can be computed in parallel. </td> + The function should be associative and commutative so that it can be computed in parallel. </td> </tr> <tr> <td> <b>countByValue</b>() </td> @@ -1072,7 +1072,7 @@ said two parameters - <i>windowLength</i> and <i>slideInterval</i>. <tr> <td> <b>reduceByWindow</b>(<i>func</i>, <i>windowLength</i>, <i>slideInterval</i>) </td> <td> Return a new single-element stream, created by aggregating elements in the stream over a - sliding interval using <i>func</i>. The function should be associative so that it can be computed + sliding interval using <i>func</i>. The function should be associative and commutative so that it can be computed correctly in parallel. </td> </tr> |