diff options
author | uncleGen <hustyugm@gmail.com> | 2015-01-13 10:07:19 -0800 |
---|---|---|
committer | Andrew Or <andrew@databricks.com> | 2015-01-13 10:07:26 -0800 |
commit | 78096837c85ca41ce4ffa1aca2663b6d0f14d20d (patch) | |
tree | e967bfaed3a16b3adc03db52a90300ced57389ca | |
parent | 6d23af6a4d3b864036fef2c80022d438de88cfb5 (diff) | |
download | spark-78096837c85ca41ce4ffa1aca2663b6d0f14d20d.tar.gz spark-78096837c85ca41ce4ffa1aca2663b6d0f14d20d.tar.bz2 spark-78096837c85ca41ce4ffa1aca2663b6d0f14d20d.zip |
[SPARK-5131][Streaming][DOC]: There is a discrepancy in WAL implementation and configuration doc.
There is a discrepancy in WAL implementation and configuration doc.
Author: uncleGen <hustyugm@gmail.com>
Closes #3930 from uncleGen/master-clean-doc and squashes the following commits:
3a4245f [uncleGen] doc typo
8e407d3 [uncleGen] doc typo
(cherry picked from commit 39e333ec4350ddafe29ee0958c37eec07bec85df)
Signed-off-by: Andrew Or <andrew@databricks.com>
-rw-r--r-- | docs/configuration.md | 2 | ||||
-rw-r--r-- | docs/streaming-programming-guide.md | 2 |
2 files changed, 2 insertions, 2 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index 260cdc4c16..6e9a62c9a9 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -1218,7 +1218,7 @@ Apart from these, the following properties are also available, and may be useful </td> </tr> <tr> - <td><code>spark.streaming.receiver.writeAheadLogs.enable</code></td> + <td><code>spark.streaming.receiver.writeAheadLog.enable</code></td> <td>false</td> <td> Enable write ahead logs for receivers. All the input data received through receivers diff --git a/docs/streaming-programming-guide.md b/docs/streaming-programming-guide.md index 1ac5b9e863..1fcc3bcd63 100644 --- a/docs/streaming-programming-guide.md +++ b/docs/streaming-programming-guide.md @@ -1574,7 +1574,7 @@ To run a Spark Streaming applications, you need to have the following. recovery, thus ensuring zero data loss (discussed in detail in the [Fault-tolerance Semantics](#fault-tolerance-semantics) section). This can be enabled by setting the [configuration parameter](configuration.html#spark-streaming) - `spark.streaming.receiver.writeAheadLogs.enable` to `true`. However, these stronger semantics may + `spark.streaming.receiver.writeAheadLog.enable` to `true`. However, these stronger semantics may come at the cost of the receiving throughput of individual receivers. This can be corrected by running [more receivers in parallel](#level-of-parallelism-in-data-receiving) to increase aggregate throughput. Additionally, it is recommended that the replication of the |