diff options
author | Prashant Sharma <prashant.s@imaginea.com> | 2013-08-23 09:41:32 +0530 |
---|---|---|
committer | Prashant Sharma <prashant.s@imaginea.com> | 2013-08-23 09:44:02 +0530 |
commit | 2bc348e92c458ea36872ac43a2583370d1f3eb41 (patch) | |
tree | f6c525de48d4c54c149212206546561389a4f2b5 /docs/streaming-programming-guide.md | |
parent | 3049415e245eefac0593a3e33ee7c8a845eeb800 (diff) | |
download | spark-2bc348e92c458ea36872ac43a2583370d1f3eb41.tar.gz spark-2bc348e92c458ea36872ac43a2583370d1f3eb41.tar.bz2 spark-2bc348e92c458ea36872ac43a2583370d1f3eb41.zip |
Linking custom receiver guide
Diffstat (limited to 'docs/streaming-programming-guide.md')
-rw-r--r-- | docs/streaming-programming-guide.md | 3 |
1 files changed, 3 insertions, 0 deletions
diff --git a/docs/streaming-programming-guide.md b/docs/streaming-programming-guide.md index 8cd1b0cd66..a74c17bdb7 100644 --- a/docs/streaming-programming-guide.md +++ b/docs/streaming-programming-guide.md @@ -301,6 +301,9 @@ dstream.checkpoint(checkpointInterval) // checkpointInterval must be a multiple For DStreams that must be checkpointed (that is, DStreams created by `updateStateByKey` and `reduceByKeyAndWindow` with inverse function), the checkpoint interval of the DStream is by default set to a multiple of the DStream's sliding interval such that its at least 10 seconds. +## Customizing Receiver +Spark comes with a built in support for most common usage scenarios where input stream source can be either a network socket stream to support for a few message queues. Apart from that it is also possible to supply your own custom receiver via a convenient API. Find more details at [Custom Receiver Guide](streaming-custom-receivers.html) + # Performance Tuning Getting the best performance of a Spark Streaming application on a cluster requires a bit of tuning. This section explains a number of the parameters and configurations that can tuned to improve the performance of you application. At a high level, you need to consider two things: <ol> |