diff options
| author | Iulian Dragos <jaguarul@gmail.com> | 2015-07-22 15:54:08 -0700 |
|---|---|---|
| committer | Tathagata Das <tathagata.das1565@gmail.com> | 2015-07-22 15:54:08 -0700 |
| commit | 798dff7b4baa952c609725b852bcb6a9c9e5a317 (patch) | |
| tree | 18cf81cb9b10ae26403866a74f9b1d776b5b5c00 /bin | |
| parent | fe26584a1f5b472fb2e87aa7259aec822a619a3b (diff) | |
| download | spark-798dff7b4baa952c609725b852bcb6a9c9e5a317.tar.gz spark-798dff7b4baa952c609725b852bcb6a9c9e5a317.tar.bz2 spark-798dff7b4baa952c609725b852bcb6a9c9e5a317.zip | |
[SPARK-8975] [STREAMING] Adds a mechanism to send a new rate from the driver to the block generator
First step for [SPARK-7398](https://issues.apache.org/jira/browse/SPARK-7398).
tdas huitseeker
Author: Iulian Dragos <jaguarul@gmail.com>
Author: François Garillot <francois@garillot.net>
Closes #7471 from dragos/topic/streaming-bp/dynamic-rate and squashes the following commits:
8941cf9 [Iulian Dragos] Renames and other nitpicks.
162d9e5 [Iulian Dragos] Use Reflection for accessing truly private `executor` method and use the listener bus to know when receivers have registered (`onStart` is called before receivers have registered, leading to flaky behavior).
210f495 [Iulian Dragos] Revert "Added a few tests that measure the receiver’s rate."
0c51959 [Iulian Dragos] Added a few tests that measure the receiver’s rate.
261a051 [Iulian Dragos] - removed field to hold the current rate limit in rate limiter - made rate limit a Long and default to Long.MaxValue (consequence of the above) - removed custom `waitUntil` and replaced it by `eventually`
cd1397d [Iulian Dragos] Add a test for the propagation of a new rate limit from driver to receivers.
6369b30 [Iulian Dragos] Merge pull request #15 from huitseeker/SPARK-8975
d15de42 [François Garillot] [SPARK-8975][Streaming] Adds Ratelimiter unit tests w.r.t. spark.streaming.receiver.maxRate
4721c7d [François Garillot] [SPARK-8975][Streaming] Add a mechanism to send a new rate from the driver to the block generator
Diffstat (limited to 'bin')
0 files changed, 0 insertions, 0 deletions