diff options
| author | Jesper Lundgren <jesper.lundgren@vpon.com> | 2015-02-03 14:53:39 -0800 |
|---|---|---|
| committer | Tathagata Das <tathagata.das1565@gmail.com> | 2015-02-03 14:53:39 -0800 |
| commit | 1e8b5394b44a0d3b36f64f10576c3ae3b977810c (patch) | |
| tree | ebad7c64745f362ca80105860ad7a2b03ae60aa3 /python | |
| parent | 681f9df47ff40f7b0d9175d835e9758d33a13a06 (diff) | |
| download | spark-1e8b5394b44a0d3b36f64f10576c3ae3b977810c.tar.gz spark-1e8b5394b44a0d3b36f64f10576c3ae3b977810c.tar.bz2 spark-1e8b5394b44a0d3b36f64f10576c3ae3b977810c.zip | |
[STREAMING] SPARK-4986 Wait for receivers to deregister and receiver job to terminate
A slow receiver might not have enough time to shutdown cleanly even when graceful shutdown is used. This PR extends graceful waiting to make sure all receivers have deregistered and that the receiver job has terminated.
Author: Jesper Lundgren <jesper.lundgren@vpon.com>
Closes #4338 from cleaton/stopreceivers and squashes the following commits:
a9cf223 [Jesper Lundgren] remove cleaner.ttl config
f969b6e [Jesper Lundgren] fix inversed logic in unit test
3d0bd35 [Jesper Lundgren] switch boleans to match running status instead of terminated
9a9ff88 [Jesper Lundgren] wait for receivers to shutdown and receiver job to terminate
d179372 [Jesper Lundgren] Add graceful shutdown unit test covering slow receiver onStop
Diffstat (limited to 'python')
0 files changed, 0 insertions, 0 deletions