diff options
| author | Tathagata Das <tathagata.das1565@gmail.com> | 2015-11-12 19:02:49 -0800 |
|---|---|---|
| committer | Tathagata Das <tathagata.das1565@gmail.com> | 2015-11-12 19:02:49 -0800 |
| commit | e4e46b20f6475f8e148d5326f7c88c57850d46a1 (patch) | |
| tree | a9d6c48bf1090d5e25cf32b8dd67edfb66bc158a /mllib | |
| parent | 7786f9cc0790d27854a1e184f66a9b4df4d040a2 (diff) | |
| download | spark-e4e46b20f6475f8e148d5326f7c88c57850d46a1.tar.gz spark-e4e46b20f6475f8e148d5326f7c88c57850d46a1.tar.bz2 spark-e4e46b20f6475f8e148d5326f7c88c57850d46a1.zip | |
[SPARK-11681][STREAMING] Correctly update state timestamp even when state is not updated
Bug: Timestamp is not updated if there is data but the corresponding state is not updated. This is wrong, and timeout is defined as "no data for a while", not "not state update for a while".
Fix: Update timestamp when timestamp when timeout is specified, otherwise no need.
Also refactored the code for better testability and added unit tests.
Author: Tathagata Das <tathagata.das1565@gmail.com>
Closes #9648 from tdas/SPARK-11681.
Diffstat (limited to 'mllib')
0 files changed, 0 insertions, 0 deletions