diff options
| author | Burak Yavuz <brkyvz@gmail.com> | 2015-11-09 14:39:18 -0800 |
|---|---|---|
| committer | Tathagata Das <tathagata.das1565@gmail.com> | 2015-11-09 14:39:18 -0800 |
| commit | a3a7c9103e136035d65a5564f9eb0fa04727c4f3 (patch) | |
| tree | afa494adb7a10cbf78bbc82b502a33cffb3de9aa /mllib | |
| parent | 150f6a89b79f0e5bc31aa83731429dc7ac5ea76b (diff) | |
| download | spark-a3a7c9103e136035d65a5564f9eb0fa04727c4f3.tar.gz spark-a3a7c9103e136035d65a5564f9eb0fa04727c4f3.tar.bz2 spark-a3a7c9103e136035d65a5564f9eb0fa04727c4f3.zip | |
[SPARK-11359][STREAMING][KINESIS] Checkpoint to DynamoDB even when new data doesn't come in
Currently, the checkpoints to DynamoDB occur only when new data comes in, as we update the clock for the checkpointState. This PR makes the checkpoint a scheduled execution based on the `checkpointInterval`.
Author: Burak Yavuz <brkyvz@gmail.com>
Closes #9421 from brkyvz/kinesis-checkpoint.
Diffstat (limited to 'mllib')
0 files changed, 0 insertions, 0 deletions