diff options
author | Tathagata Das <tathagata.das1565@gmail.com> | 2017-03-27 19:04:16 -0700 |
---|---|---|
committer | Tathagata Das <tathagata.das1565@gmail.com> | 2017-03-27 19:04:16 -0700 |
commit | 8a6f33f0483dcee81467e6374a796b5dbd53ea30 (patch) | |
tree | 6e20dd10fda762d23f0f2848407c194bafa90684 /.gitignore | |
parent | a250933c625ed720d15a0e479e9c51113605b102 (diff) | |
download | spark-8a6f33f0483dcee81467e6374a796b5dbd53ea30.tar.gz spark-8a6f33f0483dcee81467e6374a796b5dbd53ea30.tar.bz2 spark-8a6f33f0483dcee81467e6374a796b5dbd53ea30.zip |
[SPARK-19876][SS] Follow up: Refactored BatchCommitLog to simplify logic
## What changes were proposed in this pull request?
Existing logic seemingly writes null to the BatchCommitLog, even though it does additional checks to write '{}' (valid json) to the log. This PR simplifies the logic by disallowing use of `log.add(batchId, metadata)` and instead using `log.add(batchId)`. No question of specifying metadata, so no confusion related to null.
## How was this patch tested?
Existing tests pass.
Author: Tathagata Das <tathagata.das1565@gmail.com>
Closes #17444 from tdas/SPARK-19876-1.
Diffstat (limited to '.gitignore')
0 files changed, 0 insertions, 0 deletions