diff options
author | Adam Budde <budde@amazon.com> | 2017-03-24 12:40:29 -0700 |
---|---|---|
committer | Burak Yavuz <brkyvz@gmail.com> | 2017-03-24 12:40:29 -0700 |
commit | 707e501832fa7adde0a884c528a7352983d83520 (patch) | |
tree | a8607e7dd2ec0abe38ab34efdc6d1e9c315085a5 /mllib-local/src | |
parent | 9299d071f95798e33b18c08d3c75bb26f88b266b (diff) | |
download | spark-707e501832fa7adde0a884c528a7352983d83520.tar.gz spark-707e501832fa7adde0a884c528a7352983d83520.tar.bz2 spark-707e501832fa7adde0a884c528a7352983d83520.zip |
[SPARK-19911][STREAMING] Add builder interface for Kinesis DStreams
## What changes were proposed in this pull request?
- Add new KinesisDStream.scala containing KinesisDStream.Builder class
- Add KinesisDStreamBuilderSuite test suite
- Make KinesisInputDStream ctor args package private for testing
- Add JavaKinesisDStreamBuilderSuite test suite
- Add args to KinesisInputDStream and KinesisReceiver for optional
service-specific auth (Kinesis, DynamoDB and CloudWatch)
## How was this patch tested?
Added ```KinesisDStreamBuilderSuite``` to verify builder class works as expected
Author: Adam Budde <budde@amazon.com>
Closes #17250 from budde/KinesisStreamBuilder.
Diffstat (limited to 'mllib-local/src')
0 files changed, 0 insertions, 0 deletions