diff options
| author | Burak Yavuz <brkyvz@gmail.com> | 2015-10-25 21:18:35 -0700 |
|---|---|---|
| committer | Tathagata Das <tathagata.das1565@gmail.com> | 2015-10-25 21:18:35 -0700 |
| commit | 63accc79625d8a03d0624717af5e1d81b18a6da3 (patch) | |
| tree | e043db0052621a19a6040f4e813a43875fa4f9f3 /streaming | |
| parent | 80279ac1875d488f7000f352a958a35536bd4c2e (diff) | |
| download | spark-63accc79625d8a03d0624717af5e1d81b18a6da3.tar.gz spark-63accc79625d8a03d0624717af5e1d81b18a6da3.tar.bz2 spark-63accc79625d8a03d0624717af5e1d81b18a6da3.zip | |
[SPARK-10891][STREAMING][KINESIS] Add MessageHandler to KinesisUtils.createStream similar to Direct Kafka
This PR allows users to map a Kinesis `Record` to a generic `T` when creating a Kinesis stream. This is particularly useful, if you would like to do extra work with Kinesis metadata such as sequence number, and partition key.
TODO:
- [x] add tests
Author: Burak Yavuz <brkyvz@gmail.com>
Closes #8954 from brkyvz/kinesis-handler.
Diffstat (limited to 'streaming')
0 files changed, 0 insertions, 0 deletions