diff options
| author | Mariusz Strzelecki <mariusz.strzelecki@allegrogroup.com> | 2016-08-09 09:44:43 -0700 |
|---|---|---|
| committer | Davies Liu <davies.liu@gmail.com> | 2016-08-09 09:44:43 -0700 |
| commit | 29081b587f3423bf5a3e0066357884d0c26a04bf (patch) | |
| tree | b86e35b297a8b3100a19dc0e85f828434524b96e /common | |
| parent | 182e11904bf2093c2faa57894a1c4bb11d872596 (diff) | |
| download | spark-29081b587f3423bf5a3e0066357884d0c26a04bf.tar.gz spark-29081b587f3423bf5a3e0066357884d0c26a04bf.tar.bz2 spark-29081b587f3423bf5a3e0066357884d0c26a04bf.zip | |
[SPARK-16950] [PYSPARK] fromOffsets parameter support in KafkaUtils.createDirectStream for python3
## What changes were proposed in this pull request?
Ability to use KafkaUtils.createDirectStream with starting offsets in python 3 by using java.lang.Number instead of Long during param mapping in scala helper. This allows py4j to pass Integer or Long to the map and resolves ClassCastException problems.
## How was this patch tested?
unit tests
jerryshao - could you please look at this PR?
Author: Mariusz Strzelecki <mariusz.strzelecki@allegrogroup.com>
Closes #14540 from szczeles/kafka_pyspark.
Diffstat (limited to 'common')
0 files changed, 0 insertions, 0 deletions