diff options
author | Roberto Agostino Vitillo <ra.vitillo@gmail.com> | 2017-02-17 11:43:57 -0800 |
---|---|---|
committer | Shixiong Zhu <shixiong@databricks.com> | 2017-02-17 11:44:18 -0800 |
commit | 1a3f5f8c55d873aaf8145a8bc4867fc9902cf93d (patch) | |
tree | 495c962a3981a854258453f92c7417fd347557bc /dev/.rat-excludes | |
parent | 4cc06f4eb1fbf1ba1fc6165783e22f93dc3b14ac (diff) | |
download | spark-1a3f5f8c55d873aaf8145a8bc4867fc9902cf93d.tar.gz spark-1a3f5f8c55d873aaf8145a8bc4867fc9902cf93d.tar.bz2 spark-1a3f5f8c55d873aaf8145a8bc4867fc9902cf93d.zip |
[SPARK-19517][SS] KafkaSource fails to initialize partition offsets
## What changes were proposed in this pull request?
This patch fixes a bug in `KafkaSource` with the (de)serialization of the length of the JSON string that contains the initial partition offsets.
## How was this patch tested?
I ran the test suite for spark-sql-kafka-0-10.
Author: Roberto Agostino Vitillo <ra.vitillo@gmail.com>
Closes #16857 from vitillo/kafka_source_fix.
Diffstat (limited to 'dev/.rat-excludes')
-rw-r--r-- | dev/.rat-excludes | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/dev/.rat-excludes b/dev/.rat-excludes index 6d24434ccc..2355d40d1e 100644 --- a/dev/.rat-excludes +++ b/dev/.rat-excludes @@ -105,3 +105,4 @@ org.apache.spark.scheduler.ExternalClusterManager org.apache.spark.deploy.yarn.security.ServiceCredentialProvider spark-warehouse structured-streaming/* +kafka-source-initial-offset-version-2.1.0.bin |