diff options
| author | cody koeninger <cody@koeninger.org> | 2015-06-19 18:54:07 -0700 |
|---|---|---|
| committer | Tathagata Das <tathagata.das1565@gmail.com> | 2015-06-19 18:54:07 -0700 |
| commit | 1b6fe9b1a70aa3f81448c2705ea3a4b501cbda9d (patch) | |
| tree | a287b75a28408bd0d831a9257873fa0995e6c670 /scalastyle-config.xml | |
| parent | bec40e52be1bbe8fd6f3a1daa6284429d6b5d841 (diff) | |
| download | spark-1b6fe9b1a70aa3f81448c2705ea3a4b501cbda9d.tar.gz spark-1b6fe9b1a70aa3f81448c2705ea3a4b501cbda9d.tar.bz2 spark-1b6fe9b1a70aa3f81448c2705ea3a4b501cbda9d.zip | |
[SPARK-8127] [STREAMING] [KAFKA] KafkaRDD optimize count() take() isEmpty()
…ed KafkaRDD methods. Possible fix for [SPARK-7122], but probably a worthwhile optimization regardless.
Author: cody koeninger <cody@koeninger.org>
Closes #6632 from koeninger/kafka-rdd-count and squashes the following commits:
321340d [cody koeninger] [SPARK-8127][Streaming][Kafka] additional test of ordering of take()
5a05d0f [cody koeninger] [SPARK-8127][Streaming][Kafka] additional test of isEmpty
f68bd32 [cody koeninger] [Streaming][Kafka][SPARK-8127] code cleanup
9555b73 [cody koeninger] Merge branch 'master' into kafka-rdd-count
253031d [cody koeninger] [Streaming][Kafka][SPARK-8127] mima exclusion for change to private method
8974b9e [cody koeninger] [Streaming][Kafka][SPARK-8127] check offset ranges before constructing KafkaRDD
c3768c5 [cody koeninger] [Streaming][Kafka] Take advantage of offset range info for size-related KafkaRDD methods. Possible fix for [SPARK-7122], but probably a worthwhile optimization regardless.
Diffstat (limited to 'scalastyle-config.xml')
0 files changed, 0 insertions, 0 deletions