diff options
| author | jerryshao <sshao@hortonworks.com> | 2015-10-16 11:53:47 +0100 |
|---|---|---|
| committer | Sean Owen <sowen@cloudera.com> | 2015-10-16 11:53:47 +0100 |
| commit | 43f5d1f326d7a2a4a78fe94853d0d05237568203 (patch) | |
| tree | ee8b15f4e95d4ae7b15e751bb3af60a958cfe134 /project/SparkBuild.scala | |
| parent | eb0b4d6e2ddfb765f082d0d88472626336ad2609 (diff) | |
| download | spark-43f5d1f326d7a2a4a78fe94853d0d05237568203.tar.gz spark-43f5d1f326d7a2a4a78fe94853d0d05237568203.tar.bz2 spark-43f5d1f326d7a2a4a78fe94853d0d05237568203.zip | |
[SPARK-11060] [STREAMING] Fix some potential NPE in DStream transformation
This patch fixes:
1. Guard out against NPEs in `TransformedDStream` when parent DStream returns None instead of empty RDD.
2. Verify some input streams which will potentially return None.
3. Add unit test to verify the behavior when input stream returns None.
cc tdas , please help to review, thanks a lot :).
Author: jerryshao <sshao@hortonworks.com>
Closes #9070 from jerryshao/SPARK-11060.
Diffstat (limited to 'project/SparkBuild.scala')
0 files changed, 0 insertions, 0 deletions