diff options
| author | jerryshao <saisai.shao@intel.com> | 2015-01-20 23:37:47 -0800 |
|---|---|---|
| committer | Patrick Wendell <patrick@databricks.com> | 2015-01-20 23:37:47 -0800 |
| commit | 424d8c6ffff42e4231cc1088b7e69e3c0f5e6b56 (patch) | |
| tree | 75713ab6e19a7e2eab63a332f8c4bdb5e83a74d2 /project/MimaExcludes.scala | |
| parent | ec5b0f2cef4b30047c7f88bdc00d10b6aa308124 (diff) | |
| download | spark-424d8c6ffff42e4231cc1088b7e69e3c0f5e6b56.tar.gz spark-424d8c6ffff42e4231cc1088b7e69e3c0f5e6b56.tar.bz2 spark-424d8c6ffff42e4231cc1088b7e69e3c0f5e6b56.zip | |
[SPARK-5297][Streaming] Fix Java file stream type erasure problem
Current Java file stream doesn't support custom key/value type because of loss of type information, details can be seen in [SPARK-5297](https://issues.apache.org/jira/browse/SPARK-5297). Fix this problem by getting correct `ClassTag` from `Class[_]`.
Author: jerryshao <saisai.shao@intel.com>
Closes #4101 from jerryshao/SPARK-5297 and squashes the following commits:
e022ca3 [jerryshao] Add Mima exclusion
ecd61b8 [jerryshao] Fix Java fileInputStream type erasure problem
Diffstat (limited to 'project/MimaExcludes.scala')
| -rw-r--r-- | project/MimaExcludes.scala | 4 |
1 files changed, 4 insertions, 0 deletions
diff --git a/project/MimaExcludes.scala b/project/MimaExcludes.scala index 95fef23ee4..127973b658 100644 --- a/project/MimaExcludes.scala +++ b/project/MimaExcludes.scala @@ -86,6 +86,10 @@ object MimaExcludes { // SPARK-5270 ProblemFilters.exclude[MissingMethodProblem]( "org.apache.spark.api.java.JavaRDDLike.isEmpty") + ) ++ Seq( + // SPARK-5297 Java FileStream do not work with custom key/values + ProblemFilters.exclude[MissingMethodProblem]( + "org.apache.spark.streaming.api.java.JavaStreamingContext.fileStream") ) case v if v.startsWith("1.2") => |