aboutsummaryrefslogtreecommitdiff
path: root/streaming/src/test/java
Commit message (Collapse)AuthorAgeFilesLines
...
* [java8API] SPARK-964 Investigate the potential for using JDK 8 lambda ↵Prashant Sharma2014-03-031-30/+32
| | | | | | | | | | | | | | | | | | | expressions for the Java/Scala APIs Author: Prashant Sharma <prashant.s@imaginea.com> Author: Patrick Wendell <pwendell@gmail.com> Closes #17 from ScrapCodes/java8-lambdas and squashes the following commits: 95850e6 [Patrick Wendell] Some doc improvements and build changes to the Java 8 patch. 85a954e [Prashant Sharma] Nit. import orderings. 673f7ac [Prashant Sharma] Added support for -java-home as well 80a13e8 [Prashant Sharma] Used fake class tag syntax 26eb3f6 [Prashant Sharma] Patrick's comments on PR. 35d8d79 [Prashant Sharma] Specified java 8 building in the docs 31d4cd6 [Prashant Sharma] Maven build to support -Pjava8-tests flag. 4ab87d3 [Prashant Sharma] Review feedback on the pr c33dc2c [Prashant Sharma] SPARK-964, Java 8 API Support.
* SPARK 1084.1 (resubmitted)Sean Owen2014-02-271-37/+87
| | | | | | | | | | | | | | | (Ported from https://github.com/apache/incubator-spark/pull/637 ) Author: Sean Owen <sowen@cloudera.com> Closes #31 from srowen/SPARK-1084.1 and squashes the following commits: 6c4a32c [Sean Owen] Suppress warnings about legitimate unchecked array creations, or change code to avoid it f35b833 [Sean Owen] Fix two misc javadoc problems 254e8ef [Sean Owen] Fix one new style error introduced in scaladoc warning commit 5b2fce2 [Sean Owen] Fix scaladoc invocation warning, and enable javac warnings properly, with plugin config updates 007762b [Sean Owen] Remove dead scaladoc links b8ff8cb [Sean Owen] Replace deprecated Ant <tasks> with <target>
* Made some classes private[stremaing] and deprecated a method in ↵Tathagata Das2014-01-151-3/+3
| | | | JavaStreamingContext.
* Removed StreamingContext.registerInputStream and registerOutputStream - they ↵Tathagata Das2014-01-131-2/+1
| | | | were useless as InputDStream has been made to register itself. Also made DStream.register() private[streaming] - not useful to expose the confusing function. Updated a lot of documentation.
* Removing mentions in testsPatrick Wendell2014-01-121-2/+0
|
* Fix wonky imports from mergeAndrew Or2014-01-091-8/+1
|
* Merge github.com:apache/incubator-sparkAndrew Or2014-01-092-90/+55
|\ | | | | | | | | | | Conflicts: core/src/main/scala/org/apache/spark/SparkEnv.scala streaming/src/test/java/org/apache/spark/streaming/JavaAPISuite.java
| * Merge remote-tracking branch 'apache/master' into project-refactorTathagata Das2014-01-061-1/+3
| |\ | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: examples/src/main/java/org/apache/spark/streaming/examples/JavaFlumeEventCount.java streaming/src/main/scala/org/apache/spark/streaming/StreamingContext.scala streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaStreamingContext.scala streaming/src/test/java/org/apache/spark/streaming/JavaAPISuite.java streaming/src/test/scala/org/apache/spark/streaming/InputStreamsSuite.scala streaming/src/test/scala/org/apache/spark/streaming/TestSuiteBase.scala
| * | Removed unnecessary comments.Tathagata Das2013-12-311-26/+0
| | |
| * | Refactored kafka, flume, zeromq, mqtt as separate external projects, with ↵Tathagata Das2013-12-302-70/+56
| | | | | | | | | | | | their own self-contained scala API, java API, scala unit tests and java unit tests. Updated examples to use the external projects.
* | | Merge remote-tracking branch 'spark/master'Andrew Or2014-01-021-3/+7
|\ \ \ | | |/ | |/| | | | | | | Conflicts: core/src/main/scala/org/apache/spark/rdd/CoGroupedRDD.scala
| * | Fix other failing testsMatei Zaharia2013-12-281-3/+6
| | |
| * | Fix test failures due to setting / clearing clock type in StreamingMatei Zaharia2013-12-281-3/+4
| |/
* | Address Aaron's commentsAndrew Or2013-12-291-4/+4
| |
* | Fix streaming JavaAPISuite againAndrew Or2013-12-261-8/+12
| |
* | Fix streaming JavaAPISuite that depended on orderAaron Davidson2013-12-261-11/+16
|/
* Merge branch 'master' into scala-2.10Raymond Liu2013-11-132-28/+433
|\
| * Merge branch 'apache-master' into transformTathagata Das2013-10-252-7/+62
| |\
| | * Style fixesPatrick Wendell2013-10-241-9/+9
| | |
| | * Spacing fixPatrick Wendell2013-10-241-4/+4
| | |
| | * Small spacing fixPatrick Wendell2013-10-241-2/+2
| | |
| | * Adding Java versions and associated testsPatrick Wendell2013-10-242-0/+56
| | |
| | * Some clean-up of testsPatrick Wendell2013-10-241-2/+1
| | |
| * | Fixed accidental bug.Tathagata Das2013-10-241-1/+1
| | |
| * | Added JavaStreamingContext.transformTathagata Das2013-10-241-30/+102
| | |
| * | Merge branch 'apache-master' into transformTathagata Das2013-10-221-5/+11
| |\|
| | * Upgrade Kafka 0.7.2 to Kafka 0.8.0-beta1 for Spark Streamingjerryshao2013-10-121-5/+11
| | |
| * | Fixed bug in Java transformWith, added more Java testcases for transform and ↵Tathagata Das2013-10-221-15/+204
| | | | | | | | | | | | transformWith, added missing variations of Java join and cogroup, updated various Scala and Java API docs.
| * | Updated TransformDStream to allow n-ary DStream transform. Added ↵Tathagata Das2013-10-211-3/+86
| |/ | | | | | | transformWith, leftOuterJoin and rightOuterJoin operations to DStream for Scala and Java APIs. Also added n-ary union and n-ary transform operations to StreamingContext for Scala and Java APIs.
* | fixed some warningsMartin Weindel2013-10-051-46/+48
| |
* | Akka 2.2 migrationPrashant Sharma2013-09-221-1/+1
| |
* | Merged with masterPrashant Sharma2013-09-062-25/+60
|\|
| * Initial work to rename package to org.apache.sparkMatei Zaharia2013-09-012-24/+25
| |
| * Add Apache license headers and LICENSE and NOTICE filesMatei Zaharia2013-07-162-1/+35
| |
* | Merge branch 'master' into master-mergePrashant Sharma2013-07-031-5/+9
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/pom.xml core/src/main/scala/spark/MapOutputTracker.scala core/src/main/scala/spark/RDD.scala core/src/main/scala/spark/RDDCheckpointData.scala core/src/main/scala/spark/SparkContext.scala core/src/main/scala/spark/Utils.scala core/src/main/scala/spark/api/python/PythonRDD.scala core/src/main/scala/spark/deploy/client/Client.scala core/src/main/scala/spark/deploy/master/MasterWebUI.scala core/src/main/scala/spark/deploy/worker/Worker.scala core/src/main/scala/spark/deploy/worker/WorkerWebUI.scala core/src/main/scala/spark/rdd/BlockRDD.scala core/src/main/scala/spark/rdd/ZippedRDD.scala core/src/main/scala/spark/scheduler/cluster/StandaloneSchedulerBackend.scala core/src/main/scala/spark/storage/BlockManager.scala core/src/main/scala/spark/storage/BlockManagerMaster.scala core/src/main/scala/spark/storage/BlockManagerMasterActor.scala core/src/main/scala/spark/storage/BlockManagerUI.scala core/src/main/scala/spark/util/AkkaUtils.scala core/src/test/scala/spark/SizeEstimatorSuite.scala pom.xml project/SparkBuild.scala repl/src/main/scala/spark/repl/SparkILoop.scala repl/src/test/scala/spark/repl/ReplSuite.scala streaming/src/main/scala/spark/streaming/StreamingContext.scala streaming/src/main/scala/spark/streaming/api/java/JavaStreamingContext.scala streaming/src/main/scala/spark/streaming/dstream/KafkaInputDStream.scala streaming/src/main/scala/spark/streaming/util/MasterFailureTest.scala
| * Initialize Twitter4J OAuth from system properties instead of promptingMatei Zaharia2013-06-291-1/+1
| |
| * fixing kafkaStream Java API and adding testseanm2013-05-101-0/+6
| |
| * adding kafkaStream API testsseanm2013-05-101-2/+2
| |
| * Surfacing decoders on KafkaInputDStreamseanm2013-04-161-4/+2
| |
* | Fixed Warning: ClassManifest -> ClassTagPrashant Sharma2013-04-291-10/+12
|/
* Fixed differences in APIs of StreamingContext and JavaStreamingContext. ↵Tathagata Das2013-02-231-5/+32
| | | | Change rawNetworkStream to rawSocketStream, and added twitter, actor, zeroMQ streams to JavaStreamingContext. Also added them to JavaAPISuite.
* Merge branch 'mesos-streaming' into streamingTathagata Das2013-02-202-4/+48
|\ | | | | | | | | Conflicts: streaming/src/test/java/spark/streaming/JavaAPISuite.java
| * Small changes that were missing in mergePatrick Wendell2013-02-191-0/+1
| |
| * Use RDD type for `transform` operator in Java.Patrick Wendell2013-02-191-2/+87
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This is an improved implementation of the `transform` operator in Java. The main difference is that this allows all four possible types of transform functions 1. JavaRDD -> JavaRDD 2. JavaRDD -> JavaPairRDD 3. JavaPairRDD -> JavaPairRDD 4. JavaPairRDD -> JavaRDD whereas previously only (1) and (3) were possible. Conflicts: streaming/src/test/java/spark/streaming/JavaAPISuite.java
| * Use RDD type for `foreach` operator in Java.Patrick Wendell2013-02-192-2/+4
| |
* | Merge branch 'mesos-master' into streamingTathagata Das2013-02-201-3/+183
|\ \ | |/ |/| | | | | | | Conflicts: core/src/main/scala/spark/rdd/CheckpointRDD.scala streaming/src/main/scala/spark/streaming/dstream/ReducedWindowedDStream.scala
| * STREAMING-50: Support transform workaround in JavaPairDStreamPatrick Wendell2013-02-121-0/+45
| | | | | | | | | | | | This ports a useful workaround (the `transform` function) to JavaPairDStream. It is necessary to do things like sorting which are not supported yet in the core streaming API.
| * Using tuple swap()Patrick Wendell2013-02-111-2/+2
| |
| * small fixPatrick Wendell2013-02-111-2/+2
| |
| * Fix for MapPartitionsPatrick Wendell2013-02-111-15/+52
| |
generated by cgit v1.2.3 (git 2.39.1) at 2024-09-10 05:38:12 +0000