aboutsummaryrefslogtreecommitdiff
path: root/streaming/src/test/java
Commit message (Collapse)AuthorAgeFilesLines
...
| * Merge remote-tracking branch 'apache/master' into project-refactorTathagata Das2014-01-061-1/+3
| |\ | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: examples/src/main/java/org/apache/spark/streaming/examples/JavaFlumeEventCount.java streaming/src/main/scala/org/apache/spark/streaming/StreamingContext.scala streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaStreamingContext.scala streaming/src/test/java/org/apache/spark/streaming/JavaAPISuite.java streaming/src/test/scala/org/apache/spark/streaming/InputStreamsSuite.scala streaming/src/test/scala/org/apache/spark/streaming/TestSuiteBase.scala
| * | Removed unnecessary comments.Tathagata Das2013-12-311-26/+0
| | |
| * | Refactored kafka, flume, zeromq, mqtt as separate external projects, with ↵Tathagata Das2013-12-302-70/+56
| | | | | | | | | | | | their own self-contained scala API, java API, scala unit tests and java unit tests. Updated examples to use the external projects.
* | | Merge remote-tracking branch 'spark/master'Andrew Or2014-01-021-3/+7
|\ \ \ | | |/ | |/| | | | | | | Conflicts: core/src/main/scala/org/apache/spark/rdd/CoGroupedRDD.scala
| * | Fix other failing testsMatei Zaharia2013-12-281-3/+6
| | |
| * | Fix test failures due to setting / clearing clock type in StreamingMatei Zaharia2013-12-281-3/+4
| |/
* | Address Aaron's commentsAndrew Or2013-12-291-4/+4
| |
* | Fix streaming JavaAPISuite againAndrew Or2013-12-261-8/+12
| |
* | Fix streaming JavaAPISuite that depended on orderAaron Davidson2013-12-261-11/+16
|/
* Merge branch 'master' into scala-2.10Raymond Liu2013-11-132-28/+433
|\
| * Merge branch 'apache-master' into transformTathagata Das2013-10-252-7/+62
| |\
| | * Style fixesPatrick Wendell2013-10-241-9/+9
| | |
| | * Spacing fixPatrick Wendell2013-10-241-4/+4
| | |
| | * Small spacing fixPatrick Wendell2013-10-241-2/+2
| | |
| | * Adding Java versions and associated testsPatrick Wendell2013-10-242-0/+56
| | |
| | * Some clean-up of testsPatrick Wendell2013-10-241-2/+1
| | |
| * | Fixed accidental bug.Tathagata Das2013-10-241-1/+1
| | |
| * | Added JavaStreamingContext.transformTathagata Das2013-10-241-30/+102
| | |
| * | Merge branch 'apache-master' into transformTathagata Das2013-10-221-5/+11
| |\|
| | * Upgrade Kafka 0.7.2 to Kafka 0.8.0-beta1 for Spark Streamingjerryshao2013-10-121-5/+11
| | |
| * | Fixed bug in Java transformWith, added more Java testcases for transform and ↵Tathagata Das2013-10-221-15/+204
| | | | | | | | | | | | transformWith, added missing variations of Java join and cogroup, updated various Scala and Java API docs.
| * | Updated TransformDStream to allow n-ary DStream transform. Added ↵Tathagata Das2013-10-211-3/+86
| |/ | | | | | | transformWith, leftOuterJoin and rightOuterJoin operations to DStream for Scala and Java APIs. Also added n-ary union and n-ary transform operations to StreamingContext for Scala and Java APIs.
* | fixed some warningsMartin Weindel2013-10-051-46/+48
| |
* | Akka 2.2 migrationPrashant Sharma2013-09-221-1/+1
| |
* | Merged with masterPrashant Sharma2013-09-062-25/+60
|\|
| * Initial work to rename package to org.apache.sparkMatei Zaharia2013-09-012-24/+25
| |
| * Add Apache license headers and LICENSE and NOTICE filesMatei Zaharia2013-07-162-1/+35
| |
* | Merge branch 'master' into master-mergePrashant Sharma2013-07-031-5/+9
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/pom.xml core/src/main/scala/spark/MapOutputTracker.scala core/src/main/scala/spark/RDD.scala core/src/main/scala/spark/RDDCheckpointData.scala core/src/main/scala/spark/SparkContext.scala core/src/main/scala/spark/Utils.scala core/src/main/scala/spark/api/python/PythonRDD.scala core/src/main/scala/spark/deploy/client/Client.scala core/src/main/scala/spark/deploy/master/MasterWebUI.scala core/src/main/scala/spark/deploy/worker/Worker.scala core/src/main/scala/spark/deploy/worker/WorkerWebUI.scala core/src/main/scala/spark/rdd/BlockRDD.scala core/src/main/scala/spark/rdd/ZippedRDD.scala core/src/main/scala/spark/scheduler/cluster/StandaloneSchedulerBackend.scala core/src/main/scala/spark/storage/BlockManager.scala core/src/main/scala/spark/storage/BlockManagerMaster.scala core/src/main/scala/spark/storage/BlockManagerMasterActor.scala core/src/main/scala/spark/storage/BlockManagerUI.scala core/src/main/scala/spark/util/AkkaUtils.scala core/src/test/scala/spark/SizeEstimatorSuite.scala pom.xml project/SparkBuild.scala repl/src/main/scala/spark/repl/SparkILoop.scala repl/src/test/scala/spark/repl/ReplSuite.scala streaming/src/main/scala/spark/streaming/StreamingContext.scala streaming/src/main/scala/spark/streaming/api/java/JavaStreamingContext.scala streaming/src/main/scala/spark/streaming/dstream/KafkaInputDStream.scala streaming/src/main/scala/spark/streaming/util/MasterFailureTest.scala
| * Initialize Twitter4J OAuth from system properties instead of promptingMatei Zaharia2013-06-291-1/+1
| |
| * fixing kafkaStream Java API and adding testseanm2013-05-101-0/+6
| |
| * adding kafkaStream API testsseanm2013-05-101-2/+2
| |
| * Surfacing decoders on KafkaInputDStreamseanm2013-04-161-4/+2
| |
* | Fixed Warning: ClassManifest -> ClassTagPrashant Sharma2013-04-291-10/+12
|/
* Fixed differences in APIs of StreamingContext and JavaStreamingContext. ↵Tathagata Das2013-02-231-5/+32
| | | | Change rawNetworkStream to rawSocketStream, and added twitter, actor, zeroMQ streams to JavaStreamingContext. Also added them to JavaAPISuite.
* Merge branch 'mesos-streaming' into streamingTathagata Das2013-02-202-4/+48
|\ | | | | | | | | Conflicts: streaming/src/test/java/spark/streaming/JavaAPISuite.java
| * Small changes that were missing in mergePatrick Wendell2013-02-191-0/+1
| |
| * Use RDD type for `transform` operator in Java.Patrick Wendell2013-02-191-2/+87
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This is an improved implementation of the `transform` operator in Java. The main difference is that this allows all four possible types of transform functions 1. JavaRDD -> JavaRDD 2. JavaRDD -> JavaPairRDD 3. JavaPairRDD -> JavaPairRDD 4. JavaPairRDD -> JavaRDD whereas previously only (1) and (3) were possible. Conflicts: streaming/src/test/java/spark/streaming/JavaAPISuite.java
| * Use RDD type for `foreach` operator in Java.Patrick Wendell2013-02-192-2/+4
| |
* | Merge branch 'mesos-master' into streamingTathagata Das2013-02-201-3/+183
|\ \ | |/ |/| | | | | | | Conflicts: core/src/main/scala/spark/rdd/CheckpointRDD.scala streaming/src/main/scala/spark/streaming/dstream/ReducedWindowedDStream.scala
| * STREAMING-50: Support transform workaround in JavaPairDStreamPatrick Wendell2013-02-121-0/+45
| | | | | | | | | | | | This ports a useful workaround (the `transform` function) to JavaPairDStream. It is necessary to do things like sorting which are not supported yet in the core streaming API.
| * Using tuple swap()Patrick Wendell2013-02-111-2/+2
| |
| * small fixPatrick Wendell2013-02-111-2/+2
| |
| * Fix for MapPartitionsPatrick Wendell2013-02-111-15/+52
| |
| * Fix for flatmapPatrick Wendell2013-02-111-0/+42
| |
| * Indentation fixPatrick Wendell2013-02-111-10/+10
| |
| * Initial cut at replacing K, V in Java filesPatrick Wendell2013-02-111-0/+56
| |
* | Changed networkStream to socketStream and pluggableNetworkStream to become ↵Tathagata Das2013-02-181-3/+2
| | | | | | | | networkStream as a way to create streams from arbitrary network receiver.
* | Many changes to ensure better 2nd recovery if 2nd failure happens whileTathagata Das2013-02-172-16/+39
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | recovering from 1st failure - Made the scheduler to checkpoint after clearing old metadata which ensures that a new checkpoint is written as soon as at least one batch gets computed while recovering from a failure. This ensures that if there is a 2nd failure while recovering from 1st failure, the system start 2nd recovery from a newer checkpoint. - Modified Checkpoint writer to write checkpoint in a different thread. - Added a check to make sure that compute for InputDStreams gets called only for strictly increasing times. - Changed implementation of slice to call getOrCompute on parent DStream in time-increasing order. - Added testcase to test slice. - Fixed testGroupByKeyAndWindow testcase in JavaAPISuite to verify results with expected output in an order-independent manner.
* | Removed countByKeyAndWindow on paired DStreams, and added ↵Tathagata Das2013-02-141-49/+30
| | | | | | | | countByValueAndWindow for all DStreams. Updated both scala and java API and testsuites.
* | Changed scheduler and file input stream to fix bugs in the driver fault ↵Tathagata Das2013-02-131-10/+11
| | | | | | | | tolerance. Added MasterFailureTest to rigorously test master fault tolerance with file input stream.
generated by cgit v1.2.3 (git 2.39.1) at 2024-08-09 09:54:11 +0000