diff options
| author | Shixiong Zhu <shixiong@databricks.com> | 2016-01-20 13:55:41 -0800 |
|---|---|---|
| committer | Tathagata Das <tathagata.das1565@gmail.com> | 2016-01-20 13:55:41 -0800 |
| commit | b7d74a602f622d8e105b349bd6d17ba42e7668dc (patch) | |
| tree | 118deb532942513693e60f851dde638d7fa818cd /dev/sparktestsupport | |
| parent | 944fdadf77523570f6b33544ad0b388031498952 (diff) | |
| download | spark-b7d74a602f622d8e105b349bd6d17ba42e7668dc.tar.gz spark-b7d74a602f622d8e105b349bd6d17ba42e7668dc.tar.bz2 spark-b7d74a602f622d8e105b349bd6d17ba42e7668dc.zip | |
[SPARK-7799][SPARK-12786][STREAMING] Add "streaming-akka" project
Include the following changes:
1. Add "streaming-akka" project and org.apache.spark.streaming.akka.AkkaUtils for creating an actorStream
2. Remove "StreamingContext.actorStream" and "JavaStreamingContext.actorStream"
3. Update the ActorWordCount example and add the JavaActorWordCount example
4. Make "streaming-zeromq" depend on "streaming-akka" and update the codes accordingly
Author: Shixiong Zhu <shixiong@databricks.com>
Closes #10744 from zsxwing/streaming-akka-2.
Diffstat (limited to 'dev/sparktestsupport')
| -rw-r--r-- | dev/sparktestsupport/modules.py | 12 |
1 files changed, 12 insertions, 0 deletions
diff --git a/dev/sparktestsupport/modules.py b/dev/sparktestsupport/modules.py index 93a8c15e3e..efe58ea2e0 100644 --- a/dev/sparktestsupport/modules.py +++ b/dev/sparktestsupport/modules.py @@ -222,6 +222,18 @@ streaming_flume_sink = Module( ) +streaming_akka = Module( + name="streaming-akka", + dependencies=[streaming], + source_file_regexes=[ + "external/akka", + ], + sbt_test_goals=[ + "streaming-akka/test", + ] +) + + streaming_flume = Module( name="streaming-flume", dependencies=[streaming], |