index
:
spark
2.12/build
SPARK-10001-hotfix
SPARK-10001-sigint
SPARK-14511-genjavadoc
SPARK-17647
WIP-SPARK-17647
escape
genjavadoc
macros
master
packages
scala-2.12
value-classes
Mirror of Apache Spark
about
summary
refs
log
tree
commit
diff
log msg
author
committer
range
path:
root
/
streaming
Commit message (
Expand
)
Author
Age
Files
Lines
...
|
*
|
Merge branch 'streaming' into ScrapCode-streaming
Tathagata Das
2013-02-18
45
-1027
/
+2015
|
|
\
\
|
|
*
|
Added checkpointing and fault-tolerance semantics to the programming guide. F...
Tathagata Das
2013-02-18
6
-6
/
+11
|
|
*
|
Many changes to ensure better 2nd recovery if 2nd failure happens while
Tathagata Das
2013-02-17
18
-97
/
+208
|
|
*
|
Made MasterFailureTest more robust.
Tathagata Das
2013-02-15
1
-4
/
+22
|
|
*
|
Moved Java streaming examples to examples/src/main/java/spark/streaming/... a...
Tathagata Das
2013-02-14
1
-1
/
+1
|
|
*
|
Added TwitterInputDStream from example to StreamingContext. Renamed example T...
Tathagata Das
2013-02-14
2
-17
/
+105
|
|
*
|
Removed countByKeyAndWindow on paired DStreams, and added countByValueAndWind...
Tathagata Das
2013-02-14
8
-183
/
+226
|
|
*
|
Changes functions comments to make them more consistent.
Tathagata Das
2013-02-13
2
-45
/
+45
|
|
*
|
Added filter functionality to reduceByKeyAndWindow with inverse. Consolidated...
Tathagata Das
2013-02-13
7
-81
/
+102
|
|
*
|
Changed scheduler and file input stream to fix bugs in the driver fault toler...
Tathagata Das
2013-02-13
18
-452
/
+693
|
|
*
|
Fixed bugs in FileInputDStream and Scheduler that occasionally failed to repr...
Tathagata Das
2013-02-10
6
-91
/
+221
|
|
*
|
Added an initial spark job to ensure worker nodes are initialized.
Tathagata Das
2013-02-09
2
-2
/
+7
|
|
*
|
Merge branch 'mesos-master' into streaming
Tathagata Das
2013-02-07
22
-15
/
+195
|
|
|
\
|
|
|
|
*
Streaming constructor which takes JavaSparkContext
Patrick Wendell
2013-02-05
1
-0
/
+8
|
|
|
*
Remove activation of profiles by default
Mikhail Bautin
2013-01-31
1
-11
/
+0
|
|
|
*
Merge pull request #415 from stephenh/driver
Matei Zaharia
2013-01-29
7
-8
/
+8
|
|
|
|
\
|
|
|
|
*
Replace old 'master' term with 'driver'.
Stephen Haberman
2013-01-25
7
-8
/
+8
|
|
|
*
|
Fix code that depended on metadata cleaner interval being in minutes
Matei Zaharia
2013-01-28
2
-5
/
+5
|
|
|
|
/
|
|
|
*
Refactor daemon thread pool creation.
Josh Rosen
2013-01-21
1
-2
/
+3
|
|
|
*
Move JavaAPISuite into spark.streaming.
Stephen Haberman
2013-01-21
2
-0
/
+0
|
|
|
*
Add Maven build file for streaming, and fix some issues in SBT file
Matei Zaharia
2013-01-20
10
-0
/
+182
|
|
*
|
Updated JavaStreamingContext with updated kafkaStream API.
Tathagata Das
2013-02-07
1
-17
/
+9
|
|
*
|
Merge branch 'mesos-streaming' into streaming
Tathagata Das
2013-02-07
5
-88
/
+91
|
|
|
\
\
|
|
|
*
\
Merge pull request #372 from Reinvigorate/sm-kafka
Tathagata Das
2013-02-07
2
-91
/
+13
|
|
|
|
\
\
|
|
|
|
*
|
kafkaStream API cleanup. A quorum of zookeepers can now be specified
seanm
2013-01-18
2
-15
/
+10
|
|
|
|
*
|
further KafkaInputDStream cleanup (removing unused and commented out code rel...
seanm
2013-01-18
1
-69
/
+3
|
|
|
|
*
|
Removing offset management code that is non-existent in kafka 0.7.0+
seanm
2013-01-14
1
-7
/
+0
|
|
|
*
|
|
Merge pull request #373 from Reinvigorate/sm-updateStateByKey
Tathagata Das
2013-02-07
4
-6
/
+78
|
|
|
|
\
\
\
|
|
|
|
|
_
|
/
|
|
|
|
/
|
|
|
|
|
|
*
|
Splitting StreamingContext.queueStream into two methods
seanm
2013-01-20
1
-4
/
+18
|
|
|
|
*
|
adding updateStateByKey object lifecycle test
seanm
2013-01-20
2
-0
/
+50
|
|
|
|
*
|
Merge branch 'streaming' into sm-updateStateByKey
seanm
2013-01-15
3
-8
/
+8
|
|
|
|
|
\
\
|
|
|
|
*
|
|
StateDStream changes to give updateStateByKey consistent behavior
seanm
2013-01-14
1
-2
/
+10
|
|
|
|
|
|
/
|
|
|
|
|
/
|
|
|
*
|
|
|
Fixed checkpoint testcases
Tathagata Das
2013-01-23
3
-172
/
+129
|
|
*
|
|
|
Added support for rescheduling unprocessed batches on master failure.
Tathagata Das
2013-01-23
5
-12
/
+53
|
|
*
|
|
|
Added support for saving input files of FileInputDStream to graph checkpoints...
Tathagata Das
2013-01-22
6
-66
/
+159
|
|
*
|
|
|
Refactored DStreamCheckpointData.
Tathagata Das
2013-01-22
4
-64
/
+99
|
|
|
/
/
/
|
*
|
|
|
Plug in actor as stream receiver API
Prashant Sharma
2013-01-19
3
-0
/
+152
|
*
|
|
|
Changed method name of createReceiver to getReceiver as it is not intended to...
Prashant Sharma
2013-01-19
6
-28
/
+28
*
|
|
|
|
actor as receiver
Prashant Sharma
2013-01-22
4
-0
/
+269
*
|
|
|
|
Changed method name of createReceiver to getReceiver as it is not intended to...
Prashant Sharma
2013-01-21
6
-8
/
+8
|
|
/
/
/
|
/
|
|
|
*
|
|
|
Fixed streaming testsuite bugs
Tathagata Das
2013-01-20
7
-6
/
+24
*
|
|
|
Merge branch 'mesos-streaming' into streaming
Tathagata Das
2013-01-20
8
-120
/
+2452
|
\
|
|
|
|
*
|
|
Moving tests to appropriate directory
Patrick Wendell
2013-01-17
2
-0
/
+0
|
*
|
|
Adding queueStream and some slight refactoring
Patrick Wendell
2013-01-17
2
-81
/
+163
|
*
|
|
Merge branch 'streaming' into streaming-java-api
Patrick Wendell
2013-01-17
1
-3
/
+3
|
|
\
\
\
|
|
|
|
/
|
|
|
/
|
|
*
|
|
Import fixup
Patrick Wendell
2013-01-17
3
-3
/
+0
|
*
|
|
Style cleanup
Patrick Wendell
2013-01-17
3
-3
/
+26
|
*
|
|
Checkpointing in Streaming java API
Patrick Wendell
2013-01-17
3
-3
/
+93
|
*
|
|
Adding flatMap
Patrick Wendell
2013-01-17
2
-4
/
+106
|
*
|
|
Adding other updateState functions
Patrick Wendell
2013-01-17
1
-13
/
+49
[prev]
[next]