index
:
spark
2.12/build
SPARK-10001-hotfix
SPARK-10001-sigint
SPARK-14511-genjavadoc
SPARK-17647
WIP-SPARK-17647
escape
genjavadoc
macros
master
packages
scala-2.12
value-classes
Mirror of Apache Spark
about
summary
refs
log
tree
commit
diff
log msg
author
committer
range
Commit message (
Expand
)
Author
Age
Files
Lines
...
|
*
|
|
|
Modifications to make sure LocalScheduler terminate cleanly without errors wh...
Tathagata Das
2012-12-27
5
-18
/
+29
|
*
|
|
|
Merge branch 'mesos' into dev-merge
Tathagata Das
2012-12-26
8
-158
/
+108
|
|
\
\
\
\
|
*
\
\
\
\
Merge branch 'dev-checkpoint' of github.com:radlab/spark into dev-merge
Tathagata Das
2012-12-26
27
-479
/
+930
|
|
\
\
\
\
\
|
|
|
_
|
_
|
/
/
|
|
/
|
|
|
|
|
|
*
|
|
|
Merge branch 'dev' of github.com:radlab/spark into dev-checkpoint
Tathagata Das
2012-12-20
19
-122
/
+717
|
|
|
\
\
\
\
|
|
*
|
|
|
|
Fixed bugs in CheckpointRDD and spark.CheckpointSuite.
Tathagata Das
2012-12-20
3
-12
/
+9
|
|
*
|
|
|
|
Changed checkpoint writing and reading process.
Tathagata Das
2012-12-20
3
-25
/
+124
|
|
*
|
|
|
|
Introduced getSpits, getDependencies, and getPreferredLocations in RDD and RD...
Tathagata Das
2012-12-18
22
-113
/
+134
|
|
*
|
|
|
|
Converted CheckpointState in RDDCheckpointData to use scala Enumeration.
Tathagata Das
2012-12-17
1
-26
/
+22
|
|
*
|
|
|
|
Made checkpoint data in RDDs optional to further reduce serialized size.
Tathagata Das
2012-12-11
4
-17
/
+29
|
|
*
|
|
|
|
Fixed bug in UnionRDD and CoGroupedRDD
Tathagata Das
2012-12-11
3
-115
/
+10
|
|
*
|
|
|
|
Bunch of bug fixes related to checkpointing in RDDs. RDDCheckpointData object...
Tathagata Das
2012-12-10
13
-90
/
+389
|
|
*
|
|
|
|
Modified checkpoint testsuite to more comprehensively test checkpointing of v...
Tathagata Das
2012-12-07
14
-110
/
+285
|
|
*
|
|
|
|
Refactored RDD checkpointing to minimize extra fields in RDD class.
Tathagata Das
2012-12-04
12
-194
/
+144
|
*
|
|
|
|
|
Merge branch 'master' of github.com:mesos/spark into dev
Reynold Xin
2012-12-20
90
-899
/
+3244
|
|
\
\
\
\
\
\
|
|
|
_
|
/
/
/
/
|
|
/
|
|
|
|
|
|
*
|
|
|
|
|
Added clear property to JavaAPISuite to remove port binding errors.
Tathagata Das
2012-12-11
1
-0
/
+2
|
*
|
|
|
|
|
Merge pull request #5 from radlab/flume-integration
Tathagata Das
2012-12-09
11
-10
/
+280
|
|
\
\
\
\
\
\
|
|
*
|
|
|
|
|
Changes in response to TD's review.
Patrick Wendell
2012-12-07
7
-18
/
+32
|
|
*
|
|
|
|
|
Adding Flume InputDStream
Patrick Wendell
2012-12-07
9
-7
/
+248
|
|
*
|
|
|
|
|
Adding locality aware parallelize
Patrick Wendell
2012-12-07
2
-3
/
+18
|
|
|
|
_
|
_
|
_
|
/
|
|
|
/
|
|
|
|
|
*
/
|
|
|
|
Removed unnecessary testcases.
Tathagata Das
2012-12-08
1
-4
/
+4
|
|
/
/
/
/
/
|
*
|
|
|
|
Added kafka JAR
Denny
2012-12-05
2
-1
/
+1
|
*
|
|
|
|
Adjust Kafka code to work with new streaming changes.
Denny
2012-12-05
2
-4
/
+5
|
*
|
|
|
|
Merge branch 'dev' into kafka
Denny
2012-12-05
69
-355
/
+1024
|
|
\
\
\
\
\
|
|
|
|
/
/
/
|
|
|
/
|
|
|
|
|
*
|
|
|
Added metadata cleaner to HttpBroadcast to clean up old broacast files.
Tathagata Das
2012-12-03
1
-0
/
+24
|
|
*
|
|
|
Minor mods
Tathagata Das
2012-12-02
1
-1
/
+1
|
|
*
|
|
|
Made RDD checkpoint not create a new thread. Fixed bug in detecting when spar...
Tathagata Das
2012-12-02
3
-26
/
+17
|
|
*
|
|
|
Minor modifications.
Tathagata Das
2012-12-01
4
-6
/
+28
|
|
*
|
|
|
Added ssc.union
Tathagata Das
2012-12-01
2
-1
/
+6
|
|
*
|
|
|
Added TimeStampedHashSet and used that to cleanup the list of registered RDD ...
Tathagata Das
2012-11-29
3
-9
/
+81
|
|
*
|
|
|
Added metadata cleaner to BlockManager to remove old blocks completely.
Tathagata Das
2012-11-28
2
-12
/
+36
|
|
*
|
|
|
Renamed CleanupTask to MetadataCleaner.
Tathagata Das
2012-11-28
5
-14
/
+15
|
|
*
|
|
|
Modified StorageLevel and BlockManagerId to cache common objects and use cach...
Tathagata Das
2012-11-28
4
-29
/
+101
|
|
*
|
|
|
Bug fixes
Tathagata Das
2012-11-28
3
-10
/
+20
|
|
*
|
|
|
Modified bunch HashMaps in Spark to use TimeStampedHashMap and made various m...
Tathagata Das
2012-11-27
7
-18
/
+165
|
|
*
|
|
|
Merged branch mesos/master to branch dev.
Tathagata Das
2012-11-26
34
-169
/
+467
|
|
|
\
\
\
\
|
|
*
|
|
|
|
Modified StreamingContext API to make constructor accept the batch size (sinc...
Tathagata Das
2012-11-19
16
-98
/
+92
|
|
*
|
|
|
|
Fixed bug in the number of splits in RDD after checkpointing. Modified reduce...
Tathagata Das
2012-11-19
6
-5
/
+14
|
*
|
|
|
|
|
Added Kafka Wordcount producer
Denny
2012-11-19
2
-25
/
+52
|
*
|
|
|
|
|
Comment out code for fault-tolerance.
Denny
2012-11-19
1
-17
/
+18
|
*
|
|
|
|
|
Merge branch 'dev' into kafka
Denny
2012-11-19
9
-7
/
+380
|
|
\
|
|
|
|
|
|
|
*
|
|
|
|
Merge branch 'dev' of github.com:radlab/spark into dev
Tathagata Das
2012-11-17
5
-0
/
+335
|
|
|
\
\
\
\
\
|
|
|
*
\
\
\
\
Merge pull request #4 from radlab/streaming-example
Patrick Wendell
2012-11-16
2
-0
/
+170
|
|
|
|
\
\
\
\
\
|
|
|
|
*
|
|
|
|
A "streaming page view" example.
Patrick Wendell
2012-11-16
2
-0
/
+170
|
|
|
*
|
|
|
|
|
Merge pull request #3 from radlab/streaming-docs
Patrick Wendell
2012-11-14
3
-0
/
+165
|
|
|
|
\
\
\
\
\
\
|
|
|
|
*
|
|
|
|
|
Streaming programming guide. STREAMING-2 #resolve
Patrick Wendell
2012-11-13
3
-0
/
+165
|
|
|
|
|
/
/
/
/
/
|
|
*
|
/
/
/
/
/
Fixed checkpointing bug in CoGroupedRDD. CoGroupSplits kept around the RDD sp...
Tathagata Das
2012-11-17
4
-7
/
+45
|
|
|
/
/
/
/
/
/
|
*
|
|
|
|
|
|
Merge branch 'dev' into kafka
Denny
2012-11-13
10
-128
/
+156
|
|
\
|
|
|
|
|
|
|
|
*
|
|
|
|
|
Fixed bug in MappedValuesRDD, and set default graph checkpoint interval to be...
Tathagata Das
2012-11-13
3
-5
/
+22
|
|
*
|
|
|
|
|
Replaced StateRDD in StateDStream with MapPartitionsRDD.
Tathagata Das
2012-11-13
1
-12
/
+3
|
|
*
|
|
|
|
|
Optimized checkpoint writing by reusing FileSystem object. Fixed bug in updat...
Tathagata Das
2012-11-13
8
-111
/
+129
[prev]
[next]