index
:
spark
2.12/build
SPARK-10001-hotfix
SPARK-10001-sigint
SPARK-14511-genjavadoc
SPARK-17647
WIP-SPARK-17647
escape
genjavadoc
macros
master
packages
scala-2.12
value-classes
Mirror of Apache Spark
about
summary
refs
log
tree
commit
diff
log msg
author
committer
range
Commit message (
Expand
)
Author
Age
Files
Lines
*
Merge pull request #377 from andrewor14/master
Patrick Wendell
2014-01-10
17
-93
/
+1118
|
\
|
*
Update documentation for externalSorting
Andrew Or
2014-01-10
1
-3
/
+2
|
*
Address Patrick's and Reynold's comments
Andrew Or
2014-01-10
5
-47
/
+73
|
*
Fix wonky imports from merge
Andrew Or
2014-01-09
1
-8
/
+1
|
*
Defensively allocate memory from global pool
Andrew Or
2014-01-09
5
-47
/
+80
|
*
Merge github.com:apache/incubator-spark
Andrew Or
2014-01-09
293
-2974
/
+5557
|
|
\
|
*
|
Get SparkConf from SparkEnv, rather than creating new ones
Andrew Or
2014-01-07
3
-6
/
+6
|
*
|
Use AtomicInteger for numRunningTasks
Andrew Or
2014-01-04
1
-12
/
+7
|
*
|
Address Mark's comments
Andrew Or
2014-01-04
3
-18
/
+13
|
*
|
Assign spill threshold as a fraction of maximum memory
Andrew Or
2014-01-04
5
-33
/
+81
|
*
|
Remove unnecessary ClassTag's
Andrew Or
2014-01-03
2
-7
/
+4
|
*
|
Refactor using SparkConf
Andrew Or
2014-01-03
4
-19
/
+21
|
*
|
Merge remote-tracking branch 'spark/master'
Andrew Or
2014-01-02
182
-1764
/
+3172
|
|
\
\
|
*
|
|
TempBlockId takes UUID and is explicitly non-serializable
Aaron Davidson
2014-01-02
2
-5
/
+6
|
*
|
|
Simplify ExternalAppendOnlyMap on the assumption that the mergeCombiners func...
Andrew Or
2014-01-01
3
-135
/
+53
|
*
|
|
Merge branch 'master' of github.com:andrewor14/incubator-spark
Andrew Or
2013-12-31
4
-9
/
+9
|
|
\
\
\
|
|
*
|
|
Rename IntermediateBlockId to TempBlockId
Aaron Davidson
2013-12-31
4
-9
/
+9
|
*
|
|
|
Address Patrick's and Reynold's comments
Andrew Or
2013-12-31
1
-49
/
+71
|
|
/
/
/
|
*
|
|
Merge branch 'master' of github.com:andrewor14/incubator-spark
Andrew Or
2013-12-31
3
-97
/
+71
|
|
\
\
\
|
|
*
|
|
Add new line at end of file
Aaron Davidson
2013-12-30
1
-1
/
+1
|
|
*
|
|
Refactor SamplingSizeTracker into SizeTrackingAppendOnlyMap
Aaron Davidson
2013-12-30
3
-97
/
+71
|
*
|
|
|
Add support and test for null keys in ExternalAppendOnlyMap
Andrew Or
2013-12-31
4
-32
/
+139
|
*
|
|
|
Add warning message for spilling
Andrew Or
2013-12-31
1
-5
/
+9
|
*
|
|
|
Address Aaron's and Jerry's comments
Andrew Or
2013-12-31
2
-5
/
+6
|
|
/
/
/
|
*
|
|
Fix CheckpointSuite test fail
Andrew Or
2013-12-30
1
-2
/
+2
|
*
|
|
Simplify merge logic based on the invariant that all spills contain unique keys
Andrew Or
2013-12-30
1
-37
/
+22
|
*
|
|
Merge pull request from aarondav: Utilize DiskBlockManager pathway for temp f...
Andrew Or
2013-12-30
3
-16
/
+49
|
*
|
|
Merge branch 'master' of github.com:andrewor14/incubator-spark
Andrew Or
2013-12-29
2
-9
/
+11
|
|
\
\
\
|
|
*
|
|
Use Comparator instead of Ordering
Aaron Davidson
2013-12-29
2
-9
/
+11
|
*
|
|
|
Add test suite for ExternalAppendOnlyMap
Andrew Or
2013-12-29
1
-0
/
+217
|
*
|
|
|
Make serializer a parameter to ExternalAppendOnlyMap
Andrew Or
2013-12-29
2
-4
/
+4
|
|
/
/
/
|
*
|
|
Address Aaron's comments
Andrew Or
2013-12-29
5
-88
/
+188
|
*
|
|
Add Apache headers
Aaron Davidson
2013-12-27
3
-4
/
+54
|
*
|
|
Rename spark.shuffle.buffer variables
Andrew Or
2013-12-27
1
-2
/
+2
|
*
|
|
Final cleanup
Andrew Or
2013-12-26
4
-25
/
+28
|
*
|
|
Use real serializer & manual ordering
Aaron Davidson
2013-12-26
1
-11
/
+27
|
*
|
|
Return efficient iterator if no spillage happened
Aaron Davidson
2013-12-26
3
-9
/
+20
|
*
|
|
Sort AppendOnlyMap in-place
Andrew Or
2013-12-26
2
-14
/
+51
|
*
|
|
Fix streaming JavaAPISuite again
Andrew Or
2013-12-26
1
-8
/
+12
|
*
|
|
Fix streaming JavaAPISuite that depended on order
Aaron Davidson
2013-12-26
1
-11
/
+16
|
*
|
|
Allow Product2 rather than just tuple kv pairs
Aaron Davidson
2013-12-26
2
-8
/
+8
|
*
|
|
Move maps to util, and refactor more
Andrew Or
2013-12-26
7
-23
/
+22
|
*
|
|
SamplingSizeTracker + Map + test suite
Aaron Davidson
2013-12-26
5
-11
/
+204
|
*
|
|
New minor edits
Andrew Or
2013-12-26
3
-54
/
+49
|
*
|
|
Minor cleanup for Scala style
Aaron Davidson
2013-12-26
3
-55
/
+55
|
*
|
|
Add toggle for ExternalAppendOnlyMap in Aggregator and CoGroupedRDD
Andrew Or
2013-12-26
3
-24
/
+65
|
*
|
|
Provide for cases when mergeCombiners is not specified in ExternalAppendOnlyMap
Andrew Or
2013-12-26
2
-68
/
+121
|
*
|
|
Refactor ExternalAppendOnlyMap to take in KVC instead of just KV
Andrew Or
2013-12-26
3
-76
/
+78
|
*
|
|
Working ExternalAppendOnlyMap for both CoGroupedRDDs and Aggregator
Andrew Or
2013-12-26
4
-66
/
+61
|
*
|
|
Working ExternalAppendOnlyMap for Aggregator, but not for CoGroupedRDD
Andrew Or
2013-12-26
4
-21
/
+182
[next]