index
:
spark
2.12/build
SPARK-10001-hotfix
SPARK-10001-sigint
SPARK-14511-genjavadoc
SPARK-17647
WIP-SPARK-17647
escape
genjavadoc
macros
master
packages
scala-2.12
value-classes
Mirror of Apache Spark
about
summary
refs
log
tree
commit
diff
log msg
author
committer
range
path:
root
/
core
/
src
Commit message (
Expand
)
Author
Age
Files
Lines
*
Fixed bug in the number of splits in RDD after checkpointing. Modified reduce...
Tathagata Das
2012-11-19
1
-1
/
+2
*
Fixed checkpointing bug in CoGroupedRDD. CoGroupSplits kept around the RDD sp...
Tathagata Das
2012-11-17
2
-4
/
+42
*
Optimized checkpoint writing by reusing FileSystem object. Fixed bug in updat...
Tathagata Das
2012-11-13
1
-5
/
+1
*
Refactored BlockManagerMaster (not BlockManagerMasterActor) to simplify the c...
Tathagata Das
2012-11-11
3
-198
/
+127
*
Fixed deadlock in BlockManager.
Tathagata Das
2012-11-09
2
-89
/
+101
*
Fixed major bugs in checkpointing.
Tathagata Das
2012-11-05
1
-2
/
+4
*
Made checkpointing of dstream graph to work with checkpointing of RDDs. For s...
Tathagata Das
2012-11-04
2
-15
/
+30
*
Added 'synchronized' to RDD serialization to ensure checkpoint-related change...
Tathagata Das
2012-10-31
3
-4
/
+92
*
Added checkpointing support to all RDDs, along with CheckpointSuite to test c...
Tathagata Das
2012-10-30
22
-107
/
+352
*
Modified RDD API to make dependencies a var (therefore can be changed to chec...
Tathagata Das
2012-10-29
19
-107
/
+149
*
Merge remote-tracking branch 'public/master' into dev
Matei Zaharia
2012-10-24
193
-2097
/
+5043
|
\
|
*
Strip leading mesos:// in URLs passed to Mesos
Matei Zaharia
2012-10-24
1
-2
/
+3
|
*
Merge pull request #281 from rxin/memreport
Matei Zaharia
2012-10-23
3
-71
/
+93
|
|
\
|
|
*
Serialize accumulator updates in TaskResult for local mode.
Reynold Xin
2012-10-15
1
-4
/
+5
|
|
*
Added a method to report slave memory status.
Reynold Xin
2012-10-14
2
-67
/
+88
|
*
|
Merge remote-tracking branch 'JoshRosen/shuffle_refactoring' into dev
Matei Zaharia
2012-10-23
13
-250
/
+113
|
|
\
\
|
|
*
|
Remove map-side combining from ShuffleMapTask.
Josh Rosen
2012-10-13
8
-94
/
+37
|
|
*
|
Remove mapSideCombine field from Aggregator.
Josh Rosen
2012-10-13
5
-22
/
+15
|
|
*
|
Change ShuffleFetcher to return an Iterator.
Josh Rosen
2012-10-13
8
-167
/
+63
|
|
*
|
Add helper methods to Aggregator.
Josh Rosen
2012-10-13
1
-1
/
+32
|
*
|
|
Support for Hadoop 2 distributions such as cdh4
Thomas Dudziak
2012-10-18
7
-20
/
+45
|
|
|
/
|
|
/
|
|
*
|
Made ShuffleDependency automatically find a shuffle ID for itself
Matei Zaharia
2012-10-14
3
-5
/
+6
|
*
|
Take executor environment vars as an arguemnt to SparkContext
Matei Zaharia
2012-10-13
7
-79
/
+107
|
|
/
|
*
Protect from null env variables in mesos.
Denny
2012-10-13
2
-8
/
+16
|
*
Protect from setting null environment variables.
Denny
2012-10-13
1
-1
/
+5
|
*
Don't use system envs for Mesos.
Denny
2012-10-13
2
-2
/
+2
|
*
Let the user specify environment variables to be passed to the Executors.
Denny
2012-10-13
5
-48
/
+21
|
*
More doc updates, and moved Serializer to a subpackage.
Matei Zaharia
2012-10-12
12
-25
/
+51
|
*
Some doc and usability improvements:
Matei Zaharia
2012-10-12
11
-22
/
+83
|
*
Added a test for when an RDD only partially fits in memory
Matei Zaharia
2012-10-12
1
-2
/
+18
|
*
Document cartesian() operation
Matei Zaharia
2012-10-12
2
-0
/
+8
|
*
Merge pull request #271 from shivaram/block-manager-npe-fix
Matei Zaharia
2012-10-12
8
-39
/
+58
|
|
\
|
|
*
Add test to verify if RDD is computed even if block manager has insufficient
Shivaram Venkataraman
2012-10-12
1
-0
/
+10
|
|
*
Change block manager to accept a ArrayBuffer instead of an iterator to ensure
Shivaram Venkataraman
2012-10-11
7
-39
/
+48
|
*
|
Adding Java documentation
Patrick Wendell
2012-10-11
6
-10
/
+454
|
|
/
|
*
Fixed bug when fetching Jar dependencies.
Denny
2012-10-10
2
-6
/
+6
|
*
Added documentation to all the *RDDFunction classes, and moved them into
Matei Zaharia
2012-10-09
9
-54
/
+273
|
*
Updates to documentation:
Matei Zaharia
2012-10-09
1
-1
/
+1
|
*
Fixes a typo, adds scaladoc comments to SparkContext constructors.
Andy Konwinski
2012-10-08
2
-5
/
+11
|
*
More docs in RDD class
Patrick Wendell
2012-10-08
1
-1
/
+45
|
*
A start on scaladoc for the public APIs.
Andy Konwinski
2012-10-08
1
-6
/
+29
|
*
Merge branch 'dev' into bc-fix-dev
Mosharaf Chowdhury
2012-10-08
70
-477
/
+1108
|
|
\
|
|
*
Made compression configurable separately for shuffle, broadcast and RDDs
Matei Zaharia
2012-10-07
4
-38
/
+118
|
|
*
Merge pull request #251 from JoshRosen/docs/internals
Matei Zaharia
2012-10-07
5
-11
/
+40
|
|
|
\
|
|
|
*
Make ShuffleDependency.aggregator explicitly optional.
Josh Rosen
2012-10-07
4
-7
/
+11
|
|
|
*
Document the Dependency classes.
Josh Rosen
2012-10-07
2
-1
/
+26
|
|
|
*
Remove unused isShuffle field from Dependency.
Josh Rosen
2012-10-07
1
-3
/
+3
|
|
*
|
Changed the println to logInfo in Utils.fetchFile.
Reynold Xin
2012-10-07
1
-1
/
+1
|
|
*
|
Merge pull request #250 from rxin/dev
Matei Zaharia
2012-10-07
2
-18
/
+40
|
|
|
\
\
|
|
|
*
|
Fixed a bug in addFile that if the file is specified as "file:///", the
Reynold Xin
2012-10-07
2
-18
/
+40
[next]