index
:
spark
2.12/build
SPARK-10001-hotfix
SPARK-10001-sigint
SPARK-14511-genjavadoc
SPARK-17647
WIP-SPARK-17647
escape
genjavadoc
macros
master
packages
scala-2.12
value-classes
Mirror of Apache Spark
about
summary
refs
log
tree
commit
diff
log msg
author
committer
range
path:
root
/
core
Commit message (
Expand
)
Author
Age
Files
Lines
*
Merge ShufflePerfTester patch into shuffle block consolidation
Aaron Davidson
2013-10-21
16
-446
/
+491
|
\
|
*
Merge pull request #95 from aarondav/perftest
Reynold Xin
2013-10-21
1
-0
/
+0
|
|
\
|
|
*
Put StoragePerfTester in org/apache/
Aaron Davidson
2013-10-21
1
-0
/
+0
|
*
|
Fix mesos urls
Aaron Davidson
2013-10-21
1
-2
/
+2
|
|
/
|
*
Merge pull request #88 from rxin/clean
Patrick Wendell
2013-10-21
7
-101
/
+113
|
|
\
|
|
*
Made JobLogger public again and some minor cleanup.
Reynold Xin
2013-10-20
1
-68
/
+54
|
|
*
Made the following traits/interfaces/classes non-public:
Reynold Xin
2013-10-20
7
-39
/
+65
|
*
|
Merge pull request #41 from pwendell/shuffle-benchmark
Patrick Wendell
2013-10-20
6
-4
/
+141
|
|
\
\
|
|
*
|
Making the timing block more narrow for the sync
Patrick Wendell
2013-10-07
1
-2
/
+2
|
|
*
|
Minor cleanup
Patrick Wendell
2013-10-07
3
-66
/
+45
|
|
*
|
Perf benchmark
Patrick Wendell
2013-10-07
1
-0
/
+89
|
|
*
|
Trying new approach with writes
Patrick Wendell
2013-10-07
2
-7
/
+7
|
|
*
|
Adding option to force sync to the filesystem
Patrick Wendell
2013-10-07
1
-3
/
+17
|
|
*
|
Track and report write throughput for shuffle tasks.
Patrick Wendell
2013-10-07
5
-2
/
+57
|
*
|
|
Merge pull request #89 from rxin/executor
Reynold Xin
2013-10-20
1
-20
/
+23
|
|
\
\
\
|
|
*
|
|
Don't setup the uncaught exception handler in local mode.
Reynold Xin
2013-10-20
1
-20
/
+23
|
|
|
|
/
|
|
|
/
|
|
*
|
|
Merge pull request #75 from JoshRosen/block-manager-cleanup
Matei Zaharia
2013-10-20
1
-292
/
+166
|
|
\
\
\
|
|
*
|
|
Minor cleanup based on @aarondav's code review.
Josh Rosen
2013-10-20
1
-11
/
+5
|
|
*
|
|
De-duplicate code in dropOld[Non]BroadcastBlocks.
Josh Rosen
2013-10-19
1
-20
/
+6
|
|
*
|
|
Code de-duplication in put() and putBytes().
Josh Rosen
2013-10-19
1
-140
/
+89
|
|
*
|
|
De-duplication in getRemote() and getRemoteBytes().
Josh Rosen
2013-10-19
1
-32
/
+18
|
|
*
|
|
De-duplication in getLocal() and getLocalBytes().
Josh Rosen
2013-10-19
1
-100
/
+59
|
*
|
|
|
Merge pull request #84 from rxin/kill1
Reynold Xin
2013-10-20
1
-21
/
+38
|
|
\
\
\
\
|
|
|
_
|
/
/
|
|
/
|
|
|
|
|
*
|
|
Updated setGroupId documentation and marked dagSchedulerSource and blockManag...
Reynold Xin
2013-10-20
1
-4
/
+4
|
|
*
|
|
Added documentation for setJobGroup. Also some minor cleanup in SparkContext.
Reynold Xin
2013-10-19
1
-19
/
+36
|
*
|
|
|
Merge pull request #85 from rxin/clean
Matei Zaharia
2013-10-20
1
-0
/
+2
|
|
\
\
\
\
|
|
|
_
|
/
/
|
|
/
|
|
|
|
|
*
|
|
Moved the top level spark package object from spark to org.apache.spark
Reynold Xin
2013-10-19
1
-0
/
+2
|
|
|
/
/
*
|
|
|
Remove executorId from Task.run()
Aaron Davidson
2013-10-21
3
-3
/
+3
*
|
|
|
Documentation update
Aaron Davidson
2013-10-20
1
-3
/
+1
*
|
|
|
Close shuffle writers during failure & remove executorId from TaskContext
Aaron Davidson
2013-10-20
7
-15
/
+13
*
|
|
|
Cleanup old shuffle file metadata from memory
Aaron Davidson
2013-10-20
2
-7
/
+13
*
|
|
|
Address Josh and Reynold's comments
Aaron Davidson
2013-10-20
6
-18
/
+17
*
|
|
|
Fix compiler errors
Aaron Davidson
2013-10-20
3
-5
/
+5
*
|
|
|
Basic shuffle file consolidation
Aaron Davidson
2013-10-20
8
-14
/
+57
*
|
|
|
Refactor of DiskStore for shuffle file consolidation
Aaron Davidson
2013-10-20
10
-269
/
+366
|
/
/
/
*
|
|
Merge pull request #78 from mosharaf/master
Reynold Xin
2013-10-19
4
-2125
/
+0
|
\
\
\
|
|
/
/
|
/
|
|
|
*
|
Removed BitTorrentBroadcast and TreeBroadcast. TorrentBroadcast is replacing ...
Mosharaf Chowdhury
2013-10-18
4
-2125
/
+0
*
|
|
Merge pull request #74 from rxin/kill
Matei Zaharia
2013-10-18
4
-7
/
+75
|
\
\
\
|
|
/
/
|
/
|
|
|
*
|
Job cancellation via job group id.
Reynold Xin
2013-10-18
4
-7
/
+75
*
|
|
Merge pull request #68 from mosharaf/master
Matei Zaharia
2013-10-18
5
-9
/
+308
|
\
\
\
|
*
|
|
Should compile now.
Mosharaf Chowdhury
2013-10-17
1
-1
/
+2
|
*
|
|
Added an after block to reset spark.broadcast.factory
Mosharaf Chowdhury
2013-10-17
1
-0
/
+4
|
*
|
|
BroadcastSuite updated to test both HttpBroadcast and TorrentBroadcast in loc...
Mosharaf Chowdhury
2013-10-17
1
-3
/
+44
|
*
|
|
Merge remote-tracking branch 'upstream/master'
Mosharaf Chowdhury
2013-10-17
9
-105
/
+63
|
|
\
|
|
|
*
|
|
Code styling. Updated doc.
Mosharaf Chowdhury
2013-10-17
1
-4
/
+4
|
*
|
|
Removed unused code.
Mosharaf Chowdhury
2013-10-17
2
-14
/
+11
|
*
|
|
Fixes for the new BlockId naming convention.
Mosharaf Chowdhury
2013-10-16
2
-7
/
+14
|
*
|
|
Default blockSize is 4MB.
Mosharaf Chowdhury
2013-10-16
1
-1
/
+1
|
*
|
|
Removed unnecessary code, and added comment of memory-latency tradeoff.
Mosharaf Chowdhury
2013-10-16
1
-4
/
+6
|
*
|
|
Torrent-ish broadcast based on BlockManager.
Mosharaf Chowdhury
2013-10-16
3
-4
/
+251
[next]