aboutsummaryrefslogtreecommitdiff
Commit message (Expand)AuthorAgeFilesLines
* Update spark_ec2.py to use new spark-ec2 scriptsShivaram Venkataraman2013-01-262-12/+32
* Merge pull request #416 from stephenh/morefinallyMatei Zaharia2013-01-252-29/+30
|\
| * Call executeOnCompleteCallbacks in more finally blocks.Stephen Haberman2013-01-252-29/+30
|/
* Merge pull request #411 from stephenh/localsparkcontextMatei Zaharia2013-01-2417-246/+110
|\
| * Merge branch 'master' into localsparkcontextStephen Haberman2013-01-2463-704/+783
| |\ | |/ |/|
* | Merge pull request #412 from pwendell/master-url-warningMatei Zaharia2013-01-241-0/+5
|\ \
| * | SPARK-541: Adding a warning for invalid Master URLPatrick Wendell2013-01-241-0/+5
|/ /
* | Merge pull request #396 from JoshRosen/spark-653Matei Zaharia2013-01-242-14/+29
|\ \
| * | Remove use of abc.ABCMeta due to cloudpickle issue.Josh Rosen2013-01-231-7/+4
| * | Make AccumulatorParam an abstract base class.Josh Rosen2013-01-212-13/+31
* | | Merge pull request #410 from rxin/splitpruningrddMatei Zaharia2013-01-231-1/+6
|\ \ \
| * | | Added a clearDependencies method in PartitionPruningRDD.Reynold Xin2013-01-231-1/+6
* | | | Merge pull request #409 from rxin/splitpruningrddMatei Zaharia2013-01-233-11/+64
|\| | |
| * | | Updated PruneDependency to change "split" to "partition".Reynold Xin2013-01-232-6/+6
| * | | Removed pruneSplits method in RDD and renamed SplitsPruningRDD toReynold Xin2013-01-234-37/+27
| * | | Marked prev RDD as transient in SplitsPruningRDD.Reynold Xin2013-01-231-2/+2
| * | | Created a PruneDependency to properly assign dependency forReynold Xin2013-01-232-7/+25
| * | | Updated assert == to ===.Reynold Xin2013-01-231-3/+3
| * | | Added an extra assert for split size check.Reynold Xin2013-01-231-2/+5
| * | | Added pruntSplits method to RDD.Reynold Xin2013-01-233-7/+49
* | | | Merge remote-tracking branch 'woggling/remove-machines'Matei Zaharia2013-01-232-9/+102
|\ \ \ \
| * | | | Remove more dead code from test.Charles Reiss2013-01-231-1/+0
| * | | | Clarify TODO.Charles Reiss2013-01-231-1/+2
| * | | | Remove dead code in test.Charles Reiss2013-01-231-2/+0
| * | | | Add tests of various node failure scenarios.Charles Reiss2013-01-231-0/+72
| * | | | Extra debugging from hostLost()Charles Reiss2013-01-231-1/+4
| * | | | Force generation increment after shuffle map stageCharles Reiss2013-01-231-1/+8
| * | | | Use generation numbers for fetch failure trackingCharles Reiss2013-01-221-7/+20
| | |/ / | |/| |
* | | | Fix compile error due to cherry-pickMatei Zaharia2013-01-231-1/+1
* | | | be sure to set class loader of kryo instancesImran Rashid2013-01-231-1/+4
* | | | Merge pull request #407 from woggling/no-cache-trackerMatei Zaharia2013-01-237-411/+83
|\ \ \ \
| * | | | Actually add CacheManager.Charles Reiss2013-01-231-0/+65
| * | | | Eliminate CacheTracker.Charles Reiss2013-01-226-411/+18
* | | | | Merge pull request #406 from tdas/masterMatei Zaharia2013-01-2311-61/+121
|\ \ \ \ \
| * | | | | One more fix. Made even default constructor of BlockManagerId private to prev...Tathagata Das2013-01-233-7/+14
| * | | | | Made StorageLevel constructor private, and added StorageLevels.create() to th...Tathagata Das2013-01-234-5/+18
| * | | | | Modified StorageLevel API to ensure zero duplicate objects.Tathagata Das2013-01-224-26/+44
| * | | | | Modified BlockManagerId API to ensure zero duplicate objects. Fixed BlockMana...Tathagata Das2013-01-226-29/+51
* | | | | | Merge pull request #394 from JoshRosen/add_file_fixMatei Zaharia2013-01-2319-77/+249
|\ \ \ \ \ \ | |_|_|_|/ / |/| | | | |
| * | | | | Allow PySpark's SparkFiles to be used from driverJosh Rosen2013-01-236-13/+67
| * | | | | Fix sys.path bug in PySpark SparkContext.addPyFileJosh Rosen2013-01-224-7/+41
| * | | | | Add synchronization to Executor.updateDependencies() (SPARK-662)Josh Rosen2013-01-211-16/+18
| * | | | | Don't download files to master's working directory.Josh Rosen2013-01-2116-51/+133
* | | | | | Merge pull request #405 from JoshRosen/spark-530Matei Zaharia2013-01-221-0/+31
|\ \ \ \ \ \
| * | | | | | Add test for driver hanging on exit (SPARK-530).Josh Rosen2013-01-221-0/+31
|/ / / / / /
* | | | | | Merge remote-tracking branch 'stephenh/cleanup'Matei Zaharia2013-01-2215-58/+31
|\ \ \ \ \ \
| * | | | | | Further simplify getOrElse call.Stephen Haberman2013-01-211-1/+1
| * | | | | | Minor cleanup.Stephen Haberman2013-01-2116-60/+33
* | | | | | | Merge pull request #397 from JoshRosen/refactoring/daemon-threadsMatei Zaharia2013-01-225-50/+13
|\ \ \ \ \ \ \
| * | | | | | | Refactor daemon thread pool creation.Josh Rosen2013-01-215-50/+13
| | |_|_|_|/ / | |/| | | | |