aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Activate hadoop1 profile by default for maven buildsShivaram Venkataraman2013-01-076-1/+19
|
* Update expected size of strings to match our dummy string classShivaram Venkataraman2013-01-071-18/+13
|
* Make default hadoop version 1.0.3 in pom.xmlShivaram Venkataraman2013-01-071-1/+1
|
* Use a dummy string class in Size Estimator tests to make it resistant to jdkShivaram Venkataraman2013-01-071-12/+21
| | | | versions
* Remove unused BoundedMemoryCache file and associated test case.Shivaram Venkataraman2013-01-072-176/+0
|
* Update Hadoop dependency to 1.0.3 as 0.20 has Sun specific dependencies. AlsoShivaram Venkataraman2013-01-072-2/+8
| | | | | fix SequenceFileRDDFunctions to pick the right type conversion across Hadoop versions
* Remove dependencies on sun jvm classes. Instead use reflection to inferShivaram Venkataraman2013-01-072-6/+29
| | | | HotSpot options and total physical memory size
* Merge branch 'master' of github.com:mesos/sparkMatei Zaharia2013-01-072-0/+17
|\
| * Merge pull request #351 from stephenh/valuesMatei Zaharia2013-01-052-0/+17
| |\ | | | | | | Add PairRDDFunctions.keys and values.
| | * Fix typo.Stephen Haberman2013-01-051-1/+1
| | |
| | * Add PairRDDFunctions.keys and values.Stephen Haberman2013-01-052-0/+17
| | |
* | | Add Accumulable.setValue for easier use in JavaMatei Zaharia2013-01-072-5/+19
| | |
* | | Add PairRDD.keys() and values() to Java APIMatei Zaharia2013-01-051-0/+10
|/ /
* | Add methods called just 'accumulator' for int/double in Java APIMatei Zaharia2013-01-052-2/+15
| |
* | Fix Accumulators in Java, and add a test for themMatei Zaharia2013-01-054-13/+79
| |
* | Merge pull request #352 from stephenh/collectMatei Zaharia2013-01-052-0/+8
|\ \ | |/ |/| Add RDD.collect(PartialFunction).
| * Add RDD.collect(PartialFunction).Stephen Haberman2013-01-052-0/+8
|/
* Merge pull request #349 from woggling/cache-finallyMatei Zaharia2013-01-012-11/+28
|\ | | | | Avoid stalls when computation of cached RDD throws exception
| * Remove some dead commentsCharles Reiss2013-01-011-6/+0
| |
| * Test with exception while computing cached RDD.Charles Reiss2013-01-011-0/+23
| |
| * Mark key as not loading in CacheTracker even when compute() failsCharles Reiss2013-01-011-10/+10
| |
* | Merge pull request #348 from JoshRosen/spark-597Matei Zaharia2013-01-014-0/+58
|\ \ | |/ |/| Raise exception when hashing Java arrays (SPARK-597)
| * Raise exception when hashing Java arrays (SPARK-597)Josh Rosen2012-12-314-0/+58
|/
* Merge pull request #345 from JoshRosen/fix/add-fileMatei Zaharia2012-12-294-36/+101
|\ | | | | Fix deletion of files in current working directory by clearFiles()
| * Change Utils.fetchFile() warning to SparkException.Josh Rosen2012-12-282-7/+10
| |
| * Add addFile() and addJar() to JavaSparkContext.Josh Rosen2012-12-281-0/+34
| |
| * Add synchronization to LocalScheduler.updateDependencies().Josh Rosen2012-12-281-16/+18
| |
| * Skip deletion of files in clearFiles().Josh Rosen2012-12-282-20/+46
|/ | | | | | | | | | | | | | | | This fixes an issue where Spark could delete original files in the current working directory that were added to the job using addFile(). There was also the potential for addFile() to overwrite local files, which is addressed by changing Utils.fetchFile() to log a warning instead of overwriting a file with new contents. This is a short-term fix; a better long-term solution would be to remove the dependence on storing files in the current working directory, since we can't change the cwd from Java.
* Merge pull request #343 from markhamstra/spark-601Matei Zaharia2012-12-242-1/+12
|\ | | | | lookup() needn't fail when there is no partitioner
| * fall back to filter-map-collect when calling lookup() on an RDD without a ↵Mark Hamstra2012-12-242-1/+12
|/ | | | partitioner
* Merge pull request #342 from markhamstra/spark-645Matei Zaharia2012-12-242-5/+11
|\ | | | | Allow distinct() to be called without parentheses
| * Allow distinct() to be called without parentheses when using the default ↵Mark Hamstra2012-12-242-5/+11
|/ | | | number of splits.
* Updated Kryo version for Maven pom file.Reynold Xin2012-12-211-1/+1
|
* Updated Kryo documentation for Kryo version update.Reynold Xin2012-12-211-14/+16
|
* Remove the call to close input stream in Kryo serializer.Reynold Xin2012-12-211-1/+1
|
* Merge pull request #341 from rxin/4a3fb06ac2d11125feb08acbbd4df76d1e91b677Matei Zaharia2012-12-212-138/+69
|\ | | | | Kryo2 update against Spark master
| * Updated Kryo to 2.20.Reynold Xin2012-10-162-138/+69
| |
* | Merge pull request #327 from rxin/spark-633Matei Zaharia2012-12-2017-770/+1097
|\ \ | | | | | | Added the ability in block manager to remove blocks.
| * | Let the slave notify the master block removal.Reynold Xin2012-12-205-93/+84
| | |
| * | Moved BlockManager's IdGenerator into BlockManager object. Removed someReynold Xin2012-12-195-36/+22
| | | | | | | | | | | | excessive debug messages.
| * | Merge branch 'spark-633' of github.com:rxin/spark into spark-633Reynold Xin2012-12-144-7/+23
| |\ \
| | * | Return success or failure in BlockStore.remove().Josh Rosen2012-12-134-7/+23
| | | |
| * | | Fixed conflicts from merging Charles' and TD's block manager changes.Reynold Xin2012-12-143-173/+158
| | | |
| * | | Merge branch 'master' of github.com:mesos/spark into spark-633Reynold Xin2012-12-131-7/+9
| |\ \ \
| * | | | Merged TD's block manager refactoring.Reynold Xin2012-12-139-647/+805
| | | | |
| * | | | Merge branch 'master' of github.com:mesos/spark into spark-633Reynold Xin2012-12-1312-21/+138
| |\ \ \ \
| * \ \ \ \ Merge branch 'master' of github.com:mesos/spark into spark-633Reynold Xin2012-12-1329-231/+268
| |\ \ \ \ \ | | |_|_|/ / | |/| | | |
| * | | | | Added the ability in block manager to remove blocks.Reynold Xin2012-12-139-170/+361
| | | | | |
* | | | | | Merge pull request #337 from pwendell/worker-liveness-uiMatei Zaharia2012-12-195-3/+19
|\ \ \ \ \ \ | | | | | | | | | | | | | | SPARK-616: Logging dead workers in Web UI.
| * | | | | | SPARK-616: Logging dead workers in Web UI.Patrick Wendell2012-12-175-3/+19
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This patch keeps track of which workers have died and marks them as such in the master web UI. It also handles workers which die and re-register using different actor ID's.
generated by cgit v1.2.3 (git 2.39.1) at 2024-09-19 14:23:56 +0000