aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Merge remote-tracking branch 'upstream/master'Ameet Talwalkar2013-09-0838-261/+786
|\
| * Merge pull request #906 from pwendell/ganglia-sinkPatrick Wendell2013-09-0812-36/+166
| |\ | | | | | | Clean-up of Metrics Code/Docs and Add Ganglia Sink
| | * Adding sc name in metrics sourcePatrick Wendell2013-09-085-9/+14
| | |
| | * Fixing package name in template confPatrick Wendell2013-09-081-7/+7
| | |
| | * Adding more docs and some code cleanupPatrick Wendell2013-09-085-20/+62
| | |
| | * Ganglia sinkPatrick Wendell2013-09-082-0/+83
| | |
| * | Merge pull request #908 from pwendell/masterMatei Zaharia2013-09-081-1/+7
| |\ \ | | | | | | | | Fix target JVM version in scala build
| | * | Fix target JVM version in scala buildPatrick Wendell2013-09-081-1/+7
| | |/
| * | Merge pull request #898 from ilikerps/660Matei Zaharia2013-09-086-4/+81
| |\ \ | | | | | | | | SPARK-660: Add StorageLevel support in Python
| | * | Whoopsy daisyAaron Davidson2013-09-081-1/+0
| | | |
| | * | Export StorageLevel and refactorAaron Davidson2013-09-076-29/+65
| | | |
| | * | Remove reflection, hard-code StorageLevelsAaron Davidson2013-09-073-35/+26
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The sc.StorageLevel -> StorageLevel pathway is a bit janky, but otherwise the shell would have to call a private method of SparkContext. Having StorageLevel available in sc also doesn't seem like the end of the world. There may be a better solution, though. As for creating the StorageLevel object itself, this seems to be the best way in Python 2 for creating singleton, enum-like objects: http://stackoverflow.com/questions/36932/how-can-i-represent-an-enum-in-python
| | * | Memoize StorageLevels read from JVMAaron Davidson2013-09-062-3/+10
| | | |
| | * | SPARK-660: Add StorageLevel support in PythonAaron Davidson2013-09-054-1/+45
| | | | | | | | | | | | | | | | | | | | It uses reflection... I am not proud of that fact, but it at least ensures compatibility (sans refactoring of the StorageLevel stuff).
| * | | Merge pull request #900 from pwendell/cdh-docsMatei Zaharia2013-09-082-0/+77
| |\ \ \ | | | | | | | | | | Provide docs to describe running on CDH/HDP cluster.
| | * | | File renamePatrick Wendell2013-09-072-4/+2
| | | | |
| | * | | Changes based on feedbackPatrick Wendell2013-09-071-12/+24
| | | | |
| | * | | Provide docs to describe running on CDH/HDP cluster.Patrick Wendell2013-09-062-0/+67
| | | | | | | | | | | | | | | | | | | | This doc consolidates information relevant to CDH/HDP users in a single place.
| * | | | Merge pull request #904 from pwendell/masterPatrick Wendell2013-09-072-1/+35
| |\ \ \ \ | | | |_|/ | | |/| | Adding Apache license to two files
| | * | | Adding Apache license to two filesPatrick Wendell2013-09-072-1/+35
| | | | |
| * | | | Merge pull request #901 from ooyala/2013-09/0.8-doc-changesMatei Zaharia2013-09-072-4/+21
| |\ \ \ \ | | | | | | | | | | | | 0.8 Doc changes for make-distribution.sh
| | * | | | CR feedback from MateiEvan Chan2013-09-072-7/+1
| | | | | |
| | * | | | Add references to make-distribution.shEvan Chan2013-09-062-0/+19
| | | | | |
| | * | | | "launch" scripts is more accurate terminologyEvan Chan2013-09-061-2/+2
| | | | | |
| | * | | | Easier way to start the masterEvan Chan2013-09-061-1/+1
| | | | | |
| | * | | | Add notes about starting spark-shellEvan Chan2013-09-061-1/+5
| | | |/ / | | |/| |
| * | | | Merge pull request #903 from rxin/resulttaskMatei Zaharia2013-09-071-2/+2
| |\ \ \ \ | | | | | | | | | | | | Fixed the bug that ResultTask was not properly deserializing outputId.
| | * | | | Fixed the bug that ResultTask was not properly deserializing outputId.Reynold Xin2013-09-071-2/+2
| | | | | |
| * | | | | Merge pull request #892 from jey/fix-yarn-assemblyMatei Zaharia2013-09-077-205/+145
| |\ \ \ \ \ | | |/ / / / | |/| | | | YARN build fixes
| | * | | | Minor YARN build cleanupsJey Kottalam2013-09-064-38/+2
| | | | | |
| | * | | | Fix YARN assembly generation under MavenJey Kottalam2013-09-062-158/+121
| | | | | |
| | * | | | Clarify YARN exampleJey Kottalam2013-09-061-9/+22
| | |/ / /
| * | | | Merge pull request #897 from pwendell/masterPatrick Wendell2013-09-062-0/+50
| |\ \ \ \ | | |/ / / | |/| / / | | |/ / Docs describing Spark monitoring and instrumentation
| | * | Docs describing Spark monitoring and instrumentationPatrick Wendell2013-09-062-0/+50
| | | |
| * | | Hot fix to resolve the compilation error caused by SPARK-821.Reynold Xin2013-09-061-1/+1
| | | |
| * | | Merge pull request #895 from ilikerps/821Patrick Wendell2013-09-057-7/+102
| |\ \ \ | | | | | | | | | | SPARK-821: Don't cache results when action run locally on driver
| | * | | Reynold's second round of commentsAaron Davidson2013-09-052-17/+19
| | | | |
| | * | | Add unit test and address commentsAaron Davidson2013-09-055-6/+98
| | | | |
| | * | | SPARK-821: Don't cache results when action run locally on driverAaron Davidson2013-09-054-4/+5
| | | |/ | | |/| | | | | | | | | | | | | | | | | Caching the results of local actions (e.g., rdd.first()) causes the driver to store entire partitions in its own memory, which may be highly constrained. This patch simply makes the CacheManager avoid caching the result of all locally-run computations.
| * | | Merge pull request #891 from xiajunluan/SPARK-864Matei Zaharia2013-09-051-1/+8
| |\ \ \ | | | | | | | | | | [SPARK-864]DAGScheduler Exception if we delete Worker and StandaloneExecutorBackend then add Worker
| | * | | Fix bug SPARK-864Andrew xia2013-09-051-1/+8
| | | | |
| * | | | Merge pull request #893 from ilikerps/masterPatrick Wendell2013-09-041-0/+92
| |\ \ \ \ | | | |/ / | | |/| | SPARK-884: Add unit test to validate Spark JSON output
| | * | | Fix line over 100 charsAaron Davidson2013-09-041-2/+2
| | | | |
| | * | | Address Patrick's commentsAaron Davidson2013-09-041-8/+15
| | | | |
| | * | | SPARK-884: Add unit test to validate Spark JSON outputAaron Davidson2013-09-041-0/+85
| | |/ / | | | | | | | | | | | | | | | | This unit test simply validates that the outputs of the JsonProtocol methods are syntactically valid JSON.
* | | | updates based on comments to PRAmeet Talwalkar2013-09-081-49/+83
| | | |
* | | | updated contentAmeet Talwalkar2013-09-051-1/+147
|/ / /
* | | Merge pull request #894 from c0s/masterMatei Zaharia2013-09-041-6/+5
|\ \ \ | |_|/ |/| | Updating assembly README to reflect recent changes in the build.
| * | Updating assembly README to reflect recent changes in the build.Konstantin Boudnik2013-09-041-6/+5
|/ /
* | Minor spacing fixPatrick Wendell2013-09-031-2/+4
| |
generated by cgit v1.2.3 (git 2.39.1) at 2024-09-19 17:01:25 +0000