aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Some doc and usability improvements:Matei Zaharia2012-10-1214-24/+90
| | | | | | | - Added a StorageLevels class for easy access to StorageLevel constants in Java - Added doc comments on Function classes in Java - Updated Accumulator and HadoopWriter docs slightly
* Added a test for when an RDD only partially fits in memoryMatei Zaharia2012-10-121-2/+18
|
* Document cartesian() operationMatei Zaharia2012-10-122-0/+8
|
* Merge branch 'dev' of github.com:mesos/spark into devMatei Zaharia2012-10-1223-76/+593
|\
| * Merge pull request #271 from shivaram/block-manager-npe-fixMatei Zaharia2012-10-128-39/+58
| |\ | | | | | | Change block manager to accept a ArrayBuffer
| | * Add test to verify if RDD is computed even if block manager has insufficientShivaram Venkataraman2012-10-121-0/+10
| | | | | | | | | | | | memory
| | * Change block manager to accept a ArrayBuffer instead of an iterator to ensureShivaram Venkataraman2012-10-117-39/+48
| | | | | | | | | | | | | | | that the computation can proceed even if we run out of memory to cache the block. Update CacheTracker to use this new interface
| * | Merge pull request #270 from pwendell/java-javadocMatei Zaharia2012-10-116-10/+454
| |\ \ | | |/ | |/| Adding Java documentation
| | * Adding Java documentationPatrick Wendell2012-10-116-10/+454
| |/
| * Merge pull request #268 from pwendell/sonatypeMatei Zaharia2012-10-102-3/+57
| |\ | | | | | | Adding code for publishing to Sonatype.
| | * Changing tabs to spacesPatrick Wendell2012-10-101-17/+17
| | |
| | * Adding code for publishing to Sonatype.Patrick Wendell2012-10-102-3/+57
| | | | | | | | | | | | | | | | | | | | | By default - I'm leaving this commented out. This is because there is a bug in the PGP signing plugin which causes it to active even duing a publish-local. So we'll just uncomment when we decide to publish.
| * | Merge pull request #267 from dennybritz/devMatei Zaharia2012-10-102-6/+6
| |\ \ | | | | | | | | Fixed bug when fetching Jar dependencies.
| | * | Fixed bug when fetching Jar dependencies.Denny2012-10-102-6/+6
| |/ / | | | | | | | | | Instead of checking currentFiles check currentJars.
| * | Merge pull request #265 from pwendell/docs-version-configMatei Zaharia2012-10-105-18/+18
| |\ \ | | |/ | |/| Making Spark version configurable in docs and updating Bagel doc
| | * Updating Bagel build instructionsPatrick Wendell2012-10-091-2/+3
| | |
| | * Updating programming guide with new link instructionsPatrick Wendell2012-10-091-1/+7
| | |
| | * Removing reference to publish-local in the quickstartPatrick Wendell2012-10-091-11/+4
| | |
| | * Fixing YARN instructionsPatrick Wendell2012-10-091-3/+3
| | |
| | * Adding SNAPSHOT to Spark version in doc configPatrick Wendell2012-10-091-1/+1
| |/
* / TweakMatei Zaharia2012-10-122-2/+2
|/
* Added documentation to all the *RDDFunction classes, and moved them intoMatei Zaharia2012-10-099-54/+273
| | | | | the spark package to make them more visible. Also documented various other miscellaneous things in the API.
* Updates to documentation:Matei Zaharia2012-10-098-111/+124
| | | | | | | | - Edited quick start and tuning guide to simplify them a little - Simplified top menu bar - Made private a SparkContext constructor parameter that was left as public - Various small fixes
* Merge pull request #262 from andyk/document-public-apisMatei Zaharia2012-10-092-7/+80
|\ | | | | Document RDD api (i.e. RDD.scala)
| * Merge remote-tracking branch 'public-spark/dev' into document-public-apisAndy Konwinski2012-10-081-1/+1
| |\
| * | Fixes a typo, adds scaladoc comments to SparkContext constructors.Andy Konwinski2012-10-082-5/+11
| | |
| * | More docs in RDD classPatrick Wendell2012-10-081-1/+45
| | |
| * | A start on scaladoc for the public APIs.Andy Konwinski2012-10-081-6/+29
| | |
* | | Merge pull request #260 from andyk/update-docs-to-use-version-varsMatei Zaharia2012-10-099-21/+34
|\ \ \ | | | | | | | | Updates docs to use the new version num vars and adds Spark version in nav bar
| * | | Updating lots of docs to use the new special version number variables,Andy Konwinski2012-10-089-21/+34
| |/ / | | | | | | | | | | | | also adding the version to the navbar so it is easy to tell which version of Spark these docs were compiled for.
* | | Merge pull request #263 from RayRacine/m1.mediumMatei Zaharia2012-10-091-0/+1
|\ \ \ | |_|/ |/| | Add m1.medium node option to cluster management script.
| * | Add m1.medium node option to cluster management script.Ray Racine2012-10-091-0/+1
|/ /
* | Merge pull request #256 from pwendell/new-download-instrMatei Zaharia2012-10-081-1/+1
|\ \ | |/ |/| Adding new download instructions
| * Adding new download instructionsPatrick Wendell2012-10-081-1/+1
| |
* | Merge pull request #259 from mosharaf/bc-fix-devMatei Zaharia2012-10-085-26/+35
|\ \ | |/ |/| Synchronization bug fix in broadcast implementations
| * Merge branch 'dev' into bc-fix-devMosharaf Chowdhury2012-10-0883-510/+1414
| |\
| | * Merge remote-tracking branch 'upstream/dev' into devMosharaf Chowdhury2012-10-0883-510/+1414
| | |\
| * | | Conflict fixedMosharaf Chowdhury2012-10-02217-1536/+14270
| |\| |
| | * | Merge remote-tracking branch 'upstream/dev' into devMosharaf Chowdhury2012-10-02125-438/+754
| | |\ \
| | * \ \ Merge remote-tracking branch 'upstream/dev' into devMosharaf Chowdhury2012-10-01154-1130/+13275
| | |\ \ \
| | * \ \ \ Merge remote-tracking branch 'upstream/dev' into devMosharaf Chowdhury2012-09-089-8/+186
| | |\ \ \ \
| | * \ \ \ \ Merge remote-tracking branch 'upstream/dev' into devMosharaf Chowdhury2012-09-069-137/+158
| | |\ \ \ \ \
| | * \ \ \ \ \ Merge remote-tracking branch 'upstream/dev' into devMosharaf Chowdhury2012-09-031-26/+50
| | |\ \ \ \ \ \
| | * \ \ \ \ \ \ Merge remote-tracking branch 'upstream/dev' into devMosharaf Chowdhury2012-09-015-12/+66
| | |\ \ \ \ \ \ \
| | * \ \ \ \ \ \ \ Merge remote-tracking branch 'upstream/dev' into devMosharaf Chowdhury2012-08-302-31/+27
| | |\ \ \ \ \ \ \ \
| * | | | | | | | | | Synchronization bug fix in broadcast implementationsMosharaf Chowdhury2012-08-302-15/+23
| | | | | | | | | | |
| * | | | | | | | | | Bug fix. Fixed log messages. Updated BroadcastTest example to have iterations.Mosharaf Chowdhury2012-08-304-12/+13
| |/ / / / / / / / /
| * | | | | | | | | Merge remote-tracking branch 'upstream/dev' into devMosharaf Chowdhury2012-08-305-23/+114
| |\ \ \ \ \ \ \ \ \
| * \ \ \ \ \ \ \ \ \ Merge remote-tracking branch 'upstream/dev' into devMosharaf Chowdhury2012-08-2811-33/+91
| |\ \ \ \ \ \ \ \ \ \
| * \ \ \ \ \ \ \ \ \ \ Merge remote-tracking branch 'upstream/dev' into devMosharaf Chowdhury2012-08-2317-16/+56
| |\ \ \ \ \ \ \ \ \ \ \