aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Updates to documentation:Matei Zaharia2012-10-098-111/+124
| | | | | | | | - Edited quick start and tuning guide to simplify them a little - Simplified top menu bar - Made private a SparkContext constructor parameter that was left as public - Various small fixes
* Merge pull request #262 from andyk/document-public-apisMatei Zaharia2012-10-092-7/+80
|\ | | | | Document RDD api (i.e. RDD.scala)
| * Merge remote-tracking branch 'public-spark/dev' into document-public-apisAndy Konwinski2012-10-081-1/+1
| |\
| * | Fixes a typo, adds scaladoc comments to SparkContext constructors.Andy Konwinski2012-10-082-5/+11
| | |
| * | More docs in RDD classPatrick Wendell2012-10-081-1/+45
| | |
| * | A start on scaladoc for the public APIs.Andy Konwinski2012-10-081-6/+29
| | |
* | | Merge pull request #260 from andyk/update-docs-to-use-version-varsMatei Zaharia2012-10-099-21/+34
|\ \ \ | | | | | | | | Updates docs to use the new version num vars and adds Spark version in nav bar
| * | | Updating lots of docs to use the new special version number variables,Andy Konwinski2012-10-089-21/+34
| |/ / | | | | | | | | | | | | also adding the version to the navbar so it is easy to tell which version of Spark these docs were compiled for.
* | | Merge pull request #263 from RayRacine/m1.mediumMatei Zaharia2012-10-091-0/+1
|\ \ \ | |_|/ |/| | Add m1.medium node option to cluster management script.
| * | Add m1.medium node option to cluster management script.Ray Racine2012-10-091-0/+1
|/ /
* | Merge pull request #256 from pwendell/new-download-instrMatei Zaharia2012-10-081-1/+1
|\ \ | |/ |/| Adding new download instructions
| * Adding new download instructionsPatrick Wendell2012-10-081-1/+1
| |
* | Merge pull request #259 from mosharaf/bc-fix-devMatei Zaharia2012-10-085-26/+35
|\ \ | |/ |/| Synchronization bug fix in broadcast implementations
| * Merge branch 'dev' into bc-fix-devMosharaf Chowdhury2012-10-0883-510/+1414
| |\
| | * Merge remote-tracking branch 'upstream/dev' into devMosharaf Chowdhury2012-10-0883-510/+1414
| | |\
| * | | Conflict fixedMosharaf Chowdhury2012-10-02217-1536/+14270
| |\| |
| | * | Merge remote-tracking branch 'upstream/dev' into devMosharaf Chowdhury2012-10-02125-438/+754
| | |\ \
| | * \ \ Merge remote-tracking branch 'upstream/dev' into devMosharaf Chowdhury2012-10-01154-1130/+13275
| | |\ \ \
| | * \ \ \ Merge remote-tracking branch 'upstream/dev' into devMosharaf Chowdhury2012-09-089-8/+186
| | |\ \ \ \
| | * \ \ \ \ Merge remote-tracking branch 'upstream/dev' into devMosharaf Chowdhury2012-09-069-137/+158
| | |\ \ \ \ \
| | * \ \ \ \ \ Merge remote-tracking branch 'upstream/dev' into devMosharaf Chowdhury2012-09-031-26/+50
| | |\ \ \ \ \ \
| | * \ \ \ \ \ \ Merge remote-tracking branch 'upstream/dev' into devMosharaf Chowdhury2012-09-015-12/+66
| | |\ \ \ \ \ \ \
| | * \ \ \ \ \ \ \ Merge remote-tracking branch 'upstream/dev' into devMosharaf Chowdhury2012-08-302-31/+27
| | |\ \ \ \ \ \ \ \
| * | | | | | | | | | Synchronization bug fix in broadcast implementationsMosharaf Chowdhury2012-08-302-15/+23
| | | | | | | | | | |
| * | | | | | | | | | Bug fix. Fixed log messages. Updated BroadcastTest example to have iterations.Mosharaf Chowdhury2012-08-304-12/+13
| |/ / / / / / / / /
| * | | | | | | | | Merge remote-tracking branch 'upstream/dev' into devMosharaf Chowdhury2012-08-305-23/+114
| |\ \ \ \ \ \ \ \ \
| * \ \ \ \ \ \ \ \ \ Merge remote-tracking branch 'upstream/dev' into devMosharaf Chowdhury2012-08-2811-33/+91
| |\ \ \ \ \ \ \ \ \ \
| * \ \ \ \ \ \ \ \ \ \ Merge remote-tracking branch 'upstream/dev' into devMosharaf Chowdhury2012-08-2317-16/+56
| |\ \ \ \ \ \ \ \ \ \ \
| * \ \ \ \ \ \ \ \ \ \ \ Merge remote-tracking branch 'upstream/dev' into devMosharaf Chowdhury2012-08-231-0/+1
| |\ \ \ \ \ \ \ \ \ \ \ \
| * \ \ \ \ \ \ \ \ \ \ \ \ Merge remote-tracking branch 'upstream/dev' into devMosharaf Chowdhury2012-08-2330-233/+456
| |\ \ \ \ \ \ \ \ \ \ \ \ \
* | \ \ \ \ \ \ \ \ \ \ \ \ \ Merge pull request #257 from andyk/add-version-vars-to-docsMatei Zaharia2012-10-0815-90/+98
|\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Adds special version variables to docs templating system
| * | | | | | | | | | | | | | | Updates README.md with instructions for running jekyll without buildingAndy Konwinski2012-10-081-1/+3
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | scaladoc (i.e. run `SKIP_SCALADOC=1 jekyll`).
| * | | | | | | | | | | | | | | Merge remote-tracking branch 'public-spark/dev' into add-version-vars-to-docsAndy Konwinski2012-10-082-2/+7
| |\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | |/ / / / / / / / / / / / / / / |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: docs/quick-start.md
* | | | | | | | | | | | | | | | Merge pull request #254 from pwendell/quickstart-fixMatei Zaharia2012-10-081-1/+1
|\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | |_|_|_|_|_|_|_|_|_|_|_|_|_|_|/ |/| | | | | | | | | | | | | | | Removing one link in quickstart
| * | | | | | | | | | | | | | | Removing one link in quickstartPatrick Wendell2012-10-081-1/+1
| | | | | | | | | | | | | | | |
* | | | | | | | | | | | | | | | Merge pull request #255 from andyk/fix-nav-gapMatei Zaharia2012-10-081-1/+6
|\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | |/ / / / / / / / / / / / / / / |/| | | | | | | | | | | | | | | Removes the annoying small gap above the nav menu dropdown boxes
| * | | | | | | | | | | | | | | Fixes the small gap above the nav menu dropdown boxes and the hoverableAndy Konwinski2012-10-081-1/+6
|/ / / / / / / / / / / / / / / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | menu items that was causing the dropdowns to go away when the user moved their mouse down towards them.
| * / / / / / / / / / / / / / Adds liquid variables to docs templating system so that they can be usedAndy Konwinski2012-10-0814-89/+95
|/ / / / / / / / / / / / / / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | throughout the docs: SPARK_VERSION, SCALA_VERSION, and MESOS_VERSION. To use them, e.g. use {{site.SPARK_VERSION}}. Also removes uses of {{HOME_PATH}} which were being resolved to "" by the templating system anyway.
* | | | | | | | | | | | | | Made compression configurable separately for shuffle, broadcast and RDDsMatei Zaharia2012-10-075-52/+145
| | | | | | | | | | | | | |
* | | | | | | | | | | | | | Merge pull request #251 from JoshRosen/docs/internalsMatei Zaharia2012-10-075-11/+40
|\ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Document Dependency classes and make minor interface improvements
| * | | | | | | | | | | | | | Make ShuffleDependency.aggregator explicitly optional.Josh Rosen2012-10-074-7/+11
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | It was confusing to be using new Aggregator[K, V, V](null, null, null, false) to represent the absence of an aggregator.
| * | | | | | | | | | | | | | Document the Dependency classes.Josh Rosen2012-10-072-1/+26
| | | | | | | | | | | | | | |
| * | | | | | | | | | | | | | Remove unused isShuffle field from Dependency.Josh Rosen2012-10-071-3/+3
| | | | | | | | | | | | | | |
* | | | | | | | | | | | | | | Merge pull request #253 from rxin/devReynold Xin2012-10-071-1/+1
|\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Changed the println to logInfo in Utils.fetchFile.
| * | | | | | | | | | | | | | | Changed the println to logInfo in Utils.fetchFile.Reynold Xin2012-10-071-1/+1
|/ / / / / / / / / / / / / / /
* | | | | | | | | | | | | | | Merge pull request #250 from rxin/devMatei Zaharia2012-10-072-18/+40
|\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Fixed a bug in addFile that if the file is specified as "file:///", the symlink is created incorrectly for local mode.
| * | | | | | | | | | | | | | | Fixed a bug in addFile that if the file is specified as "file:///", theReynold Xin2012-10-072-18/+40
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | symlink is created wrong for local mode.
* | | | | | | | | | | | | | | | Improve error messageMatei Zaharia2012-10-071-1/+1
| | | | | | | | | | | | | | | |
* | | | | | | | | | | | | | | | Don't crash on ask timeout exceptions in deploy.Client.stop() (fixes a crash ↵Matei Zaharia2012-10-071-3/+8
|/ / / / / / / / / / / / / / / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | in tests)
* / / / / / / / / / / / / / / Removed the need to sleep in tests due to waiting for Akka to shut downMatei Zaharia2012-10-0717-23/+44
|/ / / / / / / / / / / / / /