aboutsummaryrefslogtreecommitdiff
path: root/docs/configuration.md
Commit message (Collapse)AuthorAgeFilesLines
* Change port from 3030 to 4040Patrick Wendell2013-09-111-1/+1
|
* Work in progress:Matei Zaharia2013-09-081-11/+21
| | | | | | | - Add job scheduling docs - Rename some fair scheduler properties - Organize intro page better - Link to Apache wiki for "contributing to Spark"
* Fix spark.io.compression.codec and change default codec to LZFMatei Zaharia2013-09-021-1/+1
|
* Doc improvementsMatei Zaharia2013-09-011-1/+3
|
* Move some classes to more appropriate packages:Matei Zaharia2013-09-011-5/+5
| | | | | | * RDD, *RDDFunctions -> org.apache.spark.rdd * Utils, ClosureCleaner, SizeEstimator -> org.apache.spark.util * JavaSerializer, KryoSerializer -> org.apache.spark.serializer
* Update docs for new packageMatei Zaharia2013-09-011-9/+9
|
* More updates, describing changes to recommended use of environment varsMatei Zaharia2013-08-311-47/+38
| | | | and new Python stuff
* Update docs for Spark UI portMatei Zaharia2013-08-201-1/+1
|
* Address some review comments:Matei Zaharia2013-08-181-2/+28
| | | | | | | | | | - When a resourceOffers() call has multiple offers, force the TaskSets to consider them in increasing order of locality levels so that they get a chance to launch stuff locally across all offers - Simplify ClusterScheduler.prioritizeContainers - Add docs on the new configuration options
* Merge remote-tracking branch 'dlyubimov/SPARK-827'Matei Zaharia2013-07-311-0/+8
|\ | | | | | | | | Conflicts: docs/configuration.md
| * typoDmitriy Lyubimov2013-07-271-1/+1
| |
| * changes per comments.Dmitriy Lyubimov2013-07-271-0/+8
| |
* | Documentation update for compression codec.Reynold Xin2013-07-301-3/+18
| |
* | Add an option to disable reference tracking in KryoMatei Zaharia2013-07-151-1/+11
| |
* | Merge remote-tracking branch 'pwendell/ui-updates'Matei Zaharia2013-07-061-2/+9
|\ \ | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/scheduler/DAGScheduler.scala core/src/main/scala/spark/util/AkkaUtils.scala pom.xml
| * | Adding config option for retained stagesPatrick Wendell2013-06-261-2/+9
| |/
* | Update docs on SCALA_LIBRARY_PATHMatei Zaharia2013-06-301-1/+3
| |
* | Made use of spark.executor.memory setting consistent and documented itMatei Zaharia2013-06-301-11/+20
| | | | | | | | | | | | Conflicts: core/src/main/scala/spark/SparkContext.scala
* | Merge branch 'master' into streamingTathagata Das2013-06-241-0/+7
|\| | | | | | | | | Conflicts: .gitignore
| * Some tweaks to docsMatei Zaharia2013-02-261-0/+7
| |
* | adding spark.streaming.blockInterval propertyseanm2013-04-161-0/+7
|/
* Change spark.cleaner.delay to spark.cleaner.ttl. Updated docs.Tathagata Das2013-02-231-3/+3
|
* Use a separate memory setting for standalone cluster daemonsMatei Zaharia2013-02-101-1/+9
| | | | | Conflicts: docs/_config.yml
* Replace old 'master' term with 'driver'.Stephen Haberman2013-01-251-6/+6
|
* Add more Akka settings to docsMatei Zaharia2013-01-211-0/+16
|
* Updated Streaming Programming Guide.Tathagata Das2013-01-011-0/+11
|
* tweaksMatei Zaharia2012-10-131-7/+7
|
* Document how to configure SPARK_MEM & co on a per-job basisMatei Zaharia2012-10-131-7/+19
|
* Adds liquid variables to docs templating system so that they can be usedAndy Konwinski2012-10-081-8/+8
| | | | | | | | | throughout the docs: SPARK_VERSION, SCALA_VERSION, and MESOS_VERSION. To use them, e.g. use {{site.SPARK_VERSION}}. Also removes uses of {{HOME_PATH}} which were being resolved to "" by the templating system anyway.
* Made compression configurable separately for shuffle, broadcast and RDDsMatei Zaharia2012-10-071-14/+27
|
* Modified shuffle to limit the maximum outstanding data size in bytes,Matei Zaharia2012-10-061-3/+5
| | | | | | instead of the maximum number of outstanding fetches. This should make it faster when there are many small map output files, as well as more robust to overallocating memory on large map outputs.
* Some bug fixes and logging fixes for broadcast.Matei Zaharia2012-10-011-1/+2
|
* Added an option to compress blocks in the block storeMatei Zaharia2012-09-271-0/+17
|
* Minor doc fixesMatei Zaharia2012-09-261-1/+1
|
* Updates to standalone cluster, web UI and deploy docs.Matei Zaharia2012-09-261-4/+4
|
* More updates to docs, including tuning guideMatei Zaharia2012-09-261-7/+167
|
* - Add docs/api to .gitignoreAndy Konwinski2012-09-161-2/+0
| | | | | | | | | | | | | - Rework/expand the nav bar with more of the docs site - Removing parts of docs about EC2 and Mesos that differentiate between running 0.5 and before - Merged subheadings from running-on-amazon-ec2.html that are still relevant (i.e., "Using a newer version of Spark" and "Accessing Data in S3") into ec2-scripts.html and deleted running-on-amazon-ec2.html - Added some TODO comments to a few docs - Updated the blurb about AMP Camp - Renamed programming-guide to spark-programming-guide - Fixing typos/etc. in Standalone Spark doc
* Fixing lots of broken links.Andy Konwinski2012-09-121-2/+2
|
* Adding docs directory containing documentation currently on the wikiAndy Konwinski2012-09-121-0/+24
which can be compiled via jekyll, using the command `jekyll`. To compile and run a local webserver to serve the doc as a website, run `jekyll --server`.