aboutsummaryrefslogtreecommitdiff
path: root/docs/configuration.md
Commit message (Collapse)AuthorAgeFilesLines
* Address review commentsMatei Zaharia2014-01-071-2/+2
|
* Add way to limit default # of cores used by applications on standalone modeMatei Zaharia2014-01-071-4/+29
| | | | Also documents the spark.deploy.spreadOut option.
* formatting related fixes suggested by Patrick.Prashant Sharma2014-01-071-1/+1
|
* Allow configuration to be printed in logs for diagnosis.Prashant Sharma2014-01-071-0/+7
|
* Allow users to set arbitrary akka configurations via spark conf.Prashant Sharma2014-01-071-0/+8
|
* Clarify spark.cores.maxAndrew Ash2014-01-061-1/+2
| | | It controls the count of cores across the cluster, not on a per-machine basis.
* Updated docs for SparkConf and handled review commentsMatei Zaharia2013-12-301-15/+56
|
* A few corrections to documentation.Prashant Sharma2013-12-121-7/+7
|
* Merge branch 'master' into akka-bug-fixPrashant Sharma2013-12-111-1/+35
|\ | | | | | | | | | | | | | | | | | | Conflicts: core/pom.xml core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala pom.xml project/SparkBuild.scala streaming/pom.xml yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocationHandler.scala
| * Correct spellling error in configuration.mdAaron Davidson2013-12-071-1/+1
| |
| * Minor formatting fix in config filePatrick Wendell2013-12-061-1/+0
| |
| * Adding disclaimer for shuffle file consolidationPatrick Wendell2013-12-061-1/+1
| |
| * Small changes from Matei reviewPatrick Wendell2013-12-041-2/+2
| |
| * Document missing configs and set shuffle consolidation to false.Patrick Wendell2013-12-041-1/+36
| |
* | Improvements from the review comments and followed Boy Scout Rule.Prashant Sharma2013-11-271-2/+2
| |
* | Documenting the newly added spark properties.Prashant Sharma2013-11-261-1/+22
|/
* Merge pull request #76 from pwendell/masterReynold Xin2013-10-181-1/+1
|\ | | | | | | | | | | | | Clarify compression property. Clarifies that this governs compression of internal data, not input data or output data.
| * Clarify compression property.Patrick Wendell2013-10-181-1/+1
| | | | | | | | | | Clarifies that this governs compression of internal data, not input data or output data.
* | Code styling. Updated doc.Mosharaf Chowdhury2013-10-171-0/+8
|/
* Change port from 3030 to 4040Patrick Wendell2013-09-111-1/+1
|
* Work in progress:Matei Zaharia2013-09-081-11/+21
| | | | | | | - Add job scheduling docs - Rename some fair scheduler properties - Organize intro page better - Link to Apache wiki for "contributing to Spark"
* Fix spark.io.compression.codec and change default codec to LZFMatei Zaharia2013-09-021-1/+1
|
* Doc improvementsMatei Zaharia2013-09-011-1/+3
|
* Move some classes to more appropriate packages:Matei Zaharia2013-09-011-5/+5
| | | | | | * RDD, *RDDFunctions -> org.apache.spark.rdd * Utils, ClosureCleaner, SizeEstimator -> org.apache.spark.util * JavaSerializer, KryoSerializer -> org.apache.spark.serializer
* Update docs for new packageMatei Zaharia2013-09-011-9/+9
|
* More updates, describing changes to recommended use of environment varsMatei Zaharia2013-08-311-47/+38
| | | | and new Python stuff
* Update docs for Spark UI portMatei Zaharia2013-08-201-1/+1
|
* Address some review comments:Matei Zaharia2013-08-181-2/+28
| | | | | | | | | | - When a resourceOffers() call has multiple offers, force the TaskSets to consider them in increasing order of locality levels so that they get a chance to launch stuff locally across all offers - Simplify ClusterScheduler.prioritizeContainers - Add docs on the new configuration options
* Merge remote-tracking branch 'dlyubimov/SPARK-827'Matei Zaharia2013-07-311-0/+8
|\ | | | | | | | | Conflicts: docs/configuration.md
| * typoDmitriy Lyubimov2013-07-271-1/+1
| |
| * changes per comments.Dmitriy Lyubimov2013-07-271-0/+8
| |
* | Documentation update for compression codec.Reynold Xin2013-07-301-3/+18
| |
* | Add an option to disable reference tracking in KryoMatei Zaharia2013-07-151-1/+11
| |
* | Merge remote-tracking branch 'pwendell/ui-updates'Matei Zaharia2013-07-061-2/+9
|\ \ | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/scheduler/DAGScheduler.scala core/src/main/scala/spark/util/AkkaUtils.scala pom.xml
| * | Adding config option for retained stagesPatrick Wendell2013-06-261-2/+9
| |/
* | Update docs on SCALA_LIBRARY_PATHMatei Zaharia2013-06-301-1/+3
| |
* | Made use of spark.executor.memory setting consistent and documented itMatei Zaharia2013-06-301-11/+20
| | | | | | | | | | | | Conflicts: core/src/main/scala/spark/SparkContext.scala
* | Merge branch 'master' into streamingTathagata Das2013-06-241-0/+7
|\| | | | | | | | | Conflicts: .gitignore
| * Some tweaks to docsMatei Zaharia2013-02-261-0/+7
| |
* | adding spark.streaming.blockInterval propertyseanm2013-04-161-0/+7
|/
* Change spark.cleaner.delay to spark.cleaner.ttl. Updated docs.Tathagata Das2013-02-231-3/+3
|
* Use a separate memory setting for standalone cluster daemonsMatei Zaharia2013-02-101-1/+9
| | | | | Conflicts: docs/_config.yml
* Replace old 'master' term with 'driver'.Stephen Haberman2013-01-251-6/+6
|
* Add more Akka settings to docsMatei Zaharia2013-01-211-0/+16
|
* Updated Streaming Programming Guide.Tathagata Das2013-01-011-0/+11
|
* tweaksMatei Zaharia2012-10-131-7/+7
|
* Document how to configure SPARK_MEM & co on a per-job basisMatei Zaharia2012-10-131-7/+19
|
* Adds liquid variables to docs templating system so that they can be usedAndy Konwinski2012-10-081-8/+8
| | | | | | | | | throughout the docs: SPARK_VERSION, SCALA_VERSION, and MESOS_VERSION. To use them, e.g. use {{site.SPARK_VERSION}}. Also removes uses of {{HOME_PATH}} which were being resolved to "" by the templating system anyway.
* Made compression configurable separately for shuffle, broadcast and RDDsMatei Zaharia2012-10-071-14/+27
|
* Modified shuffle to limit the maximum outstanding data size in bytes,Matei Zaharia2012-10-061-3/+5
| | | | | | instead of the maximum number of outstanding fetches. This should make it faster when there are many small map output files, as well as more robust to overallocating memory on large map outputs.
generated by cgit v1.2.3 (git 2.39.1) at 2024-07-29 01:07:05 +0000