aboutsummaryrefslogtreecommitdiff
path: root/docs/python-programming-guide.md
diff options
context:
space:
mode:
authorEwen Cheslack-Postava <me@ewencp.org>2013-10-22 11:49:52 -0700
committerEwen Cheslack-Postava <me@ewencp.org>2013-10-22 11:49:52 -0700
commitc8748c25eb2812d82a1b6b8433a1531bb00fa335 (patch)
tree4010497725027e8c56a7c51cdcfa401995838268 /docs/python-programming-guide.md
parent317a9eb1ceb165a74493c452a6c5fc0f9b5e2760 (diff)
downloadspark-c8748c25eb2812d82a1b6b8433a1531bb00fa335.tar.gz
spark-c8748c25eb2812d82a1b6b8433a1531bb00fa335.tar.bz2
spark-c8748c25eb2812d82a1b6b8433a1531bb00fa335.zip
Add notes to python documentation about using SparkContext.setSystemProperty.
Diffstat (limited to 'docs/python-programming-guide.md')
-rw-r--r--docs/python-programming-guide.md11
1 files changed, 11 insertions, 0 deletions
diff --git a/docs/python-programming-guide.md b/docs/python-programming-guide.md
index 6c2336ad0c..55e39b1de1 100644
--- a/docs/python-programming-guide.md
+++ b/docs/python-programming-guide.md
@@ -131,6 +131,17 @@ sc = SparkContext("local", "App Name", pyFiles=['MyFile.py', 'lib.zip', 'app.egg
Files listed here will be added to the `PYTHONPATH` and shipped to remote worker machines.
Code dependencies can be added to an existing SparkContext using its `addPyFile()` method.
+You can set [system properties](configuration.html#system-properties)
+using `SparkContext.setSystemProperty()` class method *before*
+instantiating SparkContext. For example, to set the amount of memory
+per executor process:
+
+{% highlight python %}
+from pyspark import SparkContext
+SparkContext.setSystemProperty('spark.executor.memory', '2g')
+sc = SparkContext("local", "App Name")
+{% endhighlight %}
+
# API Docs
[API documentation](api/pyspark/index.html) for PySpark is available as Epydoc.