diff options
author | Patrick Wendell <pwendell@gmail.com> | 2014-01-01 21:29:12 -0800 |
---|---|---|
committer | Patrick Wendell <pwendell@gmail.com> | 2014-01-01 21:29:12 -0800 |
commit | 3713f8129a618a633a7aca8c944960c3e7ac9d3b (patch) | |
tree | ff3aa8fa3460078007259a6a6479dc4aec27b50a /docs/_config.yml | |
parent | c1d928a897f8daed5d7e74f4af476b67046f348d (diff) | |
parent | 7e8d2e8a5c88d16c771923504c433491b109ab2a (diff) | |
download | spark-3713f8129a618a633a7aca8c944960c3e7ac9d3b.tar.gz spark-3713f8129a618a633a7aca8c944960c3e7ac9d3b.tar.bz2 spark-3713f8129a618a633a7aca8c944960c3e7ac9d3b.zip |
Merge pull request #309 from mateiz/conf2
SPARK-544. Migrate configuration to a SparkConf class
This is still a work in progress based on Prashant and Evan's code. So far I've done the following:
- Got rid of global SparkContext.globalConf
- Passed SparkConf to serializers and compression codecs
- Made SparkConf public instead of private[spark]
- Improved API of SparkContext and SparkConf
- Switched executor environment vars to be passed through SparkConf
- Fixed some places that were still using system properties
- Fixed some tests, though others are still failing
This still fails several tests in core, repl and streaming, likely due to properties not being set or cleared correctly (some of the tests run fine in isolation). But the API at least is hopefully ready for review. Unfortunately there was a lot of global stuff before due to a "SparkContext.globalConf" method that let you set a "default" configuration of sorts, which meant I had to make some pretty big changes.
Diffstat (limited to 'docs/_config.yml')
-rw-r--r-- | docs/_config.yml | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/docs/_config.yml b/docs/_config.yml index 02067f9750..11d18f0ac2 100644 --- a/docs/_config.yml +++ b/docs/_config.yml @@ -4,7 +4,7 @@ markdown: kramdown # These allow the documentation to be updated with nerw releases # of Spark, Scala, and Mesos. SPARK_VERSION: 0.9.0-incubating-SNAPSHOT -SPARK_VERSION_SHORT: 0.9.0-SNAPSHOT +SPARK_VERSION_SHORT: 0.9.0 SCALA_VERSION: 2.10 MESOS_VERSION: 0.13.0 SPARK_ISSUE_TRACKER_URL: https://spark-project.atlassian.net |