diff options
| author | Andrew Or <andrewor14@gmail.com> | 2014-05-22 20:32:27 -0700 |
|---|---|---|
| committer | Tathagata Das <tathagata.das1565@gmail.com> | 2014-05-22 20:32:27 -0700 |
| commit | cce77457e00aa5f1f4db3d50454cf257efb156ed (patch) | |
| tree | 394fc239b6db7cd2f88144ca3b40edb52f31f14a /dev/audit-release | |
| parent | 8edbee7d1b4afc192d97ba192a5526affc464205 (diff) | |
| download | spark-cce77457e00aa5f1f4db3d50454cf257efb156ed.tar.gz spark-cce77457e00aa5f1f4db3d50454cf257efb156ed.tar.bz2 spark-cce77457e00aa5f1f4db3d50454cf257efb156ed.zip | |
[SPARK-1896] Respect spark.master (and --master) before MASTER in spark-shell
The hierarchy for configuring the Spark master in the shell is as follows:
```
MASTER > --master > spark.master (spark-defaults.conf)
```
This is inconsistent with the way we run normal applications, which is:
```
--master > spark.master (spark-defaults.conf) > MASTER
```
I was trying to run a shell locally on a standalone cluster launched through the ec2 scripts, which automatically set `MASTER` in spark-env.sh. It was surprising to me that `--master` didn't take effect, considering that this is the way we tell users to set their masters [here](http://people.apache.org/~pwendell/spark-1.0.0-rc7-docs/scala-programming-guide.html#initializing-spark).
Author: Andrew Or <andrewor14@gmail.com>
Closes #846 from andrewor14/shell-master and squashes the following commits:
2cb81c9 [Andrew Or] Respect spark.master before MASTER in REPL
Diffstat (limited to 'dev/audit-release')
0 files changed, 0 insertions, 0 deletions