diff options
| author | sharkd <sharkd.tu@gmail.com> | 2016-07-12 10:10:35 -0700 |
|---|---|---|
| committer | Marcelo Vanzin <vanzin@cloudera.com> | 2016-07-12 10:10:35 -0700 |
| commit | d513c99c19e229f72d03006e251725a43c13fefd (patch) | |
| tree | 699321cd48efb2929ab8b9fd610a981a4853e3da /licenses/LICENSE-sorttable.js.txt | |
| parent | c377e49e38a290e5c4fbc178278069788674dfb7 (diff) | |
| download | spark-d513c99c19e229f72d03006e251725a43c13fefd.tar.gz spark-d513c99c19e229f72d03006e251725a43c13fefd.tar.bz2 spark-d513c99c19e229f72d03006e251725a43c13fefd.zip | |
[SPARK-16414][YARN] Fix bugs for "Can not get user config when calling SparkHadoopUtil.get.conf on yarn cluser mode"
## What changes were proposed in this pull request?
The `SparkHadoopUtil` singleton was instantiated before `ApplicationMaster` in `ApplicationMaster.main` when deploying spark on yarn cluster mode, the `conf` in the `SparkHadoopUtil` singleton didn't include user's configuration.
So, we should load the properties file with the Spark configuration and set entries as system properties before `SparkHadoopUtil` first instantiate.
## How was this patch tested?
Add a test case
Author: sharkd <sharkd.tu@gmail.com>
Author: sharkdtu <sharkdtu@tencent.com>
Closes #14088 from sharkdtu/master.
Diffstat (limited to 'licenses/LICENSE-sorttable.js.txt')
0 files changed, 0 insertions, 0 deletions