diff options
| author | Reynold Xin <rxin@apache.org> | 2013-11-06 23:22:47 -0800 |
|---|---|---|
| committer | Reynold Xin <rxin@apache.org> | 2013-11-06 23:22:47 -0800 |
| commit | be7e8da98ad04d66b61cd7fc8af7ae61a649d71c (patch) | |
| tree | 4505f9a8d4372d255e2e78b8bb5618e77c23d37a /docs/monitoring.md | |
| parent | aadeda5e7697a433c82879033e758fbc403680dc (diff) | |
| parent | 12dc385a49b9dc5478a9f769de3f8c3965141a64 (diff) | |
| download | spark-be7e8da98ad04d66b61cd7fc8af7ae61a649d71c.tar.gz spark-be7e8da98ad04d66b61cd7fc8af7ae61a649d71c.tar.bz2 spark-be7e8da98ad04d66b61cd7fc8af7ae61a649d71c.zip | |
Merge pull request #23 from jerryshao/multi-user
Add Spark multi-user support for standalone mode and Mesos
This PR add multi-user support for Spark both standalone mode and Mesos (coarse and fine grained ) mode, user can specify the user name who submit app through environment variable `SPARK_USER` or use default one. Executor will communicate with Hadoop using specified user name.
Also I fixed one bug in JobLogger when different user wrote job log to specified folder which has no right file permission.
I separate previous [PR750](https://github.com/mesos/spark/pull/750) into two PRs, in this PR I only solve multi-user support problem. I will try to solve security auth problem in subsequent PR because security auth is a complicated problem especially for Shark Server like long-run app (both Kerberos TGT and HDFS delegation token should be renewed or re-created through app's run time).
Diffstat (limited to 'docs/monitoring.md')
0 files changed, 0 insertions, 0 deletions