diff options
| author | Andrew Or <andrewor14@gmail.com> | 2014-05-10 20:58:02 -0700 |
|---|---|---|
| committer | Patrick Wendell <pwendell@gmail.com> | 2014-05-10 20:58:02 -0700 |
| commit | 83e0424d87022e7a967088365931a08aa06ffd9f (patch) | |
| tree | 0bca98b588dfe7d553bf6c4afc366fb245aad56a /project | |
| parent | 2b7bd29eb6ee5baf739eec143044ecfc296b9b1f (diff) | |
| download | spark-83e0424d87022e7a967088365931a08aa06ffd9f.tar.gz spark-83e0424d87022e7a967088365931a08aa06ffd9f.tar.bz2 spark-83e0424d87022e7a967088365931a08aa06ffd9f.zip | |
[SPARK-1774] Respect SparkSubmit --jars on YARN (client)
SparkSubmit ignores `--jars` for YARN client. This is a bug.
This PR also automatically adds the application jar to `spark.jar`. Previously, when running as yarn-client, you must specify the jar additionally through `--files` (because `--jars` didn't work). Now you don't have to explicitly specify it through either.
Tested on a YARN cluster.
Author: Andrew Or <andrewor14@gmail.com>
Closes #710 from andrewor14/yarn-jars and squashes the following commits:
35d1928 [Andrew Or] Merge branch 'master' of github.com:apache/spark into yarn-jars
c27bf6c [Andrew Or] For yarn-cluster and python, do not add primaryResource to spark.jar
c92c5bf [Andrew Or] Minor cleanups
269f9f3 [Andrew Or] Fix format
013d840 [Andrew Or] Fix tests
1407474 [Andrew Or] Merge branch 'master' of github.com:apache/spark into yarn-jars
3bb75e8 [Andrew Or] Allow SparkSubmit --jars to take effect in yarn-client mode
Diffstat (limited to 'project')
0 files changed, 0 insertions, 0 deletions