diff options
| author | Nezih Yigitbasi <nyigitbasi@netflix.com> | 2016-06-16 18:19:29 -0700 |
|---|---|---|
| committer | Marcelo Vanzin <vanzin@cloudera.com> | 2016-06-16 18:20:16 -0700 |
| commit | 63470afc997fb9d6b6f8a911c25964743556c9cc (patch) | |
| tree | 02588d1187e7e3ff855edf3f55f0d3a5aa10d39f /repl/scala-2.11/src | |
| parent | f1bf0d2f3a61d81686f36763e83d3be89c98435f (diff) | |
| download | spark-63470afc997fb9d6b6f8a911c25964743556c9cc.tar.gz spark-63470afc997fb9d6b6f8a911c25964743556c9cc.tar.bz2 spark-63470afc997fb9d6b6f8a911c25964743556c9cc.zip | |
[SPARK-15782][YARN] Fix spark.jars and spark.yarn.dist.jars handling
When `--packages` is specified with spark-shell the classes from those packages cannot be found, which I think is due to some of the changes in SPARK-12343.
Tested manually with both scala 2.10 and 2.11 repls.
vanzin davies can you guys please review?
Author: Marcelo Vanzin <vanzin@cloudera.com>
Author: Nezih Yigitbasi <nyigitbasi@netflix.com>
Closes #13709 from nezihyigitbasi/SPARK-15782.
Diffstat (limited to 'repl/scala-2.11/src')
| -rw-r--r-- | repl/scala-2.11/src/main/scala/org/apache/spark/repl/Main.scala | 4 |
1 files changed, 1 insertions, 3 deletions
diff --git a/repl/scala-2.11/src/main/scala/org/apache/spark/repl/Main.scala b/repl/scala-2.11/src/main/scala/org/apache/spark/repl/Main.scala index 771670fa55..28fe84d6fe 100644 --- a/repl/scala-2.11/src/main/scala/org/apache/spark/repl/Main.scala +++ b/repl/scala-2.11/src/main/scala/org/apache/spark/repl/Main.scala @@ -54,9 +54,7 @@ object Main extends Logging { // Visible for testing private[repl] def doMain(args: Array[String], _interp: SparkILoop): Unit = { interp = _interp - val jars = conf.getOption("spark.jars") - .map(_.replace(",", File.pathSeparator)) - .getOrElse("") + val jars = Utils.getUserJars(conf).mkString(File.pathSeparator) val interpArguments = List( "-Yrepl-class-based", "-Yrepl-outdir", s"${outputDir.getAbsolutePath}", |