diff options
author | Sean Owen <sowen@cloudera.com> | 2016-11-14 16:52:07 +0900 |
---|---|---|
committer | Kousuke Saruta <sarutak@oss.nttdata.co.jp> | 2016-11-14 16:52:07 +0900 |
commit | f95b124c68ccc2e318f6ac30685aa47770eea8f3 (patch) | |
tree | 04cf4b027abd9cc09b057da047424b66706f8d8d /core/src/main | |
parent | 07be232ea12dfc8dc3701ca948814be7dbebf4ee (diff) | |
download | spark-f95b124c68ccc2e318f6ac30685aa47770eea8f3.tar.gz spark-f95b124c68ccc2e318f6ac30685aa47770eea8f3.tar.bz2 spark-f95b124c68ccc2e318f6ac30685aa47770eea8f3.zip |
[SPARK-18382][WEBUI] "run at null:-1" in UI when no file/line info in call site info
## What changes were proposed in this pull request?
Avoid reporting null/-1 file / line number in call sites if encountering StackTraceElement without this info
## How was this patch tested?
Existing tests
Author: Sean Owen <sowen@cloudera.com>
Closes #15862 from srowen/SPARK-18382.
Diffstat (limited to 'core/src/main')
-rw-r--r-- | core/src/main/scala/org/apache/spark/util/Utils.scala | 8 |
1 files changed, 6 insertions, 2 deletions
diff --git a/core/src/main/scala/org/apache/spark/util/Utils.scala b/core/src/main/scala/org/apache/spark/util/Utils.scala index d341982ae9..23b95b9f64 100644 --- a/core/src/main/scala/org/apache/spark/util/Utils.scala +++ b/core/src/main/scala/org/apache/spark/util/Utils.scala @@ -1419,8 +1419,12 @@ private[spark] object Utils extends Logging { } callStack(0) = ste.toString // Put last Spark method on top of the stack trace. } else { - firstUserLine = ste.getLineNumber - firstUserFile = ste.getFileName + if (ste.getFileName != null) { + firstUserFile = ste.getFileName + if (ste.getLineNumber >= 0) { + firstUserLine = ste.getLineNumber + } + } callStack += ste.toString insideSpark = false } |