diff options
| author | Juan Rodriguez Hortala <hortala@amazon.com> | 2017-03-26 10:39:05 +0100 |
|---|---|---|
| committer | Sean Owen <sowen@cloudera.com> | 2017-03-26 10:39:05 +0100 |
| commit | 362ee93296a0de6342b4339e941e6a11f445c5b2 (patch) | |
| tree | e1402cf609eaecc748e63c9545c4866a4a20e3cd /resource-managers | |
| parent | 93bb0b911b6c790fa369b39da51a83d8f62da909 (diff) | |
| download | spark-362ee93296a0de6342b4339e941e6a11f445c5b2.tar.gz spark-362ee93296a0de6342b4339e941e6a11f445c5b2.tar.bz2 spark-362ee93296a0de6342b4339e941e6a11f445c5b2.zip | |
logging improvements
## What changes were proposed in this pull request?
Adding additional information to existing logging messages:
- YarnAllocator: log the executor ID together with the container id when a container for an executor is launched.
- NettyRpcEnv: log the receiver address when there is a timeout waiting for an answer to a remote call.
- ExecutorAllocationManager: fix a typo in the logging message for the list of executors to be removed.
## How was this patch tested?
Build spark and submit the word count example to a YARN cluster using cluster mode
Author: Juan Rodriguez Hortala <hortala@amazon.com>
Closes #17411 from juanrh/logging-improvements.
Diffstat (limited to 'resource-managers')
| -rw-r--r-- | resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocator.scala | 3 |
1 files changed, 2 insertions, 1 deletions
diff --git a/resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocator.scala b/resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocator.scala index abd2de75c6..25556763da 100644 --- a/resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocator.scala +++ b/resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocator.scala @@ -494,7 +494,8 @@ private[yarn] class YarnAllocator( val containerId = container.getId val executorId = executorIdCounter.toString assert(container.getResource.getMemory >= resource.getMemory) - logInfo(s"Launching container $containerId on host $executorHostname") + logInfo(s"Launching container $containerId on host $executorHostname " + + s"for executor with ID $executorId") def updateInternalState(): Unit = synchronized { numExecutorsRunning += 1 |