diff options
| author | Brian Cho <bcho@fb.com> | 2016-09-29 15:59:17 -0400 |
|---|---|---|
| committer | Andrew Or <andrewor14@gmail.com> | 2016-09-29 15:59:17 -0400 |
| commit | 027dea8f294504bc5cd8bfedde546d171cb78657 (patch) | |
| tree | 4adae6be3891d1bda58dd97701a58991e21b1bee | |
| parent | cb87b3ced9453b5717fa8e8637b97a2f3f25fdd7 (diff) | |
| download | spark-027dea8f294504bc5cd8bfedde546d171cb78657.tar.gz spark-027dea8f294504bc5cd8bfedde546d171cb78657.tar.bz2 spark-027dea8f294504bc5cd8bfedde546d171cb78657.zip | |
[SPARK-17715][SCHEDULER] Make task launch logs DEBUG
## What changes were proposed in this pull request?
Ramp down the task launch logs from INFO to DEBUG. Task launches can happen orders of magnitude more than executor registration so it makes the logs easier to handle if they are different log levels. For larger jobs, there can be 100,000s of task launches which makes the driver log huge.
## How was this patch tested?
No tests, as this is a trivial change.
Author: Brian Cho <bcho@fb.com>
Closes #15290 from dafrista/ramp-down-task-logging.
| -rw-r--r-- | core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala b/core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala index 2d09863166..0dae0e614e 100644 --- a/core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala +++ b/core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala @@ -265,7 +265,7 @@ class CoarseGrainedSchedulerBackend(scheduler: TaskSchedulerImpl, val rpcEnv: Rp val executorData = executorDataMap(task.executorId) executorData.freeCores -= scheduler.CPUS_PER_TASK - logInfo(s"Launching task ${task.taskId} on executor id: ${task.executorId} hostname: " + + logDebug(s"Launching task ${task.taskId} on executor id: ${task.executorId} hostname: " + s"${executorData.executorHost}.") executorData.executorEndpoint.send(LaunchTask(new SerializableBuffer(serializedTask))) |