You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by gu...@apache.org on 2018/07/21 08:43:15 UTC
spark git commit: [SPARK-24873][YARN] Turn off spark-shell noisy log
output
Repository: spark
Updated Branches:
refs/heads/master 106880edc -> d7ae4247e
[SPARK-24873][YARN] Turn off spark-shell noisy log output
## What changes were proposed in this pull request?
[SPARK-24182](https://github.com/apache/spark/pull/21243) changed the `logApplicationReport` from `false` to `true`. This pr revert it to `false`. otherwise `spark-shell` will show noisy log output:
```java
...
18/07/16 04:46:25 INFO Client: Application report for application_1530676576026_54551 (state: RUNNING)
18/07/16 04:46:26 INFO Client: Application report for application_1530676576026_54551 (state: RUNNING)
...
```
Closes https://github.com/apache/spark/pull/21827
## How was this patch tested?
manual tests
Author: Yuming Wang <yu...@ebay.com>
Closes #21784 from wangyum/SPARK-24182.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d7ae4247
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/d7ae4247
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/d7ae4247
Branch: refs/heads/master
Commit: d7ae4247ea8754dcb5fa03c2e0bf2d9aab7828e5
Parents: 106880e
Author: Yuming Wang <yu...@ebay.com>
Authored: Sat Jul 21 16:43:10 2018 +0800
Committer: hyukjinkwon <gu...@apache.org>
Committed: Sat Jul 21 16:43:10 2018 +0800
----------------------------------------------------------------------
.../spark/scheduler/cluster/YarnClientSchedulerBackend.scala | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/d7ae4247/resource-managers/yarn/src/main/scala/org/apache/spark/scheduler/cluster/YarnClientSchedulerBackend.scala
----------------------------------------------------------------------
diff --git a/resource-managers/yarn/src/main/scala/org/apache/spark/scheduler/cluster/YarnClientSchedulerBackend.scala b/resource-managers/yarn/src/main/scala/org/apache/spark/scheduler/cluster/YarnClientSchedulerBackend.scala
index f1a8df0..9397a1e 100644
--- a/resource-managers/yarn/src/main/scala/org/apache/spark/scheduler/cluster/YarnClientSchedulerBackend.scala
+++ b/resource-managers/yarn/src/main/scala/org/apache/spark/scheduler/cluster/YarnClientSchedulerBackend.scala
@@ -111,7 +111,7 @@ private[spark] class YarnClientSchedulerBackend(
override def run() {
try {
val YarnAppReport(_, state, diags) =
- client.monitorApplication(appId.get, logApplicationReport = true)
+ client.monitorApplication(appId.get, logApplicationReport = false)
logError(s"YARN application has exited unexpectedly with state $state! " +
"Check the YARN application logs for more details.")
diags.foreach { err =>
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org