You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@zeppelin.apache.org by zjffdu <gi...@git.apache.org> on 2018/06/20 06:58:06 UTC
[GitHub] zeppelin pull request #3038: ZEPPELIN-3556. set spark.yarn.submit.waitAppCom...
GitHub user zjffdu opened a pull request:
https://github.com/apache/zeppelin/pull/3038
ZEPPELIN-3556. set spark.yarn.submit.waitAppCompletion to false in yarn-cluster mode
### What is this PR for?
Set `spark.yarn.submit.waitAppCompletion` to false in yarn-cluster mode, so that in the interpreter log we won't see many logs of monitor yarn app status which is useless.
### What type of PR is it?
[Improvement]
### Todos
* [ ] - Task
### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-3556
### How should this be tested?
* CI pass
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/zjffdu/zeppelin ZEPPELIN-3556
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/zeppelin/pull/3038.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3038
----
commit 7474987a693c48489bdc453890e0f72baa3e3697
Author: Jeff Zhang <zj...@...>
Date: 2018-06-20T06:56:11Z
ZEPPELIN-3556. set spark.yarn.submit.waitAppCompletion to false in yarn-cluster mode
----
---
[GitHub] zeppelin issue #3038: ZEPPELIN-3556. set spark.yarn.submit.waitAppCompletion...
Posted by zjffdu <gi...@git.apache.org>.
Github user zjffdu commented on the issue:
https://github.com/apache/zeppelin/pull/3038
@felixcheung Could you help review it ? Thanks
---
[GitHub] zeppelin issue #3038: ZEPPELIN-3556. set spark.yarn.submit.waitAppCompletion...
Posted by zjffdu <gi...@git.apache.org>.
Github user zjffdu commented on the issue:
https://github.com/apache/zeppelin/pull/3038
Yes, the `interpreter.sh` will exit after zeppelin server and spark interpreter process establish connection
---
[GitHub] zeppelin pull request #3038: ZEPPELIN-3556. set spark.yarn.submit.waitAppCom...
Posted by asfgit <gi...@git.apache.org>.
Github user asfgit closed the pull request at:
https://github.com/apache/zeppelin/pull/3038
---
[GitHub] zeppelin issue #3038: ZEPPELIN-3556. set spark.yarn.submit.waitAppCompletion...
Posted by felixcheung <gi...@git.apache.org>.
Github user felixcheung commented on the issue:
https://github.com/apache/zeppelin/pull/3038
Looks fine.
Isn’t this config has other implications though, that it won’t wait for the app to finish?
________________________________
---