You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2020/08/13 06:43:55 UTC
[GitHub] [incubator-doris] xy720 opened a new issue #4346: [Spark Load] Use the yarn command to get status and kill the application
xy720 opened a new issue #4346:
URL: https://github.com/apache/incubator-doris/issues/4346
**Motivation**
Spark load currently needs to get status and kill application running on YARN cluster by hadoop-yarn-client api.
However, this approach is not suitable for multiple environments.
For example, KILL operation requires authentication. If user has their own security authentication system which is different from hadoop official authentication (simple, kerberos), the KILL operation will fail.
Therefore, I suggest to add a configurable yarn environment, and use yarn command to get status and kill the application. By default, the official yarn environment is used, but users can configure their own environment.
**Description**
The format of the yarn command is generally as follows:
```
yarn --config confdir application <-kill | -status> <Application ID>
```
We can manage yarn configuration files's directory by `--config` option, and gernerate configuration files (e.g. core-site.xml) into the specified directory.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] xy720 closed issue #4346: [Spark Load] Use the yarn command to get status and kill the application
Posted by GitBox <gi...@apache.org>.
xy720 closed issue #4346:
URL: https://github.com/apache/incubator-doris/issues/4346
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org