You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Youquan Lin (Jira)" <ji...@apache.org> on 2020/06/12 17:59:00 UTC
[jira] [Updated] (YARN-10313) Add hadoop process id to the suffix
of hadoop-unjar directory
[ https://issues.apache.org/jira/browse/YARN-10313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Youquan Lin updated YARN-10313:
-------------------------------
Description:
We used azkaban to submit many yarn jobs, and the /tmp directory will have many hadoop-unjar directories. Sometimes the hadoop-unjar directory on the azkaban machine takes up a lot of space, but we do not know which process generated this directory. In order to solve this problem, we add the hadoop process id to the suffix of the hadoop-unjar directory.
- hadoop process id
```
10554 org.apache.hadoop.util.RunJar
```
- hadoop-unjar directory name
```
hadoop-unjar8020753511094521686-10554
```
was:We used azkaban to submit many yarn jobs, and the /tmp directory will have many hadoop-unjar directories. Sometimes the hadoop-unjar directory on the azkaban machine takes up a lot of space, but we do not know which process generated this directory. In order to solve this problem, we add the hadoop process id to the suffix of the hadoop-unjar directory
> Add hadoop process id to the suffix of hadoop-unjar directory
> -------------------------------------------------------------
>
> Key: YARN-10313
> URL: https://issues.apache.org/jira/browse/YARN-10313
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: client
> Affects Versions: 3.1.3
> Reporter: Youquan Lin
> Assignee: Youquan Lin
> Priority: Major
>
> We used azkaban to submit many yarn jobs, and the /tmp directory will have many hadoop-unjar directories. Sometimes the hadoop-unjar directory on the azkaban machine takes up a lot of space, but we do not know which process generated this directory. In order to solve this problem, we add the hadoop process id to the suffix of the hadoop-unjar directory.
>
> - hadoop process id
> ```
> 10554 org.apache.hadoop.util.RunJar
> ```
> - hadoop-unjar directory name
> ```
> hadoop-unjar8020753511094521686-10554
> ```
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org