You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by "Zac Zhou (JIRA)" <ji...@apache.org> on 2018/09/20 14:41:00 UTC
[jira] [Created] (YARN-8806) Enable local staging directory and
clean it up when submarine job is submitted
Zac Zhou created YARN-8806:
------------------------------
Summary: Enable local staging directory and clean it up when submarine job is submitted
Key: YARN-8806
URL: https://issues.apache.org/jira/browse/YARN-8806
Project: Hadoop YARN
Issue Type: Sub-task
Environment: In the /tmp dir, there are launch scripts which are not cleaned up as follows:
-rw-r--r-- 1 hadoop netease 1100 Sep 18 10:46 PRIMARY_WORKER-launch-script8635233314077649086.sh
-rw-r--r-- 1 hadoop netease 1100 Sep 18 10:46 WORKER-launch-script129488020578466938.sh
-rw-r--r-- 1 hadoop netease 1028 Sep 18 10:46 PS-launch-script471092031021738136.sh
Reporter: Zac Zhou
Assignee: Zac Zhou
YarnServiceJobSubmitter.generateCommandLaunchScript creates container launch scripts in the local filesystem. Container launch scripts would be uploaded to hdfs staging dir, but would not be not deleted after the job is submitted
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org