You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@submarine.apache.org by "Wei-Chiu Chuang (Jira)" <ji...@apache.org> on 2020/03/10 00:18:00 UTC
[jira] [Commented] (SUBMARINE-18) Enable local staging directory
and clean it up when submarine job is submitted
[ https://issues.apache.org/jira/browse/SUBMARINE-18?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17055475#comment-17055475 ]
Wei-Chiu Chuang commented on SUBMARINE-18:
------------------------------------------
Just checking to see if this is still relevant and whether to rebase & raise a PR, or close it as won't fix/later.
> Enable local staging directory and clean it up when submarine job is submitted
> ------------------------------------------------------------------------------
>
> Key: SUBMARINE-18
> URL: https://issues.apache.org/jira/browse/SUBMARINE-18
> Project: Apache Submarine
> Issue Type: New Feature
> Components: Commons
> Environment: In the /tmp dir, there are launch scripts which are not cleaned up as follows:
> -rw-r--r-- 1 hadoop netease 1100 Sep 18 10:46 PRIMARY_WORKER-launch-script8635233314077649086.sh
> -rw-r--r-- 1 hadoop netease 1100 Sep 18 10:46 WORKER-launch-script129488020578466938.sh
> -rw-r--r-- 1 hadoop netease 1028 Sep 18 10:46 PS-launch-script471092031021738136.sh
> Reporter: Zac Zhou
> Assignee: Zac Zhou
> Priority: Major
> Attachments: YARN-8806.001.patch, YARN-8806.002.patch, YARN-8806.003.patch, YARN-8806.004.patch, YARN-8806.005.patch, YARN-8806.006.patch
>
>
> YarnServiceJobSubmitter.generateCommandLaunchScript creates container launch scripts in the local filesystem. Container launch scripts would be uploaded to hdfs staging dir, but would not be not deleted after the job is submitted
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@submarine.apache.org
For additional commands, e-mail: dev-help@submarine.apache.org