You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Victor Wong (Jira)" <ji...@apache.org> on 2020/01/23 08:33:00 UTC
[jira] [Commented] (FLINK-15447) To improve utilization of the
`java.io.tmpdir` for YARN module
[ https://issues.apache.org/jira/browse/FLINK-15447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021858#comment-17021858 ]
Victor Wong commented on FLINK-15447:
-------------------------------------
[~rongr] updated this issue based on your suggestion. Could you assign it to me? Thanks!
> To improve utilization of the `java.io.tmpdir` for YARN module
> --------------------------------------------------------------
>
> Key: FLINK-15447
> URL: https://issues.apache.org/jira/browse/FLINK-15447
> Project: Flink
> Issue Type: Improvement
> Components: Deployment / YARN
> Affects Versions: 1.9.1
> Reporter: Victor Wong
> Priority: Major
>
> *#Background*
> Currently, when running Flink on Yarn, the "java.io.tmpdir" property is set to the default value, which is "/tmp".
> Sometimes we ran into exceptions caused by a full "/tmp" directory, which would not be cleaned automatically after applications finished.
>
> #*Goal*
> quoted from: [HADOOP-2735|https://issues.apache.org/jira/browse/HADOOP-2735]
> _1) Tasks can utilize all disks when using tmp_
> _2) Any undeleted tmp files will be deleted by the tasktracker when task(job?) is done._
>
> #*Suggestion*
> I think we can set "java.io.tmpdir" to "{{{{PWD}}}}/tmp" directory, or something similar. "{{{{PWD}}}}" will be replaced with the true working directory of JM/TM by Yarn, which will be cleaned automatically.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)