You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Nico Kruber (JIRA)" <ji...@apache.org> on 2017/12/18 10:56:00 UTC
[jira] [Created] (FLINK-8279) Use Mesos/YARN temp directories as
fallback for BlobServer/Cache temp directories
Nico Kruber created FLINK-8279:
----------------------------------
Summary: Use Mesos/YARN temp directories as fallback for BlobServer/Cache temp directories
Key: FLINK-8279
URL: https://issues.apache.org/jira/browse/FLINK-8279
Project: Flink
Issue Type: Improvement
Components: Distributed Coordination, Network
Affects Versions: 1.4.0
Reporter: Nico Kruber
Assignee: Nico Kruber
Currently, the BLOB server and cache processes (temporarily) stash incoming files into their local file system in the directory given by the {{blob.storage.directory}} configuration property. If this property is not set or empty, it will fall back to {{java.io.tmpdir}}.
Instead, in a Mesos/YARN environment, we could use the temporary directories they assigned to the Flink job which are not only the proper folder to use, but may also offer some more space.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)