You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Chesnay Schepler (Jira)" <ji...@apache.org> on 2020/08/20 19:11:00 UTC
[jira] [Updated] (FLINK-19007) Automatically set presto staging
directory to io.tmp.dirs
[ https://issues.apache.org/jira/browse/FLINK-19007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chesnay Schepler updated FLINK-19007:
-------------------------------------
Description:
The presto S3 filesystem uses a staging directory on the local disk (for buffering data or something). This directory by default points to {{/tmp}}.
We often see users configuring a special directory for temporary files via {{io.tmp.dirs}}, and it would make sense to automatically set the {{staging-directory}} to the same path, iff it was not explicitly configured.
The corresponding property is {{presto.s3.staging-directory}}, found at {{com.facebook.presto.hive.s3.PrestoS3FileSystem.S3_STAGING_DIRECTORY}}.
was:
The presto S3 filesystem uses a staging directory on the local disk (for buffering data or smth). This directory by default points to {{/tmp}}.
We often see users configuring a special directory for temporary files via {{io.tmp.dirs}}, and it would make sense to automatically set the {{staging-directory}} to the same path, iff it was not explicitly configured.
The corresponding property is {{presto.s3.staging-directory}}, found at {{com.facebook.presto.hive.s3.PrestoS3FileSystem.S3_STAGING_DIRECTORY}}.
> Automatically set presto staging directory to io.tmp.dirs
> ---------------------------------------------------------
>
> Key: FLINK-19007
> URL: https://issues.apache.org/jira/browse/FLINK-19007
> Project: Flink
> Issue Type: Improvement
> Components: Connectors / FileSystem, Runtime / Configuration
> Reporter: Chesnay Schepler
> Priority: Major
> Fix For: 1.12.0
>
>
> The presto S3 filesystem uses a staging directory on the local disk (for buffering data or something). This directory by default points to {{/tmp}}.
> We often see users configuring a special directory for temporary files via {{io.tmp.dirs}}, and it would make sense to automatically set the {{staging-directory}} to the same path, iff it was not explicitly configured.
> The corresponding property is {{presto.s3.staging-directory}}, found at {{com.facebook.presto.hive.s3.PrestoS3FileSystem.S3_STAGING_DIRECTORY}}.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)