You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Chesnay Schepler (Jira)" <ji...@apache.org> on 2022/01/26 12:27:00 UTC

[jira] [Assigned] (FLINK-25597) Document which URI based config options works with local / general filesystem

     [ https://issues.apache.org/jira/browse/FLINK-25597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chesnay Schepler reassigned FLINK-25597:
----------------------------------------

    Assignee: Chesnay Schepler

> Document which URI based config options works with local / general filesystem
> -----------------------------------------------------------------------------
>
>                 Key: FLINK-25597
>                 URL: https://issues.apache.org/jira/browse/FLINK-25597
>             Project: Flink
>          Issue Type: Technical Debt
>          Components: Documentation, Runtime / Coordination
>            Reporter: David Morávek
>            Assignee: Chesnay Schepler
>            Priority: Major
>             Fix For: 1.15.0
>
>
> From S3 documentation [1]:
> {code}
> Note that these examples are not exhaustive and you can use S3 in other places as well, including your high availability setup or the EmbeddedRocksDBStateBackend; everywhere that Flink expects a FileSystem URI.
> {code}
> This is not correct, because there are config options such as `web.upload.dir`, that don't work with the filesystem abstraction and therefore can be only used with the local (java) filesystem. We should document these options with what type of filesystem they expect and get rid of the misleading note in s3 documentation.
> Example: https://lists.apache.org/thread/5sqz77nsr5mkzv3r1w114v2x52vyk80c
> [1] https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/deployment/filesystems/s3/#amazon-s3



--
This message was sent by Atlassian Jira
(v8.20.1#820001)