You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Robert Metzger (Jira)" <ji...@apache.org> on 2020/12/08 06:41:08 UTC

[jira] [Updated] (FLINK-18562) Add Support for Azure Data Lake Store Gen 2 in Flink File System

     [ https://issues.apache.org/jira/browse/FLINK-18562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robert Metzger updated FLINK-18562:
-----------------------------------
    Fix Version/s:     (was: 1.12.0)
                   1.13.0

> Add Support for Azure Data Lake Store Gen 2 in Flink File System
> ----------------------------------------------------------------
>
>                 Key: FLINK-18562
>                 URL: https://issues.apache.org/jira/browse/FLINK-18562
>             Project: Flink
>          Issue Type: Improvement
>          Components: Connectors / FileSystem
>    Affects Versions: 1.12.0
>            Reporter: Israel Ekpo
>            Assignee: Israel Ekpo
>            Priority: Major
>             Fix For: 1.13.0
>
>
> The objective of this improvement is to add support for Azure Data Lake Store Gen 2 (ADLS Gen2) [1] in the Flink File System [2]
> This will allow include the abfs(s) scheme/protocol via ADLS Gen2 to be available as one of the distributed filesystems that can be used for savepointing, checkpointing, data sources and sinks in Flink jobs.
> It will also simplify the implementation of managed identities [3] which is an added security benefit in environments where system assigned and user assigned managed identities can be leveraged.
> [1] https://hadoop.apache.org/docs/current/hadoop-azure/abfs.html
> [2] https://github.com/apache/flink/tree/master/flink-filesystems
> [3] https://hadoop.apache.org/docs/current/hadoop-azure-datalake/index.html#Using_MSI_.28Managed_Service_Identity.29



--
This message was sent by Atlassian Jira
(v8.3.4#803005)