You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Danny Chen (Jira)" <ji...@apache.org> on 2021/03/11 12:01:00 UTC

[jira] [Created] (HUDI-1681) Support object storage for Flink writer

Danny Chen created HUDI-1681:
--------------------------------

             Summary: Support object storage for Flink writer
                 Key: HUDI-1681
                 URL: https://issues.apache.org/jira/browse/HUDI-1681
             Project: Apache Hudi
          Issue Type: Sub-task
          Components: Flink Integration
            Reporter: Danny Chen
             Fix For: 0.8.0


In order to support object storage, we need these changes:

- Use the Hadoop filesystem so that we can find the plugin filesystem
- Do not fetch file size until the file handle is closed
- Do not close the opened filesystem because we want to use the filesystem cache



--
This message was sent by Atlassian Jira
(v8.3.4#803005)