You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Charles (Jira)" <ji...@apache.org> on 2022/06/05 05:20:00 UTC

[jira] [Commented] (HUDI-4189) Support custom filesystem schema

    [ https://issues.apache.org/jira/browse/HUDI-4189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17550168#comment-17550168 ] 

Charles commented on HUDI-4189:
-------------------------------

link: https://github.com/apache/hudi/pull/5712

> Support custom filesystem schema
> --------------------------------
>
>                 Key: HUDI-4189
>                 URL: https://issues.apache.org/jira/browse/HUDI-4189
>             Project: Apache Hudi
>          Issue Type: New Feature
>          Components: cli
>            Reporter: Charles
>            Priority: Major
>              Labels: pull-request-available
>
> Add options:
>  # --user-defined-schemes='[\{"name":"ufs","supportsAppend":true},\{"name":"somefs","supportsAppend":false}]'
>  # --override-predefined-schemes=false
> to let user specified filesystem schemes.
>  
> This feature is useful in the following two cases:
>  # Some vendors provide hdfs-compatible filesystems and change the protocol name from hdfs:// to [x]fs://.
>  # Some vendors provide totally new filesystems, and they already integrate these filesystems with spark.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)