You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Raymond Xu (Jira)" <ji...@apache.org> on 2020/11/09 19:38:00 UTC

[jira] [Commented] (HUDI-768) Support split/merge source datasets during export

    [ https://issues.apache.org/jira/browse/HUDI-768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17228779#comment-17228779 ] 

Raymond Xu commented on HUDI-768:
---------------------------------

[~vinoth] i wonder if we should close this as won't do. This sort of advanced transformation feature can be integrated to deltastreamer. The exporter feature better be kept lean and simple. WDYT?

> Support split/merge source datasets during export
> -------------------------------------------------
>
>                 Key: HUDI-768
>                 URL: https://issues.apache.org/jira/browse/HUDI-768
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: Utilities
>            Reporter: Raymond Xu
>            Priority: Major
>
> comment mentioned this use case
> https://github.com/apache/incubator-hudi/issues/1480#issuecomment-608650572
> some more logic to implement for exporter to take multiple source/target paths. Also some efforts to support multiple datasets in Transformer interface.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)