You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2023/01/28 20:20:00 UTC

[jira] [Assigned] (HUDI-5639) Ensure for spark streaming, single writer does not need to set any additional configs with 0.13.0

     [ https://issues.apache.org/jira/browse/HUDI-5639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

sivabalan narayanan reassigned HUDI-5639:
-----------------------------------------

    Assignee: sivabalan narayanan

> Ensure for spark streaming, single writer does not need to set any additional configs with 0.13.0
> -------------------------------------------------------------------------------------------------
>
>                 Key: HUDI-5639
>                 URL: https://issues.apache.org/jira/browse/HUDI-5639
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: writer-core
>            Reporter: sivabalan narayanan
>            Assignee: sivabalan narayanan
>            Priority: Blocker
>
> We added multi-writer capability to spark streaming. [https://github.com/apache/hudi/pull/7383]
>  
> this introduced a identifier config that each writer should set. For a single writer, we should set some default and not ask user to explicitly set the configs. 
> for multi-writer scenarios, its fair to expect users to set different identifiers for diff writers. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)