You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2023/01/28 20:20:00 UTC
[jira] [Assigned] (HUDI-5639) Ensure for spark streaming, single writer does not need to set any additional configs with 0.13.0
[ https://issues.apache.org/jira/browse/HUDI-5639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
sivabalan narayanan reassigned HUDI-5639:
-----------------------------------------
Assignee: sivabalan narayanan
> Ensure for spark streaming, single writer does not need to set any additional configs with 0.13.0
> -------------------------------------------------------------------------------------------------
>
> Key: HUDI-5639
> URL: https://issues.apache.org/jira/browse/HUDI-5639
> Project: Apache Hudi
> Issue Type: Improvement
> Components: writer-core
> Reporter: sivabalan narayanan
> Assignee: sivabalan narayanan
> Priority: Blocker
>
> We added multi-writer capability to spark streaming. [https://github.com/apache/hudi/pull/7383]
>
> this introduced a identifier config that each writer should set. For a single writer, we should set some default and not ask user to explicitly set the configs.
> for multi-writer scenarios, its fair to expect users to set different identifiers for diff writers.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)