You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Sagar Sumit (Jira)" <ji...@apache.org> on 2022/06/08 01:55:00 UTC

[jira] [Created] (HUDI-4206) Multiple writers with S3EventsSource to write to same object metadata table

Sagar Sumit created HUDI-4206:
---------------------------------

             Summary: Multiple writers with S3EventsSource to write to same object metadata table
                 Key: HUDI-4206
                 URL: https://issues.apache.org/jira/browse/HUDI-4206
             Project: Apache Hudi
          Issue Type: Task
            Reporter: Sagar Sumit


It would be helpful to support multiple writers for the intermediate metadata table in cases where a single job with `S3EventsSource` that consumes from SQS isn't able to keep up with the pace that messages are being produced in the queue. This will require users to configure a lock provider to support OCC.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)