You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2023/11/13 04:49:00 UTC

[jira] [Created] (HUDI-7086) Scale GCS event source to consume large no of msgs from queue

sivabalan narayanan created HUDI-7086:
-----------------------------------------

             Summary: Scale GCS event source to consume large no of msgs from queue
                 Key: HUDI-7086
                 URL: https://issues.apache.org/jira/browse/HUDI-7086
             Project: Apache Hudi
          Issue Type: Improvement
          Components: deltastreamer
            Reporter: sivabalan narayanan


We should be able to consume 100 or more messages in one batch for GCS event source. 

 

If apis has some limitations, lets invoke multiple times before ingesting to hudi. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)