You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Timothy Brown (Jira)" <ji...@apache.org> on 2025/06/27 14:25:00 UTC

[jira] [Closed] (HUDI-9557) Add ability to configure batch size and max concurrent requests in Glue Sync

     [ https://issues.apache.org/jira/browse/HUDI-9557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Timothy Brown closed HUDI-9557.
-------------------------------
    Resolution: Duplicate

> Add ability to configure batch size and max concurrent requests in Glue Sync
> ----------------------------------------------------------------------------
>
>                 Key: HUDI-9557
>                 URL: https://issues.apache.org/jira/browse/HUDI-9557
>             Project: Apache Hudi
>          Issue Type: Improvement
>            Reporter: Timothy Brown
>            Priority: Minor
>
> Currently the max partitions per request is hardcoded. Let's make this configurable and also configure a max concurrent requests. We have seen the initial sync timeout due to too many inflight requests when there are hundreds of thousands of partitions for a table.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)