You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "kazdy (Jira)" <ji...@apache.org> on 2023/05/17 21:14:00 UTC

[jira] [Updated] (HUDI-6232) Support skip archive for glue sync

     [ https://issues.apache.org/jira/browse/HUDI-6232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

kazdy updated HUDI-6232:
------------------------
    Priority: Major  (was: Minor)

> Support skip archive for glue sync
> ----------------------------------
>
>                 Key: HUDI-6232
>                 URL: https://issues.apache.org/jira/browse/HUDI-6232
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: meta-sync
>            Reporter: kazdy
>            Assignee: kazdy
>            Priority: Major
>             Fix For: 0.14.0
>
>
> Glue has soft limit of 100k table versions. With every table update new version is created. In streaming scenarios we can hit 100k table versions quickly.
> Users should be able to skip table archival when using glue meta sync. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)