You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "bibhu107 (via GitHub)" <gi...@apache.org> on 2024/05/11 17:39:59 UTC

[I] [SUPPORT] Archival support for metadata table of Record level indexing [hudi]

bibhu107 opened a new issue, #11195:
URL: https://github.com/apache/hudi/issues/11195

   Hi Community,
   
   I am seeking guidance on implementing archival policies for the Metadata table in Hudi's record-level indexing (RLI). We are not concerned with retaining data older than three years, as we move that data from standard S3 storage to Glacier. Additionally, we would like to archive the metadata record keys provided by Hudi's record-level indexing to keep storage costs under control. I wanted to inquire if there are any plans to introduce TTL or Archival support for the Hudi metadata table's record keys. Is there any plan to bring this feature. 
   
   Thanks
   
   cc - @codope 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [SUPPORT] Archival support for metadata table of Record level indexing [hudi]

Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on issue #11195:
URL: https://github.com/apache/hudi/issues/11195#issuecomment-2106088949

   > I wanted to inquire if there are any plans to introduce TTL or Archival support for the Hudi metadata table's record keys.
   
   Record level ttl is a very tipical request for regular K-V storage, so as to the RLI.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [FEATURE REQUEST] Archival support for metadata table of Record level indexing [hudi]

Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on issue #11195:
URL: https://github.com/apache/hudi/issues/11195#issuecomment-2209850466

   Not really, you can create a JIRA to trace it.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [FEATURE REQUEST] Archival support for metadata table of Record level indexing [hudi]

Posted by "bibhu107 (via GitHub)" <gi...@apache.org>.
bibhu107 commented on issue #11195:
URL: https://github.com/apache/hudi/issues/11195#issuecomment-2208515794

   @danny0405 Are you planning to create a JIRA ticket for same?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org