[jira] [Commented] (HUDI-3893) Add support to refresh hoodie.properties at regular intervals

["sivabalan narayanan (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HUDI-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523120#comment-17523120 ] 

sivabalan narayanan commented on HUDI-3893:
-------------------------------------------

suggested to user

 

do you think you can add a lambda or something for following
 {{touch ${HUDI_TABLE_PATH}/.hoodie/hoodie.properties}}
and that should solve the problem right?

 

> Add support to refresh hoodie.properties at regular intervals
> -------------------------------------------------------------
>
>                 Key: HUDI-3893
>                 URL: https://issues.apache.org/jira/browse/HUDI-3893
>             Project: Apache Hudi
>          Issue Type: Task
>            Reporter: sivabalan narayanan
>            Priority: Critical
>             Fix For: 0.12.0
>
>
> in cloud stores, users could set up lifecycle policy to delete files which are not touched for say 30 days. So, wrt "hoodie.properties" which is created once and never updated for the most part, it could get caught with the lifecycle policy. We can ask users not to set the lifecycle policy, but would be good to add support to hoodie to make it resilient. 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)