[GitHub] [hudi] nsivabalan commented on pull request #4800: [HUDI-2761] Fixing unnecessary refreshing of timeline in Timelineserver

[GitBox <gi...@apache.org>]

nsivabalan commented on pull request #4800:
URL: https://github.com/apache/hudi/pull/4800#issuecomment-1038104078


   @xushiyan @n3nash :
   I put up a patch as is what I got from the community user. and I heard that its being already run in prod if I am not wrong. so, went ahead and put up a patch. atleast I wanted to have discussions on both approaches. 
   but as I mentioned in the description, I am also inclined towards using lastInstantTime which makes sense. Will go ahead and fix the patch. 
   
   @danny0405 : we need to think more about cleaning not triggering any refresh. If I am not wrong, none of the apis in FileSystemView knows for which operation it is being executed for (for eg, getLatestBaseFiles). So, ignoring the timeline refresh just for cleaning will mean that we leak such information to the FileSystemView which needs some thinking. I am to take a look at the code to see how this might pan out. Will keep you posted. 
   but thanks for bringing up a good point. appreciate it. 
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org