You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/02/20 12:12:09 UTC

[GitHub] [hudi] nsivabalan commented on issue #4846: [SUPPORT] [Question]Code Logic in RocksDbBasedFileSystemView

nsivabalan commented on issue #4846:
URL: https://github.com/apache/hudi/issues/4846#issuecomment-1046224183


   this is my understanding by looking at the code of interest. will wait to hear from Balaji though. 
   Its more of an optimization. If we don't override, we call into fetchLatestBaseFiles(partitionPath) which in turn calls into fetchAllStoredFileGroups(partitionPath). so this is essentially fetching all file groups for the partition of interest and then deducing from it. 
   
   where as in our overridden method, we filter directly w/ rocksDB for the partition and fileId of interest and then fetching just the latest from it, which I feel might be faster. 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org