You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/01/27 18:48:58 UTC

[GitHub] [hudi] prashantwason commented on pull request #2494: [HUDI-1552] Improve performance of key lookups from base file in Metadata Table.

prashantwason commented on pull request #2494:
URL: https://github.com/apache/hudi/pull/2494#issuecomment-768495604


   > > The size of the base file was 3MB so this means that the in-memory HFile block caching was also working.
   > 
   > Trying to understand this part. Was the workload, trying to fetch all the keys out of the HFile or just 1?
   
   The workload was a commit followed by a Clean operation with num_versions_retained=1 so it will clean all partitions. Hence, number of key lookups should be equal to number of partitions and all the keys should have been read from the HFile.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org