You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/01/13 22:02:42 UTC

[GitHub] [hudi] vburenin commented on pull request #2440: Fixed suboptimal implementation of a magic sequence search

vburenin commented on pull request #2440:
URL: https://github.com/apache/hudi/pull/2440#issuecomment-759766940


   @vinothchandar I suspect the buffering of underlaying reads is on FileSystem driver, isn't it? If it is, GCS clearly not buffering it that can be seen in a form of a significant time distance (80 ms) between the calls to the readyFully method.
   ```
   404120 [Executor task launch worker for task 268] INFO  org.apache.hudi.common.table.log.HoodieLogFileReader  - Current magic position: 263
   404183 [Executor task launch worker for task 268] INFO  org.apache.hudi.common.table.log.HoodieLogFileReader  - Current magic position: 264
   404246 [Executor task launch worker for task 268] INFO  org.apache.hudi.common.table.log.HoodieLogFileReader  - Current magic position: 265
   ```


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org