You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "ergophobiac (via GitHub)" <gi...@apache.org> on 2023/08/11 07:24:53 UTC

[GitHub] [hudi] ergophobiac commented on issue #9352: "hoodie.embed.timeline.server.async" causing skipped cleans

ergophobiac commented on issue #9352:
URL: https://github.com/apache/hudi/issues/9352#issuecomment-1674316491

   We found the cause of the problem (putting it here so anyone else who runs into this can find it). 
   
   In streaming sink, the timeline server is shut down at the end of the first micro-batch. If like us, you have **hoodie.embed.timeline.server.async=true**, then it may lead to other table services getting an inconsistent view of the timeline, leading to problems down the line. 
   
   You can monitor the following for an in-depth explanation and resolution timeline:
   
   - [HUDI-3636](https://issues.apache.org/jira/browse/HUDI-3636)
   - Pull requests #5269 and #9266 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org