You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "danny0405 (via GitHub)" <gi...@apache.org> on 2023/03/29 02:50:53 UTC

[GitHub] [hudi] danny0405 commented on pull request #8245: [HUDI-5944] Added the ability to fix partitiion missing in hudi synctool

danny0405 commented on PR #8245:
URL: https://github.com/apache/hudi/pull/8245#issuecomment-1487872941

   > Hi,
   > 
   > We got the same issue before when syncing Hive partition if there are more then one writer. And we fix this issue by using @boneanxs 's solution in this PR: #7627
   > 
   > Further more, it can solve downstream pipeline stream reading issue. If there is a downstream Hudi reader reading data in stream mode, there will be the same issue as this ticket mentioned. @boneanxs 's solution can solve this problem fundamentally.
   > 
   > May I ask if it is appropriate that we can add this feature (#7627) in Hudi timeline?
   
   Yes, adding the physical processing time instead of logical timestamp on timeline should be helpful in some senarios.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org