You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/08/23 08:32:45 UTC

[GitHub] [hudi] duyuqiu2021 opened a new issue #3524: [SUPPORT] About data delay Timeline problem

duyuqiu2021 opened a new issue #3524:
URL: https://github.com/apache/hudi/issues/3524


   Hello everyone.
   
   Now in my business scenario, the system generates a transaction at 10:00. This data is stored in the hudi's table. At 10:05, the customer pays for the order and the warehouse delivers it at 10:10. However, the shipment record data of 10:10 is written to the hudi's table at 10:12, and the payment record of 10:05 is written to the hudi's table at 10:15.
   
   Now, when I query the hudi's table, I can only find the payment record at 10:05.
   
   I saw the description of the timeline on your official website. It mentioned data delay, but there is no specific solution.
   
   Excuse me, how to deal with this situation?
   
   Any help would be greatly apreciated.
   
   Thanks very much
   
   **Environment Description**
   
   Hudi version : 0.8.0
   
   Spark version : 2.4.7
   
   Hadoop version : 2.7.7
   
   Storage (HDFS/S3/GCS..) : HDFS
   
   Running on Docker? (yes/no) : no


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] duyuqiu2021 commented on issue #3524: [SUPPORT] About data delay Timeline problem

Posted by GitBox <gi...@apache.org>.
duyuqiu2021 commented on issue #3524:
URL: https://github.com/apache/hudi/issues/3524#issuecomment-903583411


   When my data was written into the hudi database, the "ts" timestamp was specified, and the time stamp of the shipment record was after the payment record.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] duyuqiu2021 closed issue #3524: [SUPPORT] About data delay Timeline problem

Posted by GitBox <gi...@apache.org>.
duyuqiu2021 closed issue #3524:
URL: https://github.com/apache/hudi/issues/3524


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org