You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "forest455 (via GitHub)" <gi...@apache.org> on 2023/05/29 15:16:46 UTC

[GitHub] [hudi] forest455 opened a new issue, #8841: [SUPPORT] presto querying hudi COW table can't get latest snapshot

forest455 opened a new issue, #8841:
URL: https://github.com/apache/hudi/issues/8841

   After using HoodieMultiTableDeltaStreamer   ingesting mysql Binlogs through kafka-connector with Mysql Debezium,   all change logs for each primary key from source table are persisted into a hudi COW table.  using presto as my query engine I get all the change logs in a table ,however I want  query the latest snapshot of a table which means the result only consists one latest updated record .
    Can anyone help to instruct me to solve this problem.  Thanks .
   
   
   
   * Hudi version : 0.13.0
   
   * Spark version : 3.3.1
   
   * Hive version : 3.1.3
   
   * Hadoop version : 3.1.1
   
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] ad1happy2go commented on issue #8841: [SUPPORT] presto querying hudi COW table can't get latest snapshot

Posted by "ad1happy2go (via GitHub)" <gi...@apache.org>.
ad1happy2go commented on issue #8841:
URL: https://github.com/apache/hudi/issues/8841#issuecomment-1570297210

   @forest455 What record key are you using? I am asking this to understand how you are getting all changes for each primary key into hudi table.
   
   Ideally it should do upsert per primary key, so only latest record should be available when you run the queries unless you do time travel query.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] ad1happy2go commented on issue #8841: [SUPPORT] presto querying hudi COW table can't get latest snapshot

Posted by "ad1happy2go (via GitHub)" <gi...@apache.org>.
ad1happy2go commented on issue #8841:
URL: https://github.com/apache/hudi/issues/8841#issuecomment-1570297744

   @forest455 What record key are you using? I am asking this to understand how you are getting all changes for each primary key into hudi table.
   
   Ideally it should do upsert per primary key, so only latest record should be available when you run the queries unless you do time travel query.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] forest455 commented on issue #8841: [SUPPORT] presto querying hudi COW table can't get latest snapshot

Posted by "forest455 (via GitHub)" <gi...@apache.org>.
forest455 commented on issue #8841:
URL: https://github.com/apache/hudi/issues/8841#issuecomment-1570453047

   Thanks very much for your answer.
   for your understanding here are some screenshots.  Please let me know if something need to know further. Thanks again.
   ![image](https://github.com/apache/hudi/assets/95460060/d68e48b0-bb57-4963-95d8-20737e681f32)
   ![image](https://github.com/apache/hudi/assets/95460060/6c8558d9-f773-4de3-a728-fc6f5e8bb7a7)
   ![image](https://github.com/apache/hudi/assets/95460060/f0fca614-0b76-4565-9f05-bebccca16aff)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] forest455 closed issue #8841: [SUPPORT] presto querying hudi COW table can't get latest snapshot

Posted by "forest455 (via GitHub)" <gi...@apache.org>.
forest455 closed issue #8841: [SUPPORT]  presto querying hudi COW table  can't get latest snapshot  
URL: https://github.com/apache/hudi/issues/8841


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org