You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "zhoulii (via GitHub)" <gi...@apache.org> on 2025/07/11 04:03:02 UTC

[I] [Bug] Lookup table loading is not timely when input of join tasks and lookup table both are sparse. [paimon]

zhoulii opened a new issue, #5878:
URL: https://github.com/apache/paimon/issues/5878

   ### Search before asking
   
   - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar.
   
   
   ### Paimon version
   
   1.0
   
   ### Compute Engine
   
   flink 1.18
   
   ### Minimal reproduce step
   
   the inputs of join task and lookup table both are sparse, in this case, there are some empty commits, when refresh lookup table, It cannot guarantee that the latest snapshot will be loaded every time. The loading process will be interrupted when an empty snapshot is encountered.
   
   ### What doesn't meet your expectations?
   
   <img width="2960" height="1878" alt="Image" src="https://github.com/user-attachments/assets/e13225fc-ec72-47b5-80c1-ada18e9a3d25" />
   
   snapshot-1074680 was generated at 00:27, but it was loaded at 06:31.
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [x] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Bug] Lookup table loading is not timely when input of join tasks and lookup table both are sparse. [paimon]

Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi closed issue #5878: [Bug] Lookup table loading is not timely when input of join tasks and lookup table both are sparse.
URL: https://github.com/apache/paimon/issues/5878


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org