You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "Stephen0421 (via GitHub)" <gi...@apache.org> on 2024/03/18 10:08:52 UTC
[I] [Bug] load index too slow when restart flink job using dynamic bucket. [incubator-paimon]
Stephen0421 opened a new issue, #3038:
URL: https://github.com/apache/incubator-paimon/issues/3038
### Search before asking
- [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found nothing similar.
### Paimon version
0.7
### Compute Engine
Flink
### Minimal reproduce step
Can try to write data using dynamic bucket with datagen generate 0 to 500,000,000 keys, stop the job and restart.
### What doesn't meet your expectations?
This cost around 20 minute to load index, it's too slow.
### Anything else?
_No response_
### Are you willing to submit a PR?
- [X] I'm willing to submit a PR!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] load index too slow when restart flink job using dynamic bucket. [incubator-paimon]
Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi commented on issue #3038:
URL: https://github.com/apache/incubator-paimon/issues/3038#issuecomment-2003771711
> Can assign the ticket to me? Already have a solution to solve the issue.
Feel free to open PR. In Paimon community, you don't need to care about issue assigning.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] load index too slow when restart flink job using dynamic bucket. [incubator-paimon]
Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi closed issue #3038: [Bug] load index too slow when restart flink job using dynamic bucket.
URL: https://github.com/apache/incubator-paimon/issues/3038
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] load index too slow when restart flink job using dynamic bucket. [incubator-paimon]
Posted by "Stephen0421 (via GitHub)" <gi...@apache.org>.
Stephen0421 commented on issue #3038:
URL: https://github.com/apache/incubator-paimon/issues/3038#issuecomment-2003466310
Can assign the ticket to me? Already have a solution to solve the issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org