You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "wangyp501 (via GitHub)" <gi...@apache.org> on 2023/10/07 08:41:40 UTC
[PR] [core] Retry read consumer fromPath [incubator-paimon]
wangyp501 opened a new pull request, #2092:
URL: https://github.com/apache/incubator-paimon/pull/2092
<!-- Please specify the module before the PR name: [core] ... or [flink] ... -->
### Purpose
Retry read consumer fromPath , Avoid no content and Job restart
<!-- Linking this pull request to the issue -->
Exception：
<!-- What is the purpose of the change -->
### Tests
ConsumerManagerTest.java
testReadConsumer()
<!-- List UT and IT cases to verify this change -->
### API and Format
<!-- Does this change affect API or storage format -->
### Documentation
READ_CONSUMER_RETRY_NUM = 3;
READ_CONSUMER_RETRY_INTERVAL = 100 MILLISECONDS;
<!-- Does this change introduce a new feature -->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [core] Retry read consumer fromPath [incubator-paimon]
Posted by "dragonkid (via GitHub)" <gi...@apache.org>.
dragonkid commented on PR #2092:
URL: https://github.com/apache/incubator-paimon/pull/2092#issuecomment-1752282107
I think this is still not the final resolution. It seems the exception will still be thrown on retries over the limit.
With the number of consumers on the same table growing, the probability of reading empty from `fromPath` is larger.
So, maybe the job will still fail randomly under this resolution?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [core] Retry read consumer fromPath [incubator-paimon]
Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi merged PR #2092:
URL: https://github.com/apache/incubator-paimon/pull/2092
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [core] Retry read consumer fromPath [incubator-paimon]
Posted by "wangyp501 (via GitHub)" <gi...@apache.org>.
wangyp501 closed pull request #2092: [core] Retry read consumer fromPath
URL: https://github.com/apache/incubator-paimon/pull/2092
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [core] Retry read consumer fromPath [incubator-paimon]
Posted by "wangyp501 (via GitHub)" <gi...@apache.org>.
wangyp501 commented on PR #2092:
URL: https://github.com/apache/incubator-paimon/pull/2092#issuecomment-1751951320
@JingsongLi PTAL,thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [core] Retry read consumer fromPath [incubator-paimon]
Posted by "wangyp501 (via GitHub)" <gi...@apache.org>.
wangyp501 commented on PR #2092:
URL: https://github.com/apache/incubator-paimon/pull/2092#issuecomment-1752231855
您好，我是王云朋，您的邮件我已经收到。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org