You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by "Aatirhassanpir (via GitHub)" <gi...@apache.org> on 2025/01/22 22:55:02 UTC
[I] Title Bug: Kafka producer retries failing for non-retriable exceptions [pinot]
Aatirhassanpir opened a new issue, #14891:
URL: https://github.com/apache/pinot/issues/14891
### Description
Problem Statement
The Kafka producer is not correctly retrying failed messages when encountering certain exceptions that should be retriable according to the configured retry policy. This results in messages being lost when a non-retriable exception occurs, and the producer stops processing subsequent messages.
### Expected Behavior
The Kafka producer should retry the message delivery when a non-retriable exception occurs, based on the retry configurations (e.g., retries, acks, max.in.flight.requests.per.connection). Instead of failing outright, the producer should handle these exceptions and attempt to resend the message until the configured retry limit is reached.
### Actual Behavior
Currently, when a non-retriable exception is encountered, the Kafka producer fails to retry the delivery of the failed message. This causes message loss and prevents the producer from proceeding with further message deliveries, effectively halting the production process.
### Steps to Reproduce
Configure the Kafka producer with a retry policy (e.g., set retries to a positive integer, configure acks to all, etc.).
Simulate a non-retriable exception (such as a TimeoutException or a specific custom exception) while producing a message.
Observe that the producer does not retry and instead fails without any retry attempts.
### Environment
Kafka version: 3.0.0
Pinot version: 0.7.0
OS: Ubuntu 20.04 LTS
Java version: OpenJDK 11
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Title Bug: Kafka producer retries failing for non-retriable exceptions [pinot]
Posted by "Jackie-Jiang (via GitHub)" <gi...@apache.org>.
Jackie-Jiang closed issue #14891: Title Bug: Kafka producer retries failing for non-retriable exceptions
URL: https://github.com/apache/pinot/issues/14891
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Title Bug: Kafka producer retries failing for non-retriable exceptions [pinot]
Posted by "Jackie-Jiang (via GitHub)" <gi...@apache.org>.
Jackie-Jiang commented on issue #14891:
URL: https://github.com/apache/pinot/issues/14891#issuecomment-2608588787
Suspect this is AI generated. Closing it
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org