You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@kafka.apache.org by "Alexander Stepanov (JIRA)" <ji...@apache.org> on 2018/05/16 13:44:00 UTC

[jira] [Created] (KAFKA-6909) Message Accumulation in case of no connection to Kafka

Alexander Stepanov created KAFKA-6909:
-----------------------------------------

             Summary: Message Accumulation in case of no connection to Kafka
                 Key: KAFKA-6909
                 URL: https://issues.apache.org/jira/browse/KAFKA-6909
             Project: Kafka
          Issue Type: Improvement
          Components: clients
            Reporter: Alexander Stepanov


Simple situation:

0) We have service A which works with Kafka as client

1) No connection to Kafka

2) Service A accumulates messages for sending to Kafka, but still no connection to Kafka

3) Then service A is crashed for some reason, for example, OOM or just server is dead

4) How to recover accumulated messages?

I think - it will be good to have some general code basement to persist service's outgoing messages to Kafka. For example, if service A is crashed, it can fetch messages from some local storage on startup and resend it to Kafka.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)