You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@samza.apache.org by "Christopher (JIRA)" <ji...@apache.org> on 2016/03/11 20:14:39 UTC

[jira] [Created] (SAMZA-891) Unable to handle exception thrown inside of KafkaSystemProducer

Christopher created SAMZA-891:
---------------------------------

             Summary: Unable to handle exception thrown inside of KafkaSystemProducer
                 Key: SAMZA-891
                 URL: https://issues.apache.org/jira/browse/SAMZA-891
             Project: Samza
          Issue Type: Bug
          Components: kafka
    Affects Versions: 0.10.0
            Reporter: Christopher


Currently we have a task that may produce a message that is too large to be sent to Kafka. In the current KafkaSystemProducer a MessageSizeTooLargeException is thrown that we can't catch. 
Configuring Kafka to accept a message of the correct size works well but we would like to prevent a StreamTask from entering a retry loop since it will continue to fail each time it produces that super large message.

We would like to be able to configure which exceptions trigger a shutdown or merely dropping a message on the floor with a large warning. We are also open to other suggestions on what the proper method for properly handling that exception.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)