[jira] [Created] (STORM-1869) Add ability for Kafka Spout to do limited retries on failed tuples, and redirect down a "failed" stream

["Stephen Powis (JIRA)" <ji...@apache.org>]

Stephen Powis created STORM-1869:
------------------------------------

             Summary: Add ability for Kafka Spout to do limited retries on failed tuples, and redirect down a "failed" stream
                 Key: STORM-1869
                 URL: https://issues.apache.org/jira/browse/STORM-1869
             Project: Apache Storm
          Issue Type: Improvement
          Components: storm-kafka
            Reporter: Stephen Powis


h4. Summary

KafkaSpout provides no way to limit the number of times a tuple can fail within your topology.  I think it'd be great to allow configuring a hard limit to the number of times a tuple can be failed before it is no longer retried.

Additionally, it'd be fantastic if the spout could do a one-time emit of this tuple down a "failed" stream.  This stream would allow you to handle these failed tuples in some way -- persist the failed tuple to some other storage system to be replayed later?  logged?  ignored? tons of things you could possibly want to do with these.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)