You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@storm.apache.org by "Jeff Fenchel (JIRA)" <ji...@apache.org> on 2016/09/11 07:23:20 UTC

[jira] [Commented] (STORM-2087) Storm-kafka-client: Failed tuples are not always replayed

    [ https://issues.apache.org/jira/browse/STORM-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15481263#comment-15481263 ] 

Jeff Fenchel commented on STORM-2087:
-------------------------------------

The fix is now in that PR as well

> Storm-kafka-client: Failed tuples are not always replayed 
> ----------------------------------------------------------
>
>                 Key: STORM-2087
>                 URL: https://issues.apache.org/jira/browse/STORM-2087
>             Project: Apache Storm
>          Issue Type: Bug
>            Reporter: Jeff Fenchel
>
> I am working with kafka 10 and the storm-kafka-client from master. It appears that tuples are not always being replayed when they are failed.
> With a topology that randomly fails tuples a small percentage of the time I found that the committed kafka offset would get stuck and eventually processing would stop even though the committed offset was no where near the end of the topic. 
> I have also replicated the issue in unit tests with this PR: 
> https://github.com/apache/storm/pull/1679
> It seems that increasing the number of times I call nextTuple for the in order case will make it work, but it doesn't seem to help the case where tuples are failed out of order from which they were emitted. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)