[jira] [Updated] (SAMZA-30) Back off in BrokerProxy when fetch fails

["Chris Riccomini (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SAMZA-30?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chris Riccomini updated SAMZA-30:
---------------------------------

    Fix Version/s:     (was: 0.7.0)
    
> Back off in BrokerProxy when fetch fails
> ----------------------------------------
>
>                 Key: SAMZA-30
>                 URL: https://issues.apache.org/jira/browse/SAMZA-30
>             Project: Samza
>          Issue Type: Bug
>          Components: kafka
>    Affects Versions: 0.6.0
>            Reporter: Chris Riccomini
>              Labels: newbie
>
> The BrokerProxy immediately recreates its simple consumer, and re-fetches when an exception is thrown in its fetch loop (inside its thread). We should add a backoff here. Rather than doing a fixed time (say sleep 10s), let's do an exponential backoff with a cap (0s, 100s, 200s, 400s, 800s, 1.6s, .. up to cap), so we don't introduce lag in the case where there's a one-off failure and an immediate reconnect would work.
> I suggest adding a config to allow the backoff time and max cap and to be defined, but default it to 100ms, and 10s, respectively.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira