[jira] [Created] (SAMZA-736) BrokerProxy will stuck in infinite loop if consumer.fetch throws OOME

["Yi Pan (Data Infrastructure) (JIRA)" <ji...@apache.org>]

Yi Pan (Data Infrastructure) created SAMZA-736:
--------------------------------------------------

             Summary: BrokerProxy will stuck in infinite loop if consumer.fetch throws OOME
                 Key: SAMZA-736
                 URL: https://issues.apache.org/jira/browse/SAMZA-736
             Project: Samza
          Issue Type: Bug
            Reporter: Yi Pan (Data Infrastructure)


In BrokerProxy code, we are re-trying on exceptions from consumer fetch in an infinite loop. However, when there is OOME thrown from consumer fetch that can not be resolved, the container will stuck forever.

It is useful to:
1) Categorize the type of exceptions that the BrokerProxy can not recover and fail the container
Or 2) Set an upper bound of retry on "hard" exceptions (e.g. OOME) and fail the container when the upper bound is reached



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)