You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@samza.apache.org by "Shanthoosh Venkataraman (JIRA)" <ji...@apache.org> on 2017/05/19 23:31:04 UTC

[jira] [Created] (SAMZA-1302) Improve Zookeeper error handling

Shanthoosh Venkataraman created SAMZA-1302:
----------------------------------------------

             Summary: Improve Zookeeper error handling 
                 Key: SAMZA-1302
                 URL: https://issues.apache.org/jira/browse/SAMZA-1302
             Project: Samza
          Issue Type: Improvement
            Reporter: Shanthoosh Venkataraman
            Priority: Minor
             Fix For: 0.14.0


In samza standalone, Zookeeper is used for accomplishing the following.

A) For storing and retrieving the job model.
B) Leader election amongst available stream processors.
C) Propagating job model expiry to stream processors.
D) Barrier for job model version upgrade.

ZooKeeper Exceptions from all of the above scenarios are not propagated back to LocalApplicationRunner.waitForFinish.

Incase of exception, an application will wait indefinitely if it is not bubbled up correctly. 

Potentially could cause stalled processors and duplicate stream processors.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)