You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Jakob Homan (JIRA)" <ji...@apache.org> on 2014/07/11 18:24:05 UTC

[jira] [Created] (SAMZA-329) AM should read checkpoints and provide them to containers

Jakob Homan created SAMZA-329:
---------------------------------

             Summary: AM should read checkpoints and provide them to containers
                 Key: SAMZA-329
                 URL: https://issues.apache.org/jira/browse/SAMZA-329
             Project: Samza
          Issue Type: Improvement
          Components: kafka
            Reporter: Jakob Homan


Currently each container reads its checkpoint partition to find the latest offsets.  Post SAMZA-123, the checkpoints are written into a single-partition topic that each container reads through, discarding those checkpoints for which it does not have SSPs.  It would be better if the AM were to read the checkpoint once and pass the offset to the container as part of the input stream definition.



--
This message was sent by Atlassian JIRA
(v6.2#6252)