You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Jakob Homan (JIRA)" <ji...@apache.org> on 2014/07/11 18:24:05 UTC
[jira] [Created] (SAMZA-329) AM should read checkpoints and provide
them to containers
Jakob Homan created SAMZA-329:
---------------------------------
Summary: AM should read checkpoints and provide them to containers
Key: SAMZA-329
URL: https://issues.apache.org/jira/browse/SAMZA-329
Project: Samza
Issue Type: Improvement
Components: kafka
Reporter: Jakob Homan
Currently each container reads its checkpoint partition to find the latest offsets. Post SAMZA-123, the checkpoints are written into a single-partition topic that each container reads through, discarding those checkpoints for which it does not have SSPs. It would be better if the AM were to read the checkpoint once and pass the offset to the container as part of the input stream definition.
--
This message was sent by Atlassian JIRA
(v6.2#6252)