You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@samza.apache.org by "Naveen Somasundaram (JIRA)" <ji...@apache.org> on 2015/05/16 00:42:00 UTC

[jira] [Created] (SAMZA-679) Optimize CoordinatorStream's bootstrap mechanism

Naveen Somasundaram created SAMZA-679:
-----------------------------------------

             Summary: Optimize CoordinatorStream's bootstrap mechanism
                 Key: SAMZA-679
                 URL: https://issues.apache.org/jira/browse/SAMZA-679
             Project: Samza
          Issue Type: Sub-task
            Reporter: Naveen Somasundaram


At present, when the bootstrap using the CoordinatorStreamConsumer, we read all the messages into a set. Which is fine, if log compaction is working, but given that:
1. The log compaction can be turned off/broken for whatever reason
2. The is time interval between compaction

We should consider fixing the bootstrap method to hold only the latest checkpoint (Override equals and hascode of the set is one way to go about it)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)