You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@samza.apache.org by "Yi Pan (Data Infrastructure) (JIRA)" <ji...@apache.org> on 2015/04/16 01:33:00 UTC

[jira] [Created] (SAMZA-650) Implement window metadata store

Yi Pan (Data Infrastructure) created SAMZA-650:
--------------------------------------------------

             Summary: Implement window metadata store
                 Key: SAMZA-650
                 URL: https://issues.apache.org/jira/browse/SAMZA-650
             Project: Samza
          Issue Type: Sub-task
            Reporter: Yi Pan (Data Infrastructure)


In SAMZA-552, window operator is designed to have a window metadata store internally to keep all windows' metadata in retention. This metadata store should be a KV store w/ a changelog (i.e. LoggedStore), with the following definition of key and value:

# Time-based window metadata store:
## Key: window start timestamp
## Value: {start_time, start_offset, end_time, last_offset}
# Tuple-based window metadata store:
## Key: window start offset
## Value: {start_offset, last_offset}




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)