[jira] [Created] (SAMZA-651) Implement message store for window operator

["Yi Pan (Data Infrastructure) (JIRA)" <ji...@apache.org>]

Yi Pan (Data Infrastructure) created SAMZA-651:
--------------------------------------------------

             Summary: Implement message store for window operator
                 Key: SAMZA-651
                 URL: https://issues.apache.org/jira/browse/SAMZA-651
             Project: Samza
          Issue Type: Sub-task
          Components: sql
            Reporter: Yi Pan (Data Infrastructure)


In window operator design (SAMZA-552), a Message Store may be needed to store all messages in the windows in retention. The Message Store should be a Key-Value store that do not need changelog. The value in the message store is always the input message, while the key of the message store could vary quite a lot based on time/tuple windows and the access pattern of messages in the window operator (e.g. different join conditions results in different access pattern to windowed messages as illustrated in SAMZA-552).

The goal of this task is to implement the following two options initially, which are considered to be common use cases:

# Timestamp + offset as the message key
# Some ID field + timestamp + offset as the message key



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)