You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@samza.apache.org by "Xinyu Liu (JIRA)" <ji...@apache.org> on 2017/05/26 21:25:04 UTC

[jira] [Created] (SAMZA-1312) Add Control Messages and Serde

Xinyu Liu created SAMZA-1312:
--------------------------------

             Summary: Add Control Messages and Serde
                 Key: SAMZA-1312
                 URL: https://issues.apache.org/jira/browse/SAMZA-1312
             Project: Samza
          Issue Type: Bug
            Reporter: Xinyu Liu
            Assignee: Xinyu Liu


The format of the intermediate stream message:

IntermediateMessage =>  [MessageType MessageData]
  MessageType => byte
  MessageData => byte[]
 
  MessageType => [0(UserMessage), 1(Watermark), 2(EndOfStream)]
  MessageData => [UserMessage/ControlMessage]
  ControlMessage =>
     Type => int
     Version => int
     Other Message Data (based on different types of control message)

For user message, we will use the user provided serde (default is the system serde). For control message, we will use JSON serde since it is built in Samza and easy to parse.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)