You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Xinyu Liu (JIRA)" <ji...@apache.org> on 2017/05/26 21:27:04 UTC

[jira] [Updated] (SAMZA-1312) Add Control Messages and Intermediate Stream Serde

     [ https://issues.apache.org/jira/browse/SAMZA-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Xinyu Liu updated SAMZA-1312:
-----------------------------
    Summary: Add Control Messages and Intermediate Stream Serde  (was: Add Control Messages and Serde)

> Add Control Messages and Intermediate Stream Serde
> --------------------------------------------------
>
>                 Key: SAMZA-1312
>                 URL: https://issues.apache.org/jira/browse/SAMZA-1312
>             Project: Samza
>          Issue Type: Bug
>            Reporter: Xinyu Liu
>            Assignee: Xinyu Liu
>
> The format of the intermediate stream message:
> * IntermediateMessage =>  [MessageType MessageData]
> **  MessageType => byte
> **  MessageData => byte[]
>  
> *  MessageType => [0(UserMessage), 1(Watermark), 2(EndOfStream)]
> *  MessageData => [UserMessage/ControlMessage]
> *  ControlMessage =>
> **     Type => int
> **     Version => int
> **     Other Message Data (based on different types of control message)
> For user message, we will use the user provided serde (default is the system serde). For control message, we will use JSON serde since it is built in Samza and easy to parse.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)