You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@samza.apache.org by "Xinyu Liu (JIRA)" <ji...@apache.org> on 2018/03/30 18:40:00 UTC

[jira] [Created] (SAMZA-1633) Add more doc about partitionBy operator

Xinyu Liu created SAMZA-1633:
--------------------------------

             Summary: Add more doc about partitionBy operator
                 Key: SAMZA-1633
                 URL: https://issues.apache.org/jira/browse/SAMZA-1633
             Project: Samza
          Issue Type: Bug
            Reporter: Xinyu Liu
            Assignee: Xinyu Liu


information includes:

-{color:#3b73af} {color}{color:#000000}intermediate stream creates a new stream from system defined by "job.default.system". It's usually a new Kafka topic. The creation is done when the first time the job starts, and use the max(partitions in each input topic and output topic) to create the partition. You can also override it by configuring "{color}{color:#008000}*job.intermediate.stream.partitions*{color}{color:#000000}".{color}

- the intermediate stream in high-level api is also being used to carry some control messages which is needed in certain Samza jobs, like Samza on Hadoop, or event-time watermarks.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)