[jira] [Commented] (SAMZA-1214) Allow users to set a default replication.factor for intermediate topics.

["Jake Maes (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SAMZA-1214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15973297#comment-15973297 ] 

Jake Maes commented on SAMZA-1214:
----------------------------------

Discussed this with [~yipan] and [~pmaheshwari]. 

We're going to add a new config scope to allow users to set system-wide defaults for stream properties. 
{noFormat}
systems.[system-name].default.stream.*
{noFormat}

Why set it at a system level? Because properties like "replication.factor" are system-specific and if a job uses multiple systems, the defaults for one system may not apply to others and since different systems may handle unexpected properties in different ways (e.g. throw vs warn), it's better to keep the defaults separate.

> Allow users to set a default replication.factor for intermediate topics.
> ------------------------------------------------------------------------
>
>                 Key: SAMZA-1214
>                 URL: https://issues.apache.org/jira/browse/SAMZA-1214
>             Project: Samza
>          Issue Type: Bug
>            Reporter: Jake Maes
>            Assignee: Jake Maes
>             Fix For: 0.13.0
>
>
> For auto-topic creation, samza uses a default replication factor of 2. However, this default doesn't not work in simple demo scenarios like the local, single-broker kafka we deploy using the "grid" script.
> To get around this, users need a way to set the replication factor. 
> The new config allows it to be set as follows
> {noFormat}
> streams.[streamId].replication.factor
> {noFormat}
>  but since intermediate streams are autogenerated, the user doesn't know the streamId. 
> We need a way for users to set the default replication factor for all streams.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)