You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Yan Fang (JIRA)" <ji...@apache.org> on 2014/06/04 20:57:02 UTC

[jira] [Assigned] (SAMZA-144) Add stream-level overrides for KafkaSystemFactory config

     [ https://issues.apache.org/jira/browse/SAMZA-144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yan Fang reassigned SAMZA-144:
------------------------------

    Assignee: Yan Fang

> Add stream-level overrides for KafkaSystemFactory config
> --------------------------------------------------------
>
>                 Key: SAMZA-144
>                 URL: https://issues.apache.org/jira/browse/SAMZA-144
>             Project: Samza
>          Issue Type: Bug
>          Components: kafka
>    Affects Versions: 0.6.0
>            Reporter: Chris Riccomini
>            Assignee: Yan Fang
>
> Currently, we allow Kafka systems to be defined with:
> {noformat}
> systems.my-kafka-system.consumer.*
> {noformat}
> And:
> {noformat}
> systems.my-kafka-system.producer.*
> {noformat}
> We don't support stream-level configurations, the way we do with StreamConfig configuration:
> {code}
>   val STREAM_PREFIX = "systems.%s.streams.%s."
>   val MSG_SERDE = STREAM_PREFIX + "samza.msg.serde"
>   val KEY_SERDE = STREAM_PREFIX + "samza.key.serde"
>   val CONSUMER_RESET_OFFSET = STREAM_PREFIX + "samza.reset.offset"
> {code}
> We should add stream-level configuration override support for Kafka consumer and producers with:
> {noformat}
> systems.my-kafka-system.streams.my-kafka-topic.consumer.*
> systems.my-kafka-system.streams.my-kafka-topic.producer.*
> {noformat}
> KafkaConfig and KafkaSystemFactory should be updated to handle these.



--
This message was sent by Atlassian JIRA
(v6.2#6252)