[jira] [Created] (SAMZA-144) Add stream-level overrides for KafkaSystemFactory config

["Chris Riccomini (JIRA)" <ji...@apache.org>]

Chris Riccomini created SAMZA-144:
-------------------------------------

             Summary: Add stream-level overrides for KafkaSystemFactory config
                 Key: SAMZA-144
                 URL: https://issues.apache.org/jira/browse/SAMZA-144
             Project: Samza
          Issue Type: Bug
          Components: kafka
    Affects Versions: 0.6.0
            Reporter: Chris Riccomini


Currently, we allow Kafka systems to be defined with:

{noformat}
systems.my-kafka-system.consumer.*
{noformat}

And:

{noformat}
systems.my-kafka-system.consumer.*
{noformat}

We don't support stream-level configurations, the way we do with StreamConfig configuration:

{code}
  val STREAM_PREFIX = "systems.%s.streams.%s."
  val MSG_SERDE = STREAM_PREFIX + "samza.msg.serde"
  val KEY_SERDE = STREAM_PREFIX + "samza.key.serde"
  val CONSUMER_RESET_OFFSET = STREAM_PREFIX + "samza.reset.offset"
{code}

We should add stream-level configuration override support for Kafka consumer and producers with:

{noformat}
systems.my-kafka-system.streams.my-kafka-topic.consumer.*
systems.my-kafka-system.streams.my-kafka-topic.producer.*
{noformat}

KafkaConfig and KafkaSystemFactory should be updated to handle these.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)