You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@gobblin.apache.org by "Vicky Kak (JIRA)" <ji...@apache.org> on 2017/08/06 04:55:00 UTC

[jira] [Created] (GOBBLIN-190) Kafka Sink replication factor and partition creation.

Vicky Kak created GOBBLIN-190:
---------------------------------

             Summary: Kafka Sink replication factor and partition creation.
                 Key: GOBBLIN-190
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-190
             Project: Apache Gobblin
          Issue Type: New Feature
          Components: gobblin-kafka
            Reporter: Vicky Kak
            Assignee: Shirshanka Das
            Priority: Critical


The current implementation of the Kafka Writer does not allow the user to configure the replication-factor and partitions for the topic. The producer API creates a topic with the default configuration if the topic is not found when message is send to the topic. We may have to use the scala API's to configure the topics during creation for 0.8.1, for the 0.9.0 kafka there seems to be java apis.
The following link could be of help to this issue
[https://stackoverflow.com/questions/16946778/how-can-we-create-a-topic-in-kafka-from-the-ide-using-api]




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)