You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gobblin.apache.org by "Abhishek Tiwari (JIRA)" <ji...@apache.org> on 2017/11/01 22:02:00 UTC

[jira] [Resolved] (GOBBLIN-190) Kafka Sink replication factor and partition creation.

     [ https://issues.apache.org/jira/browse/GOBBLIN-190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Abhishek Tiwari resolved GOBBLIN-190.
-------------------------------------
    Resolution: Fixed

Issue resolved by pull request #2126
[https://github.com/apache/incubator-gobblin/pull/2126]

> Kafka Sink replication factor and partition creation.
> -----------------------------------------------------
>
>                 Key: GOBBLIN-190
>                 URL: https://issues.apache.org/jira/browse/GOBBLIN-190
>             Project: Apache Gobblin
>          Issue Type: New Feature
>          Components: gobblin-kafka
>            Reporter: Vicky Kak
>            Assignee: Vicky Kak
>            Priority: Critical
>
> The current implementation of the Kafka Writer does not allow the user to configure the replication-factor and partitions for the topic. The producer API creates a topic with the default configuration if the topic is not found when message is send to the topic. We may have to use the scala API's to configure the topics during creation for 0.8.1, for the 0.9.0 kafka there seems to be java apis.
> The following link could be of help to this issue
> [https://stackoverflow.com/questions/16946778/how-can-we-create-a-topic-in-kafka-from-the-ide-using-api]



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)