[jira] [Commented] (NIFI-791) Expose more configuration options for GetKafka processor

["Mark Payne (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/NIFI-791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14643646#comment-14643646 ] 

Mark Payne commented on NIFI-791:
---------------------------------

The following message was received on the NiFi dev alias and makes a lot of sense in my opinion:

The GetKafka processor has a couple of Kafka Consumer Config values that
are hard-coded.

props.setProperty("auto.commit.enable", "true"); // just be explicit
props.setProperty("auto.offset.reset", "smallest");

These should be configurable property values in the Processor. Most
notable for me is the "auto.offset.reset". Smallest vs. Largest has some
implications concerning fault tolerance strategies.

It would be best to expose all of the available Kafka Consumer Config
properties. If these change though between kafka versions it would create
maintenance work for the Processors.

Another option would be to allow ad-hoc property values and end-user just
supply the kafka config values they want to override.

> Expose more configuration options for GetKafka processor
> --------------------------------------------------------
>
>                 Key: NIFI-791
>                 URL: https://issues.apache.org/jira/browse/NIFI-791
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Extensions
>            Reporter: Mark Payne
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)