You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@nifi.apache.org by "Madhire, Naveen" <Na...@capitalone.com> on 2015/11/10 19:55:00 UTC

adding new property in getkafka processor

Hi,

I want to get all the records from Kafka topic and hence setting “auto.offset.reset” to “smallest” to fetch the data from topic.

I am getting the below error when I add “auto.offset.reset” kafka property in the list of processor properties,


“auto.offset.reset” validated against “smallest” is invalid because “auto.offset.reset” is not a supported property.


Is there any other way or I am doing something wrong?


Thanks,
Naveen


________________________________________________________

The information contained in this e-mail is confidential and/or proprietary to Capital One and/or its affiliates and may only be used solely in performance of work or services for Capital One. The information transmitted herewith is intended only for use by the individual or entity to which it is addressed. If the reader of this message is not the intended recipient, you are hereby notified that any review, retransmission, dissemination, distribution, copying or other use of, or taking of any action in reliance upon this information is strictly prohibited. If you have received this communication in error, please contact the sender and delete the material from your computer.

Re: adding new property in getkafka processor

Posted by Mark Payne <ma...@hotmail.com>.
Naveen,

Fantastic! Would be happy to help if you run into any issues.

Thanks!
-Mark

> On Nov 10, 2015, at 2:10 PM, Madhire, Naveen <Na...@capitalone.com> wrote:
> 
> I would like to try this one. Let me see if I can make the changes and let you know if there are any issues.
> 
> Thanks
> 
> 
> From: Mark Payne <markap14@hotmail.com <ma...@hotmail.com>>
> Reply-To: "users@nifi.apache.org <ma...@nifi.apache.org>" <users@nifi.apache.org <ma...@nifi.apache.org>>
> Date: Tuesday, November 10, 2015 at 1:02 PM
> To: "users@nifi.apache.org <ma...@nifi.apache.org>" <users@nifi.apache.org <ma...@nifi.apache.org>>
> Subject: Re: adding new property in getkafka processor
> 
> Naveen,
> 
> This is certainly something that should be configurable. Currently, it is always using the value of "smallest". 
> 
> I have created a ticket to make this configurable in the Processor: https://issues.apache.org/jira/browse/NIFI-1146 <https://issues.apache.org/jira/browse/NIFI-1146>
> 
> Thanks
> -Mark
> 
>> On Nov 10, 2015, at 1:55 PM, Madhire, Naveen <Naveen.Madhire@capitalone.com <ma...@capitalone.com>> wrote:
>> 
>> Hi,
>> 
>> I want to get all the records from Kafka topic and hence setting “auto.offset.reset” to “smallest” to fetch the data from topic.
>> 
>> I am getting the below error when I add “auto.offset.reset” kafka property in the list of processor properties,
>> 
>> 
>> “auto.offset.reset” validated against “smallest” is invalid because “auto.offset.reset” is not a supported property.
>> 
>> 
>> Is there any other way or I am doing something wrong?
>> 
>> 
>> Thanks,
>> Naveen
>> 
>> 
>> 
>> The information contained in this e-mail is confidential and/or proprietary to Capital One and/or its affiliates and may only be used solely in performance of work or services for Capital One. The information transmitted herewith is intended only for use by the individual or entity to which it is addressed. If the reader of this message is not the intended recipient, you are hereby notified that any review, retransmission, dissemination, distribution, copying or other use of, or taking of any action in reliance upon this information is strictly prohibited. If you have received this communication in error, please contact the sender and delete the material from your computer.
> 
> 
> The information contained in this e-mail is confidential and/or proprietary to Capital One and/or its affiliates and may only be used solely in performance of work or services for Capital One. The information transmitted herewith is intended only for use by the individual or entity to which it is addressed. If the reader of this message is not the intended recipient, you are hereby notified that any review, retransmission, dissemination, distribution, copying or other use of, or taking of any action in reliance upon this information is strictly prohibited. If you have received this communication in error, please contact the sender and delete the material from your computer.

Re: adding new property in getkafka processor

Posted by "Madhire, Naveen" <Na...@capitalone.com>.
I would like to try this one. Let me see if I can make the changes and let you know if there are any issues.

Thanks


From: Mark Payne <ma...@hotmail.com>>
Reply-To: "users@nifi.apache.org<ma...@nifi.apache.org>" <us...@nifi.apache.org>>
Date: Tuesday, November 10, 2015 at 1:02 PM
To: "users@nifi.apache.org<ma...@nifi.apache.org>" <us...@nifi.apache.org>>
Subject: Re: adding new property in getkafka processor

Naveen,

This is certainly something that should be configurable. Currently, it is always using the value of "smallest".

I have created a ticket to make this configurable in the Processor: https://issues.apache.org/jira/browse/NIFI-1146

Thanks
-Mark

On Nov 10, 2015, at 1:55 PM, Madhire, Naveen <Na...@capitalone.com>> wrote:

Hi,

I want to get all the records from Kafka topic and hence setting “auto.offset.reset” to “smallest” to fetch the data from topic.

I am getting the below error when I add “auto.offset.reset” kafka property in the list of processor properties,


“auto.offset.reset” validated against “smallest” is invalid because “auto.offset.reset” is not a supported property.


Is there any other way or I am doing something wrong?


Thanks,
Naveen



________________________________
The information contained in this e-mail is confidential and/or proprietary to Capital One and/or its affiliates and may only be used solely in performance of work or services for Capital One. The information transmitted herewith is intended only for use by the individual or entity to which it is addressed. If the reader of this message is not the intended recipient, you are hereby notified that any review, retransmission, dissemination, distribution, copying or other use of, or taking of any action in reliance upon this information is strictly prohibited. If you have received this communication in error, please contact the sender and delete the material from your computer.

________________________________________________________

The information contained in this e-mail is confidential and/or proprietary to Capital One and/or its affiliates and may only be used solely in performance of work or services for Capital One. The information transmitted herewith is intended only for use by the individual or entity to which it is addressed. If the reader of this message is not the intended recipient, you are hereby notified that any review, retransmission, dissemination, distribution, copying or other use of, or taking of any action in reliance upon this information is strictly prohibited. If you have received this communication in error, please contact the sender and delete the material from your computer.

Re: adding new property in getkafka processor

Posted by Mark Payne <ma...@hotmail.com>.
Naveen,

This is certainly something that should be configurable. Currently, it is always using the value of "smallest". 

I have created a ticket to make this configurable in the Processor: https://issues.apache.org/jira/browse/NIFI-1146 <https://issues.apache.org/jira/browse/NIFI-1146>

Thanks
-Mark

> On Nov 10, 2015, at 1:55 PM, Madhire, Naveen <Na...@capitalone.com> wrote:
> 
> Hi,
> 
> I want to get all the records from Kafka topic and hence setting “auto.offset.reset” to “smallest” to fetch the data from topic.
> 
> I am getting the below error when I add “auto.offset.reset” kafka property in the list of processor properties,
> 
> 
> “auto.offset.reset” validated against “smallest” is invalid because “auto.offset.reset” is not a supported property.
> 
> 
> Is there any other way or I am doing something wrong?
> 
> 
> Thanks,
> Naveen
> 
> 
> 
> The information contained in this e-mail is confidential and/or proprietary to Capital One and/or its affiliates and may only be used solely in performance of work or services for Capital One. The information transmitted herewith is intended only for use by the individual or entity to which it is addressed. If the reader of this message is not the intended recipient, you are hereby notified that any review, retransmission, dissemination, distribution, copying or other use of, or taking of any action in reliance upon this information is strictly prohibited. If you have received this communication in error, please contact the sender and delete the material from your computer.