You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nifi.apache.org by Edgardo Vega <ed...@gmail.com> on 2016/06/02 00:17:42 UTC
cron updating value used by another processor
Trying to figure out the best way to do the following. I want to have a
flow that runs every few minutes goes to url, pulls out a piece of json,
and puts it somewhere that another processor will use for every flow file
the comes in via another stream. The other processor would be something
like RouteOnContext or ExtractText.
Any ideas?
Thanks,
Edgardo
Re: cron updating value used by another processor
Posted by Edgardo Vega <ed...@gmail.com>.
Bryan,
It worked technically. The only issue I see if that I am seeing spiky
performance. It goes from having nothing in the queue before the Fetch to
having 50k and then back down. There are only 2 items in the cache right
now.
Cheers,
Edgardo
On Wed, Jun 1, 2016 at 9:29 PM, Edgardo Vega <ed...@gmail.com> wrote:
> Bryan,
>
> I had not even thought of using those two processor. I will try tomorrow.
> Thanks for the tip.
>
> Cheers,
>
> Edgardo
>
> On Wed, Jun 1, 2016 at 8:23 PM, Bryan Bende <bb...@gmail.com> wrote:
>
>> I think PutDistributedMapCache and FetchDistributedMapCache could be used
>> for this.
>>
>> -Bryan
>>
>> On Wed, Jun 1, 2016 at 8:17 PM, Edgardo Vega <ed...@gmail.com>
>> wrote:
>>
>> > Trying to figure out the best way to do the following. I want to have a
>> > flow that runs every few minutes goes to url, pulls out a piece of json,
>> > and puts it somewhere that another processor will use for every flow
>> file
>> > the comes in via another stream. The other processor would be something
>> > like RouteOnContext or ExtractText.
>> >
>> > Any ideas?
>> >
>> > Thanks,
>> >
>> > Edgardo
>> >
>>
>
>
>
> --
> Cheers,
>
> Edgardo
>
--
Cheers,
Edgardo
Re: cron updating value used by another processor
Posted by Edgardo Vega <ed...@gmail.com>.
Bryan,
I had not even thought of using those two processor. I will try tomorrow.
Thanks for the tip.
Cheers,
Edgardo
On Wed, Jun 1, 2016 at 8:23 PM, Bryan Bende <bb...@gmail.com> wrote:
> I think PutDistributedMapCache and FetchDistributedMapCache could be used
> for this.
>
> -Bryan
>
> On Wed, Jun 1, 2016 at 8:17 PM, Edgardo Vega <ed...@gmail.com>
> wrote:
>
> > Trying to figure out the best way to do the following. I want to have a
> > flow that runs every few minutes goes to url, pulls out a piece of json,
> > and puts it somewhere that another processor will use for every flow file
> > the comes in via another stream. The other processor would be something
> > like RouteOnContext or ExtractText.
> >
> > Any ideas?
> >
> > Thanks,
> >
> > Edgardo
> >
>
--
Cheers,
Edgardo
Re: cron updating value used by another processor
Posted by Bryan Bende <bb...@gmail.com>.
I think PutDistributedMapCache and FetchDistributedMapCache could be used
for this.
-Bryan
On Wed, Jun 1, 2016 at 8:17 PM, Edgardo Vega <ed...@gmail.com> wrote:
> Trying to figure out the best way to do the following. I want to have a
> flow that runs every few minutes goes to url, pulls out a piece of json,
> and puts it somewhere that another processor will use for every flow file
> the comes in via another stream. The other processor would be something
> like RouteOnContext or ExtractText.
>
> Any ideas?
>
> Thanks,
>
> Edgardo
>