You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nifi.apache.org by Phillip Grenier <ph...@zobierlabs.com> on 2021/03/25 13:47:10 UTC
PutRecord sinks
Looking for feedback on if 2 new sinks would be accepted by the community.
1. InvokeHttpSink: that would make an http request per record, to insert or
update a remote end point
2. DistributredMapCacheSink: to insert records into the cache map by a key
given a record path
Re: PutRecord sinks
Posted by Chris Sampson <ch...@naimuri.com.INVALID>.
Pretty sure I'd have use of the second one and think it'd be a good
addition - currently I split a file by record and push each one
individually to the DMC (e.g. as a way of reporting errors between
Wait/Notify branches of a Flow), which is obviously not very efficient.
---
*Chris Sampson*
IT Consultant
chris.sampson@naimuri.com
<https://www.naimuri.com/>
On Thu, 25 Mar 2021 at 13:54, Pierre Villard <pi...@gmail.com>
wrote:
> Hi Philip,
>
> I'd definitely see a lot of use cases for the first one. I'd however
> provide an option to either have one request per record, or have a single
> HTTP call to send the complete set of records to the endpoint.
> I don't have a use case for the second one, but if you have one, that's
> great and I think this would be useful for the community.
>
> Pierre
>
> Le jeu. 25 mars 2021 à 14:47, Phillip Grenier <ph...@zobierlabs.com> a
> écrit :
>
> > Looking for feedback on if 2 new sinks would be accepted by the
> community.
> >
> > 1. InvokeHttpSink: that would make an http request per record, to insert
> or
> > update a remote end point
> > 2. DistributredMapCacheSink: to insert records into the cache map by a
> key
> > given a record path
> >
>
Re: PutRecord sinks
Posted by Pierre Villard <pi...@gmail.com>.
Hi Philip,
I'd definitely see a lot of use cases for the first one. I'd however
provide an option to either have one request per record, or have a single
HTTP call to send the complete set of records to the endpoint.
I don't have a use case for the second one, but if you have one, that's
great and I think this would be useful for the community.
Pierre
Le jeu. 25 mars 2021 à 14:47, Phillip Grenier <ph...@zobierlabs.com> a
écrit :
> Looking for feedback on if 2 new sinks would be accepted by the community.
>
> 1. InvokeHttpSink: that would make an http request per record, to insert or
> update a remote end point
> 2. DistributredMapCacheSink: to insert records into the cache map by a key
> given a record path
>