GRPC processors missing after upgrade to 1.11.3

[Dirk Arends <di...@fontis.com.au>]

Hey,

I recently upgraded from 1.11.1 to 1.11.3 and found that the GRPC
processors (ListenGRPC and InvokeGRPC) had seemingly been removed from the
packaged release. But it seems that the source code in the Nifi repo for
the “nifi-grpc-bundle” is still there and has not been removed.

I have a couple of different versions in use and have found the bundles are
missing in some but not others:

- 1.11.0: GRPC nar is missing
- 1.11.1: GRPC nar is included
- 1.11.3: GRPC nar is missing

My suspicion is the package was accidentally not included in the packaged
release, is that plausible?

This reminded me of another processor (ConvertJSONToAvro) which during the
1.9.x to 1.10.0 upgrade was removed without warning. At the time I put it
down to the Nifi community preferring the use of “ConvertRecord” instead.
Again, I found that the source code remained in the repo and was referenced
in the “nifi-nar-bundles/pom.xml”.

These links add to the confusion. While nifi-kite-nar seems to have been
removed after 1.9.x, nifi-grpc-nar reports to not be included/referenced
since 1.4, even while I have been using the processors through to 1.11.1.

https://mvnrepository.com/artifact/org.apache.nifi/nifi-kite-nar
https://mvnrepository.com/artifact/org.apache.nifi/nifi-grpc-nar

There have not been any commits in the last few months affecting these
bundles aside from release preparation commits.

I have been able to copy the 1.11.1 version and run that on 1.11.3 for now,
but I am hoping it can be included again in the next release.

Thanks in advance,

--
Dirk Arends

Re: GRPC processors missing after upgrade to 1.11.3

[Joe Witt <jo...@gmail.com>]

Dirk

Apologies on the grpc bundle being included.  Just a mistake on my part
during the RM process.

Thanks
Joe

On Mon, Mar 9, 2020 at 9:18 AM Bryan Bende <bb...@gmail.com> wrote:

> Hello,
>
> We likely need Joe to confirm about grpc since he was the RM for the last
> few releases, but I believe that it was probably just a mistake in the
> build process that caused it to not be excluded.
>
> For the other ones you referenced, those were purposely excluded due to
> space limitations with the binary artifacts that we publish. It was
> mentioned in the migration guidance that is created for every release [1].
>
> "We've removed the following nars from the default convenience binary.
> These include kite-nar, kafka-0-8-nar, flume-nar, media-nar,
> druid-controller-service-api-nar, druid-nar, other-graph-services-nar.  You
> can still get them from the various artifact repositories and use them in
> your flows but we cannot bundle them due to space limitations by default."
>
> Thanks,
>
> Bryan
>
> [1] https://cwiki.apache.org/confluence/display/NIFI/Migration+Guidance
>
> On Mon, Mar 9, 2020 at 8:48 AM Dirk Arends <di...@fontis.com.au>
> wrote:
>
>> Hey,
>>
>> I recently upgraded from 1.11.1 to 1.11.3 and found that the GRPC
>> processors (ListenGRPC and InvokeGRPC) had seemingly been removed from the
>> packaged release. But it seems that the source code in the Nifi repo for
>> the “nifi-grpc-bundle” is still there and has not been removed.
>>
>> I have a couple of different versions in use and have found the bundles
>> are missing in some but not others:
>>
>> - 1.11.0: GRPC nar is missing
>> - 1.11.1: GRPC nar is included
>> - 1.11.3: GRPC nar is missing
>>
>> My suspicion is the package was accidentally not included in the packaged
>> release, is that plausible?
>>
>> This reminded me of another processor (ConvertJSONToAvro) which during
>> the 1.9.x to 1.10.0 upgrade was removed without warning. At the time I put
>> it down to the Nifi community preferring the use of “ConvertRecord”
>> instead. Again, I found that the source code remained in the repo and was
>> referenced in the “nifi-nar-bundles/pom.xml”.
>>
>> These links add to the confusion. While nifi-kite-nar seems to have been
>> removed after 1.9.x, nifi-grpc-nar reports to not be included/referenced
>> since 1.4, even while I have been using the processors through to 1.11.1.
>>
>> https://mvnrepository.com/artifact/org.apache.nifi/nifi-kite-nar
>> https://mvnrepository.com/artifact/org.apache.nifi/nifi-grpc-nar
>>
>> There have not been any commits in the last few months affecting these
>> bundles aside from release preparation commits.
>>
>> I have been able to copy the 1.11.1 version and run that on 1.11.3 for
>> now, but I am hoping it can be included again in the next release.
>>
>> Thanks in advance,
>>
>> --
>> Dirk Arends
>>
>

Re: GRPC processors missing after upgrade to 1.11.3

[Bryan Bende <bb...@gmail.com>]

Hello,

We likely need Joe to confirm about grpc since he was the RM for the last
few releases, but I believe that it was probably just a mistake in the
build process that caused it to not be excluded.

For the other ones you referenced, those were purposely excluded due to
space limitations with the binary artifacts that we publish. It was
mentioned in the migration guidance that is created for every release [1].

"We've removed the following nars from the default convenience binary.
These include kite-nar, kafka-0-8-nar, flume-nar, media-nar,
druid-controller-service-api-nar, druid-nar, other-graph-services-nar.  You
can still get them from the various artifact repositories and use them in
your flows but we cannot bundle them due to space limitations by default."

Thanks,

Bryan

[1] https://cwiki.apache.org/confluence/display/NIFI/Migration+Guidance

On Mon, Mar 9, 2020 at 8:48 AM Dirk Arends <di...@fontis.com.au>
wrote:

> Hey,
>
> I recently upgraded from 1.11.1 to 1.11.3 and found that the GRPC
> processors (ListenGRPC and InvokeGRPC) had seemingly been removed from the
> packaged release. But it seems that the source code in the Nifi repo for
> the “nifi-grpc-bundle” is still there and has not been removed.
>
> I have a couple of different versions in use and have found the bundles
> are missing in some but not others:
>
> - 1.11.0: GRPC nar is missing
> - 1.11.1: GRPC nar is included
> - 1.11.3: GRPC nar is missing
>
> My suspicion is the package was accidentally not included in the packaged
> release, is that plausible?
>
> This reminded me of another processor (ConvertJSONToAvro) which during the
> 1.9.x to 1.10.0 upgrade was removed without warning. At the time I put it
> down to the Nifi community preferring the use of “ConvertRecord” instead.
> Again, I found that the source code remained in the repo and was referenced
> in the “nifi-nar-bundles/pom.xml”.
>
> These links add to the confusion. While nifi-kite-nar seems to have been
> removed after 1.9.x, nifi-grpc-nar reports to not be included/referenced
> since 1.4, even while I have been using the processors through to 1.11.1.
>
> https://mvnrepository.com/artifact/org.apache.nifi/nifi-kite-nar
> https://mvnrepository.com/artifact/org.apache.nifi/nifi-grpc-nar
>
> There have not been any commits in the last few months affecting these
> bundles aside from release preparation commits.
>
> I have been able to copy the 1.11.1 version and run that on 1.11.3 for
> now, but I am hoping it can be included again in the next release.
>
> Thanks in advance,
>
> --
> Dirk Arends
>