You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nifi.apache.org by Anuj Jain <An...@aeris.net> on 2020/05/21 05:44:30 UTC
https://issues.apache.org/jira/browse/NIFI-6701
Hi Team,
I need to bring this issue up https://issues.apache.org/jira/browse/NIFI-6701 as it raised in Sep'19 and seems no fix published till now as issue is still open.
I am also facing the same issue in nifi PublishGCPubsub Processor.
Threads are stuck and then messages continuously increased in the queue and showing below error in thread dump
{"stackTrace":"\"Timer-Driven Process Thread-50\" Id=8466 TIMED_WAITING on null\n\tat java.lang.Thread.sleep(Native Method)\n\tat org.apache.nifi.processors.gcp.pubsub.PublishGCPubSub.onTrigger(PublishGCPubSub.java:166)\n\tat org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)\n\tat...
Looking forward to your quick response on this.
Regards
Anuj Jain
________________________________
The information contained in this communication is confidential and intended solely for the use of the individual named or entity to whom it is addressed and others authorized to receive it. If you are not the intended recipient you are hereby notified that any disclosure, copying, circulation, distribution or taking any action in reliance on the contents of this information is strictly prohibited and may be unlawful. Please delete it and any attachments from your systems and notify the sender that you have received it in error. Unless stated to the contrary, any opinions expressed in this message are personal and may not be attributed to Aeris Communications.
Re: https://issues.apache.org/jira/browse/NIFI-6701
Posted by Pierre Villard <pi...@gmail.com>.
Hi Mark,
I can definitely help reviewing any PR related to GCP.
Just as reference point:
https://cloud.google.com/pubsub/docs/quickstart-client-libraries?hl=en#java
Thanks,
Pierre
Le jeu. 21 mai 2020 à 14:29, Mark Payne <ma...@hotmail.com> a écrit :
> Hi Anuj,
>
> Looking at the Jira, it’s likely a very trivial fix to the code - just
> remove a couple lines that shouldn’t be there. The problem is testing it
> because in order to test it, it requires that users have accounts setup to
> interact with Google Pub-Sub.
>
> I can certainly put up a Pull Request that updates the code. If I do, are
> you in a position to test the Pull Request?
>
> Thanks
> -Mark
>
> > On May 21, 2020, at 1:44 AM, Anuj Jain <An...@aeris.net> wrote:
> >
> > Hi Team,
> > I need to bring this issue up
> https://issues.apache.org/jira/browse/NIFI-6701 as it raised in Sep'19
> and seems no fix published till now as issue is still open.
> >
> > I am also facing the same issue in nifi PublishGCPubsub Processor.
> > Threads are stuck and then messages continuously increased in the queue
> and showing below error in thread dump
> >
> > {"stackTrace":"\"Timer-Driven Process Thread-50\" Id=8466 TIMED_WAITING
> on null\n\tat java.lang.Thread.sleep(Native Method)\n\tat
> org.apache.nifi.processors.gcp.pubsub.PublishGCPubSub.onTrigger(PublishGCPubSub.java:166)\n\tat
> org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)\n\tat...
> >
> > Looking forward to your quick response on this.
> >
> > Regards
> > Anuj Jain
> >
> > ________________________________
> >
> > The information contained in this communication is confidential and
> intended solely for the use of the individual named or entity to whom it is
> addressed and others authorized to receive it. If you are not the intended
> recipient you are hereby notified that any disclosure, copying,
> circulation, distribution or taking any action in reliance on the contents
> of this information is strictly prohibited and may be unlawful. Please
> delete it and any attachments from your systems and notify the sender that
> you have received it in error. Unless stated to the contrary, any opinions
> expressed in this message are personal and may not be attributed to Aeris
> Communications.
>
>
Re: https://issues.apache.org/jira/browse/NIFI-6701
Posted by Mark Payne <ma...@hotmail.com>.
Hi Anuj,
Looking at the Jira, it’s likely a very trivial fix to the code - just remove a couple lines that shouldn’t be there. The problem is testing it because in order to test it, it requires that users have accounts setup to interact with Google Pub-Sub.
I can certainly put up a Pull Request that updates the code. If I do, are you in a position to test the Pull Request?
Thanks
-Mark
> On May 21, 2020, at 1:44 AM, Anuj Jain <An...@aeris.net> wrote:
>
> Hi Team,
> I need to bring this issue up https://issues.apache.org/jira/browse/NIFI-6701 as it raised in Sep'19 and seems no fix published till now as issue is still open.
>
> I am also facing the same issue in nifi PublishGCPubsub Processor.
> Threads are stuck and then messages continuously increased in the queue and showing below error in thread dump
>
> {"stackTrace":"\"Timer-Driven Process Thread-50\" Id=8466 TIMED_WAITING on null\n\tat java.lang.Thread.sleep(Native Method)\n\tat org.apache.nifi.processors.gcp.pubsub.PublishGCPubSub.onTrigger(PublishGCPubSub.java:166)\n\tat org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)\n\tat...
>
> Looking forward to your quick response on this.
>
> Regards
> Anuj Jain
>
> ________________________________
>
> The information contained in this communication is confidential and intended solely for the use of the individual named or entity to whom it is addressed and others authorized to receive it. If you are not the intended recipient you are hereby notified that any disclosure, copying, circulation, distribution or taking any action in reliance on the contents of this information is strictly prohibited and may be unlawful. Please delete it and any attachments from your systems and notify the sender that you have received it in error. Unless stated to the contrary, any opinions expressed in this message are personal and may not be attributed to Aeris Communications.
Re: https://issues.apache.org/jira/browse/NIFI-6701
Posted by Joe Witt <jo...@gmail.com>.
anuj
you received replies. please subscribe so you get the replies.
thanks
On Fri, May 22, 2020 at 11:12 AM Anuj Jain <An...@aeris.net> wrote:
> Hi Team,
> Anyone look into this issue or have any update on this ?
>
> Regards
> Anuj Jain
>
> From: Anuj Jain
> Sent: 21 May 2020 11:15
> To: 'dev@nifi.apache.org' <de...@nifi.apache.org>
> Subject: https://issues.apache.org/jira/browse/NIFI-6701
> Importance: High
>
> Hi Team,
> I need to bring this issue up
> https://issues.apache.org/jira/browse/NIFI-6701 as it raised in Sep'19
> and seems no fix published till now as issue is still open.
>
> I am also facing the same issue in nifi PublishGCPubsub Processor.
> Threads are stuck and then messages continuously increased in the queue
> and showing below error in thread dump
> {"stackTrace":"\"Timer-Driven Process Thread-50\" Id=8466 TIMED_WAITING on
> null\n\tat java.lang.Thread.sleep(Native Method)\n\tat
> org.apache.nifi.processors.gcp.pubsub.PublishGCPubSub.onTrigger(PublishGCPubSub.java:166)\n\tat
> org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)\n\tat...
>
> Looking forward to your quick response on this.
>
> Regards
> Anuj Jain
> ________________________________
>
> The information contained in this communication is confidential and
> intended solely for the use of the individual named or entity to whom it is
> addressed and others authorized to receive it. If you are not the intended
> recipient you are hereby notified that any disclosure, copying,
> circulation, distribution or taking any action in reliance on the contents
> of this information is strictly prohibited and may be unlawful. Please
> delete it and any attachments from your systems and notify the sender that
> you have received it in error. Unless stated to the contrary, any opinions
> expressed in this message are personal and may not be attributed to Aeris
> Communications.
>
RE: https://issues.apache.org/jira/browse/NIFI-6701
Posted by Anuj Jain <An...@aeris.net>.
Hi Team,
Anyone look into this issue or have any update on this ?
Regards
Anuj Jain
From: Anuj Jain
Sent: 21 May 2020 11:15
To: 'dev@nifi.apache.org' <de...@nifi.apache.org>
Subject: https://issues.apache.org/jira/browse/NIFI-6701
Importance: High
Hi Team,
I need to bring this issue up https://issues.apache.org/jira/browse/NIFI-6701 as it raised in Sep'19 and seems no fix published till now as issue is still open.
I am also facing the same issue in nifi PublishGCPubsub Processor.
Threads are stuck and then messages continuously increased in the queue and showing below error in thread dump
{"stackTrace":"\"Timer-Driven Process Thread-50\" Id=8466 TIMED_WAITING on null\n\tat java.lang.Thread.sleep(Native Method)\n\tat org.apache.nifi.processors.gcp.pubsub.PublishGCPubSub.onTrigger(PublishGCPubSub.java:166)\n\tat org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)\n\tat...
Looking forward to your quick response on this.
Regards
Anuj Jain
________________________________
The information contained in this communication is confidential and intended solely for the use of the individual named or entity to whom it is addressed and others authorized to receive it. If you are not the intended recipient you are hereby notified that any disclosure, copying, circulation, distribution or taking any action in reliance on the contents of this information is strictly prohibited and may be unlawful. Please delete it and any attachments from your systems and notify the sender that you have received it in error. Unless stated to the contrary, any opinions expressed in this message are personal and may not be attributed to Aeris Communications.
RE: https://issues.apache.org/jira/browse/NIFI-6701
Posted by Anuj Jain <An...@aeris.net>.
Hi Pierre,
Got your point.
PR seems fine for me, I have review the code change(minor change).
Just need to know, when we are going to release new version with this change.
And till now any other way to override this GCP processor and get new nar file with this change ?
as I tried on my local machine but it showing some maven documentation error while building nifi-gcp-bundle.
Failed to execute goal org.apache.nifi:nifi-nar-maven-plugin:1.3.1:nar (default-nar) on project nifi-gcp-nar: Failed to create Extension Documentation: org.apache.nifi.documentation.xml.XmlDocumentationWriter.initialize(org.apache.nifi.components.ConfigurableComponent) -> [Help 1]
when I running mvn install on gcp-bundle
Please check and revert.
Regards
Anuj Jain
________________________________
The information contained in this communication is confidential and intended solely for the use of the individual named or entity to whom it is addressed and others authorized to receive it. If you are not the intended recipient you are hereby notified that any disclosure, copying, circulation, distribution or taking any action in reliance on the contents of this information is strictly prohibited and may be unlawful. Please delete it and any attachments from your systems and notify the sender that you have received it in error. Unless stated to the contrary, any opinions expressed in this message are personal and may not be attributed to Aeris Communications.
Re: https://issues.apache.org/jira/browse/NIFI-6701
Posted by Pierre Villard <pi...@gmail.com>.
Anuj,
We don't make releases for previous release lines of Apache NiFi (besides
1.9.2 is more than one year old). There is an ongoing discussion for
releasing either a 1.11.5 version or a 1.12.0 version. Assuming the pull
request is reviewed and merged before we make this release, then it'd
available as part of this release. It'd be up to you to upgrade to this new
version of Apache NiFi, or backport the fix in your version, or just take
the new NAR and drop it in your version of NiFi.
If you can test the pull request and provide a review on it, that would
certainly help getting it merged faster. You can also open your own pull
requests against the Apache NiFi project. NiFi is an open source project
with an amazing community and we want to make sure that anyone can
contribute to the project (by helping with the documentation, by reviewing
pull requests, by submitting pull requests, by testing release candidates,
by helping debugging issues, etc). This project is moving forward thanks to
the collaborative efforts of everyone. We understand that not everyone is
in a position to submit pull requests, but I do think that anyone can help
on many aspects of the project (not necessarily requiring to write code).
If you have an urgent need for this fix, helping others with their own
needs would likely help. You can see this as an exchange of courtesies.
Thanks for your involvement in the community.
Pierre
Le sam. 23 mai 2020 à 07:10, Anuj Jain <An...@aeris.net> a écrit :
> Hi Mark,
>
> zenfenan, did the code fix raised a PR
> https://github.com/apache/nifi/pull/4290/commits
>
> code change seems fine for me, but this is raised for master branch
> as I suggested, we can create a newer version/branch from 1.9.2, and fix
> that code there and release that
> so it will not impact other latest versions
> once it got tested in our environment then I will confirm and you will
> merge that into master and whenever Nifi new version release this fix will
> be there.
>
> Please revert if have any concern on this.
>
> Regards
> Anuj Jain
>
>
>
>
> ________________________________
>
>
> The information contained in this communication is confidential and
> intended solely for the use of the individual named or entity to whom it is
> addressed and others authorized to receive it. If you are not the intended
> recipient you are hereby notified that any disclosure, copying,
> circulation, distribution or taking any action in reliance on the contents
> of this information is strictly prohibited and may be unlawful. Please
> delete it and any attachments from your systems and notify the sender that
> you have received it in error. Unless stated to the contrary, any opinions
> expressed in this message are personal and may not be attributed to Aeris
> Communications.
>
RE: https://issues.apache.org/jira/browse/NIFI-6701
Posted by Anuj Jain <An...@aeris.net>.
Hi Mark,
zenfenan, did the code fix raised a PR
https://github.com/apache/nifi/pull/4290/commits
code change seems fine for me, but this is raised for master branch
as I suggested, we can create a newer version/branch from 1.9.2, and fix that code there and release that
so it will not impact other latest versions
once it got tested in our environment then I will confirm and you will merge that into master and whenever Nifi new version release this fix will be there.
Please revert if have any concern on this.
Regards
Anuj Jain
________________________________
The information contained in this communication is confidential and intended solely for the use of the individual named or entity to whom it is addressed and others authorized to receive it. If you are not the intended recipient you are hereby notified that any disclosure, copying, circulation, distribution or taking any action in reliance on the contents of this information is strictly prohibited and may be unlawful. Please delete it and any attachments from your systems and notify the sender that you have received it in error. Unless stated to the contrary, any opinions expressed in this message are personal and may not be attributed to Aeris Communications.
RE: https://issues.apache.org/jira/browse/NIFI-6701
Posted by Anuj Jain <An...@aeris.net>.
Hi Mark,
Sorry to sending same mail again and again as I didn't received reply as I did not subscribed mailing list.
Regarding Bug,
May be this is a minor change but this is a bug due to which Nifi processor hang and not processed data till restart.
For a suggestion , I am using PublishGCPubSub 1.9.2 , so you can change the code from this version and create one another version from this 1.9.x (any incremental version which is not available as of now like 1.9.3 or 1.9.4), I will review the PR.
So by this way, we don't have too much issue regarding testing as that version we are using and we can test it on our environment and let you know whether it works fine or not.
Let me know, If this seems fine to you.
Regards
Anuj Jain
-----Original Message-----
From: Anuj Jain <An...@aeris.net>
Sent: 22 May 2020 21:17
To: dev@nifi.apache.org
Subject: https://issues.apache.org/jira/browse/NIFI-6701
Hi Team,
I need to bring this issue up https://issues.apache.org/jira/browse/NIFI-6701 as it raised in Sep'19 and seems no fix published till now as issue is still open.
I am also facing the same issue in nifi PublishGCPubsub Processor.
Threads are stuck and then messages continuously increased in the queue and showing below error in thread dump {"stackTrace":"\"Timer-Driven Process Thread-50\" Id=8466 TIMED_WAITING on null\n\tat java.lang.Thread.sleep(Native Method)\n\tat org.apache.nifi.processors.gcp.pubsub.PublishGCPubSub.onTrigger(PublishGCPubSub.java:166)\n\tat org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)\n\tat...
Looking forward to your quick response on this.
Regards
Anuj Jain
________________________________
The information contained in this communication is confidential and intended solely for the use of the individual named or entity to whom it is addressed and others authorized to receive it. If you are not the intended recipient you are hereby notified that any disclosure, copying, circulation, distribution or taking any action in reliance on the contents of this information is strictly prohibited and may be unlawful. Please delete it and any attachments from your systems and notify the sender that you have received it in error. Unless stated to the contrary, any opinions expressed in this message are personal and may not be attributed to Aeris Communications.
________________________________
The information contained in this communication is confidential and intended solely for the use of the individual named or entity to whom it is addressed and others authorized to receive it. If you are not the intended recipient you are hereby notified that any disclosure, copying, circulation, distribution or taking any action in reliance on the contents of this information is strictly prohibited and may be unlawful. Please delete it and any attachments from your systems and notify the sender that you have received it in error. Unless stated to the contrary, any opinions expressed in this message are personal and may not be attributed to Aeris Communications.
________________________________
The information contained in this communication is confidential and intended solely for the use of the individual named or entity to whom it is addressed and others authorized to receive it. If you are not the intended recipient you are hereby notified that any disclosure, copying, circulation, distribution or taking any action in reliance on the contents of this information is strictly prohibited and may be unlawful. Please delete it and any attachments from your systems and notify the sender that you have received it in error. Unless stated to the contrary, any opinions expressed in this message are personal and may not be attributed to Aeris Communications.
https://issues.apache.org/jira/browse/NIFI-6701
Posted by Anuj Jain <An...@aeris.net>.
Hi Team,
I need to bring this issue up https://issues.apache.org/jira/browse/NIFI-6701 as it raised in Sep'19 and seems no fix published till now as issue is still open.
I am also facing the same issue in nifi PublishGCPubsub Processor.
Threads are stuck and then messages continuously increased in the queue and showing below error in thread dump
{"stackTrace":"\"Timer-Driven Process Thread-50\" Id=8466 TIMED_WAITING on null\n\tat java.lang.Thread.sleep(Native Method)\n\tat org.apache.nifi.processors.gcp.pubsub.PublishGCPubSub.onTrigger(PublishGCPubSub.java:166)\n\tat org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)\n\tat...
Looking forward to your quick response on this.
Regards
Anuj Jain
________________________________
The information contained in this communication is confidential and intended solely for the use of the individual named or entity to whom it is addressed and others authorized to receive it. If you are not the intended recipient you are hereby notified that any disclosure, copying, circulation, distribution or taking any action in reliance on the contents of this information is strictly prohibited and may be unlawful. Please delete it and any attachments from your systems and notify the sender that you have received it in error. Unless stated to the contrary, any opinions expressed in this message are personal and may not be attributed to Aeris Communications.