You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@nifi.apache.org by "GASCHLER, Jean" <je...@capgemini.com> on 2018/07/08 10:25:03 UTC
Nifi 1.7.0: queue is stuck for no reason
Hi
I have migrated from NiFi 1.6.0 to 1.7.0 in order to solve some problems with the PutMongoRecord processor.
I have now a problem with queues which are stuck without any errors in the logs (especially when they are after an Input Port).
For example,
[cid:image011.png@01D416B6.AF7ED1D0][cid:image010.png@01D416B6.654A8AF0]
The configuration of this queue example is the following:
[cid:image012.png@01D416B6.AF7ED1D0][cid:image013.png@01D416B6.AF7ED1D0]
Any idea?
Thanks
Bien cordialement - Best Regards - Freundlichen Grüßen – Cordiali saluti - Vljudno - Pozdrawiam - 亲切的问候 - με φιλικούς χαιρετισμούς
_______________________________________________________________________
[Email_CBE.gif]Jean Gaschler
This message contains information that may be privileged or confidential and is the property of the Capgemini Group. It is intended only for the person to whom it is addressed. If you are not the intended recipient, you are not authorized to read, print, retain, copy, disseminate, distribute, or use this message or any part thereof. If you receive this message in error, please notify the sender immediately and delete all copies of this message.
Re: Nifi 1.7.0: queue is stuck for no reason
Posted by Pierre Villard <pi...@gmail.com>.
That's weird... Just some shots in the dark:
- do you have threads available for processing? if you look at the number
in the top left, what's the number you have (number of threads currently
being used)? what's the size of your threads pool?
- anything in the nifi-app.log file?
2018-07-09 10:37 GMT+02:00 GASCHLER, Jean <je...@capgemini.com>:
> Hi Pierre
>
>
>
> It is a standalone node. I am currently checking the NiFi configuration.
> May be I have missed something new in the version 1.7.0.
>
>
>
> Bien cordialement - Best Regards - Freundlichen Grüßen – Cordiali
> saluti - Vljudno - Pozdrawiam - 亲切的问候 - με φιλικούς χαιρετισμούς
>
> _______________________________________________________________________
>
> [image: Email_CBE.gif]*Jean Gaschler *
>
> Architecte IT | PER PU Est
>
> DP Rhône-Alpes-Auvergne | CHSCT
>
>
>
> Capgemini Technology Services SAS
>
> 95 chemin de l'étoile
> <https://maps.google.com/?q=95+chemin+de+l'%C3%A9toile+%0D%0A+38330+Montbonnot+Saint+Martin&entry=gmail&source=g>
>
> 38330 Montbonnot Saint Martin
> <https://maps.google.com/?q=95+chemin+de+l'%C3%A9toile+%0D%0A+38330+Montbonnot+Saint+Martin&entry=gmail&source=g>
>
> Tel.: +33 (0)476 39 9584
>
> Accueil standard: +33 (0)476 39 9400
>
> Fax: +33 (0)476 39 9401
>
>
>
> [image: Email_CBE.gif]
> _______________________________________________________________________
>
> *Connect with Capgemini:*
> [image: cid:image002.gif@01D34741.C7FBCA50]
> <http://www.capgemini.com/insights-and-resources/blogs>[image:
> cid:image003.gif@01D34741.C7FBCA50] <http://www.twitter.com/capgemini>[image:
> cid:image004.gif@01D34741.C7FBCA50] <http://www.facebook.com/capgemini>[image:
> cid:image005.gif@01D34741.C7FBCA50]
> <http://www.linkedin.com/company/capgemini>[image:
> cid:image006.gif@01D34741.C7FBCA50] <http://www.slideshare.net/capgemini>[image:
> cid:image007.gif@01D34741.C7FBCA50]
> <http://www.youtube.com/capgeminimedia>
>
>
>
> Please consider the environment and do not print this email unless
> absolutely necessary.
>
> Capgemini encourages environmental awareness.
>
>
>
> *De :* Pierre Villard [mailto:pierre.villard.fr@gmail.com]
> *Envoyé :* lundi 9 juillet 2018 10:34
> *À :* users@nifi.apache.org
> *Objet :* Re: Nifi 1.7.0: queue is stuck for no reason
>
>
>
> Hi Jean,
>
>
>
> Out of curiosity, is it a NiFi cluster (if yes, of how many nodes?) or a
> standalone node?
>
>
>
> Pierre
>
>
>
> 2018-07-09 8:51 GMT+02:00 GASCHLER, Jean <je...@capgemini.com>:
>
> Yes. Here it is.
>
>
>
> But the problem appears in other places in my NiFi.
>
>
>
>
>
> *De :* Sivaprasanna [mailto:sivaprasanna246@gmail.com]
> *Envoyé :* lundi 9 juillet 2018 08:30
> *À :* users@nifi.apache.org
> *Cc :* Mark Payne
>
>
> *Objet :* Re: Nifi 1.7.0: queue is stuck for no reason
>
>
>
> Execution is fine. Can you please share the screenshot of the "Properties"
> tab of the ReplaceText processor (Replace Special Characters)?
>
>
>
> On Mon, Jul 9, 2018 at 11:12 AM GASCHLER, Jean <
> jean.gaschler@capgemini.com> wrote:
>
> Hi Mark
>
>
>
> Here is the screenshot of the Scheduling Tab. The scheduling seems OK and
> no changes have been done since NiFi version 1.6.0. Nevertheless I
> discovered the new field “Execution” but I didn’t change its default value.
> So dump is in attachement.
>
> Thanks for your help.
>
>
>
>
>
> Bien cordialement - Best Regards - Freundlichen Grüßen – Cordiali
> saluti - Vljudno - Pozdrawiam - 亲切的问候 - με φιλικούς χαιρετισμούς
>
> _______________________________________________________________________
>
> [image: Email_CBE.gif]*Jean Gaschler *
>
> Architecte IT | PER PU Est
>
> DP Rhône-Alpes-Auvergne | CHSCT
>
>
>
> Capgemini Technology Services SAS
>
> 95 chemin de l'étoile
> <https://maps.google.com/?q=95+chemin+de+l'%C3%A9toile+%0D%0A+38330+Montbonnot+Saint+Martin&entry=gmail&source=g>
>
> 38330 Montbonnot Saint Martin
> <https://maps.google.com/?q=95+chemin+de+l'%C3%A9toile+%0D%0A+38330+Montbonnot+Saint+Martin&entry=gmail&source=g>
>
> Tel.: +33 (0)476 39 9584
>
> Accueil standard: +33 (0)476 39 9400
>
> Fax: +33 (0)476 39 9401
>
>
>
>
> _______________________________________________________________________
>
> *Connect with Capgemini:*
> <http://www.capgemini.com/insights-and-resources/blogs>
>
>
>
> Please consider the environment and do not print this email unless
> absolutely necessary.
>
> Capgemini encourages environmental awareness.
>
>
>
> *De :* Mark Payne [mailto:*markap14@hotmail.com <ma...@hotmail.com>*]
> *Envoyé :* dimanche 8 juillet 2018 13:51
> *À :* *users@nifi.apache.org <us...@nifi.apache.org>*
> *Objet :* Re: Nifi 1.7.0: queue is stuck for no reason
>
>
>
> Hi Jean,
>
>
>
> It looks like the ReplaceText processor is not getting scheduled to run.
> Can you include a screenshot of the processor’s configuration- specifically
> the Scheduling Tab?
>
>
>
> Also can you gather a thread dump? You can get this by running
> “bin/nifi.sh dump thread-dump.txt”
>
>
>
> Thanks
>
> Sent from my iPhone
>
>
> On Jul 8, 2018, at 6:25 AM, GASCHLER, Jean <*jean.gaschler@capgemini.com
> <je...@capgemini.com>*> wrote:
>
> Hi
>
>
>
> I have migrated from NiFi 1.6.0 to 1.7.0 in order to solve some problems
> with the PutMongoRecord processor.
>
> I have now a problem with queues which are stuck without any errors in the
> logs (especially when they are after an Input Port).
>
> For example,
>
> <image011.png><image010.png>
>
>
>
> The configuration of this queue example is the following:
>
> <image012.png><image013.png>
>
>
>
> Any idea?
>
> Thanks
>
> Bien cordialement - Best Regards - Freundlichen Grüßen – Cordiali
> saluti - Vljudno - Pozdrawiam - 亲切的问候 - με φιλικούς χαιρετισμούς
>
> _______________________________________________________________________
>
> <image001.gif>*Jean Gaschler *
>
>
>
>
>
> This message contains information that may be privileged or confidential
> and is the property of the Capgemini Group. It is intended only for the
> person to whom it is addressed. If you are not the intended recipient, you
> are not authorized to read, print, retain, copy, disseminate, distribute,
> or use this message or any part thereof. If you receive this message in
> error, please notify the sender immediately and delete all copies of this
> message.
>
> <http://www.capgemini.com/insights-and-resources/blogs>
>
>
RE: Nifi 1.7.0: queue is stuck for no reason
Posted by "GASCHLER, Jean" <je...@capgemini.com>.
Hi Pierre
It is a standalone node. I am currently checking the NiFi configuration. May be I have missed something new in the version 1.7.0.
Bien cordialement - Best Regards - Freundlichen Grüßen – Cordiali saluti - Vljudno - Pozdrawiam - 亲切的问候 - με φιλικούς χαιρετισμούς
_______________________________________________________________________
[Email_CBE.gif]Jean Gaschler
Architecte IT | PER PU Est
DP Rhône-Alpes-Auvergne | CHSCT
Capgemini Technology Services SAS
95 chemin de l'étoile
38330 Montbonnot Saint Martin
Tel.: +33 (0)476 39 9584
Accueil standard: +33 (0)476 39 9400
Fax: +33 (0)476 39 9401
[Email_CBE.gif]
_______________________________________________________________________
Connect with Capgemini:
[cid:image002.gif@01D34741.C7FBCA50]<http://www.capgemini.com/insights-and-resources/blogs>[cid:image003.gif@01D34741.C7FBCA50]<http://www.twitter.com/capgemini>[cid:image004.gif@01D34741.C7FBCA50]<http://www.facebook.com/capgemini>[cid:image005.gif@01D34741.C7FBCA50]<http://www.linkedin.com/company/capgemini>[cid:image006.gif@01D34741.C7FBCA50]<http://www.slideshare.net/capgemini>[cid:image007.gif@01D34741.C7FBCA50]<http://www.youtube.com/capgeminimedia>
Please consider the environment and do not print this email unless absolutely necessary.
Capgemini encourages environmental awareness.
De : Pierre Villard [mailto:pierre.villard.fr@gmail.com]
Envoyé : lundi 9 juillet 2018 10:34
À : users@nifi.apache.org
Objet : Re: Nifi 1.7.0: queue is stuck for no reason
Hi Jean,
Out of curiosity, is it a NiFi cluster (if yes, of how many nodes?) or a standalone node?
Pierre
2018-07-09 8:51 GMT+02:00 GASCHLER, Jean <je...@capgemini.com>>:
Yes. Here it is.
[cid:image012.png@01D41770.D3E58F40]
But the problem appears in other places in my NiFi.
[cid:image013.png@01D41770.D3E58F40][cid:image013.png@01D41770.D3E58F40][cid:image014.png@01D41770.D3E58F40]
De : Sivaprasanna [mailto:sivaprasanna246@gmail.com<ma...@gmail.com>]
Envoyé : lundi 9 juillet 2018 08:30
À : users@nifi.apache.org<ma...@nifi.apache.org>
Cc : Mark Payne
Objet : Re: Nifi 1.7.0: queue is stuck for no reason
Execution is fine. Can you please share the screenshot of the "Properties" tab of the ReplaceText processor (Replace Special Characters)?
On Mon, Jul 9, 2018 at 11:12 AM GASCHLER, Jean <je...@capgemini.com>> wrote:
Hi Mark
Here is the screenshot of the Scheduling Tab. The scheduling seems OK and no changes have been done since NiFi version 1.6.0. Nevertheless I discovered the new field “Execution” but I didn’t change its default value. So dump is in attachement.
Thanks for your help.
Bien cordialement - Best Regards - Freundlichen Grüßen – Cordiali saluti - Vljudno - Pozdrawiam - 亲切的问候 - με φιλικούς χαιρετισμούς
_______________________________________________________________________
[Email_CBE.gif]Jean Gaschler
Architecte IT | PER PU Est
DP Rhône-Alpes-Auvergne | CHSCT
Capgemini Technology Services SAS
95 chemin de l'étoile<https://maps.google.com/?q=95+chemin+de+l'%C3%A9toile+%0D%0A+38330+Montbonnot+Saint+Martin&entry=gmail&source=g>
38330 Montbonnot Saint Martin<https://maps.google.com/?q=95+chemin+de+l'%C3%A9toile+%0D%0A+38330+Montbonnot+Saint+Martin&entry=gmail&source=g>
Tel.: +33 (0)476 39 9584
Accueil standard: +33 (0)476 39 9400
Fax: +33 (0)476 39 9401
_______________________________________________________________________
Connect with Capgemini:
<http://www.capgemini.com/insights-and-resources/blogs>
Please consider the environment and do not print this email unless absolutely necessary.
Capgemini encourages environmental awareness.
De : Mark Payne [mailto:markap14@hotmail.com]
Envoyé : dimanche 8 juillet 2018 13:51
À : users@nifi.apache.org
Objet : Re: Nifi 1.7.0: queue is stuck for no reason
Hi Jean,
It looks like the ReplaceText processor is not getting scheduled to run. Can you include a screenshot of the processor’s configuration- specifically the Scheduling Tab?
Also can you gather a thread dump? You can get this by running “bin/nifi.sh dump thread-dump.txt”
Thanks
Sent from my iPhone
On Jul 8, 2018, at 6:25 AM, GASCHLER, Jean <je...@capgemini.com> wrote:
Hi
I have migrated from NiFi 1.6.0 to 1.7.0 in order to solve some problems with the PutMongoRecord processor.
I have now a problem with queues which are stuck without any errors in the logs (especially when they are after an Input Port).
For example,
<image011.png><image010.png>
The configuration of this queue example is the following:
<image012.png><image013.png>
Any idea?
Thanks
Bien cordialement - Best Regards - Freundlichen Grüßen – Cordiali saluti - Vljudno - Pozdrawiam - 亲切的问候 - με φιλικούς χαιρετισμούς
_______________________________________________________________________
<image001.gif>Jean Gaschler
This message contains information that may be privileged or confidential and is the property of the Capgemini Group. It is intended only for the person to whom it is addressed. If you are not the intended recipient, you are not authorized to read, print, retain, copy, disseminate, distribute, or use this message or any part thereof. If you receive this message in error, please notify the sender immediately and delete all copies of this message.
<http://www.capgemini.com/insights-and-resources/blogs>
Re: Nifi 1.7.0: queue is stuck for no reason
Posted by Pierre Villard <pi...@gmail.com>.
Hi Jean,
Out of curiosity, is it a NiFi cluster (if yes, of how many nodes?) or a
standalone node?
Pierre
2018-07-09 8:51 GMT+02:00 GASCHLER, Jean <je...@capgemini.com>:
> Yes. Here it is.
>
>
>
> But the problem appears in other places in my NiFi.
>
>
>
>
>
> *De :* Sivaprasanna [mailto:sivaprasanna246@gmail.com]
> *Envoyé :* lundi 9 juillet 2018 08:30
> *À :* users@nifi.apache.org
> *Cc :* Mark Payne
>
> *Objet :* Re: Nifi 1.7.0: queue is stuck for no reason
>
>
>
> Execution is fine. Can you please share the screenshot of the "Properties"
> tab of the ReplaceText processor (Replace Special Characters)?
>
>
>
> On Mon, Jul 9, 2018 at 11:12 AM GASCHLER, Jean <
> jean.gaschler@capgemini.com> wrote:
>
> Hi Mark
>
>
>
> Here is the screenshot of the Scheduling Tab. The scheduling seems OK and
> no changes have been done since NiFi version 1.6.0. Nevertheless I
> discovered the new field “Execution” but I didn’t change its default value.
> So dump is in attachement.
>
> Thanks for your help.
>
>
>
> [image: cid:image001.png@01D41755.D674E0F0]
>
>
>
> Bien cordialement - Best Regards - Freundlichen Grüßen – Cordiali
> saluti - Vljudno - Pozdrawiam - 亲切的问候 - με φιλικούς χαιρετισμούς
>
> _______________________________________________________________________
>
> [image: Email_CBE.gif]*Jean Gaschler *
>
> Architecte IT | PER PU Est
>
> DP Rhône-Alpes-Auvergne | CHSCT
>
>
>
> Capgemini Technology Services SAS
>
> 95 chemin de l'étoile
> <https://maps.google.com/?q=95+chemin+de+l'%C3%A9toile+%0D%0A+38330+Montbonnot+Saint+Martin&entry=gmail&source=g>
>
> 38330 Montbonnot Saint Martin
> <https://maps.google.com/?q=95+chemin+de+l'%C3%A9toile+%0D%0A+38330+Montbonnot+Saint+Martin&entry=gmail&source=g>
>
> Tel.: +33 (0)476 39 9584
>
> Accueil standard: +33 (0)476 39 9400
>
> Fax: +33 (0)476 39 9401
>
>
>
> [image: Email_CBE.gif]
> _______________________________________________________________________
>
> *Connect with Capgemini:*
> [image: cid:image002.gif@01D34741.C7FBCA50]
> <http://www.capgemini.com/insights-and-resources/blogs>[image:
> cid:image003.gif@01D34741.C7FBCA50] <http://www.twitter.com/capgemini>[image:
> cid:image004.gif@01D34741.C7FBCA50] <http://www.facebook.com/capgemini>[image:
> cid:image005.gif@01D34741.C7FBCA50]
> <http://www.linkedin.com/company/capgemini>[image:
> cid:image006.gif@01D34741.C7FBCA50] <http://www.slideshare.net/capgemini>[image:
> cid:image007.gif@01D34741.C7FBCA50]
> <http://www.youtube.com/capgeminimedia>
>
>
>
> Please consider the environment and do not print this email unless
> absolutely necessary.
>
> Capgemini encourages environmental awareness.
>
>
>
> *De :* Mark Payne [mailto:markap14@hotmail.com]
> *Envoyé :* dimanche 8 juillet 2018 13:51
> *À :* users@nifi.apache.org
> *Objet :* Re: Nifi 1.7.0: queue is stuck for no reason
>
>
>
> Hi Jean,
>
>
>
> It looks like the ReplaceText processor is not getting scheduled to run.
> Can you include a screenshot of the processor’s configuration- specifically
> the Scheduling Tab?
>
>
>
> Also can you gather a thread dump? You can get this by running
> “bin/nifi.sh dump thread-dump.txt”
>
>
>
> Thanks
>
> Sent from my iPhone
>
>
> On Jul 8, 2018, at 6:25 AM, GASCHLER, Jean <je...@capgemini.com>
> wrote:
>
> Hi
>
>
>
> I have migrated from NiFi 1.6.0 to 1.7.0 in order to solve some problems
> with the PutMongoRecord processor.
>
> I have now a problem with queues which are stuck without any errors in the
> logs (especially when they are after an Input Port).
>
> For example,
>
> <image011.png><image010.png>
>
>
>
> The configuration of this queue example is the following:
>
> <image012.png><image013.png>
>
>
>
> Any idea?
>
> Thanks
>
> Bien cordialement - Best Regards - Freundlichen Grüßen – Cordiali
> saluti - Vljudno - Pozdrawiam - 亲切的问候 - με φιλικούς χαιρετισμούς
>
> _______________________________________________________________________
>
> <image001.gif>*Jean Gaschler *
>
>
>
>
>
> This message contains information that may be privileged or confidential
> and is the property of the Capgemini Group. It is intended only for the
> person to whom it is addressed. If you are not the intended recipient, you
> are not authorized to read, print, retain, copy, disseminate, distribute,
> or use this message or any part thereof. If you receive this message in
> error, please notify the sender immediately and delete all copies of this
> message.
>
>
RE: Nifi 1.7.0: queue is stuck for no reason
Posted by "GASCHLER, Jean" <je...@capgemini.com>.
Yes. Here it is.
[cid:image009.png@01D41761.FA97B5A0]
But the problem appears in other places in my NiFi.
[cid:image001.png@01D41762.0EB2F4F0][cid:image001.png@01D41762.0EB2F4F0][cid:image010.png@01D41761.FA97B5A0]
De : Sivaprasanna [mailto:sivaprasanna246@gmail.com]
Envoyé : lundi 9 juillet 2018 08:30
À : users@nifi.apache.org
Cc : Mark Payne
Objet : Re: Nifi 1.7.0: queue is stuck for no reason
Execution is fine. Can you please share the screenshot of the "Properties" tab of the ReplaceText processor (Replace Special Characters)?
On Mon, Jul 9, 2018 at 11:12 AM GASCHLER, Jean <je...@capgemini.com>> wrote:
Hi Mark
Here is the screenshot of the Scheduling Tab. The scheduling seems OK and no changes have been done since NiFi version 1.6.0. Nevertheless I discovered the new field “Execution” but I didn’t change its default value. So dump is in attachement.
Thanks for your help.
[cid:image001.png@01D41755.D674E0F0]
Bien cordialement - Best Regards - Freundlichen Grüßen – Cordiali saluti - Vljudno - Pozdrawiam - 亲切的问候 - με φιλικούς χαιρετισμούς
_______________________________________________________________________
[Email_CBE.gif]Jean Gaschler
Architecte IT | PER PU Est
DP Rhône-Alpes-Auvergne | CHSCT
Capgemini Technology Services SAS
95 chemin de l'étoile
38330 Montbonnot Saint Martin
Tel.: +33 (0)476 39 9584
Accueil standard: +33 (0)476 39 9400
Fax: +33 (0)476 39 9401
[Email_CBE.gif]
_______________________________________________________________________
Connect with Capgemini:
[cid:image002.gif@01D34741.C7FBCA50]<http://www.capgemini.com/insights-and-resources/blogs>[cid:image003.gif@01D34741.C7FBCA50]<http://www.twitter.com/capgemini>[cid:image004.gif@01D34741.C7FBCA50]<http://www.facebook.com/capgemini>[cid:image005.gif@01D34741.C7FBCA50]<http://www.linkedin.com/company/capgemini>[cid:image006.gif@01D34741.C7FBCA50]<http://www.slideshare.net/capgemini>[cid:image007.gif@01D34741.C7FBCA50]<http://www.youtube.com/capgeminimedia>
Please consider the environment and do not print this email unless absolutely necessary.
Capgemini encourages environmental awareness.
De : Mark Payne [mailto:markap14@hotmail.com<ma...@hotmail.com>]
Envoyé : dimanche 8 juillet 2018 13:51
À : users@nifi.apache.org<ma...@nifi.apache.org>
Objet : Re: Nifi 1.7.0: queue is stuck for no reason
Hi Jean,
It looks like the ReplaceText processor is not getting scheduled to run. Can you include a screenshot of the processor’s configuration- specifically the Scheduling Tab?
Also can you gather a thread dump? You can get this by running “bin/nifi.sh dump thread-dump.txt”
Thanks
Sent from my iPhone
On Jul 8, 2018, at 6:25 AM, GASCHLER, Jean <je...@capgemini.com>> wrote:
Hi
I have migrated from NiFi 1.6.0 to 1.7.0 in order to solve some problems with the PutMongoRecord processor.
I have now a problem with queues which are stuck without any errors in the logs (especially when they are after an Input Port).
For example,
<image011.png><image010.png>
The configuration of this queue example is the following:
<image012.png><image013.png>
Any idea?
Thanks
Bien cordialement - Best Regards - Freundlichen Grüßen – Cordiali saluti - Vljudno - Pozdrawiam - 亲切的问候 - με φιλικούς χαιρετισμούς
_______________________________________________________________________
<image001.gif>Jean Gaschler
This message contains information that may be privileged or confidential and is the property of the Capgemini Group. It is intended only for the person to whom it is addressed. If you are not the intended recipient, you are not authorized to read, print, retain, copy, disseminate, distribute, or use this message or any part thereof. If you receive this message in error, please notify the sender immediately and delete all copies of this message.
Re: Nifi 1.7.0: queue is stuck for no reason
Posted by Sivaprasanna <si...@gmail.com>.
Execution is fine. Can you please share the screenshot of the "Properties"
tab of the ReplaceText processor (Replace Special Characters)?
On Mon, Jul 9, 2018 at 11:12 AM GASCHLER, Jean <je...@capgemini.com>
wrote:
> Hi Mark
>
>
>
> Here is the screenshot of the Scheduling Tab. The scheduling seems OK and
> no changes have been done since NiFi version 1.6.0. Nevertheless I
> discovered the new field “Execution” but I didn’t change its default value.
> So dump is in attachement.
>
> Thanks for your help.
>
>
>
> [image: cid:image001.png@01D41755.D674E0F0]
>
>
>
> Bien cordialement - Best Regards - Freundlichen Grüßen – Cordiali
> saluti - Vljudno - Pozdrawiam - 亲切的问候 - με φιλικούς χαιρετισμούς
>
> _______________________________________________________________________
>
> [image: Email_CBE.gif]*Jean Gaschler *
>
> Architecte IT | PER PU Est
>
> DP Rhône-Alpes-Auvergne | CHSCT
>
>
>
> Capgemini Technology Services SAS
>
> 95 chemin de l'étoile
>
> 38330 Montbonnot Saint Martin
>
> Tel.: +33 (0)476 39 9584
>
> Accueil standard: +33 (0)476 39 9400
>
> Fax: +33 (0)476 39 9401
>
>
>
> [image: Email_CBE.gif]
> _______________________________________________________________________
>
> *Connect with Capgemini:*
> [image: cid:image002.gif@01D34741.C7FBCA50]
> <http://www.capgemini.com/insights-and-resources/blogs>[image:
> cid:image003.gif@01D34741.C7FBCA50] <http://www.twitter.com/capgemini>[image:
> cid:image004.gif@01D34741.C7FBCA50] <http://www.facebook.com/capgemini>[image:
> cid:image005.gif@01D34741.C7FBCA50]
> <http://www.linkedin.com/company/capgemini>[image:
> cid:image006.gif@01D34741.C7FBCA50] <http://www.slideshare.net/capgemini>[image:
> cid:image007.gif@01D34741.C7FBCA50]
> <http://www.youtube.com/capgeminimedia>
>
>
>
> Please consider the environment and do not print this email unless
> absolutely necessary.
>
> Capgemini encourages environmental awareness.
>
>
>
> *De :* Mark Payne [mailto:markap14@hotmail.com]
> *Envoyé :* dimanche 8 juillet 2018 13:51
> *À :* users@nifi.apache.org
> *Objet :* Re: Nifi 1.7.0: queue is stuck for no reason
>
>
>
> Hi Jean,
>
>
>
> It looks like the ReplaceText processor is not getting scheduled to run.
> Can you include a screenshot of the processor’s configuration- specifically
> the Scheduling Tab?
>
>
>
> Also can you gather a thread dump? You can get this by running
> “bin/nifi.sh dump thread-dump.txt”
>
>
>
> Thanks
>
> Sent from my iPhone
>
>
> On Jul 8, 2018, at 6:25 AM, GASCHLER, Jean <je...@capgemini.com>
> wrote:
>
> Hi
>
>
>
> I have migrated from NiFi 1.6.0 to 1.7.0 in order to solve some problems
> with the PutMongoRecord processor.
>
> I have now a problem with queues which are stuck without any errors in the
> logs (especially when they are after an Input Port).
>
> For example,
>
> <image011.png><image010.png>
>
>
>
> The configuration of this queue example is the following:
>
> <image012.png><image013.png>
>
>
>
> Any idea?
>
> Thanks
>
> Bien cordialement - Best Regards - Freundlichen Grüßen – Cordiali
> saluti - Vljudno - Pozdrawiam - 亲切的问候 - με φιλικούς χαιρετισμούς
>
> _______________________________________________________________________
>
> <image001.gif>*Jean Gaschler *
>
>
>
>
>
> This message contains information that may be privileged or confidential
> and is the property of the Capgemini Group. It is intended only for the
> person to whom it is addressed. If you are not the intended recipient, you
> are not authorized to read, print, retain, copy, disseminate, distribute,
> or use this message or any part thereof. If you receive this message in
> error, please notify the sender immediately and delete all copies of this
> message.
>
>
RE: Nifi 1.7.0: queue is stuck for no reason
Posted by "GASCHLER, Jean" <je...@capgemini.com>.
Hi Mark
Just to add that I found a new stuck case that I don’t understand
[cid:image003.jpg@01D41760.546E21B0] [cid:image004.jpg@01D41760.546E21B0] [cid:image005.jpg@01D41760.546E21B0]
De : GASCHLER, Jean
Envoyé : lundi 9 juillet 2018 07:42
À : users@nifi.apache.org; markap14@hotmail.com
Objet : RE: Nifi 1.7.0: queue is stuck for no reason
Hi Mark
Here is the screenshot of the Scheduling Tab. The scheduling seems OK and no changes have been done since NiFi version 1.6.0. Nevertheless I discovered the new field “Execution” but I didn’t change its default value. So dump is in attachement.
Thanks for your help.
[cid:image001.png@01D41755.D674E0F0]
Bien cordialement - Best Regards - Freundlichen Grüßen – Cordiali saluti - Vljudno - Pozdrawiam - 亲切的问候 - με φιλικούς χαιρετισμούς
_______________________________________________________________________
[Email_CBE.gif]Jean Gaschler
Architecte IT | PER PU Est
DP Rhône-Alpes-Auvergne | CHSCT
Capgemini Technology Services SAS
95 chemin de l'étoile
38330 Montbonnot Saint Martin
Tel.: +33 (0)476 39 9584
Accueil standard: +33 (0)476 39 9400
Fax: +33 (0)476 39 9401
[Email_CBE.gif]
_______________________________________________________________________
Connect with Capgemini:
[cid:image002.gif@01D34741.C7FBCA50]<http://www.capgemini.com/insights-and-resources/blogs>[cid:image003.gif@01D34741.C7FBCA50]<http://www.twitter.com/capgemini>[cid:image004.gif@01D34741.C7FBCA50]<http://www.facebook.com/capgemini>[cid:image005.gif@01D34741.C7FBCA50]<http://www.linkedin.com/company/capgemini>[cid:image006.gif@01D34741.C7FBCA50]<http://www.slideshare.net/capgemini>[cid:image007.gif@01D34741.C7FBCA50]<http://www.youtube.com/capgeminimedia>
Please consider the environment and do not print this email unless absolutely necessary.
Capgemini encourages environmental awareness.
De : Mark Payne [mailto:markap14@hotmail.com]
Envoyé : dimanche 8 juillet 2018 13:51
À : users@nifi.apache.org<ma...@nifi.apache.org>
Objet : Re: Nifi 1.7.0: queue is stuck for no reason
Hi Jean,
It looks like the ReplaceText processor is not getting scheduled to run. Can you include a screenshot of the processor’s configuration- specifically the Scheduling Tab?
Also can you gather a thread dump? You can get this by running “bin/nifi.sh dump thread-dump.txt”
Thanks
Sent from my iPhone
On Jul 8, 2018, at 6:25 AM, GASCHLER, Jean <je...@capgemini.com>> wrote:
Hi
I have migrated from NiFi 1.6.0 to 1.7.0 in order to solve some problems with the PutMongoRecord processor.
I have now a problem with queues which are stuck without any errors in the logs (especially when they are after an Input Port).
For example,
<image011.png><image010.png>
The configuration of this queue example is the following:
<image012.png><image013.png>
Any idea?
Thanks
Bien cordialement - Best Regards - Freundlichen Grüßen – Cordiali saluti - Vljudno - Pozdrawiam - 亲切的问候 - με φιλικούς χαιρετισμούς
_______________________________________________________________________
<image001.gif>Jean Gaschler
This message contains information that may be privileged or confidential and is the property of the Capgemini Group. It is intended only for the person to whom it is addressed. If you are not the intended recipient, you are not authorized to read, print, retain, copy, disseminate, distribute, or use this message or any part thereof. If you receive this message in error, please notify the sender immediately and delete all copies of this message.
RE: Nifi 1.7.0: queue is stuck for no reason
Posted by "GASCHLER, Jean" <je...@capgemini.com>.
Hi Mark
Thanks a lot for your advice. The flow is now perfectly working well.
Bien cordialement - Best Regards - Freundlichen Grüßen – Cordiali saluti - Vljudno - Pozdrawiam - 亲切的问候 - με φιλικούς χαιρετισμούς
_______________________________________________________________________
[Email_CBE.gif]Jean Gaschler
Architecte IT | PER PU Est
DP Rhône-Alpes-Auvergne | CHSCT
Capgemini Technology Services SAS
95 chemin de l'étoile
38330 Montbonnot Saint Martin
Tel.: +33 (0)476 39 9584
Accueil standard: +33 (0)476 39 9400
Fax: +33 (0)476 39 9401
[Email_CBE.gif]
_______________________________________________________________________
Connect with Capgemini:
[cid:image002.gif@01D34741.C7FBCA50]<http://www.capgemini.com/insights-and-resources/blogs>[cid:image003.gif@01D34741.C7FBCA50]<http://www.twitter.com/capgemini>[cid:image004.gif@01D34741.C7FBCA50]<http://www.facebook.com/capgemini>[cid:image005.gif@01D34741.C7FBCA50]<http://www.linkedin.com/company/capgemini>[cid:image006.gif@01D34741.C7FBCA50]<http://www.slideshare.net/capgemini>[cid:image007.gif@01D34741.C7FBCA50]<http://www.youtube.com/capgeminimedia>
Please consider the environment and do not print this email unless absolutely necessary.
Capgemini encourages environmental awareness.
De : Mark Payne [mailto:markap14@hotmail.com]
Envoyé : lundi 9 juillet 2018 16:38
À : GASCHLER, Jean
Objet : Re: Nifi 1.7.0: queue is stuck for no reason
Jean,
Looking at the Thread Dump, I can see that you have a Max Timer-Driven Thread Pool of 10.
Of these 10 threads that you have allocated to your NiFi instance, 2 threads are running GetFile
processors. The other 8 threads are running in ExecuteProcess. So that explains why the ReplaceText
processor is not running - you have no threads available in your thread pool for the processor to run.
I also see from your Scheduling tab that you have 100 Concurrent Tasks allocated to ReplaceText. Generally,
a value of 12 is "quite large" for this and 100 is certainly more than you want to have allocated to this Processor.
You'll never want this value set higher than the maximum number of threads in your thread pool. Do you also have
a large number of threads allocated to other processors?
Would recommend scaling that number down to say 2 instead of 100 and see how you fair there. If you have a large
number of small FlowFiles, you may also want to increase the Run Duration in the scheduling tab from "0 ms" to "25 ms."
You'll also likely want to increase the maximum number of threads available to your instance. You can do that by
going to the main menu in the top-right corner of NiFi and going to "Controller Settings". Typically you'll want to set that
to something in the range of 1.5 - 2 times the number of CPU cores you have available on your system.
Hope this helps!
Thanks
-Mark
On Jul 9, 2018, at 1:42 AM, GASCHLER, Jean <je...@capgemini.com>> wrote:
Hi Mark
Here is the screenshot of the Scheduling Tab. The scheduling seems OK and no changes have been done since NiFi version 1.6.0. Nevertheless I discovered the new field “Execution” but I didn’t change its default value. So dump is in attachement.
Thanks for your help.
<image001.png>
Bien cordialement - Best Regards - Freundlichen Grüßen – Cordiali saluti - Vljudno - Pozdrawiam - 亲切的问候 - με φιλικούς χαιρετισμούς
_______________________________________________________________________
<image002.gif>Jean Gaschler
Architecte IT | PER PU Est
DP Rhône-Alpes-Auvergne | CHSCT
Capgemini Technology Services SAS
95 chemin de l'étoile
38330 Montbonnot Saint Martin
Tel.: +33 (0)476 39 9584
Accueil standard: +33 (0)476 39 9400
Fax: +33 (0)476 39 9401
<image003.png>
_______________________________________________________________________
Connect with Capgemini:
<image004.gif><http://www.capgemini.com/insights-and-resources/blogs><image005.gif><http://www.twitter.com/capgemini><image006.gif><http://www.facebook.com/capgemini><image007.gif><http://www.linkedin.com/company/capgemini><image008.gif><http://www.slideshare.net/capgemini><image009.gif><http://www.youtube.com/capgeminimedia>
Please consider the environment and do not print this email unless absolutely necessary.
Capgemini encourages environmental awareness.
De : Mark Payne [mailto:markap14@hotmail.com]
Envoyé : dimanche 8 juillet 2018 13:51
À : users@nifi.apache.org<ma...@nifi.apache.org>
Objet : Re: Nifi 1.7.0: queue is stuck for no reason
Hi Jean,
It looks like the ReplaceText processor is not getting scheduled to run. Can you include a screenshot of the processor’s configuration- specifically the Scheduling Tab?
Also can you gather a thread dump? You can get this by running “bin/nifi.sh dump thread-dump.txt”
Thanks
Sent from my iPhone
On Jul 8, 2018, at 6:25 AM, GASCHLER, Jean <je...@capgemini.com>> wrote:
Hi
I have migrated from NiFi 1.6.0 to 1.7.0 in order to solve some problems with the PutMongoRecord processor.
I have now a problem with queues which are stuck without any errors in the logs (especially when they are after an Input Port).
For example,
<image011.png><image010.png>
The configuration of this queue example is the following:
<image012.png><image013.png>
Any idea?
Thanks
Bien cordialement - Best Regards - Freundlichen Grüßen – Cordiali saluti - Vljudno - Pozdrawiam - 亲切的问候 - με φιλικούς χαιρετισμούς
_______________________________________________________________________
<image001.gif>Jean Gaschler
This message contains information that may be privileged or confidential and is the property of the Capgemini Group. It is intended only for the person to whom it is addressed. If you are not the intended recipient, you are not authorized to read, print, retain, copy, disseminate, distribute, or use this message or any part thereof. If you receive this message in error, please notify the sender immediately and delete all copies of this message.
<dump-thread.txt>
RE: Nifi 1.7.0: queue is stuck for no reason
Posted by "GASCHLER, Jean" <je...@capgemini.com>.
Hi Mark
Here is the screenshot of the Scheduling Tab. The scheduling seems OK and no changes have been done since NiFi version 1.6.0. Nevertheless I discovered the new field “Execution” but I didn’t change its default value. So dump is in attachement.
Thanks for your help.
[cid:image001.png@01D41755.D674E0F0]
Bien cordialement - Best Regards - Freundlichen Grüßen – Cordiali saluti - Vljudno - Pozdrawiam - 亲切的问候 - με φιλικούς χαιρετισμούς
_______________________________________________________________________
[Email_CBE.gif]Jean Gaschler
Architecte IT | PER PU Est
DP Rhône-Alpes-Auvergne | CHSCT
Capgemini Technology Services SAS
95 chemin de l'étoile
38330 Montbonnot Saint Martin
Tel.: +33 (0)476 39 9584
Accueil standard: +33 (0)476 39 9400
Fax: +33 (0)476 39 9401
[Email_CBE.gif]
_______________________________________________________________________
Connect with Capgemini:
[cid:image002.gif@01D34741.C7FBCA50]<http://www.capgemini.com/insights-and-resources/blogs>[cid:image003.gif@01D34741.C7FBCA50]<http://www.twitter.com/capgemini>[cid:image004.gif@01D34741.C7FBCA50]<http://www.facebook.com/capgemini>[cid:image005.gif@01D34741.C7FBCA50]<http://www.linkedin.com/company/capgemini>[cid:image006.gif@01D34741.C7FBCA50]<http://www.slideshare.net/capgemini>[cid:image007.gif@01D34741.C7FBCA50]<http://www.youtube.com/capgeminimedia>
Please consider the environment and do not print this email unless absolutely necessary.
Capgemini encourages environmental awareness.
De : Mark Payne [mailto:markap14@hotmail.com]
Envoyé : dimanche 8 juillet 2018 13:51
À : users@nifi.apache.org
Objet : Re: Nifi 1.7.0: queue is stuck for no reason
Hi Jean,
It looks like the ReplaceText processor is not getting scheduled to run. Can you include a screenshot of the processor’s configuration- specifically the Scheduling Tab?
Also can you gather a thread dump? You can get this by running “bin/nifi.sh dump thread-dump.txt”
Thanks
Sent from my iPhone
On Jul 8, 2018, at 6:25 AM, GASCHLER, Jean <je...@capgemini.com>> wrote:
Hi
I have migrated from NiFi 1.6.0 to 1.7.0 in order to solve some problems with the PutMongoRecord processor.
I have now a problem with queues which are stuck without any errors in the logs (especially when they are after an Input Port).
For example,
<image011.png><image010.png>
The configuration of this queue example is the following:
<image012.png><image013.png>
Any idea?
Thanks
Bien cordialement - Best Regards - Freundlichen Grüßen – Cordiali saluti - Vljudno - Pozdrawiam - 亲切的问候 - με φιλικούς χαιρετισμούς
_______________________________________________________________________
<image001.gif>Jean Gaschler
This message contains information that may be privileged or confidential and is the property of the Capgemini Group. It is intended only for the person to whom it is addressed. If you are not the intended recipient, you are not authorized to read, print, retain, copy, disseminate, distribute, or use this message or any part thereof. If you receive this message in error, please notify the sender immediately and delete all copies of this message.
Re: Nifi 1.7.0: queue is stuck for no reason
Posted by Mark Payne <ma...@hotmail.com>.
Hi Jean,
It looks like the ReplaceText processor is not getting scheduled to run. Can you include a screenshot of the processor’s configuration- specifically the Scheduling Tab?
Also can you gather a thread dump? You can get this by running “bin/nifi.sh dump thread-dump.txt”
Thanks
Sent from my iPhone
On Jul 8, 2018, at 6:25 AM, GASCHLER, Jean <je...@capgemini.com>> wrote:
Hi
I have migrated from NiFi 1.6.0 to 1.7.0 in order to solve some problems with the PutMongoRecord processor.
I have now a problem with queues which are stuck without any errors in the logs (especially when they are after an Input Port).
For example,
<image011.png><image010.png>
The configuration of this queue example is the following:
<image012.png><image013.png>
Any idea?
Thanks
Bien cordialement - Best Regards - Freundlichen Grüßen – Cordiali saluti - Vljudno - Pozdrawiam - 亲切的问候 - με φιλικούς χαιρετισμούς
_______________________________________________________________________
<image001.gif>Jean Gaschler
This message contains information that may be privileged or confidential and is the property of the Capgemini Group. It is intended only for the person to whom it is addressed. If you are not the intended recipient, you are not authorized to read, print, retain, copy, disseminate, distribute, or use this message or any part thereof. If you receive this message in error, please notify the sender immediately and delete all copies of this message.