You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2021/06/15 08:52:30 UTC

[GitHub] [pulsar] tausifrazi123 opened a new issue #10925: Intermittent dropping of messages from Consume Pulsar : Apache NiFi

tausifrazi123 opened a new issue #10925:
URL: https://github.com/apache/pulsar/issues/10925


   **Describe the bug**
   We are using Apache Nifi to consume pulsar from a broker. There is an intermittent dropping of messages from the consume pulsar. The broker is sending the message but it is not getting consumed in the process. Surprisingly there is no error in Nifi. 
   Version currently which is used is 2.5.0 
   
   ![image](https://user-images.githubusercontent.com/84729850/122023213-f44f3000-cde4-11eb-8d77-c714b0dbc3c5.png)
   ![image](https://user-images.githubusercontent.com/84729850/122023264-00d38880-cde5-11eb-8864-2a4ba22214c2.png)
   
   
   **Expected behavior**
   It consume pulsar shouldnt drop any messages.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [pulsar] tausifrazi123 edited a comment on issue #10925: Intermittent dropping of messages from Consume Pulsar : Apache NiFi

Posted by GitBox <gi...@apache.org>.

tausifrazi123 edited a comment on issue #10925:
URL: https://github.com/apache/pulsar/issues/10925#issuecomment-866056333


   Apologies for the late reply . I think we have figured out the issue. The underlining controller service which is getting called is not closing the thread and trying to open a new thread connection which is not possible in "Exclusive" subscription type mentioned in the attached picture above.
   
   But how do we solve the problem of pulsarclientservice trying to create a new thread of connection when the old one is still alive.
   This is the configuration of the client service :
   ![image](https://user-images.githubusercontent.com/84729850/122949136-0d358380-d399-11eb-957c-cf01bc8c3633.png)
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [pulsar] tausifrazi123 commented on issue #10925: Intermittent dropping of messages from Consume Pulsar : Apache NiFi

Posted by GitBox <gi...@apache.org>.

tausifrazi123 commented on issue #10925:
URL: https://github.com/apache/pulsar/issues/10925#issuecomment-866056333


   Apologies for the late reply . I think we have figured out the issue. The underlining controller service which is getting called is not closing the thread and trying to open a new thread connection which is not possible in "Exclusive" subscription type mentioned in the attached picture above.
   
   But how do we solve the problem of pulsarclientservice trying to create a new thread of connection when the old one is still alive.
   This is the configuration of the client service :
   ![image](https://user-images.githubusercontent.com/84729850/122947800-107c3f80-d398-11eb-9b80-5190cd6ab34d.png)
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [pulsar] eolivelli commented on issue #10925: Intermittent dropping of messages from Consume Pulsar : Apache NiFi

Posted by GitBox <gi...@apache.org>.

eolivelli commented on issue #10925:
URL: https://github.com/apache/pulsar/issues/10925#issuecomment-861385741


   Can you please describe more your setup ?
   How do you configure NiFi ?
   do you see errors on the logs of the Pulsar client or in the broker ?
   
   It would be also great to upgrade to some recent Pulsar version, 2.5.x is pretty old (we are releasing 2.8)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [pulsar] codelipenghui commented on issue #10925: Intermittent dropping of messages from Consume Pulsar : Apache NiFi

Posted by GitBox <gi...@apache.org>.

codelipenghui commented on issue #10925:
URL: https://github.com/apache/pulsar/issues/10925#issuecomment-1058889348


   The issue had no activity for 30 days, mark with Stale label.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org