You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@camel.apache.org by chandresh pancholi <ch...@gmail.com> on 2017/08/16 09:16:30 UTC
Camel FTP polling is very slow
Hi,
I am polling files from FTP with below attributes.
ftpBuilder.append("://")
.append(username + "@"+ url)
.append(remotePath)
.append("?password=")
.append(password)
.append("&delay=")
.append(appConfig.getFtpDelay())
.append("&passiveMode=")
.append("true")
.append("&move=")
.append("done-")
.append(getIp())
.append("&disconnectOnBatchComplete=")
.append("true")
.append("&idempotent=")
.append("true")
.append("&maxMessagesPerPoll=5")
.append("&readLock=idempotent-changed")
.append("&readLockCheckInterval=1000") ;
Polling from FTP become really slow. Please check if I am doing something
wrong.
--
Chandresh Pancholi
Senior Software Engineer
Flipkart.com
Email-id:chandresh.pancholi@flipkart.com
Contact:08951803660
Re: Camel FTP polling is very slow
Posted by chandresh pancholi <ch...@gmail.com>.
It takes an hour to poll files from FTP. When I restart the system It
process very fast.
On Wed, Aug 16, 2017 at 2:56 PM, souciance <souciance.eqdam.rashti@gmail.com
> wrote:
> What do you mean slow? Slow compared to what?
>
> On Wed, Aug 16, 2017 at 11:16 AM, chandresh pancholi [via Camel] <
> ml+s465427n5810828h31@n5.nabble.com> wrote:
>
> > Hi,
> >
> > I am polling files from FTP with below attributes.
> >
> > ftpBuilder.append("://")
> > .append(username + "@"+ url)
> > .append(remotePath)
> > .append("?password=")
> > .append(password)
> > .append("&delay=")
> > .append(appConfig.getFtpDelay())
> > .append("&passiveMode=")
> > .append("true")
> > .append("&move=")
> > .append("done-")
> > .append(getIp())
> > .append("&disconnectOnBatchComplete=")
> > .append("true")
> > .append("&idempotent=")
> > .append("true")
> > .append("&maxMessagesPerPoll=5")
> > .append("&readLock=idempotent-changed")
> > .append("&readLockCheckInterval=1000") ;
> >
> > Polling from FTP become really slow. Please check if I am doing something
> > wrong.
> > --
> > Chandresh Pancholi
> > Senior Software Engineer
> > Flipkart.com
> > Email-id:[hidden email]
> > <http:///user/SendEmail.jtp?type=node&node=5810828&i=0>
> > Contact:08951803660
> >
> >
> > ------------------------------
> > If you reply to this email, your message will be added to the discussion
> > below:
> > http://camel.465427.n5.nabble.com/Camel-FTP-polling-is-very-
> > slow-tp5810828.html
> > To start a new topic under Camel - Users, email ml+s465427n465428h31@n5.
> > nabble.com
> > To unsubscribe from Camel - Users, click here
> > <http://camel.465427.n5.nabble.com/template/NamlServlet.jtp?macro=
> unsubscribe_by_code&node=465428&code=c291Y2lhbmNlLmVxZGFtLnJhc2h0aU
> BnbWFpbC5jb218NDY1NDI4fDE1MzI5MTE2NTY=>
> > .
> > NAML
> > <http://camel.465427.n5.nabble.com/template/NamlServlet.jtp?macro=macro_
> viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.
> BasicNamespace-nabble.view.web.template.NabbleNamespace-
> nabble.view.web.template.NodeNamespace&breadcrumbs=
> notify_subscribers%21nabble%3Aemail.naml-instant_emails%
> 21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
> >
>
>
>
>
> --
> View this message in context: http://camel.465427.n5.nabble.
> com/Camel-FTP-polling-is-very-slow-tp5810828p5810829.html
> Sent from the Camel - Users mailing list archive at Nabble.com.
--
Chandresh Pancholi
Senior Software Engineer
Flipkart.com
Email-id:chandresh.pancholi@flipkart.com
Contact:08951803660
Re: Camel FTP polling is very slow
Posted by souciance <so...@gmail.com>.
What do you mean slow? Slow compared to what?
On Wed, Aug 16, 2017 at 11:16 AM, chandresh pancholi [via Camel] <
ml+s465427n5810828h31@n5.nabble.com> wrote:
> Hi,
>
> I am polling files from FTP with below attributes.
>
> ftpBuilder.append("://")
> .append(username + "@"+ url)
> .append(remotePath)
> .append("?password=")
> .append(password)
> .append("&delay=")
> .append(appConfig.getFtpDelay())
> .append("&passiveMode=")
> .append("true")
> .append("&move=")
> .append("done-")
> .append(getIp())
> .append("&disconnectOnBatchComplete=")
> .append("true")
> .append("&idempotent=")
> .append("true")
> .append("&maxMessagesPerPoll=5")
> .append("&readLock=idempotent-changed")
> .append("&readLockCheckInterval=1000") ;
>
> Polling from FTP become really slow. Please check if I am doing something
> wrong.
> --
> Chandresh Pancholi
> Senior Software Engineer
> Flipkart.com
> Email-id:[hidden email]
> <http:///user/SendEmail.jtp?type=node&node=5810828&i=0>
> Contact:08951803660
>
>
> ------------------------------
> If you reply to this email, your message will be added to the discussion
> below:
> http://camel.465427.n5.nabble.com/Camel-FTP-polling-is-very-
> slow-tp5810828.html
> To start a new topic under Camel - Users, email ml+s465427n465428h31@n5.
> nabble.com
> To unsubscribe from Camel - Users, click here
> <http://camel.465427.n5.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=465428&code=c291Y2lhbmNlLmVxZGFtLnJhc2h0aUBnbWFpbC5jb218NDY1NDI4fDE1MzI5MTE2NTY=>
> .
> NAML
> <http://camel.465427.n5.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>
--
View this message in context: http://camel.465427.n5.nabble.com/Camel-FTP-polling-is-very-slow-tp5810828p5810829.html
Sent from the Camel - Users mailing list archive at Nabble.com.
AW: Camel FTP polling is very slow
Posted by Burkard Stephan <St...@visana.ch>.
Hi
I think "readLockCheckInterval=1000" means that the process waits 1 second for EVERY FILE to check the read-lock. So you would get a throughput of less than 1 file per second. Do you mean that with slow?
Regards
Stephan
-----Ursprüngliche Nachricht-----
Von: chandresh pancholi [mailto:chandreshpancholi007@gmail.com]
Gesendet: Mittwoch, 16. August 2017 11:17
An: users@camel.apache.org
Betreff: Camel FTP polling is very slow
Hi,
I am polling files from FTP with below attributes.
ftpBuilder.append("://")
.append(username + "@"+ url)
.append(remotePath)
.append("?password=")
.append(password)
.append("&delay=")
.append(appConfig.getFtpDelay())
.append("&passiveMode=")
.append("true")
.append("&move=")
.append("done-")
.append(getIp())
.append("&disconnectOnBatchComplete=")
.append("true")
.append("&idempotent=")
.append("true")
.append("&maxMessagesPerPoll=5")
.append("&readLock=idempotent-changed")
.append("&readLockCheckInterval=1000") ;
Polling from FTP become really slow. Please check if I am doing something wrong.
--
Chandresh Pancholi
Senior Software Engineer
Flipkart.com
Email-id:chandresh.pancholi@flipkart.com
Contact:08951803660