You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@camel.apache.org by Sorin Silaghi <so...@gmail.com> on 2011/09/01 11:30:14 UTC
Re: FTP2 Component fails to process multiple files at once
Hi all,
Is there an issue created for this ? I tried it also and it
doesn't work. Should I take this to the ServiceMix mailing list ?
thanks,
Sorin.
On Thu, May 26, 2011 at 2:23 PM, Laurentiu Trica <
laurentiu.trica@finalfolder.biz> wrote:
> Hi Claus,
>
> I tried what you said with the synchronous=true option but it doesn't seem
> to work either.
> I put that option to all the nmr routes in the test project but it's the
> same result.
> Is there anything I missed?
>
> This is what I modified:
> camel-context.xml from the endpoint
> <camelContext xmlns="http://camel.apache.org/schema/spring"
> id="camelContext">
> <route>
> <from uri="ftps://
>
> sftp-test@192.168.0.25:990/in?password=test&passiveMode=true&isImplicit=true&move=.archive&moveFailed=.error&delay=30000
> "
> />
> <to
> uri="nmr:{http://www.edigrid.de
> }ftptest-endpoint:ORDERS-IN?synchronous=true"
> />
> </route>
>
> <route>
> <from
> uri="nmr:{http://www.edigrid.de
> }ftptest-endpoint:ORDERS-OUT?synchronous=true"
> />
> <to uri="file://data/OUT" />
> </route>
>
> </camelContext>
>
> camel-context.xml from the camel Service Unit
> <camelContext xmlns="http://camel.apache.org/schema/spring"
> id="camelContext">
>
> <route id="ftp-test">
> <from
> uri="nmr:{http://www.edigrid.de
> }ftptest-endpoint:ORDERS-IN?synchronous=true"
> />
>
> <to
> uri="nmr:{http://www.edigrid.de
> }ftptest-endpoint:ORDERS-OUT?synchronous=true"
> />
> </route>
>
>
> </camelContext>
>
> Is this ok?
>
> On Thu, May 26, 2011 at 3:17 AM, Claus Ibsen <cl...@gmail.com>
> wrote:
>
> > Try setting the nmr to synchronous so the ftp consumer does its on
> > completion in the same thread context
> >
> > On Wednesday, May 25, 2011, Laurentiu Trica
> > <la...@finalfolder.biz> wrote:
> > > Hello,
> > >
> > > I attached the test application so you can run immediately. (download
> the
> > > archive from here:
> > >
> >
> https://issues.apache.org/jira/secure/attachment/12480407/test-camel-ftp.zip
> > > )
> > > It's attached to the created issue:
> > > https://issues.apache.org/jira/browse/CAMEL-4010
> > >
> > > It seems that the problem only appears when using camel-nmr. We use
> > separate
> > > Service Units to declare Local endpoints and Live endpoints for easier
> > > deployment.
> > > When using Camel NMR you can see the problem appears.
> > > Please install camel-nmr in servicemix before deploying the test
> > > application.
> > >
> > > Please tell me if you can reproduce the problem.
> > >
> > > Best regards,
> > > Laurentiu
> > >
> > > On Tue, May 24, 2011 at 7:19 PM, Taariq San <ta...@gmail.com> wrote:
> > >
> > >> Hmmm, I tried to simulate it too but didn't manage in the short time,
> > maybe
> > >> somebody who knows the component well figures it out or explains the
> > >> behavior.
> > >>
> > >> The test doesn't need a public server, and you can change the endpoint
> > to
> > >> anything you like.
> > >> It just makes it easier to see if there's something in the
> configuration
> > or
> > >> to simulate the issue.
> > >> You can attach it to the ticket you created since it's there already.
> > >>
> > >> Taariq
> > >>
> > >> On 24 May 2011, at 5:18 PM, Laurentiu Trica <
> > >> laurentiu.trica@finalfolder.biz> wrote:
> > >>
> > >> > Hello,
> > >> >
> > >> > I added a bug on JIRA:
> > https://issues.apache.org/jira/browse/CAMEL-4010
> > >> >
> > >> > I think the problem only occurs when the path to FTP includes a
> folder
> > -
> > >> > this means your files are not on the root of the FTP account.
> > >> >
> > >> > On Tue, May 24, 2011 at 1:32 PM, Laurentiu Trica <
> > >> > laurentiu.trica@finalfolder.biz> wrote:
> > >> >
> > >> >> Hi,
> > >> >>
> > >> >> The problem is not that concurrent FTP components are accessing the
> > same
> > >> >> files.
> > >> >> The problem is that the one FTP component which handles the files
> > from
> > >> the
> > >> >> FTP account is not doing it in separate connections.
> > >> >> And this is a bad thing to do in a very delicate folder based
> > >> environment
> > >> >> like a FTP account.
> > >> >>
> > >> >> As you can see from the FTP server logs, there is only one FTP
> > consumer
> > >> >> connection which handles all the files it finds. The problem is
> that
> > >> >> handling the files concurrently on a single FTP connection makes
> the
> > >> output
> > >> >> unpredictable.
> > >> >>
> > >> >> I can send my test. Where should I put it? What endpoints should I
> > use?
> > >> Do
> > >> >> you have a public access ftp account to test it?
> > >> >>
> > >> >>
> > >> >> On Mon, May 23, 2011 at 7:13 PM, Taariq Levack <ta...@gmail.com>
> > >> wrote:
> > >> >>
> > >> >>> Hi
> > >> >>>
> > >> >>> I don't know if it's a bug or not, but I would expect it to work.
> > >> >>> There's an old ticket to make FTP threadsafe[1], but I only see a
> > >> >>> concurrent
> > >> >>> producer test.
> > >> >>>
> > >> >>> Can you post your test?
> > >> >>>
> > >> >>> [1]https://issues.apache.org/jira/browse/CAMEL-1641
> > >> >>>
> > >> >>>
> > >> >>> On Mon, May 23, 2011 at 11:12 AM, Laurentiu Trica <
> > >> >>> laurentiu.trica@finalfolder.biz> wrote:
> > >> >>>
> > >> >>>> Hello again,
> > >> >>>>
> > >> >>>> Anyone had this issue before? Is it a bug in Camel FTP or it's
> just
> > >> the
> > >> >>> way
> > >> >>>> it is supposed to work?
> > >> >>>>
> > >> >>>> On Fri, May 20, 2011 at 6:00 PM, Laurentiu Trica <
> > >> >>>> laurentiu.trica@finalfolder.biz> wrote:
> > >> >>>>
> > >> >>>>> Hello,
> > >> >>>>>
> > >> >>>>> I've been struggling to solve a situation in which a FTP poller
> > was
> > >> >>> not
> > >> >>>>> working from time to time.
> > >> >>>>> I've got to the point where I think I know what the problem is.
> > >> >>>>>
> > >> >>>>> I'm using Camel 2.6 in servicemix.
> > >> >>>>>
> > >> >>>>> *I've put up a test for this:*
> > >> >>>>> - three FTP file producers at different repeating period of
> time:
> > >> 35s,
> > >> >>>>> 5min, 1h. Note that when starting servicemix they all put the
> > first
> > >> >>> file
> > >> >>>> at
> > >
> >
> > --
> > Claus Ibsen
> > -----------------
> > FuseSource
> > Email: cibsen@fusesource.com
> > Web: http://fusesource.com
> > CamelOne 2011: http://fusesource.com/camelone2011/
> > Twitter: davsclaus, fusenews
> > Blog: http://davsclaus.blogspot.com/
> > Author of Camel in Action: http://www.manning.com/ibsen/
> >
>
>
>
> --
> Laurentiu Trica
> Software Developer Mobile: (+40) 722 329318
> S.C MoreDevs S.R.L. Email: laurentiu.trica@finalfolder.biz
>
> This message can contain privileged or confidential information and it is
> intended only for addressee. Any unauthorized disclosure is strictly
> prohibited.
>