You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@camel.apache.org by Laurentiu Trica <la...@finalfolder.biz> on 2011/05/12 16:19:12 UTC

Camel FTP poller issue

Hi,

I've been using the FTP poller for some time now in production environment
and I keep having couple problems with it:

1) because I'm using an archive folder, it happens that a file cannot be
moved after being processed from, let's say /in folder to /in/archive
folder. And this, somehow, triggers the creation of another in folder with a
archive subfolder.
Just to be clear:
Initial folder structure:
/in
  /archive

The structure after the error:
/in
   archive
   in
      /archive

Seems like some operation is duplicating the folder structure.

2) It happens for a file to be processed several times
Anything goes ok, but for no reason at all, the file is processed three or
more times. I suspect it has to do with not being to move the file to the
/archive folder but I'm not sure.

3) It happens for a file to not be read entirely. Maybe it was read while
being written to the FTP account. I know that the readLock option should
work on the FTP if used with the rename strategy but this seems not to work.

Had any of you similar problems?

I'll provide some logging as soon as possible.

Thank you for your time,
Laurentiu Trica

Re: Camel FTP poller issue

Posted by Pham Ngoc Hai <pn...@yahoo.com>.
Hi,

You may want to try to use relative directory like ../in/archive

Regards,
Ngoc Hai

--- On Fri, 5/20/11, Laurentiu Trica <la...@finalfolder.biz> wrote:

> From: Laurentiu Trica <la...@finalfolder.biz>
> Subject: Re: Camel FTP poller issue
> To: users@camel.apache.org
> Date: Friday, May 20, 2011, 5:45 PM
> Hello Again,
> 
> Ngoc, your suggestion is not a solution for the problem, as
> it just prevents
> creating an empty folder - the problem is with files not
> being moved where
> they are supposed to be moved.
> 
> I have some logging which could reveal a possible bug in
> the FTP component
> when using stepwise = true (the default behaviour).
> 
> I'm using Camel 2.6 in Servicemix.
> 
> (002068)5/20/2011 12:47:11 PM - (not logged in)
> (192.168.0.194)> Connected,
> sending welcome message...
> (002068)5/20/2011 12:47:11 PM - (not logged in)
> (192.168.0.194)>
> 220-FileZilla Server version 0.9.37 beta
> (002068)5/20/2011 12:47:11 PM - (not logged in)
> (192.168.0.194)> 220-written
> by Tim Kosse (Tim.Kosse@gmx.de)
> (002068)5/20/2011 12:47:11 PM - (not logged in)
> (192.168.0.194)> 220 Please
> visit http://sourceforge.net/projects/filezilla/
> (002068)5/20/2011 12:47:11 PM - (not logged in)
> (192.168.0.194)> SSL
> connection established
> (002068)5/20/2011 12:47:11 PM - (not logged in)
> (192.168.0.194)> USER
> sftp-test
> (002068)5/20/2011 12:47:11 PM - (not logged in)
> (192.168.0.194)> 331
> Password required for sftp-test
> (002068)5/20/2011 12:47:11 PM - (not logged in)
> (192.168.0.194)> PASS ****
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 230 Logged on
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> TYPE A
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 200 Type set to A
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PBSZ 0
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 200 PBSZ=0
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PROT P
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 200 Protection
> level set to P
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 250 CWD
> successful. "/in" is current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> SYST
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 215 UNIX emulated
> by FileZilla
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PASV
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 227 Entering
> Passive Mode (192,168,0,25,222,119)
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> LIST
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 150 Connection
> accepted
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> SSL connection
> for data connection established
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 226 Transfer OK
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD /
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 250 CWD
> successful. "/" is current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 250 CWD
> successful. "/in" is current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PASV
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 227 Entering
> Passive Mode (192,168,0,25,222,120)
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> RETR
> WS_1001_-1079299972.xml
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 150 Connection
> accepted
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> SSL connection
> for data connection established
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 226 Transfer OK
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD /
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 250 CWD
> successful. "/" is current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 250 CWD
> successful. "/in" is current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PASV
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 227 Entering
> Passive Mode (192,168,0,25,222,121)
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> RETR
> WS_1001_-1254242615.xml
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 150 Connection
> accepted
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> DELE
> in/WS_1001_-1079299972.xml
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 File not
> found
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PASV
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 227 Entering
> Passive Mode (192,168,0,25,222,122)
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> NLST in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 Directory not
> found
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> PWD
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 257 "/in" is
> current directory.
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> CWD in
> (002068)5/20/2011 12:47:11 PM - sftp-test
> (192.168.0.194)> 550 CWD failed.
> "/in/in": directory not found.
> 
> As you can clearly see, Camel FTP tries to enter in the /in
> folder despite
> the fact that it is already in that folder.
> 
> How can you reproduce it:
> - put up a Service Assembly for ServiceMix composed from a
> a route as file
> producer and another route as consumer.
> - the producer puts a file every 35s on a FTP account in
> the /in folder
> - the consumer gets the file and moves it after being
> produced to /archive
> or just deletes it. If you want to move it to /archive
> folder, you'll end up
> with a structure like the one I presented in the previous
> message.
> 
> The problem we face is that the consumer is freezing just
> trying to go to a
> folder that does not exist: /in/in
> 
> Can anybody help with something?
> 
> On Thu, May 12, 2011 at 7:36 PM, Pham Ngoc Hai <pn...@yahoo.com>
> wrote:
> 
> > Hi Laurentiu Trica,
> > 1, you may want to use the exclude option, eg:
> > ?move=/in/archive&exclude=/in/archive/*
> > 2, on different systems, readLock's behavior may vary,
> the one that I find
> > works most of the time on linux is "changed". If that
> still does not work,
> > you can try to have your own
> exclusiveReadLockStrategy
> >
> > Regards,
> > Ngoc Hai
> >
> > --- On Thu, 5/12/11, Laurentiu Trica <la...@finalfolder.biz>
> > wrote:
> >
> > > From: Laurentiu Trica <la...@finalfolder.biz>
> > > Subject: Camel FTP poller issue
> > > To: "Camel" <us...@camel.apache.org>
> > > Date: Thursday, May 12, 2011, 9:19 PM
> > > Hi,
> > >
> > > I've been using the FTP poller for some time now
> in
> > > production environment
> > > and I keep having couple problems with it:
> > >
> > > 1) because I'm using an archive folder, it
> happens that a
> > > file cannot be
> > > moved after being processed from, let's say /in
> folder to
> > > /in/archive
> > > folder. And this, somehow, triggers the creation
> of another
> > > in folder with a
> > > archive subfolder.
> > > Just to be clear:
> > > Initial folder structure:
> > > /in
> > >   /archive
> > >
> > > The structure after the error:
> > > /in
> > >    archive
> > >    in
> > >       /archive
> > >
> > > Seems like some operation is duplicating the
> folder
> > > structure.
> > >
> > > 2) It happens for a file to be processed several
> times
> > > Anything goes ok, but for no reason at all, the
> file is
> > > processed three or
> > > more times. I suspect it has to do with not being
> to move
> > > the file to the
> > > /archive folder but I'm not sure.
> > >
> > > 3) It happens for a file to not be read entirely.
> Maybe it
> > > was read while
> > > being written to the FTP account. I know that the
> readLock
> > > option should
> > > work on the FTP if used with the rename strategy
> but this
> > > seems not to work.
> > >
> > > Had any of you similar problems?
> > >
> > > I'll provide some logging as soon as possible.
> > >
> > > Thank you for your time,
> > > Laurentiu Trica
> > >
> >
> 
> 
> 
> -- 
> Laurentiu Trica
> Software Developer         
>    Mobile: (+40) 722 329318
> S.C MoreDevs S.R.L.         
> Email: laurentiu.trica@finalfolder.biz
> 
> This message can contain privileged or confidential
> information and it is
> intended only for addressee. Any unauthorized disclosure is
> strictly
> prohibited.
> 

Re: Camel FTP poller issue

Posted by Laurentiu Trica <la...@finalfolder.biz>.
Hello Again,

Ngoc, your suggestion is not a solution for the problem, as it just prevents
creating an empty folder - the problem is with files not being moved where
they are supposed to be moved.

I have some logging which could reveal a possible bug in the FTP component
when using stepwise = true (the default behaviour).

I'm using Camel 2.6 in Servicemix.

(002068)5/20/2011 12:47:11 PM - (not logged in) (192.168.0.194)> Connected,
sending welcome message...
(002068)5/20/2011 12:47:11 PM - (not logged in) (192.168.0.194)>
220-FileZilla Server version 0.9.37 beta
(002068)5/20/2011 12:47:11 PM - (not logged in) (192.168.0.194)> 220-written
by Tim Kosse (Tim.Kosse@gmx.de)
(002068)5/20/2011 12:47:11 PM - (not logged in) (192.168.0.194)> 220 Please
visit http://sourceforge.net/projects/filezilla/
(002068)5/20/2011 12:47:11 PM - (not logged in) (192.168.0.194)> SSL
connection established
(002068)5/20/2011 12:47:11 PM - (not logged in) (192.168.0.194)> USER
sftp-test
(002068)5/20/2011 12:47:11 PM - (not logged in) (192.168.0.194)> 331
Password required for sftp-test
(002068)5/20/2011 12:47:11 PM - (not logged in) (192.168.0.194)> PASS ****
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 230 Logged on
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> TYPE A
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 200 Type set to A
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PBSZ 0
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 200 PBSZ=0
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PROT P
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 200 Protection
level set to P
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 250 CWD
successful. "/in" is current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> SYST
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 215 UNIX emulated
by FileZilla
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PASV
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 227 Entering
Passive Mode (192,168,0,25,222,119)
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> LIST
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 150 Connection
accepted
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> SSL connection
for data connection established
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 226 Transfer OK
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD /
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 250 CWD
successful. "/" is current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 250 CWD
successful. "/in" is current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PASV
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 227 Entering
Passive Mode (192,168,0,25,222,120)
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> RETR
WS_1001_-1079299972.xml
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 150 Connection
accepted
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> SSL connection
for data connection established
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 226 Transfer OK
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD /
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 250 CWD
successful. "/" is current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 250 CWD
successful. "/in" is current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PASV
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 227 Entering
Passive Mode (192,168,0,25,222,121)
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> RETR
WS_1001_-1254242615.xml
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 150 Connection
accepted
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> DELE
in/WS_1001_-1079299972.xml
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 File not
found
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PASV
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 227 Entering
Passive Mode (192,168,0,25,222,122)
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> NLST in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 Directory not
found
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> PWD
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 257 "/in" is
current directory.
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> CWD in
(002068)5/20/2011 12:47:11 PM - sftp-test (192.168.0.194)> 550 CWD failed.
"/in/in": directory not found.

As you can clearly see, Camel FTP tries to enter in the /in folder despite
the fact that it is already in that folder.

How can you reproduce it:
- put up a Service Assembly for ServiceMix composed from a a route as file
producer and another route as consumer.
- the producer puts a file every 35s on a FTP account in the /in folder
- the consumer gets the file and moves it after being produced to /archive
or just deletes it. If you want to move it to /archive folder, you'll end up
with a structure like the one I presented in the previous message.

The problem we face is that the consumer is freezing just trying to go to a
folder that does not exist: /in/in

Can anybody help with something?

On Thu, May 12, 2011 at 7:36 PM, Pham Ngoc Hai <pn...@yahoo.com> wrote:

> Hi Laurentiu Trica,
> 1, you may want to use the exclude option, eg:
> ?move=/in/archive&exclude=/in/archive/*
> 2, on different systems, readLock's behavior may vary, the one that I find
> works most of the time on linux is "changed". If that still does not work,
> you can try to have your own exclusiveReadLockStrategy
>
> Regards,
> Ngoc Hai
>
> --- On Thu, 5/12/11, Laurentiu Trica <la...@finalfolder.biz>
> wrote:
>
> > From: Laurentiu Trica <la...@finalfolder.biz>
> > Subject: Camel FTP poller issue
> > To: "Camel" <us...@camel.apache.org>
> > Date: Thursday, May 12, 2011, 9:19 PM
> > Hi,
> >
> > I've been using the FTP poller for some time now in
> > production environment
> > and I keep having couple problems with it:
> >
> > 1) because I'm using an archive folder, it happens that a
> > file cannot be
> > moved after being processed from, let's say /in folder to
> > /in/archive
> > folder. And this, somehow, triggers the creation of another
> > in folder with a
> > archive subfolder.
> > Just to be clear:
> > Initial folder structure:
> > /in
> >   /archive
> >
> > The structure after the error:
> > /in
> >    archive
> >    in
> >       /archive
> >
> > Seems like some operation is duplicating the folder
> > structure.
> >
> > 2) It happens for a file to be processed several times
> > Anything goes ok, but for no reason at all, the file is
> > processed three or
> > more times. I suspect it has to do with not being to move
> > the file to the
> > /archive folder but I'm not sure.
> >
> > 3) It happens for a file to not be read entirely. Maybe it
> > was read while
> > being written to the FTP account. I know that the readLock
> > option should
> > work on the FTP if used with the rename strategy but this
> > seems not to work.
> >
> > Had any of you similar problems?
> >
> > I'll provide some logging as soon as possible.
> >
> > Thank you for your time,
> > Laurentiu Trica
> >
>



-- 
Laurentiu Trica
Software Developer             Mobile: (+40) 722 329318
S.C MoreDevs S.R.L.          Email: laurentiu.trica@finalfolder.biz

This message can contain privileged or confidential information and it is
intended only for addressee. Any unauthorized disclosure is strictly
prohibited.

Re: Camel FTP poller issue

Posted by Pham Ngoc Hai <pn...@yahoo.com>.
Hi Laurentiu Trica,
1, you may want to use the exclude option, eg: ?move=/in/archive&exclude=/in/archive/*
2, on different systems, readLock's behavior may vary, the one that I find works most of the time on linux is "changed". If that still does not work, you can try to have your own exclusiveReadLockStrategy

Regards,
Ngoc Hai

--- On Thu, 5/12/11, Laurentiu Trica <la...@finalfolder.biz> wrote:

> From: Laurentiu Trica <la...@finalfolder.biz>
> Subject: Camel FTP poller issue
> To: "Camel" <us...@camel.apache.org>
> Date: Thursday, May 12, 2011, 9:19 PM
> Hi,
> 
> I've been using the FTP poller for some time now in
> production environment
> and I keep having couple problems with it:
> 
> 1) because I'm using an archive folder, it happens that a
> file cannot be
> moved after being processed from, let's say /in folder to
> /in/archive
> folder. And this, somehow, triggers the creation of another
> in folder with a
> archive subfolder.
> Just to be clear:
> Initial folder structure:
> /in
>   /archive
> 
> The structure after the error:
> /in
>    archive
>    in
>       /archive
> 
> Seems like some operation is duplicating the folder
> structure.
> 
> 2) It happens for a file to be processed several times
> Anything goes ok, but for no reason at all, the file is
> processed three or
> more times. I suspect it has to do with not being to move
> the file to the
> /archive folder but I'm not sure.
> 
> 3) It happens for a file to not be read entirely. Maybe it
> was read while
> being written to the FTP account. I know that the readLock
> option should
> work on the FTP if used with the rename strategy but this
> seems not to work.
> 
> Had any of you similar problems?
> 
> I'll provide some logging as soon as possible.
> 
> Thank you for your time,
> Laurentiu Trica
>