You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@camel.apache.org by "Laurentiu Trica (JIRA)" <ji...@apache.org> on 2011/05/24 17:18:47 UTC
[jira] [Created] (CAMEL-4010) Camel FTP component fails to process
multiple files at once from a specified folder
Camel FTP component fails to process multiple files at once from a specified folder
-----------------------------------------------------------------------------------
Key: CAMEL-4010
URL: https://issues.apache.org/jira/browse/CAMEL-4010
Project: Camel
Issue Type: Bug
Components: camel-ftp
Affects Versions: 2.6.0
Environment: Camel 2.6.0-fuse-0.1-0.9
Running in ServiceMix
Java 1.6
Reporter: Laurentiu Trica
Priority: Critical
Camel FTP component fails to process multiple files at once from a specified folder (let's assume the folder is /in).
When the consumer connects to a ftp account and finds a list of, let's say, 3 files, it will try to retrieve them in parallel but this is not handled properly.
As you can see from the below FTP server log, this is what Camel FTP does:
- it changes the current directory to /in
- retrieves the file
- it changes the current directory to /
- the second (probably) thread changes the directory to /in
- retreives the second file
- the first (probably) thread sends a delete command but it sends it as if it were in the root folder but it is actually in the /in folder
- the FTP gives an error that the file doesn't exist
- somehow the FTP Component blocks itself on the first file...
See my comments in the following log starting with *****
(002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 257 "/" is current directory.
(002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> CWD in
(002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 250 CWD successful. "/in" is current directory.
(002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PASV
(002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 227 Entering Passive Mode (192,168,0,25,228,206)
(002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> RETR WS_1001_1.xml
(002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 150 Connection accepted
(002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> SSL connection for data connection established
(002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 226 Transfer OK
(002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> CWD /
(002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 250 CWD successful. "/" is current directory.
(002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PWD
(002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 257 "/" is current directory.
(002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> CWD in
(002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 250 CWD successful. "/in" is current directory.
(002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PASV
(002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 227 Entering Passive Mode (192,168,0,25,228,207)
(002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> RETR WS_1001_2.xml
(002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 150 Connection accepted
(002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> DELE in/WS_1001_1.xml ***** The location is already /in, should be DELE WS_1001_1.xml
(002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 550 File not found
(002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PASV
(002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 227 Entering Passive Mode (192,168,0,25,228,208)
(002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> NLST in
(002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 550 Directory not found
(002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PWD
(002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 257 "/in" is current directory.
(002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> CWD in ***** Current directory is already /in
(002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 550 CWD failed. "/in/in": directory not found.
For the whole FTP server logs go here: http://pastie.org/private/kknnkxpbyzqmai7gsm8z5g
For the Servicemix/Camel(Trace) log: http://pastie.org/private/eulookxiepan3nkjyu41a
A workaround that seems to work is to use the maxMessagesPerPoll=1 option.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CAMEL-4010) Camel FTP component fails to process
multiple files at once from a specified folder
Posted by "Claus Ibsen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CAMEL-4010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Claus Ibsen updated CAMEL-4010:
-------------------------------
Priority: Major (was: Critical)
Cannot be critical as there is a workaround
> Camel FTP component fails to process multiple files at once from a specified folder
> -----------------------------------------------------------------------------------
>
> Key: CAMEL-4010
> URL: https://issues.apache.org/jira/browse/CAMEL-4010
> Project: Camel
> Issue Type: Bug
> Components: camel-ftp
> Affects Versions: 2.6.0
> Environment: Camel 2.6.0-fuse-0.1-0.9
> Running in ServiceMix
> Java 1.6
> Reporter: Laurentiu Trica
> Fix For: 2.9.0
>
> Attachments: test-camel-ftp.zip
>
>
> Camel FTP component fails to process multiple files at once from a specified folder (let's assume the folder is /in).
> When the consumer connects to a ftp account and finds a list of, let's say, 3 files, it will try to retrieve them in parallel but this is not handled properly.
> As you can see from the below FTP server log, this is what Camel FTP does:
> - it changes the current directory to /in
> - retrieves the file
> - it changes the current directory to /
> - the second (probably) thread changes the directory to /in
> - retreives the second file
> - the first (probably) thread sends a delete command but it sends it as if it were in the root folder but it is actually in the /in folder
> - the FTP gives an error that the file doesn't exist
> - somehow the FTP Component blocks itself on the first file...
> See my comments in the following log starting with *****
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 257 "/" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> CWD in
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 250 CWD successful. "/in" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PASV
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 227 Entering Passive Mode (192,168,0,25,228,206)
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> RETR WS_1001_1.xml
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 150 Connection accepted
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> SSL connection for data connection established
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 226 Transfer OK
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> CWD /
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 250 CWD successful. "/" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PWD
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 257 "/" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> CWD in
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 250 CWD successful. "/in" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PASV
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 227 Entering Passive Mode (192,168,0,25,228,207)
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> RETR WS_1001_2.xml
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 150 Connection accepted
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> DELE in/WS_1001_1.xml ***** The location is already /in, should be DELE WS_1001_1.xml
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 550 File not found
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PASV
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 227 Entering Passive Mode (192,168,0,25,228,208)
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> NLST in
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 550 Directory not found
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PWD
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 257 "/in" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> CWD in ***** Current directory is already /in
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 550 CWD failed. "/in/in": directory not found.
> For the whole FTP server logs go here: http://pastie.org/private/kknnkxpbyzqmai7gsm8z5g
> For the Servicemix/Camel(Trace) log: http://pastie.org/private/eulookxiepan3nkjyu41a
> A workaround that seems to work is to use the maxMessagesPerPoll=1 option.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (CAMEL-4010) Camel FTP component fails to process
multiple files at once from a specified folder
Posted by "Claus Ibsen (Assigned) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CAMEL-4010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Claus Ibsen reassigned CAMEL-4010:
----------------------------------
Assignee: Claus Ibsen
> Camel FTP component fails to process multiple files at once from a specified folder
> -----------------------------------------------------------------------------------
>
> Key: CAMEL-4010
> URL: https://issues.apache.org/jira/browse/CAMEL-4010
> Project: Camel
> Issue Type: Bug
> Components: camel-ftp
> Affects Versions: 2.6.0
> Environment: Camel 2.6.0-fuse-0.1-0.9
> Running in ServiceMix
> Java 1.6
> Reporter: Laurentiu Trica
> Assignee: Claus Ibsen
> Fix For: 2.9.0
>
> Attachments: test-camel-ftp.zip
>
>
> Camel FTP component fails to process multiple files at once from a specified folder (let's assume the folder is /in).
> When the consumer connects to a ftp account and finds a list of, let's say, 3 files, it will try to retrieve them in parallel but this is not handled properly.
> As you can see from the below FTP server log, this is what Camel FTP does:
> - it changes the current directory to /in
> - retrieves the file
> - it changes the current directory to /
> - the second (probably) thread changes the directory to /in
> - retreives the second file
> - the first (probably) thread sends a delete command but it sends it as if it were in the root folder but it is actually in the /in folder
> - the FTP gives an error that the file doesn't exist
> - somehow the FTP Component blocks itself on the first file...
> See my comments in the following log starting with *****
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 257 "/" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> CWD in
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 250 CWD successful. "/in" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PASV
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 227 Entering Passive Mode (192,168,0,25,228,206)
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> RETR WS_1001_1.xml
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 150 Connection accepted
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> SSL connection for data connection established
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 226 Transfer OK
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> CWD /
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 250 CWD successful. "/" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PWD
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 257 "/" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> CWD in
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 250 CWD successful. "/in" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PASV
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 227 Entering Passive Mode (192,168,0,25,228,207)
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> RETR WS_1001_2.xml
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 150 Connection accepted
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> DELE in/WS_1001_1.xml ***** The location is already /in, should be DELE WS_1001_1.xml
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 550 File not found
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PASV
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 227 Entering Passive Mode (192,168,0,25,228,208)
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> NLST in
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 550 Directory not found
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PWD
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 257 "/in" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> CWD in ***** Current directory is already /in
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 550 CWD failed. "/in/in": directory not found.
> For the whole FTP server logs go here: http://pastie.org/private/kknnkxpbyzqmai7gsm8z5g
> For the Servicemix/Camel(Trace) log: http://pastie.org/private/eulookxiepan3nkjyu41a
> A workaround that seems to work is to use the maxMessagesPerPoll=1 option.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CAMEL-4010) Camel FTP component fails to
process multiple files at once from a specified folder
Posted by "Claus Ibsen (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CAMEL-4010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13144680#comment-13144680 ]
Claus Ibsen commented on CAMEL-4010:
------------------------------------
The ftp consumer is not thread safe, we should possible force the ftp consumer to run synchronously.
> Camel FTP component fails to process multiple files at once from a specified folder
> -----------------------------------------------------------------------------------
>
> Key: CAMEL-4010
> URL: https://issues.apache.org/jira/browse/CAMEL-4010
> Project: Camel
> Issue Type: Bug
> Components: camel-ftp
> Affects Versions: 2.6.0
> Environment: Camel 2.6.0-fuse-0.1-0.9
> Running in ServiceMix
> Java 1.6
> Reporter: Laurentiu Trica
> Fix For: 2.9.0
>
> Attachments: test-camel-ftp.zip
>
>
> Camel FTP component fails to process multiple files at once from a specified folder (let's assume the folder is /in).
> When the consumer connects to a ftp account and finds a list of, let's say, 3 files, it will try to retrieve them in parallel but this is not handled properly.
> As you can see from the below FTP server log, this is what Camel FTP does:
> - it changes the current directory to /in
> - retrieves the file
> - it changes the current directory to /
> - the second (probably) thread changes the directory to /in
> - retreives the second file
> - the first (probably) thread sends a delete command but it sends it as if it were in the root folder but it is actually in the /in folder
> - the FTP gives an error that the file doesn't exist
> - somehow the FTP Component blocks itself on the first file...
> See my comments in the following log starting with *****
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 257 "/" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> CWD in
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 250 CWD successful. "/in" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PASV
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 227 Entering Passive Mode (192,168,0,25,228,206)
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> RETR WS_1001_1.xml
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 150 Connection accepted
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> SSL connection for data connection established
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 226 Transfer OK
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> CWD /
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 250 CWD successful. "/" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PWD
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 257 "/" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> CWD in
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 250 CWD successful. "/in" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PASV
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 227 Entering Passive Mode (192,168,0,25,228,207)
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> RETR WS_1001_2.xml
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 150 Connection accepted
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> DELE in/WS_1001_1.xml ***** The location is already /in, should be DELE WS_1001_1.xml
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 550 File not found
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PASV
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 227 Entering Passive Mode (192,168,0,25,228,208)
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> NLST in
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 550 Directory not found
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PWD
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 257 "/in" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> CWD in ***** Current directory is already /in
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 550 CWD failed. "/in/in": directory not found.
> For the whole FTP server logs go here: http://pastie.org/private/kknnkxpbyzqmai7gsm8z5g
> For the Servicemix/Camel(Trace) log: http://pastie.org/private/eulookxiepan3nkjyu41a
> A workaround that seems to work is to use the maxMessagesPerPoll=1 option.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CAMEL-4010) Camel FTP component fails to process
multiple files at once from a specified folder
Posted by "Claus Ibsen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CAMEL-4010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Claus Ibsen updated CAMEL-4010:
-------------------------------
Fix Version/s: 2.9.0
> Camel FTP component fails to process multiple files at once from a specified folder
> -----------------------------------------------------------------------------------
>
> Key: CAMEL-4010
> URL: https://issues.apache.org/jira/browse/CAMEL-4010
> Project: Camel
> Issue Type: Bug
> Components: camel-ftp
> Affects Versions: 2.6.0
> Environment: Camel 2.6.0-fuse-0.1-0.9
> Running in ServiceMix
> Java 1.6
> Reporter: Laurentiu Trica
> Fix For: 2.9.0
>
> Attachments: test-camel-ftp.zip
>
>
> Camel FTP component fails to process multiple files at once from a specified folder (let's assume the folder is /in).
> When the consumer connects to a ftp account and finds a list of, let's say, 3 files, it will try to retrieve them in parallel but this is not handled properly.
> As you can see from the below FTP server log, this is what Camel FTP does:
> - it changes the current directory to /in
> - retrieves the file
> - it changes the current directory to /
> - the second (probably) thread changes the directory to /in
> - retreives the second file
> - the first (probably) thread sends a delete command but it sends it as if it were in the root folder but it is actually in the /in folder
> - the FTP gives an error that the file doesn't exist
> - somehow the FTP Component blocks itself on the first file...
> See my comments in the following log starting with *****
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 257 "/" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> CWD in
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 250 CWD successful. "/in" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PASV
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 227 Entering Passive Mode (192,168,0,25,228,206)
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> RETR WS_1001_1.xml
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 150 Connection accepted
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> SSL connection for data connection established
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 226 Transfer OK
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> CWD /
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 250 CWD successful. "/" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PWD
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 257 "/" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> CWD in
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 250 CWD successful. "/in" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PASV
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 227 Entering Passive Mode (192,168,0,25,228,207)
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> RETR WS_1001_2.xml
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 150 Connection accepted
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> DELE in/WS_1001_1.xml ***** The location is already /in, should be DELE WS_1001_1.xml
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 550 File not found
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PASV
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 227 Entering Passive Mode (192,168,0,25,228,208)
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> NLST in
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 550 Directory not found
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PWD
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 257 "/in" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> CWD in ***** Current directory is already /in
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 550 CWD failed. "/in/in": directory not found.
> For the whole FTP server logs go here: http://pastie.org/private/kknnkxpbyzqmai7gsm8z5g
> For the Servicemix/Camel(Trace) log: http://pastie.org/private/eulookxiepan3nkjyu41a
> A workaround that seems to work is to use the maxMessagesPerPoll=1 option.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (CAMEL-4010) Camel FTP component fails to process
multiple files at once from a specified folder
Posted by "Claus Ibsen (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CAMEL-4010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Claus Ibsen resolved CAMEL-4010.
--------------------------------
Resolution: Fixed
Fix Version/s: 2.8.3
> Camel FTP component fails to process multiple files at once from a specified folder
> -----------------------------------------------------------------------------------
>
> Key: CAMEL-4010
> URL: https://issues.apache.org/jira/browse/CAMEL-4010
> Project: Camel
> Issue Type: Bug
> Components: camel-ftp
> Affects Versions: 2.6.0
> Environment: Camel 2.6.0-fuse-0.1-0.9
> Running in ServiceMix
> Java 1.6
> Reporter: Laurentiu Trica
> Assignee: Claus Ibsen
> Fix For: 2.8.3, 2.9.0
>
> Attachments: test-camel-ftp.zip
>
>
> Camel FTP component fails to process multiple files at once from a specified folder (let's assume the folder is /in).
> When the consumer connects to a ftp account and finds a list of, let's say, 3 files, it will try to retrieve them in parallel but this is not handled properly.
> As you can see from the below FTP server log, this is what Camel FTP does:
> - it changes the current directory to /in
> - retrieves the file
> - it changes the current directory to /
> - the second (probably) thread changes the directory to /in
> - retreives the second file
> - the first (probably) thread sends a delete command but it sends it as if it were in the root folder but it is actually in the /in folder
> - the FTP gives an error that the file doesn't exist
> - somehow the FTP Component blocks itself on the first file...
> See my comments in the following log starting with *****
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 257 "/" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> CWD in
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 250 CWD successful. "/in" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PASV
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 227 Entering Passive Mode (192,168,0,25,228,206)
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> RETR WS_1001_1.xml
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 150 Connection accepted
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> SSL connection for data connection established
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 226 Transfer OK
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> CWD /
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 250 CWD successful. "/" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PWD
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 257 "/" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> CWD in
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 250 CWD successful. "/in" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PASV
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 227 Entering Passive Mode (192,168,0,25,228,207)
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> RETR WS_1001_2.xml
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 150 Connection accepted
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> DELE in/WS_1001_1.xml ***** The location is already /in, should be DELE WS_1001_1.xml
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 550 File not found
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PASV
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 227 Entering Passive Mode (192,168,0,25,228,208)
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> NLST in
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 550 Directory not found
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PWD
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 257 "/in" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> CWD in ***** Current directory is already /in
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 550 CWD failed. "/in/in": directory not found.
> For the whole FTP server logs go here: http://pastie.org/private/kknnkxpbyzqmai7gsm8z5g
> For the Servicemix/Camel(Trace) log: http://pastie.org/private/eulookxiepan3nkjyu41a
> A workaround that seems to work is to use the maxMessagesPerPoll=1 option.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CAMEL-4010) Camel FTP component fails to process
multiple files at once from a specified folder
Posted by "Laurentiu Trica (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CAMEL-4010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Laurentiu Trica updated CAMEL-4010:
-----------------------------------
Attachment: test-camel-ftp.zip
Sample test case using Camel Nmr in combination with Camel FTP.
You need to do:
- unzip and enter the folder
- mvn install
- copy the .zip file from /sa/target to ServiceMix deploy folder
- put more than 3 files at once on the input FTP
> Camel FTP component fails to process multiple files at once from a specified folder
> -----------------------------------------------------------------------------------
>
> Key: CAMEL-4010
> URL: https://issues.apache.org/jira/browse/CAMEL-4010
> Project: Camel
> Issue Type: Bug
> Components: camel-ftp
> Affects Versions: 2.6.0
> Environment: Camel 2.6.0-fuse-0.1-0.9
> Running in ServiceMix
> Java 1.6
> Reporter: Laurentiu Trica
> Priority: Critical
> Attachments: test-camel-ftp.zip
>
>
> Camel FTP component fails to process multiple files at once from a specified folder (let's assume the folder is /in).
> When the consumer connects to a ftp account and finds a list of, let's say, 3 files, it will try to retrieve them in parallel but this is not handled properly.
> As you can see from the below FTP server log, this is what Camel FTP does:
> - it changes the current directory to /in
> - retrieves the file
> - it changes the current directory to /
> - the second (probably) thread changes the directory to /in
> - retreives the second file
> - the first (probably) thread sends a delete command but it sends it as if it were in the root folder but it is actually in the /in folder
> - the FTP gives an error that the file doesn't exist
> - somehow the FTP Component blocks itself on the first file...
> See my comments in the following log starting with *****
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 257 "/" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> CWD in
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 250 CWD successful. "/in" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PASV
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 227 Entering Passive Mode (192,168,0,25,228,206)
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> RETR WS_1001_1.xml
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 150 Connection accepted
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> SSL connection for data connection established
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 226 Transfer OK
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> CWD /
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 250 CWD successful. "/" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PWD
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 257 "/" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> CWD in
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 250 CWD successful. "/in" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PASV
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 227 Entering Passive Mode (192,168,0,25,228,207)
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> RETR WS_1001_2.xml
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 150 Connection accepted
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> DELE in/WS_1001_1.xml ***** The location is already /in, should be DELE WS_1001_1.xml
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 550 File not found
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PASV
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 227 Entering Passive Mode (192,168,0,25,228,208)
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> NLST in
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 550 Directory not found
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> PWD
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 257 "/in" is current directory.
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> CWD in ***** Current directory is already /in
> (002386)5/20/2011 17:07:03 PM - sftp-test (192.168.0.194)> 550 CWD failed. "/in/in": directory not found.
> For the whole FTP server logs go here: http://pastie.org/private/kknnkxpbyzqmai7gsm8z5g
> For the Servicemix/Camel(Trace) log: http://pastie.org/private/eulookxiepan3nkjyu41a
> A workaround that seems to work is to use the maxMessagesPerPoll=1 option.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira