You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@camel.apache.org by "Claus Ibsen (JIRA)" <ji...@apache.org> on 2011/02/11 11:22:57 UTC
[jira] Created: (CAMEL-3655) Add FtpPollingConsumer to better
support polling consumer EIPs
Add FtpPollingConsumer to better support polling consumer EIPs
--------------------------------------------------------------
Key: CAMEL-3655
URL: https://issues.apache.org/jira/browse/CAMEL-3655
Project: Camel
Issue Type: Improvement
Components: camel-ftp
Affects Versions: 2.6.0
Reporter: Claus Ibsen
Assignee: Claus Ibsen
Fix For: 2.7.0
See nabble
http://camel.465427.n5.nabble.com/Event-driven-FTP-consumer-tp3376242p3376242.html
The PollingConsumer should only poll once and thus it should not be schedule based, and it should disconnect after polling.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CAMEL-3655) Add FtpPollingConsumer to better
support polling consumer EIPs
Posted by "Claus Ibsen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CAMEL-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Claus Ibsen updated CAMEL-3655:
-------------------------------
Fix Version/s: (was: 2.8.0)
2.9.0
> Add FtpPollingConsumer to better support polling consumer EIPs
> --------------------------------------------------------------
>
> Key: CAMEL-3655
> URL: https://issues.apache.org/jira/browse/CAMEL-3655
> Project: Camel
> Issue Type: Improvement
> Components: camel-ftp
> Affects Versions: 2.6.0
> Reporter: Claus Ibsen
> Assignee: Tracy Snell
> Fix For: 2.9.0
>
>
> See nabble
> http://camel.465427.n5.nabble.com/Event-driven-FTP-consumer-tp3376242p3376242.html
> The PollingConsumer should only poll once and thus it should not be schedule based, and it should disconnect after polling.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (CAMEL-3655) Add FtpPollingConsumer to better
support polling consumer EIPs
Posted by "Claus Ibsen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CAMEL-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Claus Ibsen resolved CAMEL-3655.
--------------------------------
Resolution: Fixed
I found a better solution for Camel 2.8. So now it should work with FTP.
> Add FtpPollingConsumer to better support polling consumer EIPs
> --------------------------------------------------------------
>
> Key: CAMEL-3655
> URL: https://issues.apache.org/jira/browse/CAMEL-3655
> Project: Camel
> Issue Type: Improvement
> Components: camel-ftp
> Affects Versions: 2.6.0
> Reporter: Claus Ibsen
> Assignee: Claus Ibsen
> Fix For: 2.8.0
>
>
> See nabble
> http://camel.465427.n5.nabble.com/Event-driven-FTP-consumer-tp3376242p3376242.html
> The PollingConsumer should only poll once and thus it should not be schedule based, and it should disconnect after polling.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (CAMEL-3655) Add FtpPollingConsumer to better
support polling consumer EIPs
Posted by "Richard Kettelerij (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CAMEL-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12993490#comment-12993490 ]
Richard Kettelerij commented on CAMEL-3655:
-------------------------------------------
@Claus,
Thanks for creating the ticket (was about to do it myself but you were quicker ;)). Anyway the issue I faced with the FTP component was that there's no option to read files on-demand from FTP (or plain filesystem) in the middle of a route. The only way to read files is to use a continuously polling consumer, which is fine it a lot of case I guess.
Now this can be solved by having a consumer that polls once and disconnects so you can use it a content enricher. This should allow folks to download multiple files in one poll and continue the route. Hadrian suggested using it in a pipeline (using {{to()}}) but this requires a producer that can read from FTP instead of a consumer (CAMEL-3397).
Also this might be a more general issue, shouldn't all polling consumers (without a viable event-driven counterpart) allow for this behavior? It certainly also affects the file: component.
> Add FtpPollingConsumer to better support polling consumer EIPs
> --------------------------------------------------------------
>
> Key: CAMEL-3655
> URL: https://issues.apache.org/jira/browse/CAMEL-3655
> Project: Camel
> Issue Type: Improvement
> Components: camel-ftp
> Affects Versions: 2.6.0
> Reporter: Claus Ibsen
> Assignee: Tracy Snell
> Fix For: 2.7.0
>
>
> See nabble
> http://camel.465427.n5.nabble.com/Event-driven-FTP-consumer-tp3376242p3376242.html
> The PollingConsumer should only poll once and thus it should not be schedule based, and it should disconnect after polling.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CAMEL-3655) Add FtpPollingConsumer to better
support polling consumer EIPs
Posted by "Claus Ibsen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CAMEL-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13056371#comment-13056371 ]
Claus Ibsen commented on CAMEL-3655:
------------------------------------
Ah I spotted likely an easy solution which is to resume/suspend the consumer upon demand. Then the ftp consumer should not keep polling as its suspended, if not in demand.
I will test that and see if we can use that as a workaround for Camel 2.8. And then talk about a solution for Camel 2.9 where we develop a dedicated polling consumer for file/ftp that isn't scheduled based.
> Add FtpPollingConsumer to better support polling consumer EIPs
> --------------------------------------------------------------
>
> Key: CAMEL-3655
> URL: https://issues.apache.org/jira/browse/CAMEL-3655
> Project: Camel
> Issue Type: Improvement
> Components: camel-ftp
> Affects Versions: 2.6.0
> Reporter: Claus Ibsen
> Assignee: Claus Ibsen
> Fix For: 2.8.0
>
>
> See nabble
> http://camel.465427.n5.nabble.com/Event-driven-FTP-consumer-tp3376242p3376242.html
> The PollingConsumer should only poll once and thus it should not be schedule based, and it should disconnect after polling.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Assigned: (CAMEL-3655) Add FtpPollingConsumer to better
support polling consumer EIPs
Posted by "Claus Ibsen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CAMEL-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Claus Ibsen reassigned CAMEL-3655:
----------------------------------
Assignee: Tracy Snell (was: Claus Ibsen)
> Add FtpPollingConsumer to better support polling consumer EIPs
> --------------------------------------------------------------
>
> Key: CAMEL-3655
> URL: https://issues.apache.org/jira/browse/CAMEL-3655
> Project: Camel
> Issue Type: Improvement
> Components: camel-ftp
> Affects Versions: 2.6.0
> Reporter: Claus Ibsen
> Assignee: Tracy Snell
> Fix For: 2.7.0
>
>
> See nabble
> http://camel.465427.n5.nabble.com/Event-driven-FTP-consumer-tp3376242p3376242.html
> The PollingConsumer should only poll once and thus it should not be schedule based, and it should disconnect after polling.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CAMEL-3655) Add FtpPollingConsumer to better
support polling consumer EIPs
Posted by "Claus Ibsen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CAMEL-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Claus Ibsen updated CAMEL-3655:
-------------------------------
Fix Version/s: (was: 2.9.0)
2.8.0
> Add FtpPollingConsumer to better support polling consumer EIPs
> --------------------------------------------------------------
>
> Key: CAMEL-3655
> URL: https://issues.apache.org/jira/browse/CAMEL-3655
> Project: Camel
> Issue Type: Improvement
> Components: camel-ftp
> Affects Versions: 2.6.0
> Reporter: Claus Ibsen
> Assignee: Claus Ibsen
> Fix For: 2.8.0
>
>
> See nabble
> http://camel.465427.n5.nabble.com/Event-driven-FTP-consumer-tp3376242p3376242.html
> The PollingConsumer should only poll once and thus it should not be schedule based, and it should disconnect after polling.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CAMEL-3655) Add FtpPollingConsumer to better
support polling consumer EIPs
Posted by "Richard Kettelerij (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CAMEL-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13057465#comment-13057465 ]
Richard Kettelerij commented on CAMEL-3655:
-------------------------------------------
Nice work Claus. Seems like quite a change, I'll try testing it out when I get the change.
> Add FtpPollingConsumer to better support polling consumer EIPs
> --------------------------------------------------------------
>
> Key: CAMEL-3655
> URL: https://issues.apache.org/jira/browse/CAMEL-3655
> Project: Camel
> Issue Type: Improvement
> Components: camel-ftp
> Affects Versions: 2.6.0
> Reporter: Claus Ibsen
> Assignee: Claus Ibsen
> Fix For: 2.8.0
>
>
> See nabble
> http://camel.465427.n5.nabble.com/Event-driven-FTP-consumer-tp3376242p3376242.html
> The PollingConsumer should only poll once and thus it should not be schedule based, and it should disconnect after polling.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CAMEL-3655) Add FtpPollingConsumer to better
support polling consumer EIPs
Posted by "Claus Ibsen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CAMEL-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13055575#comment-13055575 ]
Claus Ibsen commented on CAMEL-3655:
------------------------------------
We may want to require that pollEnrich with file/ftp requires a file name to be specified? It seems a bit arbitrary to enrich a message with whatever the file/ftp consumer can scan and find in the directories.
So I most likely add that as a requirement and check that a fileName is specified and fail if not.
> Add FtpPollingConsumer to better support polling consumer EIPs
> --------------------------------------------------------------
>
> Key: CAMEL-3655
> URL: https://issues.apache.org/jira/browse/CAMEL-3655
> Project: Camel
> Issue Type: Improvement
> Components: camel-ftp
> Affects Versions: 2.6.0
> Reporter: Claus Ibsen
> Assignee: Claus Ibsen
> Fix For: 2.8.0
>
>
> See nabble
> http://camel.465427.n5.nabble.com/Event-driven-FTP-consumer-tp3376242p3376242.html
> The PollingConsumer should only poll once and thus it should not be schedule based, and it should disconnect after polling.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (CAMEL-3655) Add FtpPollingConsumer to better
support polling consumer EIPs
Posted by "Claus Ibsen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CAMEL-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Claus Ibsen updated CAMEL-3655:
-------------------------------
Fix Version/s: (was: 2.7.0)
2.8.0
> Add FtpPollingConsumer to better support polling consumer EIPs
> --------------------------------------------------------------
>
> Key: CAMEL-3655
> URL: https://issues.apache.org/jira/browse/CAMEL-3655
> Project: Camel
> Issue Type: Improvement
> Components: camel-ftp
> Affects Versions: 2.6.0
> Reporter: Claus Ibsen
> Assignee: Tracy Snell
> Fix For: 2.8.0
>
>
> See nabble
> http://camel.465427.n5.nabble.com/Event-driven-FTP-consumer-tp3376242p3376242.html
> The PollingConsumer should only poll once and thus it should not be schedule based, and it should disconnect after polling.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Issue Comment Edited: (CAMEL-3655) Add FtpPollingConsumer to
better support polling consumer EIPs
Posted by "Richard Kettelerij (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CAMEL-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12993490#comment-12993490 ]
Richard Kettelerij edited comment on CAMEL-3655 at 2/11/11 1:52 PM:
--------------------------------------------------------------------
@Claus,
Thanks for creating the ticket (was about to do it myself but you were quicker ;)). Anyway the issue I faced with the FTP component was that there's no option to read files on-demand from FTP (or plain filesystem) in the middle of a route. The only way to read files is to use a continuously polling consumer, which is fine it a lot of case I guess.
Now this can be solved by having a consumer that polls once and disconnects so you can use it a content enricher. This should allow folks to download multiple files in one poll and continue the route. Hadrian suggested using it in a pipeline (using {{to()}}) but this requires a producer that can read from FTP instead of a consumer (CAMEL-3397).
Also this might be a more general issue, shouldn't all polling consumers allow for this behavior? It certainly also affects the file: component.
was (Author: rkettelerij):
@Claus,
Thanks for creating the ticket (was about to do it myself but you were quicker ;)). Anyway the issue I faced with the FTP component was that there's no option to read files on-demand from FTP (or plain filesystem) in the middle of a route. The only way to read files is to use a continuously polling consumer, which is fine it a lot of case I guess.
Now this can be solved by having a consumer that polls once and disconnects so you can use it a content enricher. This should allow folks to download multiple files in one poll and continue the route. Hadrian suggested using it in a pipeline (using {{to()}}) but this requires a producer that can read from FTP instead of a consumer (CAMEL-3397).
Also this might be a more general issue, shouldn't all polling consumers (without a viable event-driven counterpart) allow for this behavior? It certainly also affects the file: component.
> Add FtpPollingConsumer to better support polling consumer EIPs
> --------------------------------------------------------------
>
> Key: CAMEL-3655
> URL: https://issues.apache.org/jira/browse/CAMEL-3655
> Project: Camel
> Issue Type: Improvement
> Components: camel-ftp
> Affects Versions: 2.6.0
> Reporter: Claus Ibsen
> Assignee: Tracy Snell
> Fix For: 2.7.0
>
>
> See nabble
> http://camel.465427.n5.nabble.com/Event-driven-FTP-consumer-tp3376242p3376242.html
> The PollingConsumer should only poll once and thus it should not be schedule based, and it should disconnect after polling.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Issue Comment Edited] (CAMEL-3655) Add FtpPollingConsumer
to better support polling consumer EIPs
Posted by "Richard Kettelerij (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CAMEL-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13057465#comment-13057465 ]
Richard Kettelerij edited comment on CAMEL-3655 at 6/29/11 8:57 PM:
--------------------------------------------------------------------
Nice work Claus. Seems like quite a change, I'll try testing it out when I get the chance.
was (Author: rkettelerij):
Nice work Claus. Seems like quite a change, I'll try testing it out when I get the change.
> Add FtpPollingConsumer to better support polling consumer EIPs
> --------------------------------------------------------------
>
> Key: CAMEL-3655
> URL: https://issues.apache.org/jira/browse/CAMEL-3655
> Project: Camel
> Issue Type: Improvement
> Components: camel-ftp
> Affects Versions: 2.6.0
> Reporter: Claus Ibsen
> Assignee: Claus Ibsen
> Fix For: 2.8.0
>
>
> See nabble
> http://camel.465427.n5.nabble.com/Event-driven-FTP-consumer-tp3376242p3376242.html
> The PollingConsumer should only poll once and thus it should not be schedule based, and it should disconnect after polling.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (CAMEL-3655) Add FtpPollingConsumer to better
support polling consumer EIPs
Posted by "Claus Ibsen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CAMEL-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Claus Ibsen reassigned CAMEL-3655:
----------------------------------
Assignee: Claus Ibsen (was: Tracy Snell)
> Add FtpPollingConsumer to better support polling consumer EIPs
> --------------------------------------------------------------
>
> Key: CAMEL-3655
> URL: https://issues.apache.org/jira/browse/CAMEL-3655
> Project: Camel
> Issue Type: Improvement
> Components: camel-ftp
> Affects Versions: 2.6.0
> Reporter: Claus Ibsen
> Assignee: Claus Ibsen
> Fix For: 2.8.0
>
>
> See nabble
> http://camel.465427.n5.nabble.com/Event-driven-FTP-consumer-tp3376242p3376242.html
> The PollingConsumer should only poll once and thus it should not be schedule based, and it should disconnect after polling.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira