You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@camel.apache.org by Sorin Silaghi <so...@gmail.com> on 2011/08/16 16:49:04 UTC

doneFileName doesn't seem to work

Hi All,


          My route looks like this:

    <route id="ORDERS">
      <from uri="ftp://user@my.server
/in/ceva0171?password=secret&amp;doneFileName=${file:name}.sem"/>
      <to uri="file://data/endpoints/FILE-out"/>
    </route>

          Every time a file is copied successfully to the FTP server a file
with the same name plus the .sem prefix is added. I expected the above route
to copy all the successful files from the FTP server but it doesn't seem to
work. I also tried to use doneFileName=done and then I added a filed called
"done" to the server but that didn't work either. I see no errors, nothing
in the logs to explain it. If I remove doneFileName completely it will copy
all the files.

          All I see in the logs is the following message:

17:47:10,837 | TRACE | .140/in/ceva0171 | FtpConsumer                      |
77 - org.apache.camel.camel-core - 2.7.1.fuse-00-43 | Skipping done file:
GenericFile[DPDN_DELIVERY_DPD_0000424239.TXT.sem]
17:47:10,837 | TRACE | .140/in/ceva0171 | FtpConsumer                      |
77 - org.apache.camel.camel-core - 2.7.1.fuse-00-43 | File did not match.
Will skip this file: GenericFile[DPDN_DELIVERY_DPD_0000424239.TXT.sem]
17:47:10,837 | TRACE | .140/in/ceva0171 | FtpOperations                    |
215 - org.apache.camel.camel-ftp - 2.7.1.fuse-00-43 |
existsFile(in/ceva0171/DPDN_DELIVERY_DPD_0000424240.TXT.sem)
17:47:10,935 | TRACE | .140/in/ceva0171 | FtpConsumer                      |
77 - org.apache.camel.camel-core - 2.7.1.fuse-00-43 | Done file:
in/ceva0171/DPDN_DELIVERY_DPD_0000424240.TXT.sem does not exist
17:47:10,935 | TRACE | .140/in/ceva0171 | FtpConsumer                      |
77 - org.apache.camel.camel-core - 2.7.1.fuse-00-43 | File did not match.
Will skip this file: GenericFile[DPDN_DELIVERY_DPD_0000424240.TXT]
17:47:10,935 | TRACE | .140/in/ceva0171 | FtpConsumer                      |
77 - org.apache.camel.camel-core - 2.7.1.fuse-00-43 | Skipping done file:
GenericFile[DPDN_DELIVERY_DPD_0000424240.TXT.sem]
17:47:10,935 | TRACE | .140/in/ceva0171 | FtpConsumer                      |
77 - org.apache.camel.camel-core - 2.7.1.fuse-00-43 | File did not match.
Will skip this file: GenericFile[DPDN_DELIVERY_DPD_0000424240.TXT.sem]

and if I use doneFileName=done I get:

17:34:17,625 | TRACE | .140/in/ceva0171 | FtpConsumer                      |
77 - org.apache.camel.camel-core - 2.7.1.fuse-00-43 | Done file:
in/ceva0171/done does not exist
17:34:17,625 | TRACE | .140/in/ceva0171 | FtpConsumer                      |
77 - org.apache.camel.camel-core - 2.7.1.fuse-00-43 | File did not match.
Will skip this file: GenericFile[DELIVERY_FILE_0000424225.TXT]
17:34:17,625 | TRACE | .140/in/ceva0171 | FtpOperations                    |
215 - org.apache.camel.camel-ftp - 2.7.1.fuse-00-43 |
existsFile(in/ceva0171/done)
17:34:17,720 | TRACE | .140/in/ceva0171 | FtpConsumer                      |
77 - org.apache.camel.camel-core - 2.7.1.fuse-00-43 | Done file:
in/ceva0171/done does not exist
17:34:17,720 | TRACE | .140/in/ceva0171 | FtpConsumer                      |
77 - org.apache.camel.camel-core - 2.7.1.fuse-00-43 | File did not match.
Will skip this file: GenericFile[DELIVERY_FILE_0000424225.TXT.sem]
17:34:17,720 | TRACE | .140/in/ceva0171 | FtpOperations                    |
215 - org.apache.camel.camel-ftp - 2.7.1.fuse-00-43 |
existsFile(in/ceva0171/done)

Can anybody tell me why all the files are skipped ? or what do those
messages mean ?



best regards,
                      Sorin.

Re: doneFileName doesn't seem to work

Posted by Claus Ibsen <cl...@gmail.com>.

I have created a ticket to track this bug
https://issues.apache.org/jira/browse/CAMEL-4352


On Thu, Aug 18, 2011 at 6:28 PM, Claus Ibsen <cl...@gmail.com> wrote:
> On Thu, Aug 18, 2011 at 2:30 PM, Sorin Silaghi <so...@gmail.com> wrote:
>> Hello
>>
>>
>>              The URI is:
>>
>> ftp://user@localhost/in?password=secret&amp;doneFileName=${file:name}.sem
>>
>
> You should be able to use ${file:onlyname}.sem instead. Can you try with that.
>
>
>> And it's running on Camel 2.6.0-fuse-01-15 and Fuse ESB 4.3.1-fuse-01-15. I
>> also tried it on the latest version of Fuse ESB(4.4.0) and I had the same
>> problem.
>>
>>
>> Sorin
>>
>> On Thu, Aug 18, 2011 at 1:14 PM, Claus Ibsen <cl...@gmail.com> wrote:
>>
>>> Hi
>>>
>>> Can you post your ftp endpoint uri configuration?
>>> And what version of Camel are you using?
>>>
>>>
>>>
>>> On Thu, Aug 18, 2011 at 9:28 AM, Sorin Silaghi <so...@gmail.com>
>>> wrote:
>>> > Hi,
>>> >
>>> >
>>> >        I managed to figure this one out: in short if I use stepwise=false
>>> > it works fine.
>>> >
>>> >       I did some debugging and I traced the problem down to
>>> > FtpOperations.java at line 522:
>>> >
>>> >            String[] names;
>>> >            if (directory != null) {
>>> >                names = client.listNames(directory);
>>> >            } else {
>>> >                names = client.listNames();
>>> >            }
>>> >
>>> >       Let's say I'm pooling ftp://localhost/dir-name and stepwise=true.
>>> > When it executes client.listNames(directory) the location on the server
>>> is
>>> > already "/dir-name" and it will try to list "/dir-name/dir-name" which
>>> > doesn't exist, so it doesn't find the done file. I didn't dig in any
>>> deeper
>>> > but this is clearly a bug.
>>> >
>>> >
>>> > best regards,
>>> >                   Sorin.
>>> >
>>> >
>>> > On Wed, Aug 17, 2011 at 11:32 AM, Sorin Silaghi <so...@gmail.com>
>>> wrote:
>>> >
>>> >> ok thanks, I'll give it a try and get back to you.
>>> >>
>>> >>
>>> >> On Tue, Aug 16, 2011 at 6:46 PM, Claus Ibsen <claus.ibsen@gmail.com
>>> >wrote:
>>> >>
>>> >>> On Tue, Aug 16, 2011 at 5:18 PM, Sorin Silaghi <so...@gmail.com>
>>> >>> wrote:
>>> >>> > Hi again,
>>> >>> >
>>> >>> >
>>> >>> >             After further testing it looks like this works fine for
>>> file
>>> >>> > poolers... is this not implemented on FTP ?
>>> >>> >
>>> >>>
>>> >>> It should be avail from FTP as well. For example we got some unit
>>> >>> tests in camel-ftp source code.
>>> >>>
>>> >>> I suggest to create a small unit test with file first.
>>> >>> Then try the route with FTP afterwards.
>>> >>>
>>> >>>
>>> >>> >
>>> >>> > Sorin.
>>> >>> >
>>> >>> >
>>> >>> >
>>> >>> > On Tue, Aug 16, 2011 at 5:49 PM, Sorin Silaghi <so...@gmail.com>
>>> >>> wrote:
>>> >>> >
>>> >>> >> Hi All,
>>> >>> >>
>>> >>> >>
>>> >>> >>           My route looks like this:
>>> >>> >>
>>> >>> >>     <route id="ORDERS">
>>> >>> >>       <from uri="ftp://user@my.server
>>> >>> >> /in/ceva0171?password=secret&amp;doneFileName=${file:name}.sem"/>
>>> >>> >>       <to uri="file://data/endpoints/FILE-out"/>
>>> >>> >>     </route>
>>> >>> >>
>>> >>> >>           Every time a file is copied successfully to the FTP server
>>> a
>>> >>> file
>>> >>> >> with the same name plus the .sem prefix is added. I expected the
>>> above
>>> >>> route
>>> >>> >> to copy all the successful files from the FTP server but it doesn't
>>> >>> seem to
>>> >>> >> work. I also tried to use doneFileName=done and then I added a filed
>>> >>> called
>>> >>> >> "done" to the server but that didn't work either. I see no errors,
>>> >>> nothing
>>> >>> >> in the logs to explain it. If I remove doneFileName completely it
>>> will
>>> >>> copy
>>> >>> >> all the files.
>>> >>> >>
>>> >>> >>           All I see in the logs is the following message:
>>> >>> >>
>>> >>> >> 17:47:10,837 | TRACE | .140/in/ceva0171 | FtpConsumer
>>> >>> >> | 77 - org.apache.camel.camel-core - 2.7.1.fuse-00-43 | Skipping
>>> done
>>> >>> file:
>>> >>> >> GenericFile[DPDN_DELIVERY_DPD_0000424239.TXT.sem]
>>> >>> >> 17:47:10,837 | TRACE | .140/in/ceva0171 | FtpConsumer
>>> >>> >> | 77 - org.apache.camel.camel-core - 2.7.1.fuse-00-43 | File did not
>>> >>> match.
>>> >>> >> Will skip this file:
>>> GenericFile[DPDN_DELIVERY_DPD_0000424239.TXT.sem]
>>> >>> >> 17:47:10,837 | TRACE | .140/in/ceva0171 | FtpOperations
>>> >>> >> | 215 - org.apache.camel.camel-ftp - 2.7.1.fuse-00-43 |
>>> >>> >> existsFile(in/ceva0171/DPDN_DELIVERY_DPD_0000424240.TXT.sem)
>>> >>> >> 17:47:10,935 | TRACE | .140/in/ceva0171 | FtpConsumer
>>> >>> >> | 77 - org.apache.camel.camel-core - 2.7.1.fuse-00-43 | Done file:
>>> >>> >> in/ceva0171/DPDN_DELIVERY_DPD_0000424240.TXT.sem does not exist
>>> >>> >> 17:47:10,935 | TRACE | .140/in/ceva0171 | FtpConsumer
>>> >>> >> | 77 - org.apache.camel.camel-core - 2.7.1.fuse-00-43 | File did not
>>> >>> match.
>>> >>> >> Will skip this file: GenericFile[DPDN_DELIVERY_DPD_0000424240.TXT]
>>> >>> >> 17:47:10,935 | TRACE | .140/in/ceva0171 | FtpConsumer
>>> >>> >> | 77 - org.apache.camel.camel-core - 2.7.1.fuse-00-43 | Skipping
>>> done
>>> >>> file:
>>> >>> >> GenericFile[DPDN_DELIVERY_DPD_0000424240.TXT.sem]
>>> >>> >> 17:47:10,935 | TRACE | .140/in/ceva0171 | FtpConsumer
>>> >>> >> | 77 - org.apache.camel.camel-core - 2.7.1.fuse-00-43 | File did not
>>> >>> match.
>>> >>> >> Will skip this file:
>>> GenericFile[DPDN_DELIVERY_DPD_0000424240.TXT.sem]
>>> >>> >>
>>> >>> >> and if I use doneFileName=done I get:
>>> >>> >>
>>> >>> >> 17:34:17,625 | TRACE | .140/in/ceva0171 | FtpConsumer
>>> >>> >> | 77 - org.apache.camel.camel-core - 2.7.1.fuse-00-43 | Done file:
>>> >>> >> in/ceva0171/done does not exist
>>> >>> >> 17:34:17,625 | TRACE | .140/in/ceva0171 | FtpConsumer
>>> >>> >> | 77 - org.apache.camel.camel-core - 2.7.1.fuse-00-43 | File did not
>>> >>> match.
>>> >>> >> Will skip this file: GenericFile[DELIVERY_FILE_0000424225.TXT]
>>> >>> >> 17:34:17,625 | TRACE | .140/in/ceva0171 | FtpOperations
>>> >>> >> | 215 - org.apache.camel.camel-ftp - 2.7.1.fuse-00-43 |
>>> >>> >> existsFile(in/ceva0171/done)
>>> >>> >> 17:34:17,720 | TRACE | .140/in/ceva0171 | FtpConsumer
>>> >>> >> | 77 - org.apache.camel.camel-core - 2.7.1.fuse-00-43 | Done file:
>>> >>> >> in/ceva0171/done does not exist
>>> >>> >> 17:34:17,720 | TRACE | .140/in/ceva0171 | FtpConsumer
>>> >>> >> | 77 - org.apache.camel.camel-core - 2.7.1.fuse-00-43 | File did not
>>> >>> match.
>>> >>> >> Will skip this file: GenericFile[DELIVERY_FILE_0000424225.TXT.sem]
>>> >>> >> 17:34:17,720 | TRACE | .140/in/ceva0171 | FtpOperations
>>> >>> >> | 215 - org.apache.camel.camel-ftp - 2.7.1.fuse-00-43 |
>>> >>> >> existsFile(in/ceva0171/done)
>>> >>> >>
>>> >>> >> Can anybody tell me why all the files are skipped ? or what do those
>>> >>> >> messages mean ?
>>> >>> >>
>>> >>> >>
>>> >>> >>
>>> >>> >> best regards,
>>> >>> >>                       Sorin.
>>> >>> >>
>>> >>> >
>>> >>>
>>> >>>
>>> >>>
>>> >>> --
>>> >>> Claus Ibsen
>>> >>> -----------------
>>> >>> FuseSource
>>> >>> Email: cibsen@fusesource.com
>>> >>> Web: http://fusesource.com
>>> >>> Twitter: davsclaus, fusenews
>>> >>> Blog: http://davsclaus.blogspot.com/
>>> >>> Author of Camel in Action: http://www.manning.com/ibsen/
>>> >>>
>>> >>
>>> >>
>>> >
>>>
>>>
>>>
>>> --
>>> Claus Ibsen
>>> -----------------
>>> FuseSource
>>> Email: cibsen@fusesource.com
>>> Web: http://fusesource.com
>>> Twitter: davsclaus, fusenews
>>> Blog: http://davsclaus.blogspot.com/
>>> Author of Camel in Action: http://www.manning.com/ibsen/
>>>
>>
>
>
>
> --
> Claus Ibsen
> -----------------
> FuseSource
> Email: cibsen@fusesource.com
> Web: http://fusesource.com
> Twitter: davsclaus, fusenews
> Blog: http://davsclaus.blogspot.com/
> Author of Camel in Action: http://www.manning.com/ibsen/
>



-- 
Claus Ibsen
-----------------
FuseSource
Email: cibsen@fusesource.com
Web: http://fusesource.com
Twitter: davsclaus, fusenews
Blog: http://davsclaus.blogspot.com/
Author of Camel in Action: http://www.manning.com/ibsen/