You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@camel.apache.org by "ravi.4indra" <ra...@gmail.com> on 2015/05/12 23:53:46 UTC

Warning Messages in Logs when camel application running on multiple nodes

Hi,

I have a route using camel file2 to move a file. its working fine with a
single node but with camel running on three different nodes i am seeing
below error on 2 nodes and successfully processing in the third server.

is there a configuration or option on camel to prevent this
warnings/exception in logs


org.apache.camel.component.file.GenericFileOperationFailedException: Cannot
rename file: Generi                                                                                                                                            
cFile[filename] to: GenericF                                                                                                                                            
ile[filename]
        at
org.apache.camel.component.file.strategy.GenericFileProcessStrategySupport.renameFil                                                                                                                                            
e(GenericFileProcessStrategySupport.java:115)[camel-core-2.14.0.jar:2.14.0]
        at
org.apache.camel.component.file.strategy.GenericFileDeleteProcessStrategy.begin(Gene                                                                                                                                            
ricFileDeleteProcessStrategy.java:42)[camel-core-2.14.0.jar:2.14.0]
        at
org.apache.camel.component.file.GenericFileConsumer.processExchange(GenericFileConsu                                                                                                                                            
mer.java:348)[camel-core-2.14.0.jar:2.14.0]
        at
org.apache.camel.component.file.GenericFileConsumer.processBatch(GenericFileConsumer                                                                                                                                            
.java:211)[camel-core-2.14.0.jar:2.14.0]
        at
org.apache.camel.component.file.GenericFileConsumer.poll(GenericFileConsumer.java:17                                                                                                                                            
5)[camel-core-2.14.0.jar:2.14.0]
        at
org.apache.camel.impl.ScheduledPollConsumer.doRun(ScheduledPollConsumer.java:187)[ca                                                                                                                                            
mel-core-2.14.0.jar:2.14.0]
        at
org.apache.camel.impl.ScheduledPollConsumer.run(ScheduledPollConsumer.java:114)[came                                                                                                                                            
l-core-2.14.0.jar:2.14.0]
        at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)[:1.7.0_45]
        at
java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)[:1.7.0_45]
        at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(Sche                                                                                                                                            
duledThreadPoolExecutor.java:178)[:1.7.0_45]
        at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledTh                                                                                                                                            
readPoolExecutor.java:293)[:1.7.0_45]
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)[:1.7                                                                                                                                            
.0_45]
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)[:1.7                                                                                                                                            
.0_45]
        at java.lang.Thread.run(Thread.java:744)[:1.7.0_45]


from("file://RemoteMountedDirectory"?doneFileName=${file:name}.done&delay=10&maxMessagesPerPoll=200&delete=true")
 .to("file://toLocalDirectory"+"?doneFileName=${file:name}.done");

Thanks
Ravi



--
View this message in context: http://camel.465427.n5.nabble.com/Warning-Messages-in-Logs-when-camel-application-running-on-multiple-nodes-tp5767030.html
Sent from the Camel - Users mailing list archive at Nabble.com.

Re: Warning Messages in Logs when camel application running on multiple nodes

Posted by Reji Mathews <co...@gmail.com>.
Also 'doneFileName' option . Is it applicable for producer endpoints?
Am not sure though but I feel its only for consumer endpoints.

Docs at http://camel.apache.org/file2.html

Regards
Reji

On Wed, May 13, 2015 at 2:17 PM, Henryk Konsek <he...@gmail.com> wrote:

> Hi,
>
> You should see in the logs what is the reason for the rename failure. Maybe
> problems with IO?
>
> Cheers.
>
> śr., 13.05.2015 o 08:21 użytkownik ravi.4indra <ra...@gmail.com>
> napisał:
>
> > Hi,
> >
> > I have a route using camel file2 to move a file. its working fine with a
> > single node but with camel running on three different nodes i am seeing
> > below error on 2 nodes and successfully processing in the third server.
> >
> > is there a configuration or option on camel to prevent this
> > warnings/exception in logs
> >
> >
> > org.apache.camel.component.file.GenericFileOperationFailedException:
> Cannot
> > rename file: Generi
> > cFile[filename] to: GenericF
> > ile[filename]
> >         at
> >
> >
> org.apache.camel.component.file.strategy.GenericFileProcessStrategySupport.renameFil
> >
> e(GenericFileProcessStrategySupport.java:115)[camel-core-2.14.0.jar:2.14.0]
> >         at
> >
> >
> org.apache.camel.component.file.strategy.GenericFileDeleteProcessStrategy.begin(Gene
> > ricFileDeleteProcessStrategy.java:42)[camel-core-2.14.0.jar:2.14.0]
> >         at
> >
> >
> org.apache.camel.component.file.GenericFileConsumer.processExchange(GenericFileConsu
> > mer.java:348)[camel-core-2.14.0.jar:2.14.0]
> >         at
> >
> >
> org.apache.camel.component.file.GenericFileConsumer.processBatch(GenericFileConsumer
> > .java:211)[camel-core-2.14.0.jar:2.14.0]
> >         at
> >
> >
> org.apache.camel.component.file.GenericFileConsumer.poll(GenericFileConsumer.java:17
> > 5)[camel-core-2.14.0.jar:2.14.0]
> >         at
> >
> >
> org.apache.camel.impl.ScheduledPollConsumer.doRun(ScheduledPollConsumer.java:187)[ca
> > mel-core-2.14.0.jar:2.14.0]
> >         at
> >
> >
> org.apache.camel.impl.ScheduledPollConsumer.run(ScheduledPollConsumer.java:114)[came
> > l-core-2.14.0.jar:2.14.0]
> >         at
> >
> >
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)[:1.7.0_45]
> >         at
> >
> java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)[:1.7.0_45]
> >         at
> >
> >
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(Sche
> > duledThreadPoolExecutor.java:178)[:1.7.0_45]
> >         at
> >
> >
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledTh
> > readPoolExecutor.java:293)[:1.7.0_45]
> >         at
> >
> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)[:1.7
> > .0_45]
> >         at
> >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)[:1.7
> > .0_45]
> >         at java.lang.Thread.run(Thread.java:744)[:1.7.0_45]
> >
> >
> >
> >
> from("file://RemoteMountedDirectory"?doneFileName=${file:name}.done&delay=10&maxMessagesPerPoll=200&delete=true")
> >  .to("file://toLocalDirectory"+"?doneFileName=${file:name}.done");
> >
> > Thanks
> > Ravi
> >
> >
> >
> > --
> > View this message in context:
> >
> http://camel.465427.n5.nabble.com/Warning-Messages-in-Logs-when-camel-application-running-on-multiple-nodes-tp5767030.html
> > Sent from the Camel - Users mailing list archive at Nabble.com.
> >
>

Re: Warning Messages in Logs when camel application running on multiple nodes

Posted by Reji Mathews <co...@gmail.com>.
Can you check your file access permissions on the RemoteMountedDirectory.
Apart form read, do you have 'write' rights as well??

Reji

On Wed, May 13, 2015 at 2:17 PM, Henryk Konsek <he...@gmail.com> wrote:

> Hi,
>
> You should see in the logs what is the reason for the rename failure. Maybe
> problems with IO?
>
> Cheers.
>
> śr., 13.05.2015 o 08:21 użytkownik ravi.4indra <ra...@gmail.com>
> napisał:
>
> > Hi,
> >
> > I have a route using camel file2 to move a file. its working fine with a
> > single node but with camel running on three different nodes i am seeing
> > below error on 2 nodes and successfully processing in the third server.
> >
> > is there a configuration or option on camel to prevent this
> > warnings/exception in logs
> >
> >
> > org.apache.camel.component.file.GenericFileOperationFailedException:
> Cannot
> > rename file: Generi
> > cFile[filename] to: GenericF
> > ile[filename]
> >         at
> >
> >
> org.apache.camel.component.file.strategy.GenericFileProcessStrategySupport.renameFil
> >
> e(GenericFileProcessStrategySupport.java:115)[camel-core-2.14.0.jar:2.14.0]
> >         at
> >
> >
> org.apache.camel.component.file.strategy.GenericFileDeleteProcessStrategy.begin(Gene
> > ricFileDeleteProcessStrategy.java:42)[camel-core-2.14.0.jar:2.14.0]
> >         at
> >
> >
> org.apache.camel.component.file.GenericFileConsumer.processExchange(GenericFileConsu
> > mer.java:348)[camel-core-2.14.0.jar:2.14.0]
> >         at
> >
> >
> org.apache.camel.component.file.GenericFileConsumer.processBatch(GenericFileConsumer
> > .java:211)[camel-core-2.14.0.jar:2.14.0]
> >         at
> >
> >
> org.apache.camel.component.file.GenericFileConsumer.poll(GenericFileConsumer.java:17
> > 5)[camel-core-2.14.0.jar:2.14.0]
> >         at
> >
> >
> org.apache.camel.impl.ScheduledPollConsumer.doRun(ScheduledPollConsumer.java:187)[ca
> > mel-core-2.14.0.jar:2.14.0]
> >         at
> >
> >
> org.apache.camel.impl.ScheduledPollConsumer.run(ScheduledPollConsumer.java:114)[came
> > l-core-2.14.0.jar:2.14.0]
> >         at
> >
> >
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)[:1.7.0_45]
> >         at
> >
> java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)[:1.7.0_45]
> >         at
> >
> >
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(Sche
> > duledThreadPoolExecutor.java:178)[:1.7.0_45]
> >         at
> >
> >
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledTh
> > readPoolExecutor.java:293)[:1.7.0_45]
> >         at
> >
> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)[:1.7
> > .0_45]
> >         at
> >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)[:1.7
> > .0_45]
> >         at java.lang.Thread.run(Thread.java:744)[:1.7.0_45]
> >
> >
> >
> >
> from("file://RemoteMountedDirectory"?doneFileName=${file:name}.done&delay=10&maxMessagesPerPoll=200&delete=true")
> >  .to("file://toLocalDirectory"+"?doneFileName=${file:name}.done");
> >
> > Thanks
> > Ravi
> >
> >
> >
> > --
> > View this message in context:
> >
> http://camel.465427.n5.nabble.com/Warning-Messages-in-Logs-when-camel-application-running-on-multiple-nodes-tp5767030.html
> > Sent from the Camel - Users mailing list archive at Nabble.com.
> >
>

Re: Warning Messages in Logs when camel application running on multiple nodes

Posted by Claus Ibsen <cl...@gmail.com>.
Hi

No its due having multiple nodes compete for the same files on shared
file system. You need a clustered aware read lock to fully support
this. Camel 2.16 alows to use idempotent read locks in cluster such as
a data grid to orchestrate this.


On Wed, May 13, 2015 at 10:47 AM, Henryk Konsek <he...@gmail.com> wrote:
> Hi,
>
> You should see in the logs what is the reason for the rename failure. Maybe
> problems with IO?
>
> Cheers.
>
> śr., 13.05.2015 o 08:21 użytkownik ravi.4indra <ra...@gmail.com>
> napisał:
>
>> Hi,
>>
>> I have a route using camel file2 to move a file. its working fine with a
>> single node but with camel running on three different nodes i am seeing
>> below error on 2 nodes and successfully processing in the third server.
>>
>> is there a configuration or option on camel to prevent this
>> warnings/exception in logs
>>
>>
>> org.apache.camel.component.file.GenericFileOperationFailedException: Cannot
>> rename file: Generi
>> cFile[filename] to: GenericF
>> ile[filename]
>>         at
>>
>> org.apache.camel.component.file.strategy.GenericFileProcessStrategySupport.renameFil
>> e(GenericFileProcessStrategySupport.java:115)[camel-core-2.14.0.jar:2.14.0]
>>         at
>>
>> org.apache.camel.component.file.strategy.GenericFileDeleteProcessStrategy.begin(Gene
>> ricFileDeleteProcessStrategy.java:42)[camel-core-2.14.0.jar:2.14.0]
>>         at
>>
>> org.apache.camel.component.file.GenericFileConsumer.processExchange(GenericFileConsu
>> mer.java:348)[camel-core-2.14.0.jar:2.14.0]
>>         at
>>
>> org.apache.camel.component.file.GenericFileConsumer.processBatch(GenericFileConsumer
>> .java:211)[camel-core-2.14.0.jar:2.14.0]
>>         at
>>
>> org.apache.camel.component.file.GenericFileConsumer.poll(GenericFileConsumer.java:17
>> 5)[camel-core-2.14.0.jar:2.14.0]
>>         at
>>
>> org.apache.camel.impl.ScheduledPollConsumer.doRun(ScheduledPollConsumer.java:187)[ca
>> mel-core-2.14.0.jar:2.14.0]
>>         at
>>
>> org.apache.camel.impl.ScheduledPollConsumer.run(ScheduledPollConsumer.java:114)[came
>> l-core-2.14.0.jar:2.14.0]
>>         at
>>
>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)[:1.7.0_45]
>>         at
>> java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)[:1.7.0_45]
>>         at
>>
>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(Sche
>> duledThreadPoolExecutor.java:178)[:1.7.0_45]
>>         at
>>
>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledTh
>> readPoolExecutor.java:293)[:1.7.0_45]
>>         at
>>
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)[:1.7
>> .0_45]
>>         at
>>
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)[:1.7
>> .0_45]
>>         at java.lang.Thread.run(Thread.java:744)[:1.7.0_45]
>>
>>
>>
>> from("file://RemoteMountedDirectory"?doneFileName=${file:name}.done&delay=10&maxMessagesPerPoll=200&delete=true")
>>  .to("file://toLocalDirectory"+"?doneFileName=${file:name}.done");
>>
>> Thanks
>> Ravi
>>
>>
>>
>> --
>> View this message in context:
>> http://camel.465427.n5.nabble.com/Warning-Messages-in-Logs-when-camel-application-running-on-multiple-nodes-tp5767030.html
>> Sent from the Camel - Users mailing list archive at Nabble.com.
>>



-- 
Claus Ibsen
-----------------
Red Hat, Inc.
Email: cibsen@redhat.com
Twitter: davsclaus
Blog: http://davsclaus.com
Author of Camel in Action: http://www.manning.com/ibsen
hawtio: http://hawt.io/
fabric8: http://fabric8.io/

Re: Warning Messages in Logs when camel application running on multiple nodes

Posted by Henryk Konsek <he...@gmail.com>.
Hi,

You should see in the logs what is the reason for the rename failure. Maybe
problems with IO?

Cheers.

śr., 13.05.2015 o 08:21 użytkownik ravi.4indra <ra...@gmail.com>
napisał:

> Hi,
>
> I have a route using camel file2 to move a file. its working fine with a
> single node but with camel running on three different nodes i am seeing
> below error on 2 nodes and successfully processing in the third server.
>
> is there a configuration or option on camel to prevent this
> warnings/exception in logs
>
>
> org.apache.camel.component.file.GenericFileOperationFailedException: Cannot
> rename file: Generi
> cFile[filename] to: GenericF
> ile[filename]
>         at
>
> org.apache.camel.component.file.strategy.GenericFileProcessStrategySupport.renameFil
> e(GenericFileProcessStrategySupport.java:115)[camel-core-2.14.0.jar:2.14.0]
>         at
>
> org.apache.camel.component.file.strategy.GenericFileDeleteProcessStrategy.begin(Gene
> ricFileDeleteProcessStrategy.java:42)[camel-core-2.14.0.jar:2.14.0]
>         at
>
> org.apache.camel.component.file.GenericFileConsumer.processExchange(GenericFileConsu
> mer.java:348)[camel-core-2.14.0.jar:2.14.0]
>         at
>
> org.apache.camel.component.file.GenericFileConsumer.processBatch(GenericFileConsumer
> .java:211)[camel-core-2.14.0.jar:2.14.0]
>         at
>
> org.apache.camel.component.file.GenericFileConsumer.poll(GenericFileConsumer.java:17
> 5)[camel-core-2.14.0.jar:2.14.0]
>         at
>
> org.apache.camel.impl.ScheduledPollConsumer.doRun(ScheduledPollConsumer.java:187)[ca
> mel-core-2.14.0.jar:2.14.0]
>         at
>
> org.apache.camel.impl.ScheduledPollConsumer.run(ScheduledPollConsumer.java:114)[came
> l-core-2.14.0.jar:2.14.0]
>         at
>
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)[:1.7.0_45]
>         at
> java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)[:1.7.0_45]
>         at
>
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(Sche
> duledThreadPoolExecutor.java:178)[:1.7.0_45]
>         at
>
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledTh
> readPoolExecutor.java:293)[:1.7.0_45]
>         at
>
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)[:1.7
> .0_45]
>         at
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)[:1.7
> .0_45]
>         at java.lang.Thread.run(Thread.java:744)[:1.7.0_45]
>
>
>
> from("file://RemoteMountedDirectory"?doneFileName=${file:name}.done&delay=10&maxMessagesPerPoll=200&delete=true")
>  .to("file://toLocalDirectory"+"?doneFileName=${file:name}.done");
>
> Thanks
> Ravi
>
>
>
> --
> View this message in context:
> http://camel.465427.n5.nabble.com/Warning-Messages-in-Logs-when-camel-application-running-on-multiple-nodes-tp5767030.html
> Sent from the Camel - Users mailing list archive at Nabble.com.
>