You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Gopinathan A (JIRA)" <ji...@apache.org> on 2013/10/07 15:06:42 UTC

[jira] [Commented] (FLUME-2160) SpoolDirectorySource uncaught exception

    [ https://issues.apache.org/jira/browse/FLUME-2160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13788122#comment-13788122 ] 

Gopinathan A commented on FLUME-2160:
-------------------------------------

One scenario could be spool directory  containing file with same name which is already in COMPLETED state.

I feel this issue is duplicate of FLUME-2119

> SpoolDirectorySource uncaught exception
> ---------------------------------------
>
>                 Key: FLUME-2160
>                 URL: https://issues.apache.org/jira/browse/FLUME-2160
>             Project: Flume
>          Issue Type: Bug
>          Components: Sinks+Sources
>    Affects Versions: v1.3.0
>         Environment: Linux 2.6.32-358.14.1.el6.x86_64 #1 SMP Tue Jul 16 23:51:20 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux
>            Reporter: Rob
>
> Ive noticed some instabilities with Flume, of particular is this uncaught exception.  One of the bigger challenges with this type of exception, is that the agent is now in a hung state repeating the same exception.  The tooling for inspecting what file/event is causing the issue are lacking or non-existant, and architecturally there should be some functionality equivalant to the "dead-letter-queue".  Here is the exception Im dealing with now:
> 13/08/14 15:37:05 ERROR source.SpoolDirectorySource: Uncaught exception in Runnable
> java.lang.IllegalStateException: Serializer has been closed
> 	at org.apache.flume.serialization.LineDeserializer.ensureOpen(LineDeserializer.java:124)
> 	at org.apache.flume.serialization.LineDeserializer.readEvents(LineDeserializer.java:88)
> 	at org.apache.flume.client.avro.ReliableSpoolingFileEventReader.readEvents(ReliableSpoolingFileEventReader.java:221)
> 	at org.apache.flume.source.SpoolDirectorySource$SpoolDirectoryRunnable.run(SpoolDirectorySource.java:154)
> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
> 	at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317)
> 	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150)
> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98)
> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:180)
> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:204)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> 	at java.lang.Thread.run(Thread.java:662)



--
This message was sent by Atlassian JIRA
(v6.1#6144)