You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Jonathan Hsieh (JIRA)" <ji...@apache.org> on 2011/08/18 06:01:27 UTC
[jira] [Commented] (FLUME-543) TailThread exits on repeated WAL
failures
[ https://issues.apache.org/jira/browse/FLUME-543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13086782#comment-13086782 ]
Jonathan Hsieh commented on FLUME-543:
--------------------------------------
I believe the root cause of this has something to do with resend/retry after an agent times out and improperly/racily changing the state of a log entry.
> TailThread exits on repeated WAL failures
> -----------------------------------------
>
> Key: FLUME-543
> URL: https://issues.apache.org/jira/browse/FLUME-543
> Project: Flume
> Issue Type: Bug
> Components: Sinks+Sources
> Affects Versions: v0.9.3
> Environment: Amazon EC2 Ubuntu 10.04 LTS
> Reporter: Disabled imported user
> Assignee: Jonathan Hsieh
> Priority: Critical
> Fix For: v0.9.5
>
> Attachments: FLUME-543.log
>
>
> On repeated failures:
> {noformat}
> 2011-02-28 23:37:26,908 ERROR com.cloudera.flume.core.connector.DirectDriver: Driving src/sink failed! LazyOpenSource | LazyOpenDecorator because java.lang.IllegalStateException: Expected state to be LOGGED but was SENT
> java.io.IOException: java.lang.IllegalStateException: Expected state to be LOGGED but was SENT
> at com.cloudera.flume.agent.durability.NaiveFileWALDeco$1.fireError(NaiveFileWALDeco.java:254)
> at com.cloudera.flume.core.connector.DirectDriver.fireError(DirectDriver.java:216)
> at com.cloudera.flume.core.connector.DirectDriver$PumperThread.run(DirectDriver.java:102)
> Caused by: java.lang.IllegalStateException: Expected state to be LOGGED but was SENT
> at com.google.common.base.Preconditions.checkState(Preconditions.java:145)
> at com.cloudera.flume.agent.durability.NaiveFileWALManager.changeState(NaiveFileWALManager.java:410)
> at com.cloudera.flume.agent.durability.NaiveFileWALManager.getUnackedSource(NaiveFileWALManager.java:557)
> at com.cloudera.flume.agent.durability.WALSource.next(WALSource.java:104)
> at com.cloudera.flume.core.connector.DirectDriver$PumperThread.run(DirectDriver.java:89)
> {noformat}
> The tailer exits and the master reports all nodes in ERROR state.
> {noformat}
> 2011-02-28 23:37:27,917 INFO com.cloudera.flume.handlers.text.TailSource: TailThread has exited
> {noformat}
> Full log file attached.
> Rob
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira