[jira] [Updated] (FLUME-1779) Backoff returned from HDFSEventSink after IOException

["Connor Woodson (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/FLUME-1779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Connor Woodson updated FLUME-1779:
----------------------------------

    Attachment: FLUME-1799.patch

Here's a one-line fix that throws an exception instead of returning BACKOFF; is that all that needs to be done, or is there more to this?
                
> Backoff returned from HDFSEventSink after IOException
> -----------------------------------------------------
>
>                 Key: FLUME-1779
>                 URL: https://issues.apache.org/jira/browse/FLUME-1779
>             Project: Flume
>          Issue Type: Bug
>            Reporter: Jaroslaw Grabowski
>         Attachments: FLUME-1799.patch, st
>
>
> Status.Backoff is returned from HdfsEventSink.process() in case of IOException. This behavior prevents FailoverSinkProcessor from pushing event to next sink in queue.
> In my test case, IOException is caused by serious hdfs failure, for example all DataNodes in cluster are dead. After such failure BucketWriter throws IOException and becomes unavailable - it probably should be removed from sfWriters map.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira