[jira] [Created] (FLUME-2564) Failover processor does not kick-in for HDFS sink on IOException

["Arvind Prabhakar (JIRA)" <ji...@apache.org>]

Arvind Prabhakar created FLUME-2564:
---------------------------------------

             Summary: Failover processor does not kick-in for HDFS sink on IOException
                 Key: FLUME-2564
                 URL: https://issues.apache.org/jira/browse/FLUME-2564
             Project: Flume
          Issue Type: Bug
            Reporter: Arvind Prabhakar
            Assignee: Arvind Prabhakar


>From a recent thread on the user mailing list:

{quote}
I have investigated the HDFSEventSink source code,  found if the exception was  IOException , the exception would not throw to the upper layer,
So FailOverSinkProcessor would not mark this sink as dead.
{quote} 

{code}
   ....
    } catch (IOException eIO) {
      transaction.rollback();
      LOG.warn("HDFS IO error", eIO);
      return Status.BACKOFF;
    } catch (Throwable th) {
      transaction.rollback();
      LOG.error("process failed", th);
      if (th instanceof Error) {
        throw (Error) th;
      } else {
        throw new EventDeliveryException(th);
      }
    }
    ....
{code}

The failover processor should be able to use the backoff signal as indication of failure and switch over to the next sink.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)