You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flume.apache.org by Roshan Naik <ro...@hortonworks.com> on 2014/10/07 04:12:56 UTC

Review Request 26401: HDFS Sink Cannot Reconnect After NameNode Restart

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/26401/
-----------------------------------------------------------

Review request for Flume.


Bugs: FLUME-2451
    https://issues.apache.org/jira/browse/FLUME-2451


Repository: flume-git


Description
-------

Once IOException is thrown, the process() method will remove all the active bucketwriters before exiting transaction.. leading to a new bucketwriter creation next time around. we do not bucketwriter.close() as it will only trigger additional IOExceptions.


Diffs
-----

  flume-ng-sinks/flume-hdfs-sink/src/main/java/org/apache/flume/sink/hdfs/BucketWriter.java fba3f66 
  flume-ng-sinks/flume-hdfs-sink/src/main/java/org/apache/flume/sink/hdfs/HDFSEventSink.java 4f3b3f0 

Diff: https://reviews.apache.org/r/26401/diff/


Testing
-------

Tested manually


Thanks,

Roshan Naik