You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Mike Percy (JIRA)" <ji...@apache.org> on 2013/04/26 21:22:16 UTC
[jira] [Commented] (FLUME-2027) Check for default replication fails
on federated cluster in hdfs sink
[ https://issues.apache.org/jira/browse/FLUME-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13643157#comment-13643157 ]
Mike Percy commented on FLUME-2027:
-----------------------------------
It looks like we should be using {{fs.getDefaultReplication(Path f)}} instead. This is available in Hadoop 1.1.0 and Hadoop 2 I believe
> Check for default replication fails on federated cluster in hdfs sink
> ---------------------------------------------------------------------
>
> Key: FLUME-2027
> URL: https://issues.apache.org/jira/browse/FLUME-2027
> Project: Flume
> Issue Type: Bug
> Reporter: Mike Percy
>
> Seeing the following exception when calling fs.getDefaultReplication() on a federated fs:
> {noformat}
> 13/04/26 08:52:12 ERROR hdfs.HDFSEventSink: process failed
> org.apache.hadoop.fs.viewfs.NotInMountpointException:
> getDefaultReplication on empty path is invalid
> at org.apache.hadoop.fs.viewfs.ViewFileSystem.getDefaultReplication(ViewFileSystem.java:509)
> at org.apache.flume.sink.hdfs.AbstractHDFSWriter.getFsDesiredReplication(AbstractHDFSWriter.java:104)
> at org.apache.flume.sink.hdfs.AbstractHDFSWriter.isUnderReplicated(AbstractHDFSWriter.java:73)
> at org.apache.flume.sink.hdfs.BucketWriter.shouldRotate(BucketWriter.java:486)
> at org.apache.flume.sink.hdfs.BucketWriter.append(BucketWriter.java:421)
> at org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:392)
> at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)
> at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
> at java.lang.Thread.run(Thread.java:722)
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira