You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Hari Shreedharan (JIRA)" <ji...@apache.org> on 2014/12/01 20:45:13 UTC

[jira] [Assigned] (FLUME-2565) HDFS Sink under-replication check does not work on encrypted HDFS

     [ https://issues.apache.org/jira/browse/FLUME-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hari Shreedharan reassigned FLUME-2565:
---------------------------------------

    Assignee: Hari Shreedharan

> HDFS Sink under-replication check does not work on encrypted HDFS
> -----------------------------------------------------------------
>
>                 Key: FLUME-2565
>                 URL: https://issues.apache.org/jira/browse/FLUME-2565
>             Project: Flume
>          Issue Type: Bug
>            Reporter: Hari Shreedharan
>            Assignee: Hari Shreedharan
>
> When using CryptoOutputStream (encrypted HDFS), the sink will not be able to check for under-replication and the under-replication check fails, though writes themselves will succeed. 
> {code}
> org.apache.flume.sink.hdfs.AbstractHDFSWriter	
> FileSystem's output stream doesn't support getNumCurrentReplicas; --HDFS-826 not available; fsOut=org.apache.hadoop.crypto.CryptoOutputStream; err=java.lang.NoSuchMethodException: org.apache.hadoop.crypto.CryptoOutputStream.getNumCurrentReplicas()
> {code}
> The under-replication check needs to be fixed to ensure that we don't continue to write to an under-replicated block



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)