[jira] [Comment Edited] (RANGER-731) Ranger plugin for YARN doesn't seem to be able to write audit to Kerberized HDFS

["Ramesh Mani (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/RANGER-731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007226#comment-15007226 ] 

Ramesh Mani edited comment on RANGER-731 at 11/16/15 8:06 PM:
--------------------------------------------------------------

This issue was due to hadoop-common*jar in ranger-yarn-plugin-impl folder also and this caused subtype miss match when Audit is done to HDFS.
 2015-11-13 20:08:32,253 ERROR provider.BaseAuditHandler: 329 Error writing to log file.
 java.util.ServiceConfigurationError: org.apache.hadoop.fs.FileSystem: Provider org.apache.hadoop.fs.azure.NativeAzureFileSystem not a subtype
        at java.util.ServiceLoader.fail(ServiceLoader.java:239)
        at java.util.ServiceLoader.access$300(ServiceLoader.java:185)
        at java.util.ServiceLoader$LazyIterator.nextService(ServiceLoader.java:376)
        at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:404)
        at java.util.ServiceLoader$1.next(ServiceLoader.java:480)
        at org.apache.hadoop.fs.FileSystem.loadFileSystems(FileSystem.java:2623)
        at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2634)
        at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2651)
        at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:92)
        at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2687)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2669)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:371)
        at org.apache.ranger.audit.destination.HDFSAuditDestination.getLogFileStream(HDFSAuditDestination.java:221)
        at org.apache.ranger.audit.destination.HDFSAuditDestination.logJSON(HDFSAuditDestination.java:123)
        at org.apache.ranger.audit.queue.AuditFileSpool.sendEvent(AuditFileSpool.java:890)
        at org.apache.ranger.audit.queue.AuditFileSpool.runDoAs(AuditFileSpool.java:838)
        at org.apache.ranger.audit.queue.AuditFileSpool$2.run(AuditFileSpool.java:759)
        at org.apache.ranger.audit.queue.AuditFileSpool$2.run(AuditFileSpool.java:757)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:360)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1637)
        at org.apache.ranger.audit.queue.AuditFileSpool.run(AuditFileSpool.java:765)
        at java.lang.Thread.run(Thread.java:745)


was (Author: rmani):
This issue was due to hadoop-common*jar in ranger-yarn-plugin-impl folder also and this caused subtype miss match when Audit is done to HDFS.

> Ranger plugin for YARN doesn't seem to be able to write audit to Kerberized HDFS
> --------------------------------------------------------------------------------
>
>                 Key: RANGER-731
>                 URL: https://issues.apache.org/jira/browse/RANGER-731
>             Project: Ranger
>          Issue Type: Bug
>          Components: plugins
>    Affects Versions: 0.5.0
>            Reporter: Don Bosco Durai
>            Assignee: Ramesh Mani
>
> It seems the YARN plugin is missing some configuration/jars when writing to kerberized HDFS. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)