[jira] [Comment Edited] (RANGER-1501) Audit Flush to HDFS does not actually cause the audit logs to be flushed to HDFS

["Ramesh Mani (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/RANGER-1501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16113548#comment-16113548 ] 

Ramesh Mani edited comment on RANGER-1501 at 8/3/17 10:08 PM:
--------------------------------------------------------------

reopen to do submit a improvement patch on top of this patch
Review link:https://reviews.apache.org/r/61419/


was (Author: rmani):
reopen to do submit a improvement patch on top of this patch

> Audit Flush to HDFS does not actually cause the audit logs to be flushed to HDFS 
> ---------------------------------------------------------------------------------
>
>                 Key: RANGER-1501
>                 URL: https://issues.apache.org/jira/browse/RANGER-1501
>             Project: Ranger
>          Issue Type: Bug
>          Components: audit
>    Affects Versions: 0.7.0
>            Reporter: Yan
>            Assignee: Yan
>             Fix For: 1.0.0
>
>         Attachments: 0001-RANGER-1501-Audit-Flush-to-HDFS-does-not-actually-ca.patch, 0001-RANGER-1501-Audit-Flush-to-HDFS-improvement.patch
>
>
> The reason is that HDFS file stream's flush() call does not really flush the data all the way to disk, nor even makes the data visible to HDFS users. See the HDFS semantics of the flush/sync at https://issues.apache.org/jira/browse/HADOOP-6313.
> Consequently the audit logs on HDFS won't be visible/durable from HDFS client until the log file is closed. This will, among other issues, boost chances of losing audit logs in case of system failure.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)