[GitHub] [ranger] eubnara opened a new pull request, #255: RANGER-4236: enhance Ranger JSON audit to HDFS by compressing as gzip

["eubnara (via GitHub)" <gi...@apache.org>]

eubnara opened a new pull request, #255:
URL: https://github.com/apache/ranger/pull/255

   ## What changes were proposed in this pull request?
   
   It will support gzip compression for ranger json audit to HDFS.
   This feature can be enabled by setting as follows:
   
   ```
   xasecure.audit.destination.hdfs.file.gzip.compression.enabled=true
   ```
   
   
   ## How was this patch tested?
   
   Manual tests on on-premise Hadoop cluster with several ranger-*-plugins.
   
   - ranger-hbase-plugin
   - ranger-hdfs-plugin
   - ranger-hive-plugin
   - ranger-impala-plugin
   - ranger-yarn-plugin
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@ranger.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [ranger] eubnara commented on a diff in pull request #255: RANGER-4236: enhance Ranger JSON audit to HDFS by compressing as gzip

["eubnara (via GitHub)" <gi...@apache.org>]

eubnara commented on code in PR #255:
URL: https://github.com/apache/ranger/pull/255#discussion_r1194459122


##########
agents-audit/src/main/java/org/apache/ranger/audit/utils/AbstractRangerAuditWriter.java:
##########
@@ -121,6 +128,8 @@ public void createFileSystemFolders() throws Exception {
 
     public  Configuration createConfiguration() {
         Configuration conf = new Configuration();
+        // to close gracefully after flushing
+        conf.setBoolean("fs.hdfs.impl.disable.cache", true);

Review Comment:
   It is needed to finish writing gzip trailer when closing it.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@ranger.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org