You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@ranger.apache.org by "Mahesh Hanumant Bandal (Jira)" <ji...@apache.org> on 2022/01/28 10:46:00 UTC

[jira] [Updated] (RANGER-3518) Limit the query size stored in Audit logs

     [ https://issues.apache.org/jira/browse/RANGER-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mahesh Hanumant Bandal updated RANGER-3518:
-------------------------------------------
    Description: 
Ranger audit stores complete query as it is in audit logs. If the single query size is too large (i.e reqData > 10MB) it consumes large heap size on hive plugin size. When similar 200-300 queries are executed simultaneously, ranger audit takes up more than half of the heap.

We need to configure ranger to limit the query size stored in Audit logs. We can set value for config "xasecure.audit.solr.limit.query.req.size" in ranger-hive-audit.xml Recommended value is 1024; however default value is set to Integer.MAX_VALUE

  was:
Ranger audit stores complete query as it is in audit logs. If the single query size is too large (i.e reqData > 10MB) it consumes large heap size on hive plugin size. When similar 200-300 queries are executed simultaneously, ranger audit takes up more than half of the heap.

We need to configure ranger to limit the query size stored in Audit logs (defaults to 1024 characters)


> Limit the query size stored in Audit logs
> -----------------------------------------
>
>                 Key: RANGER-3518
>                 URL: https://issues.apache.org/jira/browse/RANGER-3518
>             Project: Ranger
>          Issue Type: Improvement
>          Components: Ranger
>    Affects Versions: 3.0.0
>            Reporter: Mahesh Hanumant Bandal
>            Assignee: Mahesh Hanumant Bandal
>            Priority: Major
>             Fix For: 3.0.0
>
>
> Ranger audit stores complete query as it is in audit logs. If the single query size is too large (i.e reqData > 10MB) it consumes large heap size on hive plugin size. When similar 200-300 queries are executed simultaneously, ranger audit takes up more than half of the heap.
> We need to configure ranger to limit the query size stored in Audit logs. We can set value for config "xasecure.audit.solr.limit.query.req.size" in ranger-hive-audit.xml Recommended value is 1024; however default value is set to Integer.MAX_VALUE



--
This message was sent by Atlassian Jira
(v8.20.1#820001)