You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ranger.apache.org by Madhan Neethiraj <ma...@apache.org> on 2023/05/11 08:51:37 UTC

Review Request 74428: RANGER-4235: security-zone persistence optimized to avoid creation of unnecessary ref table entries

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/74428/
-----------------------------------------------------------

Review request for ranger, Abhishek  Kumar, Ankita Sinha, Abhay Kulkarni, Mehul Parikh, Monika Kachhadiya, Pradeep Agrawal, Ramesh Mani, Sailaja Polavarapu, Subhrat Chaudhary, and Velmurugan Periasamy.


Bugs: RANGER-4235
    https://issues.apache.org/jira/browse/RANGER-4235


Repository: ranger


Description
-------

Optimized to create only one ref-table entry per resource-type. With this optimization, for a security-zone containing 10,000 Hive tables, 2 ref-table entries are created instead of 20,000 ref-table entries.


Diffs
-----

  security-admin/src/main/java/org/apache/ranger/biz/SecurityZoneRefUpdater.java 4cfe62701 


Diff: https://reviews.apache.org/r/74428/diff/1/


Testing
-------

- create and updated security zones having 10 resources to 50,000 resources
- creating security zone with 10,000 resources took 10m46s; with this optimization, the same operation took less than 2 seconds
- updating security zone having 1,000 resources with 5,000 resources took 6m3s; with this optimization the same operation took less than 0.5 second


Thanks,

Madhan Neethiraj


Re: Review Request 74428: RANGER-4235: security-zone persistence optimized to avoid creation of unnecessary ref table entries

Posted by Ankita Sinha <an...@freestoneinfotech.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/74428/#review225449
-----------------------------------------------------------


Ship it!




Ship It!

- Ankita Sinha


On May 11, 2023, 8:51 a.m., Madhan Neethiraj wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/74428/
> -----------------------------------------------------------
> 
> (Updated May 11, 2023, 8:51 a.m.)
> 
> 
> Review request for ranger, Abhishek  Kumar, Ankita Sinha, Abhay Kulkarni, Mehul Parikh, Monika Kachhadiya, Pradeep Agrawal, Ramesh Mani, Sailaja Polavarapu, Subhrat Chaudhary, and Velmurugan Periasamy.
> 
> 
> Bugs: RANGER-4235
>     https://issues.apache.org/jira/browse/RANGER-4235
> 
> 
> Repository: ranger
> 
> 
> Description
> -------
> 
> Optimized to create only one ref-table entry per resource-type. With this optimization, for a security-zone containing 10,000 Hive tables, 2 ref-table entries are created instead of 20,000 ref-table entries.
> 
> 
> Diffs
> -----
> 
>   security-admin/src/main/java/org/apache/ranger/biz/SecurityZoneRefUpdater.java 4cfe62701 
> 
> 
> Diff: https://reviews.apache.org/r/74428/diff/1/
> 
> 
> Testing
> -------
> 
> - create and updated security zones having 10 resources to 50,000 resources
> - creating security zone with 10,000 resources took 10m46s; with this optimization, the same operation took less than 2 seconds
> - updating security zone having 1,000 resources with 5,000 resources took 6m3s; with this optimization the same operation took less than 0.5 second
> 
> 
> Thanks,
> 
> Madhan Neethiraj
> 
>