You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ranger.apache.org by "Abhay Kulkarni (Jira)" <ji...@apache.org> on 2019/12/10 20:54:00 UTC

[jira] [Commented] (RANGER-2658) Support million policies in ranger.

    [ https://issues.apache.org/jira/browse/RANGER-2658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16992938#comment-16992938 ] 

Abhay Kulkarni commented on RANGER-2658:
----------------------------------------

Could you please quantify Ranger 1.2 performance against Ranger 2.x? Which of the highlighted issues have been positively affected? Thanks!

> Support million policies in ranger.
> -----------------------------------
>
>                 Key: RANGER-2658
>                 URL: https://issues.apache.org/jira/browse/RANGER-2658
>             Project: Ranger
>          Issue Type: Improvement
>          Components: Ranger
>    Affects Versions: 1.2.0
>            Reporter: star
>            Assignee: star
>            Priority: Major
>
> We have nearly a million policies in Tencent. We found many problems by deploying ranger(1.2.0) in such a large scale. It seems that ranger is originally not designed to support large scale policies.
> If we would like to support a million policies, the following issues should be emphasized.
>    1. Policy import is very slow. It takes us a couple of days to import those policies .
>    2. It takes a long time (more than 10s) to search policies by name or user/group in ranger admin. Because it directly go through all policies in cache instead of search from index of database.
>    3. It will consume 8GB memory in user process. 
> Above problems are relieved in 2.x, but it is not enough.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)