You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@ranger.apache.org by "star (Jira)" <ji...@apache.org> on 2019/12/03 06:50:00 UTC

[jira] [Created] (RANGER-2658) Support million policies in ranger.

star created RANGER-2658:
----------------------------

             Summary: Support million policies in ranger.
                 Key: RANGER-2658
                 URL: https://issues.apache.org/jira/browse/RANGER-2658
             Project: Ranger
          Issue Type: Improvement
          Components: Ranger
    Affects Versions: 1.2.0
            Reporter: star
            Assignee: star


We have nearly a million policies in Tencent. We found many problems by deploying ranger(1.2.0) in such a large scale. It seems that ranger is originally not designed to support large scale policies.

If we would like to support a million policies, the following issues should be emphasized.

   1. Policy import is very slow. It takes us a couple of days to import those policies .

   2. It takes a long time (more than 10s) to search policies by name or user/group in ranger admin. Because it directly go through all policies in cache instead of search from index of database.

   3. It will consume 8GB memory in user process. 

Above problems are relieved in 2.x, but it is not enough.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)