[jira] [Created] (SENTRY-1826) Create a on demand ACL based HDFS Name Node plugin

["Brian Towles (JIRA)" <ji...@apache.org>]

Brian Towles created SENTRY-1826:
------------------------------------

             Summary: Create a on demand ACL based HDFS Name Node plugin 
                 Key: SENTRY-1826
                 URL: https://issues.apache.org/jira/browse/SENTRY-1826
             Project: Sentry
          Issue Type: Improvement
          Components: Hdfs Plugin
            Reporter: Brian Towles


Since the majority of files on an HDFS system are not used all the time, a plugin could be put into place that gets the ACLs from the Sentry server only when needed.  This could be done in a different plugin then the current HDFS name node plugin to allow either mechanism to be used based on the implementation choice.

This would pull ACLs from sentry on the _getAclFeature_ call that would make a direct call to sentry for those ACLs or from a local cache if its already been retrieved once. 

The current mechanism for taking updates could be replaces by a mechanism that polls for updates from Sentry and only applies/removes updates to items that are in the local cache.  This would keep items in the cache fresh to changes and still only populate as is currently being used.

This would also allow us to have programmatic and/or config driven control of the size of the number of items in the cache.  It could be based on size or last used timeouts for evictions.  This way more frequently used ACLs are kept in cache but allow for tuning of the total amount 
of space that is used to store ACLs within the Name Name itself.





--
This message was sent by Atlassian JIRA
(v6.4.14#64029)