[jira] [Created] (HDDS-7444) Improvement for ozone -du/df functionalities

["Dave Teng (Jira)" <ji...@apache.org>]

Dave Teng created HDDS-7444:
-------------------------------

             Summary: Improvement for ozone -du/df functionalities
                 Key: HDDS-7444
                 URL: https://issues.apache.org/jira/browse/HDDS-7444
             Project: Apache Ozone
          Issue Type: Improvement
          Components: Ozone Filesystem
            Reporter: Dave Teng


This is an umbrella jira for Ozones's du/df functionalities improvement:

Current Status

Related found issues:

[HDDS-7260|https://issues.apache.org/jira/browse/HDDS-7260]

[HDDS-7443|https://issues.apache.org/jira/browse/HDDS-7443]


What is supported: 

du:
- du supports _admin_ user to query on volume/bucket/directory level (only supported in _FSO_ type of bucket)
with command 
{code:java}
ozone namespace du -r /vol1/bucket1/dir{code}
df:
- df supports _admin_ user to query quota on _bucket_ level (need _FSO_ type)
{code:java}
ozone admin namespace quota /vol1/bucket1 {code}

What Not-Supported:

du:
- not supported for _non-admin_ users

df:
- not supported for _non-admin_ user
- not supported on *directory* level for _admin_ user

 

Propossal:

In order to enable du/df to work for both admin/non-admin users,
We'd like to improve the integration between Recon & Ozone.

Though another possible solution is to use SCM to sum up du/df statistics and returns to OM,
but this requires SCM to traverse all keys of the target directory, which might cause performance disadvange on SCM.

Thus we think using Recon might be a better solution.

What work is required:

1. Currently there is no ACL management in Recon.
We have to firstly integrate ACL management into Recon.(For example, Ranger)


2. Utilize Recon API for ozone du command on volume/bucket/ directory level, with ACL integrated.

3. Utilize Recon API for ozone df command on volume/bucket/ directory level, with ACL integrated.

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org