You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Hari Sekhon (JIRA)" <ji...@apache.org> on 2018/07/06 10:02:00 UTC

[jira] [Created] (HDFS-13724) Storage Tiering Show Policies Paths

Hari Sekhon created HDFS-13724:
----------------------------------

             Summary: Storage Tiering Show Policies Paths
                 Key: HDFS-13724
                 URL: https://issues.apache.org/jira/browse/HDFS-13724
             Project: Hadoop HDFS
          Issue Type: Improvement
            Reporter: Hari Sekhon


Improvement Request to add an hdfs storagepolicies command to find paths for which storage policies have been applied.

Right now you must explicitly query a single directory to get its policy to determine if one has been applied, but if another hadoop admin has configured policies on anything but trivially obvious paths such as /archive then there is no way to find which paths have policies applied to them other than by querying every single directory and subdirectory one by one which might potentially have a policy, eg:
{code:java}
hdfs storagepolicies -getStoragePolicy -path /dir3/subdir1
hdfs storagepolicies -getStoragePolicy -path /dir2
hdfs storagepolicies -getStoragePolicy -path /dir3
hdfs storagepolicies -getStoragePolicy -path /dir3/subdir1
hdfs storagepolicies -getStoragePolicy -path /dir3/subdir2
hdfs storagepolicies -getStoragePolicy -path /dir3/subdir3
...
hdfs storagepolicies -getStoragePolicy -path /dirN
...
hdfs storagepolicies -getStoragePolicy -path /dirN/subdirN/subsubdirN
...{code}
In my current environment for example, a policy was configured for /data/blah which doesn't show when trying
{code:java}
 hdfs storagepolicies -getStoragePolicy -path /data{code}
and I had no way of knowing that I had to do:
{code:java}
 hdfs storagepolicies -getStoragePolicy -path /data/blah{code}
other than trial and error of trying every directory and every subdirectory in hdfs.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org