You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Supratim Deka (Jira)" <ji...@apache.org> on 2019/11/13 06:54:00 UTC

[jira] [Created] (HDDS-2466) Split OM Key into a Prefix Part and a Name Part

Supratim Deka created HDDS-2466:
-----------------------------------

             Summary: Split OM Key into a Prefix Part and a Name Part
                 Key: HDDS-2466
                 URL: https://issues.apache.org/jira/browse/HDDS-2466
             Project: Hadoop Distributed Data Store
          Issue Type: Improvement
          Components: Ozone Manager
            Reporter: Supratim Deka
            Assignee: Supratim Deka


OM stores every key in a key table, which maps the key to a KeyInfo.

If we split the key into a prefix and a name part which are then stored in separate tables, serves 2 purposes:
1. OzoneFS operations can be made efficient by deriving a prefix tree representation of the pathnames(prefixes) - details of this are outside the current scope. Also, the prefix table can get preferential treatment when it comes to caching.
2. PutKey is not penalised by having to parse the key into each path component - this is for cases where the dataset is a pure object store. Splitting into a prefix and a name is the minimal work to be done inline during the putKey operation.




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org