[jira] [Created] (HDDS-6907) OFS should create buckets with FILE_SYSTEM_OPTIMIZED layout.

["Jyotinder Singh (Jira)" <ji...@apache.org>]

Jyotinder Singh created HDDS-6907:
-------------------------------------

             Summary: OFS should create buckets with FILE_SYSTEM_OPTIMIZED layout.
                 Key: HDDS-6907
                 URL: https://issues.apache.org/jira/browse/HDDS-6907
             Project: Apache Ozone
          Issue Type: Sub-task
            Reporter: Jyotinder Singh
            Assignee: Jyotinder Singh


As the config {{ozone.default.bucket.layout}} governs the further created bucket layout type, if the default layout type is changed to OBJECT_STORE and the bucket indirectly created via {{mkdir -p}} command also results in an OBS bucket that doesn't support further FS operations.
{code:java}
[root@quasar-kykadl-1 ~]# hdfs dfs -mkdir -p ofs://ozone1/vol/buck1
22/06/16 12:23:07 INFO rpc.RpcClient: Creating Bucket: vol/buck1, with om as owner and Versioning false and Storage Type set to DISK and Encryption set to false
[root@quasar-kykadl-1 ~]# ozone sh bucket info vol/buck1
{
  "metadata" : { },
  "volumeName" : "vol",
  "name" : "buck1",
  "storageType" : "DISK",
  "versioning" : false,
  "usedBytes" : 0,
  "usedNamespace" : 0,
  "creationTime" : "2022-06-16T12:23:07.538Z",
  "modificationTime" : "2022-06-16T12:23:07.538Z",
  "quotaInBytes" : -1,
  "quotaInNamespace" : -1,
  "bucketLayout" : "OBJECT_STORE",
  "owner" : "om",
  "link" : false
}
[root@quasar-kykadl-1 ~]# hdfs dfs -ls ofs://ozone1/vol/buck1
-ls: Bucket: buck1 has layout: OBJECT_STORE, which does not support file system semantics. Bucket Layout must be FILE_SYSTEM_OPTIMIZED or LEGACY.
 {code}
*Problems that may arise :*
In case the user adds a component later after changing the default to OBS, the component's first run of DFS directory creation will be with OBS layout type which doesn't support Filesystem semantics. 
Might see issues with Hive/Spark using Ozone FS.

Bucket created from fs cli should always be FSO not depending on the default type.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org