You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2022/06/17 12:07:00 UTC
[jira] [Updated] (HDDS-6907) OFS should create buckets with FILE_SYSTEM_OPTIMIZED layout.
[ https://issues.apache.org/jira/browse/HDDS-6907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
ASF GitHub Bot updated HDDS-6907:
---------------------------------
Labels: pull-request-available (was: )
> OFS should create buckets with FILE_SYSTEM_OPTIMIZED layout.
> ------------------------------------------------------------
>
> Key: HDDS-6907
> URL: https://issues.apache.org/jira/browse/HDDS-6907
> Project: Apache Ozone
> Issue Type: Sub-task
> Reporter: Jyotinder Singh
> Assignee: Jyotinder Singh
> Priority: Major
> Labels: pull-request-available
>
> As the config {{ozone.default.bucket.layout}} governs the further created bucket layout type, if the default layout type is changed to OBJECT_STORE and the bucket indirectly created via {{mkdir -p}} command also results in an OBS bucket that doesn't support further FS operations.
> {code:java}
> [root@quasar-kykadl-1 ~]# hdfs dfs -mkdir -p ofs://ozone1/vol/buck1
> 22/06/16 12:23:07 INFO rpc.RpcClient: Creating Bucket: vol/buck1, with om as owner and Versioning false and Storage Type set to DISK and Encryption set to false
> [root@quasar-kykadl-1 ~]# ozone sh bucket info vol/buck1
> {
> "metadata" : { },
> "volumeName" : "vol",
> "name" : "buck1",
> "storageType" : "DISK",
> "versioning" : false,
> "usedBytes" : 0,
> "usedNamespace" : 0,
> "creationTime" : "2022-06-16T12:23:07.538Z",
> "modificationTime" : "2022-06-16T12:23:07.538Z",
> "quotaInBytes" : -1,
> "quotaInNamespace" : -1,
> "bucketLayout" : "OBJECT_STORE",
> "owner" : "om",
> "link" : false
> }
> [root@quasar-kykadl-1 ~]# hdfs dfs -ls ofs://ozone1/vol/buck1
> -ls: Bucket: buck1 has layout: OBJECT_STORE, which does not support file system semantics. Bucket Layout must be FILE_SYSTEM_OPTIMIZED or LEGACY.
> {code}
> *Problems that may arise :*
> In case the user adds a component later after changing the default to OBS, the component's first run of DFS directory creation will be with OBS layout type which doesn't support Filesystem semantics.
> Might see issues with Hive/Spark using Ozone FS.
> Bucket created from fs cli should always be FSO not depending on the default type.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org