You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by GitBox <gi...@apache.org> on 2021/08/26 07:49:19 UTC
[GitHub] [ozone] iamabug opened a new pull request #2582: HDDS-5564. feature/PrefixFSO.md translation
iamabug opened a new pull request #2582:
URL: https://github.com/apache/ozone/pull/2582
## What changes were proposed in this pull request?
doc translation
## What is the link to the Apache JIRA
https://issues.apache.org/jira/browse/HDDS-5564
## How was this patch tested?
hugo server under docs diectory.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
[GitHub] [ozone] yuangu002 commented on a change in pull request #2582: HDDS-5564. feature/PrefixFSO.md translation
Posted by GitBox <gi...@apache.org>.
yuangu002 commented on a change in pull request #2582:
URL: https://github.com/apache/ozone/pull/2582#discussion_r696847342
##########
File path: hadoop-hdds/docs/content/feature/PrefixFSO.zh.md
##########
@@ -0,0 +1,61 @@
+---
+title: "基于前缀的文件系统优化"
+weight: 2
+menu:
+ main:
+ parent: 特性
+summary: 支持Supports atomic rename and delete operation.
+---
+<!---
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
+-->
+
+基于前缀的文件系统优化特性支持命名空间中任意级别目录的重命名和删除操作，且操作均能在常数时间内完成。
+
+注意：该特性只在 `ozone.om.enable.filesystem.paths` 启用时有效，这意味着对 Hadoop 文件系统的兼容性优先于对 S3 的兼容性，某些不规范的 S3 键名将会被拒绝或规范化。
+
+当 Ozone 中的桶主要通过兼容 Hadoop 的接口使用，尤其是涉及到较深目录层级下的大量文件时，强烈推荐开启该特性。
+
+## OzoneManager 元数据布局格式
+OzoneManager 支持两种元数据布局格式：简单布局格式和基于前缀的布局格式。
+
+在简单布局格式中，OM 采用全路径名来存储每个键的元数据。在基于前缀的优化布局格式中，OM 将中间目录的元数据存储在 `DirectoryTable` 中，将文件的元数据存储在 `FileTable` 中，如下图所示。两张表中的主键要么是目录名，要么是以父目录唯一标识符为前缀的文件名， 形如 `<parent
Review comment:
Thanks @iamabug and @sky76093016 for adding `zh` doc. I think you misunderstood this sentence:
`The key to the table is the name of a directory or a file prefixed by the unique identifier of its parent directory, <parent unique-id>/<filename>.`
This means that the key is in the format of `<parent-id>/<name>`, where the name is either a filename or a directory name (depends on `DirTable` or `FileTable`). So a correct translation should be something like `主键是以父目录唯一标识符为前缀的文件名或目录名`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
[GitHub] [ozone] sky76093016 commented on a change in pull request #2582: HDDS-5564. feature/PrefixFSO.md translation
Posted by GitBox <gi...@apache.org>.
sky76093016 commented on a change in pull request #2582:
URL: https://github.com/apache/ozone/pull/2582#discussion_r696415930
##########
File path: hadoop-hdds/docs/content/feature/PrefixFSO.zh.md
##########
@@ -0,0 +1,61 @@
+---
+title: "基于前缀的文件系统优化"
+weight: 2
+menu:
+ main:
+ parent: 特性
+summary: 支持Supports atomic rename and delete operation.
+---
+<!---
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
+-->
+
+基于前缀的文件系统优化特性支持命名空间中任意级别目录的重命名和删除操作，且操作均能在常数时间内完成。
+
+注意：该特性只在 `ozone.om.enable.filesystem.paths` 启用时有效，这意味着对 Hadoop 文件系统的兼容性优先于对 S3 的兼容性，某些不规范的 S3 键名将会被拒绝或规范化。
+
+当 Ozone 中的桶主要通过兼容 Hadoop 的接口使用，尤其是涉及到较深目录层级下的大量文件时，强烈推荐开启该特性。
+
+## OzoneManager 元数据布局格式
+OzoneManager 支持两种元数据布局格式：简单布局格式和基于前缀的布局格式。
+
+在简单布局格式中，OM 采用全路径名来存储每个键的元数据。在基于前缀的优化布局格式中，OM 将中间目录的元数据存储在 `DirectoryTable` 中，将文件的元数据存储在 `FileTable` 中，如下图所示。两张表中的主键要么是目录名，要么是以父目录唯一标识符为前缀的文件名， 形如 `<parent
Review comment:
Extra space
```suggestion
在简单布局格式中，OM 采用全路径名来存储每个键的元数据。在基于前缀的优化布局格式中，OM 将中间目录的元数据存储在 `DirectoryTable` 中，将文件的元数据存储在 `FileTable` 中，如下图所示。两张表中的主键要么是目录名，要么是以父目录唯一标识符为前缀的文件名，形如 `<parent
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
[GitHub] [ozone] adoroszlai commented on pull request #2582: HDDS-5564. feature/PrefixFSO.md translation
Posted by GitBox <gi...@apache.org>.
adoroszlai commented on pull request #2582:
URL: https://github.com/apache/ozone/pull/2582#issuecomment-1063338258
Thanks @iamabug @sky76093016 @cku328 @yuangu002 for the patch and reviews. What's the next step here?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
[GitHub] [ozone] sky76093016 commented on a change in pull request #2582: HDDS-5564. feature/PrefixFSO.md translation
Posted by GitBox <gi...@apache.org>.
sky76093016 commented on a change in pull request #2582:
URL: https://github.com/apache/ozone/pull/2582#discussion_r696415930
##########
File path: hadoop-hdds/docs/content/feature/PrefixFSO.zh.md
##########
@@ -0,0 +1,61 @@
+---
+title: "基于前缀的文件系统优化"
+weight: 2
+menu:
+ main:
+ parent: 特性
+summary: 支持Supports atomic rename and delete operation.
+---
+<!---
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
+-->
+
+基于前缀的文件系统优化特性支持命名空间中任意级别目录的重命名和删除操作，且操作均能在常数时间内完成。
+
+注意：该特性只在 `ozone.om.enable.filesystem.paths` 启用时有效，这意味着对 Hadoop 文件系统的兼容性优先于对 S3 的兼容性，某些不规范的 S3 键名将会被拒绝或规范化。
+
+当 Ozone 中的桶主要通过兼容 Hadoop 的接口使用，尤其是涉及到较深目录层级下的大量文件时，强烈推荐开启该特性。
+
+## OzoneManager 元数据布局格式
+OzoneManager 支持两种元数据布局格式：简单布局格式和基于前缀的布局格式。
+
+在简单布局格式中，OM 采用全路径名来存储每个键的元数据。在基于前缀的优化布局格式中，OM 将中间目录的元数据存储在 `DirectoryTable` 中，将文件的元数据存储在 `FileTable` 中，如下图所示。两张表中的主键要么是目录名，要么是以父目录唯一标识符为前缀的文件名， 形如 `<parent
Review comment:
1.Extra space
2.`要么` is too colloquial.Would it be better to use `可能`?
```suggestion
在简单布局格式中，OM 采用全路径名来存储每个键的元数据。在基于前缀的优化布局格式中，OM 将中间目录的元数据存储在 `DirectoryTable` 中，将文件的元数据存储在 `FileTable` 中，如下图所示。两张表中的主键可能是目录名，也可能是以父目录唯一标识符为前缀的文件名，形如 `<parent
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
[GitHub] [ozone] iamabug commented on a change in pull request #2582: HDDS-5564. feature/PrefixFSO.md translation
Posted by GitBox <gi...@apache.org>.
iamabug commented on a change in pull request #2582:
URL: https://github.com/apache/ozone/pull/2582#discussion_r702375619
##########
File path: hadoop-hdds/docs/content/feature/PrefixFSO.zh.md
##########
@@ -0,0 +1,61 @@
+---
+title: "基于前缀的文件系统优化"
+weight: 2
+menu:
+ main:
+ parent: 特性
+summary: 支持Supports atomic rename and delete operation.
+---
+<!---
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
+-->
+
+基于前缀的文件系统优化特性支持命名空间中任意级别目录的重命名和删除操作，且操作均能在常数时间内完成。
+
+注意：该特性只在 `ozone.om.enable.filesystem.paths` 启用时有效，这意味着对 Hadoop 文件系统的兼容性优先于对 S3 的兼容性，某些不规范的 S3 键名将会被拒绝或规范化。
+
+当 Ozone 中的桶主要通过兼容 Hadoop 的接口使用，尤其是涉及到较深目录层级下的大量文件时，强烈推荐开启该特性。
+
+## OzoneManager 元数据布局格式
+OzoneManager 支持两种元数据布局格式：简单布局格式和基于前缀的布局格式。
+
+在简单布局格式中，OM 采用全路径名来存储每个键的元数据。在基于前缀的优化布局格式中，OM 将中间目录的元数据存储在 `DirectoryTable` 中，将文件的元数据存储在 `FileTable` 中，如下图所示。两张表中的主键要么是目录名，要么是以父目录唯一标识符为前缀的文件名， 形如 `<parent
Review comment:
thanks @cku328 for the suggestion.
1. I think there is no harm using `完整路径`
2. I am not sure about here. One reason is that the word `existing` seems to be indicating that this is a design doc before PrefixFSO is implemented. Now that Simple and PrefixFSO both exist, it seems unnecessary to mention Simple as existing.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
[GitHub] [ozone] yuangu002 commented on pull request #2582: HDDS-5564. feature/PrefixFSO.md translation
Posted by GitBox <gi...@apache.org>.
yuangu002 commented on pull request #2582:
URL: https://github.com/apache/ozone/pull/2582#issuecomment-906614612
Also, @iamabug could you please add `zh` explanations on the picture? since the picture comes with English.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
[GitHub] [ozone] sky76093016 commented on a change in pull request #2582: HDDS-5564. feature/PrefixFSO.md translation
Posted by GitBox <gi...@apache.org>.
sky76093016 commented on a change in pull request #2582:
URL: https://github.com/apache/ozone/pull/2582#discussion_r696411020
##########
File path: hadoop-hdds/docs/content/feature/PrefixFSO.zh.md
##########
@@ -0,0 +1,61 @@
+---
+title: "基于前缀的文件系统优化"
+weight: 2
+menu:
+ main:
+ parent: 特性
+summary: 支持Supports atomic rename and delete operation.
Review comment:
`支持` and `support` appear repeatedly, it would be better to change to the above.
```suggestion
summary: 支持 atomic 重命名和删除操作
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
[GitHub] [ozone] sky76093016 commented on a change in pull request #2582: HDDS-5564. feature/PrefixFSO.md translation
Posted by GitBox <gi...@apache.org>.
sky76093016 commented on a change in pull request #2582:
URL: https://github.com/apache/ozone/pull/2582#discussion_r696852824
##########
File path: hadoop-hdds/docs/content/feature/PrefixFSO.zh.md
##########
@@ -0,0 +1,61 @@
+---
+title: "基于前缀的文件系统优化"
+weight: 2
+menu:
+ main:
+ parent: 特性
+summary: 支持Supports atomic rename and delete operation.
+---
+<!---
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
+-->
+
+基于前缀的文件系统优化特性支持命名空间中任意级别目录的重命名和删除操作，且操作均能在常数时间内完成。
+
+注意：该特性只在 `ozone.om.enable.filesystem.paths` 启用时有效，这意味着对 Hadoop 文件系统的兼容性优先于对 S3 的兼容性，某些不规范的 S3 键名将会被拒绝或规范化。
+
+当 Ozone 中的桶主要通过兼容 Hadoop 的接口使用，尤其是涉及到较深目录层级下的大量文件时，强烈推荐开启该特性。
+
+## OzoneManager 元数据布局格式
+OzoneManager 支持两种元数据布局格式：简单布局格式和基于前缀的布局格式。
+
+在简单布局格式中，OM 采用全路径名来存储每个键的元数据。在基于前缀的优化布局格式中，OM 将中间目录的元数据存储在 `DirectoryTable` 中，将文件的元数据存储在 `FileTable` 中，如下图所示。两张表中的主键要么是目录名，要么是以父目录唯一标识符为前缀的文件名， 形如 `<parent
Review comment:
I think so.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
[GitHub] [ozone] cku328 commented on a change in pull request #2582: HDDS-5564. feature/PrefixFSO.md translation
Posted by GitBox <gi...@apache.org>.
cku328 commented on a change in pull request #2582:
URL: https://github.com/apache/ozone/pull/2582#discussion_r697131307
##########
File path: hadoop-hdds/docs/content/feature/PrefixFSO.zh.md
##########
@@ -0,0 +1,61 @@
+---
+title: "基于前缀的文件系统优化"
+weight: 2
+menu:
+ main:
+ parent: 特性
+summary: 支持Supports atomic rename and delete operation.
Review comment:
I think it translates to `原子的`.
##########
File path: hadoop-hdds/docs/content/feature/PrefixFSO.zh.md
##########
@@ -0,0 +1,61 @@
+---
+title: "基于前缀的文件系统优化"
+weight: 2
+menu:
+ main:
+ parent: 特性
+summary: 支持Supports atomic rename and delete operation.
+---
+<!---
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
+-->
+
+基于前缀的文件系统优化特性支持命名空间中任意级别目录的重命名和删除操作，且操作均能在常数时间内完成。
+
+注意：该特性只在 `ozone.om.enable.filesystem.paths` 启用时有效，这意味着对 Hadoop 文件系统的兼容性优先于对 S3 的兼容性，某些不规范的 S3 键名将会被拒绝或规范化。
+
+当 Ozone 中的桶主要通过兼容 Hadoop 的接口使用，尤其是涉及到较深目录层级下的大量文件时，强烈推荐开启该特性。
+
+## OzoneManager 元数据布局格式
+OzoneManager 支持两种元数据布局格式：简单布局格式和基于前缀的布局格式。
+
+在简单布局格式中，OM 采用全路径名来存储每个键的元数据。在基于前缀的优化布局格式中，OM 将中间目录的元数据存储在 `DirectoryTable` 中，将文件的元数据存储在 `FileTable` 中，如下图所示。两张表中的主键要么是目录名，要么是以父目录唯一标识符为前缀的文件名， 形如 `<parent
+ unique-id>/<filename>`。
+
+
+
+
+### 基于前缀布局的目录删除操作 ###
+下图描述了进行目录删除操作时 OM 的元数据变化。
+
+
+### 基于前缀布局的目录重命名操作 ###
+下图描述了进行目录重命名操作时 OM 的元数据变化。
+
+
+## 配置
+该特性默认未启用，可以通过在 `ozone-site.xml` 进行如下配置启用：
Review comment:
```suggestion
该特性默认未启用，可以通过在 `ozone-site.xml` 进行如下配置来启用：
```
I think it will read more smoothly.
##########
File path: hadoop-hdds/docs/content/feature/PrefixFSO.zh.md
##########
@@ -0,0 +1,61 @@
+---
+title: "基于前缀的文件系统优化"
+weight: 2
+menu:
+ main:
+ parent: 特性
+summary: 支持Supports atomic rename and delete operation.
+---
+<!---
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
+-->
+
+基于前缀的文件系统优化特性支持命名空间中任意级别目录的重命名和删除操作，且操作均能在常数时间内完成。
+
+注意：该特性只在 `ozone.om.enable.filesystem.paths` 启用时有效，这意味着对 Hadoop 文件系统的兼容性优先于对 S3 的兼容性，某些不规范的 S3 键名将会被拒绝或规范化。
+
+当 Ozone 中的桶主要通过兼容 Hadoop 的接口使用，尤其是涉及到较深目录层级下的大量文件时，强烈推荐开启该特性。
+
+## OzoneManager 元数据布局格式
+OzoneManager 支持两种元数据布局格式：简单布局格式和基于前缀的布局格式。
+
+在简单布局格式中，OM 采用全路径名来存储每个键的元数据。在基于前缀的优化布局格式中，OM 将中间目录的元数据存储在 `DirectoryTable` 中，将文件的元数据存储在 `FileTable` 中，如下图所示。两张表中的主键要么是目录名，要么是以父目录唯一标识符为前缀的文件名， 形如 `<parent
Review comment:
Would it be better to replace `全路径` with `完整路径`?
I think the `existing` in the original text should be mentioned.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
[GitHub] [ozone] iamabug commented on a change in pull request #2582: HDDS-5564. feature/PrefixFSO.md translation
Posted by GitBox <gi...@apache.org>.
iamabug commented on a change in pull request #2582:
URL: https://github.com/apache/ozone/pull/2582#discussion_r696381163
##########
File path: hadoop-hdds/docs/content/feature/PrefixFSO.zh.md
##########
@@ -0,0 +1,61 @@
+---
+title: "基于前缀的文件系统优化"
+weight: 2
+menu:
+ main:
+ parent: 特性
+summary: 支持Supports atomic rename and delete operation.
+---
+<!---
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
+-->
+
+基于前缀的文件系统优化特性支持命名空间中任意级别目录的重命名和删除操作，且操作均能在常数时间内完成。
+
+注意：该特性只在 `ozone.om.enable.filesystem.paths` 启用时有效，这意味着对 Hadoop 文件系统的兼容性优先于对 S3 的兼容性，某些不规范的 S3 键名将会被拒绝或规范化。
+
+当 Ozone 中的桶主要通过兼容 Hadoop 的接口使用，尤其是涉及到较深目录层级下的大量文件时，强烈推荐开启该特性。
+
+## OzoneManager 元数据布局格式
+OzoneManager 支持两种元数据布局格式：简单布局格式和基于前缀的布局格式。
+
+在简单布局格式中，OM 采用全路径名来存储每个键的元数据。在基于前缀的优化布局格式中，OM 将中间目录的元数据存储在 `DirectoryTable` 中，将文件的元数据存储在 `FileTable` 中，如下图所示。两张表中的主键要么是目录名，要么是以父目录唯一标识符为前缀的文件名， 形如 `<parent
+ unique-id>/<filename>`。
+
+
Review comment:
Images in this doc seem fairly large, do we need to resize it or something ? @rakeshadr @elek
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
[GitHub] [ozone] iamabug commented on a change in pull request #2582: HDDS-5564. feature/PrefixFSO.md translation
Posted by GitBox <gi...@apache.org>.
iamabug commented on a change in pull request #2582:
URL: https://github.com/apache/ozone/pull/2582#discussion_r702376328
##########
File path: hadoop-hdds/docs/content/feature/PrefixFSO.zh.md
##########
@@ -0,0 +1,61 @@
+---
+title: "基于前缀的文件系统优化"
+weight: 2
+menu:
+ main:
+ parent: 特性
+summary: 支持Supports atomic rename and delete operation.
+---
+<!---
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
+-->
+
+基于前缀的文件系统优化特性支持命名空间中任意级别目录的重命名和删除操作，且操作均能在常数时间内完成。
+
+注意：该特性只在 `ozone.om.enable.filesystem.paths` 启用时有效，这意味着对 Hadoop 文件系统的兼容性优先于对 S3 的兼容性，某些不规范的 S3 键名将会被拒绝或规范化。
+
+当 Ozone 中的桶主要通过兼容 Hadoop 的接口使用，尤其是涉及到较深目录层级下的大量文件时，强烈推荐开启该特性。
+
+## OzoneManager 元数据布局格式
+OzoneManager 支持两种元数据布局格式：简单布局格式和基于前缀的布局格式。
+
+在简单布局格式中，OM 采用全路径名来存储每个键的元数据。在基于前缀的优化布局格式中，OM 将中间目录的元数据存储在 `DirectoryTable` 中，将文件的元数据存储在 `FileTable` 中，如下图所示。两张表中的主键要么是目录名，要么是以父目录唯一标识符为前缀的文件名， 形如 `<parent
+ unique-id>/<filename>`。
+
+
+
+
+### 基于前缀布局的目录删除操作 ###
+下图描述了进行目录删除操作时 OM 的元数据变化。
+
+
+### 基于前缀布局的目录重命名操作 ###
+下图描述了进行目录重命名操作时 OM 的元数据变化。
+
+
+## 配置
+该特性默认未启用，可以通过在 `ozone-site.xml` 进行如下配置启用：
Review comment:
> Also, @iamabug could you please add `zh` explanations on the picture? since the picture comes with English.
Thanks for the suggestion. I agree it would be better to use a picture with Chinese. I think we need the original to do that since we only have .png file here. cc @elek @rakeshadr
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
[GitHub] [ozone] iamabug commented on a change in pull request #2582: HDDS-5564. feature/PrefixFSO.md translation
Posted by GitBox <gi...@apache.org>.
iamabug commented on a change in pull request #2582:
URL: https://github.com/apache/ozone/pull/2582#discussion_r702376328
##########
File path: hadoop-hdds/docs/content/feature/PrefixFSO.zh.md
##########
@@ -0,0 +1,61 @@
+---
+title: "基于前缀的文件系统优化"
+weight: 2
+menu:
+ main:
+ parent: 特性
+summary: 支持Supports atomic rename and delete operation.
+---
+<!---
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
+-->
+
+基于前缀的文件系统优化特性支持命名空间中任意级别目录的重命名和删除操作，且操作均能在常数时间内完成。
+
+注意：该特性只在 `ozone.om.enable.filesystem.paths` 启用时有效，这意味着对 Hadoop 文件系统的兼容性优先于对 S3 的兼容性，某些不规范的 S3 键名将会被拒绝或规范化。
+
+当 Ozone 中的桶主要通过兼容 Hadoop 的接口使用，尤其是涉及到较深目录层级下的大量文件时，强烈推荐开启该特性。
+
+## OzoneManager 元数据布局格式
+OzoneManager 支持两种元数据布局格式：简单布局格式和基于前缀的布局格式。
+
+在简单布局格式中，OM 采用全路径名来存储每个键的元数据。在基于前缀的优化布局格式中，OM 将中间目录的元数据存储在 `DirectoryTable` 中，将文件的元数据存储在 `FileTable` 中，如下图所示。两张表中的主键要么是目录名，要么是以父目录唯一标识符为前缀的文件名， 形如 `<parent
+ unique-id>/<filename>`。
+
+
+
+
+### 基于前缀布局的目录删除操作 ###
+下图描述了进行目录删除操作时 OM 的元数据变化。
+
+
+### 基于前缀布局的目录重命名操作 ###
+下图描述了进行目录重命名操作时 OM 的元数据变化。
+
+
+## 配置
+该特性默认未启用，可以通过在 `ozone-site.xml` 进行如下配置启用：
Review comment:
> Also, @iamabug could you please add `zh` explanations on the picture? since the picture comes with English.
Thanks for the suggestion. I agree it would be better to use a picture with Chinese. I think we need the original to do that since we only have .png file here. cc @elek @rakeshadr
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
[GitHub] [ozone] iamabug commented on a change in pull request #2582: HDDS-5564. feature/PrefixFSO.md translation
Posted by GitBox <gi...@apache.org>.
iamabug commented on a change in pull request #2582:
URL: https://github.com/apache/ozone/pull/2582#discussion_r702376048
##########
File path: hadoop-hdds/docs/content/feature/PrefixFSO.zh.md
##########
@@ -0,0 +1,61 @@
+---
+title: "基于前缀的文件系统优化"
+weight: 2
+menu:
+ main:
+ parent: 特性
+summary: 支持Supports atomic rename and delete operation.
+---
+<!---
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
+-->
+
+基于前缀的文件系统优化特性支持命名空间中任意级别目录的重命名和删除操作，且操作均能在常数时间内完成。
+
+注意：该特性只在 `ozone.om.enable.filesystem.paths` 启用时有效，这意味着对 Hadoop 文件系统的兼容性优先于对 S3 的兼容性，某些不规范的 S3 键名将会被拒绝或规范化。
+
+当 Ozone 中的桶主要通过兼容 Hadoop 的接口使用，尤其是涉及到较深目录层级下的大量文件时，强烈推荐开启该特性。
+
+## OzoneManager 元数据布局格式
+OzoneManager 支持两种元数据布局格式：简单布局格式和基于前缀的布局格式。
+
+在简单布局格式中，OM 采用全路径名来存储每个键的元数据。在基于前缀的优化布局格式中，OM 将中间目录的元数据存储在 `DirectoryTable` 中，将文件的元数据存储在 `FileTable` 中，如下图所示。两张表中的主键要么是目录名，要么是以父目录唯一标识符为前缀的文件名， 形如 `<parent
Review comment:
thanks @yuangu002 I think you are right.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
[GitHub] [ozone] iamabug commented on pull request #2582: HDDS-5564. feature/PrefixFSO.md translation
Posted by GitBox <gi...@apache.org>.
iamabug commented on pull request #2582:
URL: https://github.com/apache/ozone/pull/2582#issuecomment-906178956
cc @sky76093016
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
[GitHub] [ozone] iamabug commented on pull request #2582: HDDS-5564. feature/PrefixFSO.md translation
Posted by GitBox <gi...@apache.org>.
iamabug commented on pull request #2582:
URL: https://github.com/apache/ozone/pull/2582#issuecomment-913097170
> Also, @iamabug could you please add `zh` explanations on the picture? since the picture comes with English.
Thanks for the suggestion. I agree it would be better to use a picture with Chinese. I think we need the original to do that since we only have .png file here. cc @elek @rakeshadr
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
[GitHub] [ozone] yuangu002 commented on pull request #2582: HDDS-5564. feature/PrefixFSO.md translation
Posted by GitBox <gi...@apache.org>.
yuangu002 commented on pull request #2582:
URL: https://github.com/apache/ozone/pull/2582#issuecomment-913218226
> > Also, @iamabug could you please add `zh` explanations on the picture? since the picture comes with English.
>
> Thanks for the suggestion. I agree it would be better to use a picture with Chinese. I think we need the original to do that since we only have .png file here. cc @elek @rakeshadr
I don't think you need separate pictures. We can use the original pictures, but add an explanation in Chinese which explains what the picture is saying. For example, for the first picture (Legacy layout), you can add a short description (`alt text`) in Chinese like: 在传统的OM元数据格式中，我们采用完整路径，并且用尾部斜杠来区分目录和键。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
[GitHub] [ozone] yuangu002 commented on a change in pull request #2582: HDDS-5564. feature/PrefixFSO.md translation
Posted by GitBox <gi...@apache.org>.
yuangu002 commented on a change in pull request #2582:
URL: https://github.com/apache/ozone/pull/2582#discussion_r696847342
##########
File path: hadoop-hdds/docs/content/feature/PrefixFSO.zh.md
##########
@@ -0,0 +1,61 @@
+---
+title: "基于前缀的文件系统优化"
+weight: 2
+menu:
+ main:
+ parent: 特性
+summary: 支持Supports atomic rename and delete operation.
+---
+<!---
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
+-->
+
+基于前缀的文件系统优化特性支持命名空间中任意级别目录的重命名和删除操作，且操作均能在常数时间内完成。
+
+注意：该特性只在 `ozone.om.enable.filesystem.paths` 启用时有效，这意味着对 Hadoop 文件系统的兼容性优先于对 S3 的兼容性，某些不规范的 S3 键名将会被拒绝或规范化。
+
+当 Ozone 中的桶主要通过兼容 Hadoop 的接口使用，尤其是涉及到较深目录层级下的大量文件时，强烈推荐开启该特性。
+
+## OzoneManager 元数据布局格式
+OzoneManager 支持两种元数据布局格式：简单布局格式和基于前缀的布局格式。
+
+在简单布局格式中，OM 采用全路径名来存储每个键的元数据。在基于前缀的优化布局格式中，OM 将中间目录的元数据存储在 `DirectoryTable` 中，将文件的元数据存储在 `FileTable` 中，如下图所示。两张表中的主键要么是目录名，要么是以父目录唯一标识符为前缀的文件名， 形如 `<parent
Review comment:
Thanks @iamabug and @sky76093016 for adding `zh` doc. I think you misunderstood this sentence:
`The key to the table is the name of a directory or a file prefixed by the unique identifier of its parent directory, <parent unique-id>/<filename>.`
This means that the key is in the format of `<parent-id>/<name>`, where the name is either a filename or a directory name (depends on `DirTable` or `KeyTable`). So a correct translation should be something like `主键是以父目录唯一标识符为前缀的文件名或目录名`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org