You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Jing Zhao (JIRA)" <ji...@apache.org> on 2014/01/18 02:24:27 UTC
[jira] [Resolved] (HDFS-5793) Optimize the serialization of
PermissionStatus
[ https://issues.apache.org/jira/browse/HDFS-5793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jing Zhao resolved HDFS-5793.
-----------------------------
Resolution: Fixed
Fix Version/s: HDFS-5698 (FSImage in protobuf)
Hadoop Flags: Reviewed
I've committed this.
> Optimize the serialization of PermissionStatus
> ----------------------------------------------
>
> Key: HDFS-5793
> URL: https://issues.apache.org/jira/browse/HDFS-5793
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Reporter: Haohui Mai
> Assignee: Haohui Mai
> Fix For: HDFS-5698 (FSImage in protobuf)
>
> Attachments: HDFS-5793.000.patch, HDFS-5793.001.patch
>
>
> {{PermissionStatus}} contains the user name, the group name and the permission. It is serialized into two strings and a short.
> Note that the size of unique user / groups names are relatively small, thus this format has some performance penalties. The names are stored multiple times, increasing both the storage size and the overhead of reconstructing the names.
> This jira proposes to serialize {{PermissionStatus}} similar to its in-memory layout. The code can record a mapping between user / group names and ids, and pack user / group / permission into a single 64-bit long.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)