You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Jing Zhao (JIRA)" <ji...@apache.org> on 2014/01/18 02:24:27 UTC

[jira] [Resolved] (HDFS-5793) Optimize the serialization of PermissionStatus

     [ https://issues.apache.org/jira/browse/HDFS-5793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jing Zhao resolved HDFS-5793.
-----------------------------

       Resolution: Fixed
    Fix Version/s: HDFS-5698 (FSImage in protobuf)
     Hadoop Flags: Reviewed

I've committed this.

> Optimize the serialization of PermissionStatus
> ----------------------------------------------
>
>                 Key: HDFS-5793
>                 URL: https://issues.apache.org/jira/browse/HDFS-5793
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Haohui Mai
>            Assignee: Haohui Mai
>             Fix For: HDFS-5698 (FSImage in protobuf)
>
>         Attachments: HDFS-5793.000.patch, HDFS-5793.001.patch
>
>
> {{PermissionStatus}} contains the user name, the group name and the permission. It is serialized into two strings and a short.
> Note that the size of unique user / groups names are relatively small, thus this format has some performance penalties. The names are stored multiple times, increasing both the storage size and the overhead of reconstructing the names.
> This jira proposes to serialize {{PermissionStatus}} similar to its in-memory layout. The code can record a mapping between user / group names and ids, and pack user / group / permission into a single 64-bit long.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)