You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org> on 2008/05/06 01:49:55 UTC

[jira] Updated: (HADOOP-3347) FSEditLog should not writes long and short as UTF8 and should not use ArrayWritable for writing non-array items

     [ https://issues.apache.org/jira/browse/HADOOP-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-3347:
-------------------------------------------

    Description: 
In FSEditLog, 

- long and short are first converted to String and are further converted to UTF8

- For some non-array items, it first create an ArrayWritable object to hold all the items and then writes the ArrayWritable object.

These result creating many intermediate objects which affects Namenode CPU performance and Namenode restart.

> FSEditLog should not writes long and short as UTF8 and should not use ArrayWritable for writing non-array items
> ---------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-3347
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3347
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: dfs
>            Reporter: Tsz Wo (Nicholas), SZE
>
> In FSEditLog, 
> - long and short are first converted to String and are further converted to UTF8
> - For some non-array items, it first create an ArrayWritable object to hold all the items and then writes the ArrayWritable object.
> These result creating many intermediate objects which affects Namenode CPU performance and Namenode restart.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.