You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Jing Zhao (JIRA)" <ji...@apache.org> on 2013/12/05 19:59:35 UTC
[jira] [Created] (HDFS-5633) Improve OfflineImageViewer to use less
memory
Jing Zhao created HDFS-5633:
-------------------------------
Summary: Improve OfflineImageViewer to use less memory
Key: HDFS-5633
URL: https://issues.apache.org/jira/browse/HDFS-5633
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Jing Zhao
Assignee: Jing Zhao
Priority: Minor
Currently after we rename a file/dir which is included in a snapshot, the file/dir can be linked with two different reference INodes. To avoid saving/loading the inode multiple times in/from FSImage, we use a temporary map to record whether we have visited this inode before.
However, in OfflineImageViewer (specifically, in ImageLoaderCurrent), the current implementation simply records all the directory inodes. This can take a lot of memory when the fsimage is big. We should only record an inode in the temp map when it is referenced by an INodeReference, just like what we do in FSImageFormat.
--
This message was sent by Atlassian JIRA
(v6.1#6144)