You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Tsz Wo Nicholas Sze (JIRA)" <ji...@apache.org> on 2016/02/23 23:39:18 UTC
[jira] [Commented] (HDFS-9536) OOM errors during parallel upgrade
to Block-ID based layout
[ https://issues.apache.org/jira/browse/HDFS-9536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15159789#comment-15159789 ]
Tsz Wo Nicholas Sze commented on HDFS-9536:
-------------------------------------------
In LinkArgs, src and dst are both absolute paths so that it wastes a lot of memory to store the common directory prefix. We should be able to break them into blockId, srcRelativeDir, srcRoot and dstRoot. Then, we can compute src from blockId, srcRelativeDir and srcRoot, and dst from blockId and dstRoot.
> OOM errors during parallel upgrade to Block-ID based layout
> -----------------------------------------------------------
>
> Key: HDFS-9536
> URL: https://issues.apache.org/jira/browse/HDFS-9536
> Project: Hadoop HDFS
> Issue Type: Bug
> Reporter: Vinayakumar B
> Assignee: Vinayakumar B
>
> This is a follow-up jira for the OOM errors observed during parallel upgrade to Block-ID based datanode layout using HDFS-8578 fix.
> more clue [here|https://issues.apache.org/jira/browse/HDFS-8578?focusedCommentId=15042012&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15042012]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)