You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Walter Su (JIRA)" <ji...@apache.org> on 2015/06/11 13:54:01 UTC
[jira] [Updated] (HDFS-8580) Erasure coding: Persist cellSize in
BlockInfoStriped and StripedBlockProto
[ https://issues.apache.org/jira/browse/HDFS-8580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Walter Su updated HDFS-8580:
----------------------------
Description:
Zhe Zhang, Kai Zheng and I had a offline discussion. Here is what we thought: Add a cellSize field in BlockInfoStriped as a workaround, and deal with memory usage in follow-on.(HDFS-8059)
discussion in HDFS-8494:
from Walter Su:
{quote}
I think BlockInfoStriped needs to keep cellSize.
{quote}
from [~vinayrpet]:
{quote}
I too was thinking the same when the FSImageLoader problem has came up.
{quote}
from [~jingzhao]
{quote}
Also, we should consider adding a chunk size field to StripedBlockProto and removing the cell size field from HdfsFileStatus. In this way we can access the chunk size information in the storage layer.
{quote}
was:
Zhe Zhang, Kai Zheng and I had a offline discussion. Here is what we thought: Add a cellSize field in BlockInfoStriped as a workaround, and deal with memory usage in follow-on.
discussion in HDFS-8494:
from [~jingzhao]
{quote}
Also, we should consider adding a chunk size field to StripedBlockProto and removing the cell size field from HdfsFileStatus. In this way we can access the chunk size information in the storage layer.
{quote}
> Erasure coding: Persist cellSize in BlockInfoStriped and StripedBlockProto
> --------------------------------------------------------------------------
>
> Key: HDFS-8580
> URL: https://issues.apache.org/jira/browse/HDFS-8580
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Reporter: Walter Su
> Assignee: Walter Su
>
> Zhe Zhang, Kai Zheng and I had a offline discussion. Here is what we thought: Add a cellSize field in BlockInfoStriped as a workaround, and deal with memory usage in follow-on.(HDFS-8059)
> discussion in HDFS-8494:
> from Walter Su:
> {quote}
> I think BlockInfoStriped needs to keep cellSize.
> {quote}
> from [~vinayrpet]:
> {quote}
> I too was thinking the same when the FSImageLoader problem has came up.
> {quote}
> from [~jingzhao]
> {quote}
> Also, we should consider adding a chunk size field to StripedBlockProto and removing the cell size field from HdfsFileStatus. In this way we can access the chunk size information in the storage layer.
> {quote}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)