You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "dragon (JIRA)" <ji...@apache.org> on 2016/03/15 09:16:35 UTC

[jira] [Created] (HDFS-10066) CLONE - Erasure coding: consolidate striping-related terminologies

dragon created HDFS-10066:
-----------------------------

             Summary: CLONE - Erasure coding: consolidate striping-related terminologies
                 Key: HDFS-10066
                 URL: https://issues.apache.org/jira/browse/HDFS-10066
             Project: Hadoop HDFS
          Issue Type: Sub-task
            Reporter: dragon
            Assignee: Zhe Zhang


Right now we are doing striping-based I/O in a number of places:
# Client output stream (HDFS-7889)
# Client input stream
#* pread (HDFS-7782, HDFS-7678)
#* stateful read (HDFS-8033, HDFS-8281, HDFS-8319)
# DN reconstruction (HDFS-7348)

In each place we use one or multiple of the following terminologies:
# Cell
# Stripe
# Block group
# Internal block
# Chunk

This JIRA aims to systematically define these terminologies in relation with each other and in the context of the containing file. For example, a cell belong to stripe _i_ and internal block _j_ can be indexed as {{(i, j)}} and its logical index _k_ in the file can be calculated.

With the above consolidation, hopefully we can further consolidate striping I/O codes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)