You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-dev@hadoop.apache.org by "Vinay (JIRA)" <ji...@apache.org> on 2013/11/05 14:12:21 UTC

[jira] [Created] (HDFS-5463) NameNode should limit to number of blocks per file

Vinay created HDFS-5463:
---------------------------

             Summary: NameNode should limit to number of blocks per file
                 Key: HDFS-5463
                 URL: https://issues.apache.org/jira/browse/HDFS-5463
             Project: Hadoop HDFS
          Issue Type: Bug
            Reporter: Vinay
            Assignee: Vinay


Currently there is no limit to number of blocks user can write to a file.

And blocksize also can be set to minimum possible.

User can write any number of blocks continously, which may create problems in NameNodes performance and service as the number of blocks of file increases.
Because each time new block allocated, all blocks  of the file will be persisted, and this can cause serious performance degradation


So proposal is to limit the number of maximum blocks a user can write to a file.

May be 1024 blocks(if 128*MB is block size then 128 GB can be max file size)



--
This message was sent by Atlassian JIRA
(v6.1#6144)