[jira] [Created] (HDFS-13826) Add a hidden configuration for NameNode to generate fake block locations

["Todd Lipcon (JIRA)" <ji...@apache.org>]

Todd Lipcon created HDFS-13826:
----------------------------------

             Summary: Add a hidden configuration for NameNode to generate fake block locations
                 Key: HDFS-13826
                 URL: https://issues.apache.org/jira/browse/HDFS-13826
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: namenode
            Reporter: Todd Lipcon
            Assignee: Todd Lipcon


In doing testing and benchmarking of the NameNode and dependent systems, it's often useful to be able to use an fsimage provided by some production system in a controlled environment without actually having access to any of the data. For example, while doing some recent work on Apache Impala I was trying to optimize the transmission and storage of block locations and tokens and measure the results based on metadata from a production user. In order to achieve this, it would be useful for the NN to expose a developer-only (undocumented) configuration to generate fake block locations and return them to callers. The "fake" locations should be randomly distributed across a fixed set of fake datanodes.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org