You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by "farmmamba (Jira)" <ji...@apache.org> on 2023/11/24 06:34:00 UTC

[jira] [Created] (HADOOP-18989) Use thread pool to improve the speed of creating control files in TestDFSIO

farmmamba created HADOOP-18989:
----------------------------------

             Summary: Use thread pool to improve the speed of creating control files in TestDFSIO
                 Key: HADOOP-18989
                 URL: https://issues.apache.org/jira/browse/HADOOP-18989
             Project: Hadoop Common
          Issue Type: Improvement
          Components: benchmarks, common
    Affects Versions: 3.3.6
            Reporter: farmmamba
            Assignee: farmmamba


When we use TestDFSIO tool to test the throughouts of HDFS clusters, we found it is so slow in the creating controll files stage. 

After refering to the source code, we found that method createControlFile try to create control files serially. It can be improved by using thread pool.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org