[jira] [Updated] (HDFS-11923) Stress test of DFSNetworkTopology

["Chen Liang (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HDFS-11923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chen Liang updated HDFS-11923:
------------------------------
    Attachment: HDFS-11923.003.patch

Instead of running the test indefinitely, v003 patch changes to running a certain of operations. Thanks [~ajayydv] for the suggestion.

> Stress test of DFSNetworkTopology
> ---------------------------------
>
>                 Key: HDFS-11923
>                 URL: https://issues.apache.org/jira/browse/HDFS-11923
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: namenode
>            Reporter: Chen Liang
>            Assignee: Chen Liang
>         Attachments: HDFS-11923.001.patch, HDFS-11923.002.patch, HDFS-11923.003.patch
>
>
> I wrote a stress test with {{DFSNetworkTopology}} to verify its correctness under huge number of datanode changes e.g., data node insert/delete, storage addition/removal etc. The goal is to show that the topology maintains the correct counters all time. The test is written that, unless manually terminated, it will keep randomly performing the operations nonstop. (and because of this, the test is ignored in the patch).
> My local test lasted 40 min before I stopped it, it involved more than one million datanode changes, and no error happened. We believe this should be sufficient to show the correctness of {{DFSNetworkTopology}}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org