You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Marton Elek (Jira)" <ji...@apache.org> on 2020/04/23 16:05:00 UTC
[jira] [Commented] (HDDS-3481) SCM ask 31 datanodes to replicate
the same container
[ https://issues.apache.org/jira/browse/HDDS-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17090723#comment-17090723 ]
Marton Elek commented on HDDS-3481:
-----------------------------------
Thanks to report it [~yjxxtd]. Interesting problem.
A (might be) related problem: it would be great to report the status of the replication back from the datanode. For example Recon would print it out if it would be included in the HB response. (Not sure if that's the final solution, just thinking here....)
> SCM ask 31 datanodes to replicate the same container
> ----------------------------------------------------
>
> Key: HDDS-3481
> URL: https://issues.apache.org/jira/browse/HDDS-3481
> Project: Hadoop Distributed Data Store
> Issue Type: Bug
> Reporter: runzhiwang
> Assignee: runzhiwang
> Priority: Major
> Attachments: screenshot-1.png
>
>
> *What's the problem ?*
> As the image shows, scm ask 31 datanodes to replicate container 2037 every 10 minutes.
> !screenshot-1.png!
> *What's the reason ?*
> Replicate container cost a long time, so if it cannot finish in 10 minutes, scm check the replicate num less than 3, than scm ask another datanode to replicate the container. 19 of 31 datanodes replicate container from the same source datanode, it will also cause big pressure on the source datanode and replicate container become slower. Actually it cost 4 hours to finish the first replicate.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org