You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "liaoyuxiangqin (JIRA)" <ji...@apache.org> on 2018/02/07 03:10:03 UTC
[jira] [Commented] (HDFS-7786) Handle slow writers for
DFSStripedOutputStream
[ https://issues.apache.org/jira/browse/HDFS-7786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16354898#comment-16354898 ]
liaoyuxiangqin commented on HDFS-7786:
--------------------------------------
[~libo-intel] I take a think on this issue, and want to process as follows:
1.select the slow streamers when one block group write end through comprehensive consideration slow threshold and time consuming Median.
2.use slow streams target datanodes as excluded nodes for next block group allocate, so that avoid write data to slow datanodes. Thanks.
Can you give me more advice!
> Handle slow writers for DFSStripedOutputStream
> ----------------------------------------------
>
> Key: HDFS-7786
> URL: https://issues.apache.org/jira/browse/HDFS-7786
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Reporter: Li Bo
> Priority: Major
> Labels: hdfs-ec-3.0-nice-to-have
> Fix For: HDFS-7285
>
>
> The streamers in DFSStripedOutputStream may have different write speed. We need to consider and handle the situation when one or more streamers begin to write slowly.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org