You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-issues@hadoop.apache.org by "Kihwal Lee (JIRA)" <ji...@apache.org> on 2016/08/31 20:17:20 UTC

[jira] [Commented] (HDFS-10822) Log DataNodes in the write pipeline

    [ https://issues.apache.org/jira/browse/HDFS-10822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15453244#comment-15453244 ] 

Kihwal Lee commented on HDFS-10822:
-----------------------------------

bq. Trying to diagnose a slow HDFS flush, taking longer than 10 second...
It might not be relevant in your case, but we've seen a lot of such problems with 2.6, which mostly disappeared after applying HDFS-8791 internally.

In any case, adding the debug log line seems reasonable.

> Log DataNodes in the write pipeline
> -----------------------------------
>
>                 Key: HDFS-10822
>                 URL: https://issues.apache.org/jira/browse/HDFS-10822
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: hdfs-client
>    Affects Versions: 2.6.0
>            Reporter: John Zhuge
>            Assignee: John Zhuge
>            Priority: Trivial
>              Labels: supportability
>
> Trying to diagnose a slow HDFS flush, taking longer than 10 seconds, but did not know which DNs were involved in the write pipeline. Of course, I could search NN log for the list of DNs, but it might not be possible sometimes or convenient.
> Propose to add a DEBUG trace to DataStreamer#setPipeline to print the list of DNs in the pipeline.
> BTW, we do print the list of DNs during pipeline recovery.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org