You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Hanisha Koneru (JIRA)" <ji...@apache.org> on 2017/05/09 23:13:04 UTC

[jira] [Created] (HDFS-11789) Maintain Short-Circuit Read Statistics

Hanisha Koneru created HDFS-11789:
-------------------------------------

             Summary: Maintain Short-Circuit Read Statistics
                 Key: HDFS-11789
                 URL: https://issues.apache.org/jira/browse/HDFS-11789
             Project: Hadoop HDFS
          Issue Type: Improvement
            Reporter: Hanisha Koneru
            Assignee: Hanisha Koneru


If a disk or controller hardware is faulty then short-circuit read requests can stall indefinitely while reading from the file descriptor. Currently there is no way to detect when short-circuit read requests are slow or blocked. 

This Jira proposes that each BlockReaderLocal maintain read statistics while it is active by measuring the time taken for a pre-determined fraction of read requests. These per-reader stats can be aggregated into global stats when the reader is closed. The aggregate statistics can be exposed via JMX.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org