You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Arpit Agarwal (JIRA)" <ji...@apache.org> on 2014/09/23 21:14:34 UTC

[jira] [Updated] (HDFS-7129) Metrics to track usage of memory for writes

     [ https://issues.apache.org/jira/browse/HDFS-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arpit Agarwal updated HDFS-7129:
--------------------------------
    Description: 
A few metrics to evaluate feature usage and suggest improvements. Thanks to [~sureshms] for some of these suggestions.

# Number of times a block in memory was read (before being ejected)
# Average block size for data written to memory tier
# Time the block was in memory before being ejected
# Number of blocks written to memory
# Number of memory writes requested but not satisfied (failed-over to disk)
# Number of blocks evicted without ever being read from memory
# Average delay between memory write and disk write (window where a node restart could cause data loss).
# Replicas written to disk by lazy writer
# Bytes written to disk by lazy writer
# Replicas deleted by application before being persisted to disk

  was:
A few metrics to evaluate feature usage and suggest improvements. Thanks to [~sureshms] for some of these suggestions.

# Number of times a block in memory was read (before being ejected)
# Average block size for data written to memory tier
# Time the block was in memory before being ejected
# Number of blocks written to memory
# Number of memory writes requested but not satisfied (failed-over to disk)
# Number of blocks evicted without ever being read from memory
# Average delay between memory write and disk write (window where a node restart could cause data loss).


> Metrics to track usage of memory for writes
> -------------------------------------------
>
>                 Key: HDFS-7129
>                 URL: https://issues.apache.org/jira/browse/HDFS-7129
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: datanode
>    Affects Versions: HDFS-6581
>            Reporter: Arpit Agarwal
>
> A few metrics to evaluate feature usage and suggest improvements. Thanks to [~sureshms] for some of these suggestions.
> # Number of times a block in memory was read (before being ejected)
> # Average block size for data written to memory tier
> # Time the block was in memory before being ejected
> # Number of blocks written to memory
> # Number of memory writes requested but not satisfied (failed-over to disk)
> # Number of blocks evicted without ever being read from memory
> # Average delay between memory write and disk write (window where a node restart could cause data loss).
> # Replicas written to disk by lazy writer
> # Bytes written to disk by lazy writer
> # Replicas deleted by application before being persisted to disk



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)