[jira] [Commented] (HADOOP-15493) DiskChecker should handle disk full situation

["Arpit Agarwal (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HADOOP-15493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16489910#comment-16489910 ] 

Arpit Agarwal commented on HADOOP-15493:
----------------------------------------

The patch looks for disk full as follows:
# Checks exception message for known strings seen on Linux/glibc and Windows.
# Checks for usable disk space below threshold (currently a conservative 100MB). We need a threshold as filesystems don't always report zero usable space when the disk is full.

If either condition is true, then failure to write the file is ignored.

Note: no one is using this disk check yet. It will be enabled later via HDFS-13538.

[~kihwal], could you please take a look?

> DiskChecker should handle disk full situation
> ---------------------------------------------
>
>                 Key: HADOOP-15493
>                 URL: https://issues.apache.org/jira/browse/HADOOP-15493
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Arpit Agarwal
>            Assignee: Arpit Agarwal
>            Priority: Critical
>         Attachments: HADOOP-15493.01.patch
>
>
> DiskChecker#checkDirWithDiskIo creates a file to verify that the disk is writable.
> However check should not fail when file creation fails due to disk being full. This avoids marking full disks as _failed_.
> Reported by [~kihwal] and [~daryn] in HADOOP-15450. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org