[jira] [Commented] (HDFS-17475) Add a command to check if files are readable

["ASF GitHub Bot (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HDFS-17475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18013035#comment-18013035 ] 

ASF GitHub Bot commented on HDFS-17475:
---------------------------------------

ayushtkn commented on PR #6745:
URL: https://github.com/apache/hadoop/pull/6745#issuecomment-3172457745

   Where do you feel this would be used. I don't think any service will add a precheck for this, it adds an additional perf overhead in normal scenarios.
   
   If we want to handle such scenarios, The best is either catch an exception in the service and handle (ignore/retry)




> Add a command to check if files are readable
> --------------------------------------------
>
>                 Key: HDFS-17475
>                 URL: https://issues.apache.org/jira/browse/HDFS-17475
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: hdfs
>            Reporter: Felix N
>            Assignee: Felix N
>            Priority: Minor
>              Labels: pull-request-available
>
> Sometimes a job can fail due to one unreadable file down the line due to missing replicas or dead DNs or other reason. This command should allow users to check whether files are readable by checking for metadata on DNs without executing full read pipelines of the files.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org