You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Shilun Fan (Jira)" <ji...@apache.org> on 2024/01/04 07:12:00 UTC

[jira] [Commented] (HDFS-13656) Logging more info when client completes file error

    [ https://issues.apache.org/jira/browse/HDFS-13656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802445#comment-17802445 ] 

Shilun Fan commented on HDFS-13656:
-----------------------------------

Bulk update: moved all 3.4.0 non-blocker issues, please move back if it is a blocker.

> Logging more info when client completes file error
> --------------------------------------------------
>
>                 Key: HDFS-13656
>                 URL: https://issues.apache.org/jira/browse/HDFS-13656
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>    Affects Versions: 3.0.2
>            Reporter: Yiqun Lin
>            Assignee: Yiqun Lin
>            Priority: Minor
>         Attachments: HDFS-13656.001.patch, error-hdfs.png
>
>
> We found the error when dfs client completes file.
> !error-hdfs.png!
> Now the error log is too simple and cannot provide enough info for debugging. And this error will failed the write operation and finally lead our critical tasks failed. It will be good to print retry time and file path info inĀ {{DFSOutputStream#completeFile}}. In addition, the log level can be updated from INFO to WARN, it won't be ignored easily by users.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org