You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Steve Loughran (JIRA)" <ji...@apache.org> on 2018/08/03 21:05:00 UTC
[jira] [Commented] (HADOOP-15470) S3A staging committers to not log
FNFEs on job abort listings
[ https://issues.apache.org/jira/browse/HADOOP-15470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16568757#comment-16568757 ]
Steve Loughran commented on HADOOP-15470:
-----------------------------------------
hard to replicate the stack trace above, but stepping through a test implies abortPendingUploadsInCleanup has the potential to escalate FNFE issues in cleanup
> S3A staging committers to not log FNFEs on job abort listings
> -------------------------------------------------------------
>
> Key: HADOOP-15470
> URL: https://issues.apache.org/jira/browse/HADOOP-15470
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: 3.1.0
> Reporter: Steve Loughran
> Priority: Minor
>
> When aborting a job, the staging committers list staged files in the cluster FS to abort...all exceptions are caught & downgraded to log events.
> We shouldn't even log FNFEs except at debug level, as all it means is "the job is aborting before things got that far. Printing the full stack simply creates confusion about what the problem is
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org