You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Gabor Bota (JIRA)" <ji...@apache.org> on 2018/11/21 17:08:00 UTC
[jira] [Comment Edited] (HADOOP-15370) S3A log message on rm
s3a://bucket/ not intuitive
[ https://issues.apache.org/jira/browse/HADOOP-15370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16694952#comment-16694952 ]
Gabor Bota edited comment on HADOOP-15370 at 11/21/18 5:07 PM:
---------------------------------------------------------------
Created an initial patch based on the idea that {{org.apache.hadoop.fs.s3a.S3AFileSystem#innerDelete}} returns what returned from {{org.apache.hadoop.fs.s3a.S3AFileSystem#rejectRootDirectoryDelete}}, and the same is returned to {{org.apache.hadoop.fs.s3a.S3AFileSystem#delete}} which ultimately returned to {{org.apache.hadoop.fs.shell.Delete.Rm#processPath}} and we have the {{PathIOException}} which outputs the {{Input/output error}}.
Based on that, I found that the best places to add the messages are the ones I used.
was (Author: gabor.bota):
Created an initial patch based on the idea that org.apache.hadoop.fs.s3a.S3AFileSystem#innerDelete returns what returned from org.apache.hadoop.fs.s3a.S3AFileSystem#rejectRootDirectoryDelete, and the same is returned to org.apache.hadoop.fs.s3a.S3AFileSystem#delete which ultimately returned to org.apache.hadoop.fs.shell.Delete.Rm#processPath and we have the {{PathIOException}} which outputs the Input/output error.
Based on that, I found that the best places to add the messages are the ones I used.
> S3A log message on rm s3a://bucket/ not intuitive
> -------------------------------------------------
>
> Key: HADOOP-15370
> URL: https://issues.apache.org/jira/browse/HADOOP-15370
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: 3.1.0
> Reporter: Steve Loughran
> Assignee: Gabor Bota
> Priority: Trivial
> Attachments: HADOOP-15370.001.patch
>
>
> when you try to delete the root of a bucket from command line, e.g. {{hadoop fs -rm -r -skipTrash s3a://hwdev-steve-new/}}, the output isn't that useful
> {code}
> 2018-04-06 16:35:23,048 [main] INFO s3a.S3AFileSystem (S3AFileSystem.java:rejectRootDirectoryDelete(1837)) - s3a delete the hwdev-steve-new root directory of true
> rm: `s3a://hwdev-steve-new/': Input/output error
> 2018-04-06 16:35:23,050 [pool-2-thread-1] DEBUG s3a.S3AFileSystem
> {code}
> the single log message doesn't parse, and the error message raised is lost by the FS -rm CLI command (why?)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org