You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Steve Loughran (Jira)" <ji...@apache.org> on 2021/01/05 15:05:00 UTC

[jira] [Commented] (HADOOP-17403) S3A ITestPartialRenamesDeletes failure: missing directory marker

    [ https://issues.apache.org/jira/browse/HADOOP-17403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17258986#comment-17258986 ] 

Steve Loughran commented on HADOOP-17403:
-----------------------------------------

seen during some backporting and made go away. 

I think it comes from me having a bucket config of delete batch size == 50, on a -Dscale test run there are > 50 entries to delete, but only that first 50 are included; assertions about what is found/deleted are incorrect.

I'm going close as WORKSFORME as when I change page size to 150 all is good.

> S3A ITestPartialRenamesDeletes failure: missing directory marker
> ----------------------------------------------------------------
>
>                 Key: HADOOP-17403
>                 URL: https://issues.apache.org/jira/browse/HADOOP-17403
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3, test
>    Affects Versions: 3.3.1
>            Reporter: Steve Loughran
>            Priority: Minor
>
> Seemingly transient failure of the test ITestPartialRenamesDeletes with the latest HADOOP-17244 changes in: an expected directory marker was not found.
> Test run was (unintentionally) sequential, markers=delete, s3guard on
> {code}
> -Dmarkers=delete -Ds3guard -Ddynamo -Dscale 
> {code}
> Hasn't come back since.
> The bucket's retention policy was authoritative, but no dirs were declared as such



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org