You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Steve Loughran (JIRA)" <ji...@apache.org> on 2017/09/08 14:52:00 UTC

[jira] [Commented] (HADOOP-14852) Intermittent failure of S3Guard TestConsistencyListFiles

    [ https://issues.apache.org/jira/browse/HADOOP-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16158737#comment-16158737 ] 

Steve Loughran commented on HADOOP-14852:
-----------------------------------------

Saw this working on HADOOP-14220; change order of assertions there to give a bit more diags on failure than just list size difference
{code}
Tests run: 9, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 117.338 sec <<< FAILURE! - in org.apache.hadoop.fs.s3a.ITestS3GuardListConsistency
testConsistentListFiles(org.apache.hadoop.fs.s3a.ITestS3GuardListConsistency)  Time elapsed: 43.87 sec  <<< FAILURE!
java.lang.AssertionError: s3a://hwdev-steve-frankfurt-new/fork-3/test/doTestListFiles-2-2-1-false/file-2-DELAY_LISTING_ME should have been listed
	at org.junit.Assert.fail(Assert.java:88)
	at org.junit.Assert.assertTrue(Assert.java:41)
	at org.apache.hadoop.fs.s3a.ITestS3GuardListConsistency.verifyFileIsListed(ITestS3GuardListConsistency.java:455)
	at org.apache.hadoop.fs.s3a.ITestS3GuardListConsistency.doTestListFiles(ITestS3GuardListConsistency.java:438)
	at org.apache.hadoop.fs.s3a.ITestS3GuardListConsistency.testConsistentListFiles(ITestS3GuardListConsistency.java:359)
{code}


> Intermittent failure of S3Guard TestConsistencyListFiles
> --------------------------------------------------------
>
>                 Key: HADOOP-14852
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14852
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3, test
>    Affects Versions: 3.0.0-beta1
>            Reporter: Steve Loughran
>
> I'm seeing intermittent test failures with a test run of {{ -Dparallel-tests -DtestsThreadCount=8 -Ds3guard -Ddynamo}}  (-Dauth set or unset) in which a file in DELAY-LISTING-ME isn't being returned in a listing. 
> Theories
> * test is wrong
> * config is wrong
> * code is wrong



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org