You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Steve Loughran (JIRA)" <ji...@apache.org> on 2017/09/08 14:52:00 UTC
[jira] [Commented] (HADOOP-14852) Intermittent failure of S3Guard
TestConsistencyListFiles
[ https://issues.apache.org/jira/browse/HADOOP-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16158737#comment-16158737 ]
Steve Loughran commented on HADOOP-14852:
-----------------------------------------
Saw this working on HADOOP-14220; change order of assertions there to give a bit more diags on failure than just list size difference
{code}
Tests run: 9, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 117.338 sec <<< FAILURE! - in org.apache.hadoop.fs.s3a.ITestS3GuardListConsistency
testConsistentListFiles(org.apache.hadoop.fs.s3a.ITestS3GuardListConsistency) Time elapsed: 43.87 sec <<< FAILURE!
java.lang.AssertionError: s3a://hwdev-steve-frankfurt-new/fork-3/test/doTestListFiles-2-2-1-false/file-2-DELAY_LISTING_ME should have been listed
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.apache.hadoop.fs.s3a.ITestS3GuardListConsistency.verifyFileIsListed(ITestS3GuardListConsistency.java:455)
at org.apache.hadoop.fs.s3a.ITestS3GuardListConsistency.doTestListFiles(ITestS3GuardListConsistency.java:438)
at org.apache.hadoop.fs.s3a.ITestS3GuardListConsistency.testConsistentListFiles(ITestS3GuardListConsistency.java:359)
{code}
> Intermittent failure of S3Guard TestConsistencyListFiles
> --------------------------------------------------------
>
> Key: HADOOP-14852
> URL: https://issues.apache.org/jira/browse/HADOOP-14852
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3, test
> Affects Versions: 3.0.0-beta1
> Reporter: Steve Loughran
>
> I'm seeing intermittent test failures with a test run of {{ -Dparallel-tests -DtestsThreadCount=8 -Ds3guard -Ddynamo}} (-Dauth set or unset) in which a file in DELAY-LISTING-ME isn't being returned in a listing.
> Theories
> * test is wrong
> * config is wrong
> * code is wrong
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org