[jira] [Commented] (HADOOP-18790) ITestS3ACopyFromLocalFile: AuditFailureException

["Steve Loughran (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HADOOP-18790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17739178#comment-17739178 ] 

Steve Loughran commented on HADOOP-18790:
-----------------------------------------


{code}
[ERROR] testSrcIsEmptyDirWithCopySuccessful(org.apache.hadoop.fs.s3a.ITestS3ACopyFromLocalFile)  Time elapsed: 1.748 s  <<< ERROR!
java.nio.file.AccessDeniedException: s3a://stevel-london/fork-0007/test/source5589796147222327638: org.apache.hadoop.fs.s3a.audit.AuditFailureException: 92cd5c39-d723-4c9c-add8-635f15196a2e-00000003 unaudited operation executing a request outside an audit span {object_list_request 'fork-0007/test/source5589796147222327638/' size=2, mutating=false}
        at org.apache.hadoop.fs.s3a.S3AUtils.translateException(S3AUtils.java:207)
        at org.apache.hadoop.fs.s3a.S3AUtils.translateException(S3AUtils.java:170)
        at org.apache.hadoop.fs.s3a.S3AFileSystem.s3GetFileStatus(S3AFileSystem.java:3587)
        at org.apache.hadoop.fs.s3a.S3AFileSystem.innerGetFileStatus(S3AFileSystem.java:3443)
        at org.apache.hadoop.fs.s3a.S3AFileSystem$MkdirOperationCallbacksImpl.probePathStatus(S3AFileSystem.java:3319)
        at org.apache.hadoop.fs.s3a.impl.MkdirOperation.probePathStatusOrNull(MkdirOperation.java:134)
        at org.apache.hadoop.fs.s3a.impl.MkdirOperation.getPathStatusExpectingDir(MkdirOperation.java:149)
        at org.apache.hadoop.fs.s3a.impl.MkdirOperation.execute(MkdirOperation.java:80)
        at org.apache.hadoop.fs.s3a.impl.MkdirOperation.execute(MkdirOperation.java:45)
        at org.apache.hadoop.fs.s3a.impl.ExecutingStoreOperation.apply(ExecutingStoreOperation.java:76)
        at org.apache.hadoop.fs.statistics.impl.IOStatisticsBinding.lambda$trackDurationOfOperation$5(IOStatisticsBinding.java:526)
        at org.apache.hadoop.fs.statistics.impl.IOStatisticsBinding.trackDuration(IOStatisticsBinding.java:445)
        at org.apache.hadoop.fs.s3a.S3AFileSystem$CopyFromLocalCallbacksImpl.createEmptyDir(S3AFileSystem.java:3705)
        at org.apache.hadoop.fs.s3a.impl.CopyFromLocalOperation.lambda$submitCreateEmptyDir$0(CopyFromLocalOperation.java:278)
        at org.apache.hadoop.fs.store.audit.AuditingFunctions.lambda$callableWithinAuditSpan$3(AuditingFunctions.java:117)
        at org.apache.hadoop.fs.s3a.impl.CallableSupplier.get(CallableSupplier.java:87)
        at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
        at org.apache.hadoop.util.SemaphoredDelegatingExecutor$RunnableWithPermitRelease.run(SemaphoredDelegatingExecutor.java:197)
        at org.apache.hadoop.util.SemaphoredDelegatingExecutor$RunnableWithPermitRelease.run(SemaphoredDelegatingExecutor.java:197)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:750)
Caused by: org.apache.hadoop.fs.s3a.audit.AuditFailureException: 92cd5c39-d723-4c9c-add8-635f15196a2e-00000003 unaudited operation executing a request outside an audit span {object_list_request 'fork-0007/test/source5589796147222327638/' size=2, mutating=false}
        at org.apache.hadoop.fs.s3a.audit.impl.LoggingAuditor$WarningSpan.beforeExecution(LoggingAuditor.java:422)
        at org.apache.hadoop.fs.s3a.audit.impl.ActiveAuditManagerS3A$WrappingAuditSpan.beforeExecution(ActiveAuditManagerS3A.java:784)
        at org.apache.hadoop.fs.s3a.audit.impl.ActiveAuditManagerS3A.beforeExecution(ActiveAuditManagerS3A.java:473)
        at org.apache.hadoop.fs.s3a.audit.impl.ActiveAuditManagerS3A$SdkRequestHandler.beforeExecution(ActiveAuditManagerS3A.java:619)
        at com.amazonaws.AmazonWebServiceClient.beforeClientExecution(AmazonWebServiceClient.java:787)
        at com.amazonaws.services.s3.AmazonS3Client.listObjectsV2(AmazonS3Client.java:946)
        at org.apache.hadoop.fs.s3a.S3AFileSystem.lambda$listObjects$11(S3AFileSystem.java:2494)
        at org.apache.hadoop.fs.statistics.impl.IOStatisticsBinding.lambda$trackDurationOfOperation$5(IOStatisticsBinding.java:526)
        at org.apache.hadoop.fs.s3a.Invoker.retryUntranslated(Invoker.java:440)
        at org.apache.hadoop.fs.s3a.Invoker.retryUntranslated(Invoker.java:403)
        at org.apache.hadoop.fs.s3a.S3AFileSystem.listObjects(S3AFileSystem.java:2485)
        at org.apache.hadoop.fs.s3a.S3AFileSystem.s3GetFileStatus(S3AFileSystem.java:3559)
        ... 19 more


{code}


> ITestS3ACopyFromLocalFile: AuditFailureException
> ------------------------------------------------
>
>                 Key: HADOOP-18790
>                 URL: https://issues.apache.org/jira/browse/HADOOP-18790
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3, test
>    Affects Versions: 3.3.9
>            Reporter: Steve Loughran
>            Priority: Minor
>
> test failure in AuditFailureException 
> {code}
> java.nio.file.AccessDeniedException: s3a://stevel-london/fork-0007/test/source5589796147222327638: org.apache.hadoop.fs.s3a.audit.AuditFailureException: 92cd5c39-d723-4c9c-add8-635f15196a2e-00000003 unaudited operation executing a request outside an audit span {object_list_request 'fork-0007/test/source5589796147222327638/' size=2, mutating=false}
> {code}
> the stack trace shows something is happening in an executor so maybe the context hasn't got in



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org