You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2022/04/05 02:47:00 UTC

[jira] [Commented] (HUDI-3792) Triage test failures on jenkins

    [ https://issues.apache.org/jira/browse/HUDI-3792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17517184#comment-17517184 ] 

sivabalan narayanan commented on HUDI-3792:
-------------------------------------------

Exception seems to be aws client related. and stackoverflow suggests that this is intermittant w/ S3 access and should be retriable. Hence closing it for now. 

 

> Triage test failures on jenkins 
> --------------------------------
>
>                 Key: HUDI-3792
>                 URL: https://issues.apache.org/jira/browse/HUDI-3792
>             Project: Apache Hudi
>          Issue Type: Task
>          Components: tests-ci
>            Reporter: sivabalan narayanan
>            Assignee: sivabalan narayanan
>            Priority: Blocker
>             Fix For: 0.11.0
>
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>
> Caused by: java.io.InterruptedIOException: getFileStatus on 
> [s3a://jenkins-infra-hudi/hudi/job-run/HudiIntegTestsManual_ecs/data/2022-04-03/28/MERGE_ON_READspark-long-running.yamltest-metadata-aggressive-clean-archival.properties/output/.hoodie/.heartbeat/20220403011051606]
> : com.amazonaws.AbortedException: 
> 	at org.apache.hadoop.fs.s3a.S3AUtils.translateInterruptedException(S3AUtils.java:389)
> 	at org.apache.hadoop.fs.s3a.S3AUtils.translateException(S3AUtils.java:196)
> 	at org.apache.hadoop.fs.s3a.S3AUtils.translateException(S3AUtils.java:170)
> 	at org.apache.hadoop.fs.s3a.S3AFileSystem.s3GetFileStatus(S3AFileSystem.java:3351)
> 	at org.apache.hadoop.fs.s3a.S3AFileSystem.innerGetFileStatus(S3AFileSystem.java:3185)
> 	at org.apache.hadoop.fs.s3a.S3AFileSystem.create(S3AFileSystem.java:1326)
> 	at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:1195)
> 	at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:1175)
> 	at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:1064)
> 	at org.apache.hudi.client.heartbeat.HoodieHeartbeatClient.updateHeartbeat(HoodieHeartbeatClient.java:257)
> 	... 4 more
> Caused by: com.amazonaws.AbortedException: 
> 	at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleInterruptedException(AmazonHttpClient.java:877)
> 	at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:755)
> 	at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:713)
> 	at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:695)
> 	at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:559)
> 	at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:539)
> 	at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:5437)
> 	at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:5384)
> 	at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:5378)
> 	at com.amazonaws.services.s3.AmazonS3Client.listObjectsV2(AmazonS3Client.java:970)
> 	at org.apache.hadoop.fs.s3a.S3AFileSystem.lambda$listObjects$7(S3AFileSystem.java:2116)
> 	at org.apache.hadoop.fs.statistics.impl.IOStatisticsBinding.lambda$trackDurationOfOperation$5(IOStatisticsBinding.java:489)
> 	at org.apache.hadoop.fs.s3a.Invoker.retryUntranslated(Invoker.java:412)
> 	at org.apache.hadoop.fs.s3a.Invoker.retryUntranslated(Invoker.java:375)
> 	at org.apache.hadoop.fs.s3a.S3AFileSystem.listObjects(S3AFileSystem.java:2107)
> 	at org.apache.hadoop.fs.s3a.S3AFileSystem.s3GetFileStatus(S3AFileSystem.java:3322)
> 	... 10 more
> Caused by: com.amazonaws.http.timers.client.SdkInterruptedException
> 	at com.amazonaws.http.AmazonHttpClient$RequestExecutor.checkInterrupted(AmazonHttpClient.java:932)
> 	at com.amazonaws.http.AmazonHttpClient$RequestExecutor.checkInterrupted(AmazonHttpClient.java:918)
> 	at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1112)
> 	at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:811)
> 	at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:779)
> 	at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:753)
> 	... 24 more



--
This message was sent by Atlassian Jira
(v8.20.1#820001)