You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Chesnay Schepler (Jira)" <ji...@apache.org> on 2021/09/08 12:20:00 UTC

[jira] [Commented] (FLINK-24197) Streaming File Sink end-to-end test fails with : "RestClientException: [File upload failed.]"

    [ https://issues.apache.org/jira/browse/FLINK-24197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411894#comment-17411894 ] 

Chesnay Schepler commented on FLINK-24197:
------------------------------------------

I was finally able to reproduce it. It seems depend on the size of the FileUpload; I have found a payload range of 3 bytes range (5043442-5043445) where it can be reliably reproduced.

> Streaming File Sink end-to-end test fails with : "RestClientException: [File upload failed.]"
> ---------------------------------------------------------------------------------------------
>
>                 Key: FLINK-24197
>                 URL: https://issues.apache.org/jira/browse/FLINK-24197
>             Project: Flink
>          Issue Type: Bug
>          Components: Connectors / FileSystem, Tests
>    Affects Versions: 1.15.0
>            Reporter: Dawid Wysakowicz
>            Assignee: Chesnay Schepler
>            Priority: Major
>              Labels: test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23672&view=logs&j=c88eea3b-64a0-564d-0031-9fdcd7b8abee&t=070ff179-953e-5bda-71fa-d6599415701c&l=11040
> {code}
> Caused by: org.apache.flink.util.FlinkException: Failed to execute job 'StreamingFileSinkProgram'.
> 	at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.executeAsync(StreamExecutionEnvironment.java:2056)
> 	at org.apache.flink.client.program.StreamContextEnvironment.executeAsync(StreamContextEnvironment.java:137)
> 	at org.apache.flink.client.program.StreamContextEnvironment.execute(StreamContextEnvironment.java:76)
> 	at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1917)
> 	at FileSinkProgram.main(FileSinkProgram.java:105)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:498)
> 	at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355)
> 	... 8 more
> Caused by: org.apache.flink.runtime.client.JobSubmissionException: Failed to submit JobGraph.
> 	at org.apache.flink.client.program.rest.RestClusterClient.lambda$submitJob$11(RestClusterClient.java:433)
> 	at java.util.concurrent.CompletableFuture.uniExceptionally(CompletableFuture.java:884)
> 	at java.util.concurrent.CompletableFuture$UniExceptionally.tryFire(CompletableFuture.java:866)
> 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
> 	at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990)
> 	at org.apache.flink.util.concurrent.FutureUtils.lambda$retryOperationWithDelay$9(FutureUtils.java:373)
> 	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
> 	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
> 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
> 	at java.util.concurrent.CompletableFuture.postFire(CompletableFuture.java:575)
> 	at java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:943)
> 	at java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:456)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> 	at java.lang.Thread.run(Thread.java:748)
> Caused by: org.apache.flink.runtime.rest.util.RestClientException: [File upload failed.]
> 	at org.apache.flink.runtime.rest.RestClient.parseResponse(RestClient.java:532)
> 	at org.apache.flink.runtime.rest.RestClient.lambda$submitRequest$3(RestClient.java:512)
> 	at java.util.concurrent.CompletableFuture.uniCompose(CompletableFuture.java:966)
> 	at java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:940)
> 	... 4 more
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)