You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Dian Fu (Jira)" <ji...@apache.org> on 2020/10/15 02:16:00 UTC

[jira] [Created] (FLINK-19645) ShuffleCompressionITCase.testDataCompressionForBlockingShuffle is instable

Dian Fu created FLINK-19645:
-------------------------------

             Summary: ShuffleCompressionITCase.testDataCompressionForBlockingShuffle is instable
                 Key: FLINK-19645
                 URL: https://issues.apache.org/jira/browse/FLINK-19645
             Project: Flink
          Issue Type: Bug
          Components: Runtime / Network
    Affects Versions: 1.12.0
            Reporter: Dian Fu


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=7631&view=logs&j=39d5b1d5-3b41-54dc-6458-1e2ddd1cdcf3&t=a99e99c7-21cd-5a1f-7274-585e62b72f56

{code}
2020-10-14T21:46:25.3133019Z [ERROR] testDataCompressionForBlockingShuffle[useBroadcastPartitioner = true](org.apache.flink.test.runtime.ShuffleCompressionITCase)  Time elapsed: 34.949 s  <<< ERROR!
2020-10-14T21:46:25.3133688Z org.apache.flink.util.FlinkException: Could not close resource.
2020-10-14T21:46:25.3134146Z 	at org.apache.flink.util.AutoCloseableAsync.close(AutoCloseableAsync.java:42)
2020-10-14T21:46:25.3134716Z 	at org.apache.flink.test.runtime.ShuffleCompressionITCase.executeTest(ShuffleCompressionITCase.java:114)
2020-10-14T21:46:25.3135396Z 	at org.apache.flink.test.runtime.ShuffleCompressionITCase.testDataCompressionForBlockingShuffle(ShuffleCompressionITCase.java:89)
2020-10-14T21:46:25.3135941Z 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2020-10-14T21:46:25.3136410Z 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2020-10-14T21:46:25.3136959Z 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2020-10-14T21:46:25.3137435Z 	at java.lang.reflect.Method.invoke(Method.java:498)
2020-10-14T21:46:25.3137915Z 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
2020-10-14T21:46:25.3138459Z 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
2020-10-14T21:46:25.3138987Z 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
2020-10-14T21:46:25.3139524Z 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
2020-10-14T21:46:25.3140017Z 	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
2020-10-14T21:46:25.3140495Z 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
2020-10-14T21:46:25.3141037Z 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
2020-10-14T21:46:25.3141520Z 	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
2020-10-14T21:46:25.3142213Z 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
2020-10-14T21:46:25.3142672Z 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
2020-10-14T21:46:25.3143134Z 	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
2020-10-14T21:46:25.3143578Z 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
2020-10-14T21:46:25.3144026Z 	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
2020-10-14T21:46:25.3144437Z 	at org.junit.runners.Suite.runChild(Suite.java:128)
2020-10-14T21:46:25.3144815Z 	at org.junit.runners.Suite.runChild(Suite.java:27)
2020-10-14T21:46:25.3147907Z 	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
2020-10-14T21:46:25.3148415Z 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
2020-10-14T21:46:25.3149058Z 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
2020-10-14T21:46:25.3149526Z 	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
2020-10-14T21:46:25.3149993Z 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
2020-10-14T21:46:25.3150429Z 	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
2020-10-14T21:46:25.3150918Z 	at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
2020-10-14T21:46:25.3151469Z 	at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
2020-10-14T21:46:25.3152045Z 	at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
2020-10-14T21:46:25.3152599Z 	at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
2020-10-14T21:46:25.3153163Z 	at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
2020-10-14T21:46:25.3155116Z 	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
2020-10-14T21:46:25.3157282Z 	at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
2020-10-14T21:46:25.3159466Z 	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)
2020-10-14T21:46:25.3167068Z Caused by: java.util.concurrent.TimeoutException: Invocation of public abstract java.util.concurrent.CompletableFuture org.apache.flink.runtime.resourcemanager.ResourceManagerGateway.deregisterApplication(org.apache.flink.runtime.clusterframework.ApplicationStatus,java.lang.String) timed out.
2020-10-14T21:46:25.3173751Z 	at org.apache.flink.runtime.rpc.akka.$Proxy28.deregisterApplication(Unknown Source)
2020-10-14T21:46:25.3371159Z 	at org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent.deregisterApplication(DispatcherResourceManagerComponent.java:124)
2020-10-14T21:46:25.3372499Z 	at org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent.lambda$deregisterApplicationAndClose$0(DispatcherResourceManagerComponent.java:111)
2020-10-14T21:46:25.3373451Z 	at org.apache.flink.runtime.concurrent.FutureUtils.lambda$composeAfterwards$18(FutureUtils.java:598)
2020-10-14T21:46:25.3374185Z 	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
2020-10-14T21:46:25.3374864Z 	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
2020-10-14T21:46:25.3375645Z 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
2020-10-14T21:46:25.3376288Z 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
2020-10-14T21:46:25.3376972Z 	at org.apache.flink.runtime.rest.RestServerEndpoint.lambda$closeAsync$1(RestServerEndpoint.java:306)
2020-10-14T21:46:25.3377646Z 	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
2020-10-14T21:46:25.3378325Z 	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
2020-10-14T21:46:25.3379001Z 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
2020-10-14T21:46:25.3379643Z 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
2020-10-14T21:46:25.3380545Z 	at org.apache.flink.runtime.concurrent.FutureUtils.lambda$null$17(FutureUtils.java:607)
2020-10-14T21:46:25.3381211Z 	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
2020-10-14T21:46:25.3381884Z 	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
2020-10-14T21:46:25.3382535Z 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
2020-10-14T21:46:25.3383176Z 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
2020-10-14T21:46:25.3383872Z 	at org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint.lambda$null$0(DispatcherRestEndpoint.java:153)
2020-10-14T21:46:25.3384683Z 	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
2020-10-14T21:46:25.3385494Z 	at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:792)
2020-10-14T21:46:25.3386252Z 	at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2153)
2020-10-14T21:46:25.3386984Z 	at org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint.lambda$shutDownInternal$1(DispatcherRestEndpoint.java:145)
2020-10-14T21:46:25.3387713Z 	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
2020-10-14T21:46:25.3388371Z 	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
2020-10-14T21:46:25.3389040Z 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
2020-10-14T21:46:25.3389677Z 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
2020-10-14T21:46:25.3390339Z 	at org.apache.flink.runtime.concurrent.FutureUtils.lambda$runAfterwardsAsync$16(FutureUtils.java:573)
2020-10-14T21:46:25.3391041Z 	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
2020-10-14T21:46:25.3391789Z 	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
2020-10-14T21:46:25.3392449Z 	at java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:456)
2020-10-14T21:46:25.3392968Z 	at java.lang.Thread.run(Thread.java:748)
2020-10-14T21:46:25.3394844Z Caused by: akka.pattern.AskTimeoutException: Ask timed out on [Actor[akka://flink/user/rpc/resourcemanager_2#-1642668643]] after [10000 ms]. Message of type [org.apache.flink.runtime.rpc.messages.LocalFencedMessage]. A typical reason for `AskTimeoutException` is that the recipient actor didn't send a reply.
2020-10-14T21:46:25.3396483Z 	at akka.pattern.PromiseActorRef$$anonfun$2.apply(AskSupport.scala:635)
2020-10-14T21:46:25.3396982Z 	at akka.pattern.PromiseActorRef$$anonfun$2.apply(AskSupport.scala:635)
2020-10-14T21:46:25.3397478Z 	at akka.pattern.PromiseActorRef$$anonfun$1.apply$mcV$sp(AskSupport.scala:648)
2020-10-14T21:46:25.3397950Z 	at akka.actor.Scheduler$$anon$4.run(Scheduler.scala:205)
2020-10-14T21:46:25.3398439Z 	at scala.concurrent.Future$InternalCallbackExecutor$.unbatchedExecute(Future.scala:601)
2020-10-14T21:46:25.3398967Z 	at scala.concurrent.BatchingExecutor$class.execute(BatchingExecutor.scala:109)
2020-10-14T21:46:25.3399483Z 	at scala.concurrent.Future$InternalCallbackExecutor$.execute(Future.scala:599)
2020-10-14T21:46:25.3400054Z 	at akka.actor.LightArrayRevolverScheduler$TaskHolder.executeTask(LightArrayRevolverScheduler.scala:328)
2020-10-14T21:46:25.3400662Z 	at akka.actor.LightArrayRevolverScheduler$$anon$4.executeBucket$1(LightArrayRevolverScheduler.scala:279)
2020-10-14T21:46:25.3401274Z 	at akka.actor.LightArrayRevolverScheduler$$anon$4.nextTick(LightArrayRevolverScheduler.scala:283)
2020-10-14T21:46:25.3401859Z 	at akka.actor.LightArrayRevolverScheduler$$anon$4.run(LightArrayRevolverScheduler.scala:235)
2020-10-14T21:46:25.3402237Z 	... 1 more
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)