You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2021/02/03 18:43:28 UTC
[GitHub] [pulsar] lhotari opened a new issue #9456: Flaky-test: TestProxy
lhotari opened a new issue #9456:
URL: https://github.com/apache/pulsar/issues/9456
org.apache.pulsar.tests.integration.proxy.TestProxy is flaky. The test fails sporadically.
```
org.apache.pulsar.client.admin.PulsarAdminException$ServerSideErrorException: HTTP 502 Bad Gateway
at org.apache.pulsar.client.admin.internal.BaseResource.getApiException(BaseResource.java:205)
at org.apache.pulsar.client.admin.internal.BaseResource$1.failed(BaseResource.java:129)
at org.glassfish.jersey.client.JerseyInvocation$1.failed(JerseyInvocation.java:839)
at org.glassfish.jersey.client.JerseyInvocation$1.completed(JerseyInvocation.java:820)
at org.glassfish.jersey.client.ClientRuntime.processResponse(ClientRuntime.java:229)
at org.glassfish.jersey.client.ClientRuntime.access$200(ClientRuntime.java:62)
at org.glassfish.jersey.client.ClientRuntime$2.lambda$response$0(ClientRuntime.java:173)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:288)
at org.glassfish.jersey.client.ClientRuntime$2.response(ClientRuntime.java:173)
```
Usage tip: To enable automatic navigation to failure message, open the following links with CTRL/CMD-click.
[example failure 2021-02-01T06:08:49.4104114Z](https://github.com/apache/pulsar/runs/1804096958?check_suite_focus=true#step:14:930)
[example failure 2021-02-01T06:08:49.3802067Z](https://github.com/apache/pulsar/runs/1804096958?check_suite_focus=true#step:14:864)
[example failure 2021-02-01T06:08:49.3556802Z](https://github.com/apache/pulsar/runs/1804096958?check_suite_focus=true#step:14:798)
[example failure 2021-01-31T13:02:30.0545770Z](https://github.com/apache/pulsar/runs/1800964450?check_suite_focus=true#step:13:677)
[example failure 2021-01-31T13:02:30.0137124Z](https://github.com/apache/pulsar/runs/1800964450?check_suite_focus=true#step:13:611)
[example failure 2021-01-30T02:26:30.6628142Z](https://github.com/apache/pulsar/runs/1795631678?check_suite_focus=true#step:13:24214)
[example failure 2021-01-29T17:19:38.4438309Z](https://github.com/apache/pulsar/runs/1791621677?check_suite_focus=true#step:13:773)
[example failure 2021-01-29T17:19:38.4224603Z](https://github.com/apache/pulsar/runs/1791621677?check_suite_focus=true#step:13:707)
[example failure 2021-01-29T17:19:38.3858653Z](https://github.com/apache/pulsar/runs/1791621677?check_suite_focus=true#step:13:641)
[example failure 2021-01-26T08:49:12.4035864Z](https://github.com/apache/pulsar/runs/1767404896?check_suite_focus=true#step:13:660)
[example failure 2021-01-26T08:49:12.3640261Z](https://github.com/apache/pulsar/runs/1767404896?check_suite_focus=true#step:13:554)
[example failure 2021-01-25T23:42:12.7819774Z](https://github.com/apache/pulsar/runs/1762681036?check_suite_focus=true#step:13:684)
[example failure 2021-01-25T23:42:12.7557522Z](https://github.com/apache/pulsar/runs/1762681036?check_suite_focus=true#step:13:618)
[example failure 2021-01-25T23:42:12.7065182Z](https://github.com/apache/pulsar/runs/1762681036?check_suite_focus=true#step:13:552)
[example failure 2021-01-25T23:32:03.6055459Z](https://github.com/apache/pulsar/runs/1762435794?check_suite_focus=true#step:13:800)
[example failure 2021-01-25T23:32:03.5656385Z](https://github.com/apache/pulsar/runs/1762435794?check_suite_focus=true#step:13:694)
[example failure 2021-01-24T07:47:11.3148924Z](https://github.com/apache/pulsar/runs/1756352573?check_suite_focus=true#step:13:685)
[example failure 2021-01-24T07:47:11.2975393Z](https://github.com/apache/pulsar/runs/1756352573?check_suite_focus=true#step:13:619)
[example failure 2021-01-24T07:47:10.8681488Z](https://github.com/apache/pulsar/runs/1756352573?check_suite_focus=true#step:13:553)
[example failure 2021-01-24T02:31:55.7399535Z](https://github.com/apache/pulsar/runs/1755730928?check_suite_focus=true#step:13:823)
[example failure 2021-01-24T02:31:55.7213392Z](https://github.com/apache/pulsar/runs/1755730928?check_suite_focus=true#step:13:757)
[example failure 2021-01-24T02:31:55.6758255Z](https://github.com/apache/pulsar/runs/1755730928?check_suite_focus=true#step:13:691)
[example failure 2021-01-23T05:54:36.9441729Z](https://github.com/apache/pulsar/runs/1752936627?check_suite_focus=true#step:13:687)
[example failure 2021-01-23T05:54:36.9123370Z](https://github.com/apache/pulsar/runs/1752936627?check_suite_focus=true#step:13:621)
[example failure 2021-01-22T16:49:26.2412723Z](https://github.com/apache/pulsar/runs/1749790429?check_suite_focus=true#step:13:747)
[example failure 2021-01-22T16:49:26.1943849Z](https://github.com/apache/pulsar/runs/1749790429?check_suite_focus=true#step:13:681)
[example failure 2021-01-22T16:49:26.1706308Z](https://github.com/apache/pulsar/runs/1749790429?check_suite_focus=true#step:13:615)
[example failure 2021-01-22T04:21:50.8650936Z](https://github.com/apache/pulsar/runs/1746201351?check_suite_focus=true#step:12:40028)
[example failure 2021-01-22T04:21:50.7932591Z](https://github.com/apache/pulsar/runs/1746201351?check_suite_focus=true#step:12:39962)
[example failure 2021-01-22T04:21:50.7403464Z](https://github.com/apache/pulsar/runs/1746201351?check_suite_focus=true#step:12:39896)
[example failure 2021-01-22T04:21:50.6575502Z](https://github.com/apache/pulsar/runs/1746201351?check_suite_focus=true#step:12:39830)
[example failure 2021-01-22T04:21:50.5733658Z](https://github.com/apache/pulsar/runs/1746201351?check_suite_focus=true#step:12:39764)
[example failure 2021-01-22T00:16:00.9898236Z](https://github.com/apache/pulsar/runs/1745443224?check_suite_focus=true#step:13:907)
[example failure 2021-01-22T00:16:00.9719398Z](https://github.com/apache/pulsar/runs/1745443224?check_suite_focus=true#step:13:841)
[example failure 2021-01-22T00:16:00.9320254Z](https://github.com/apache/pulsar/runs/1745443224?check_suite_focus=true#step:13:775)
<details>
<summary>Full exception stacktrace</summary>
<code><pre>
org.apache.pulsar.client.admin.PulsarAdminException$ServerSideErrorException: HTTP 502 Bad Gateway
at org.apache.pulsar.client.admin.internal.BaseResource.getApiException(BaseResource.java:205)
at org.apache.pulsar.client.admin.internal.BaseResource$1.failed(BaseResource.java:129)
at org.glassfish.jersey.client.JerseyInvocation$1.failed(JerseyInvocation.java:839)
at org.glassfish.jersey.client.JerseyInvocation$1.completed(JerseyInvocation.java:820)
at org.glassfish.jersey.client.ClientRuntime.processResponse(ClientRuntime.java:229)
at org.glassfish.jersey.client.ClientRuntime.access$200(ClientRuntime.java:62)
at org.glassfish.jersey.client.ClientRuntime$2.lambda$response$0(ClientRuntime.java:173)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:288)
at org.glassfish.jersey.client.ClientRuntime$2.response(ClientRuntime.java:173)
at org.apache.pulsar.client.admin.internal.http.AsyncHttpConnector.lambda$apply$1(AsyncHttpConnector.java:210)
at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
at org.apache.pulsar.client.admin.internal.http.AsyncHttpConnector.lambda$retryOperation$3(AsyncHttpConnector.java:251)
at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
at org.asynchttpclient.netty.NettyResponseFuture.loadContent(NettyResponseFuture.java:222)
at org.asynchttpclient.netty.NettyResponseFuture.done(NettyResponseFuture.java:257)
at org.asynchttpclient.netty.handler.AsyncHttpClientHandler.finishUpdate(AsyncHttpClientHandler.java:241)
at org.asynchttpclient.netty.handler.HttpHandler.handleChunk(HttpHandler.java:114)
at org.asynchttpclient.netty.handler.HttpHandler.handleRead(HttpHandler.java:143)
at org.asynchttpclient.netty.handler.AsyncHttpClientHandler.channelRead(AsyncHttpClientHandler.java:78)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:436)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:324)
at io.netty.handler.codec.ByteToMessageDecoder.channelInputClosed(ByteToMessageDecoder.java:383)
at io.netty.handler.codec.ByteToMessageDecoder.channelInactive(ByteToMessageDecoder.java:354)
at io.netty.handler.codec.http.HttpClientCodec$Decoder.channelInactive(HttpClientCodec.java:311)
at io.netty.channel.CombinedChannelDuplexHandler.channelInactive(CombinedChannelDuplexHandler.java:221)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:262)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:248)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:241)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelInactive(DefaultChannelPipeline.java:1405)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:262)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:248)
at io.netty.channel.DefaultChannelPipeline.fireChannelInactive(DefaultChannelPipeline.java:901)
at io.netty.channel.AbstractChannel$AbstractUnsafe$8.run(AbstractChannel.java:818)
at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164)
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:472)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:497)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
Caused by: javax.ws.rs.ServerErrorException: HTTP 502 Bad Gateway
at org.glassfish.jersey.client.JerseyInvocation.createExceptionForFamily(JerseyInvocation.java:941)
at org.glassfish.jersey.client.JerseyInvocation.convertToException(JerseyInvocation.java:921)
at org.glassfish.jersey.client.JerseyInvocation.access$500(JerseyInvocation.java:77)
... 55 more
</pre></code>
</details>
[example failure 2021-01-30T02:26:30.7146760Z](https://github.com/apache/pulsar/runs/1795631678?check_suite_focus=true#step:13:24280)
<details>
<summary>Full exception stacktrace</summary>
<code><pre>
org.apache.pulsar.client.admin.PulsarAdminException$ServerSideErrorException: HTTP 502 Bad Gateway
at org.apache.pulsar.client.admin.internal.BaseResource.getApiException(BaseResource.java:205)
at org.apache.pulsar.client.admin.internal.BaseResource$1.failed(BaseResource.java:129)
at org.glassfish.jersey.client.JerseyInvocation$1.failed(JerseyInvocation.java:839)
at org.glassfish.jersey.client.JerseyInvocation$1.completed(JerseyInvocation.java:820)
at org.glassfish.jersey.client.ClientRuntime.processResponse(ClientRuntime.java:229)
at org.glassfish.jersey.client.ClientRuntime.access$200(ClientRuntime.java:62)
at org.glassfish.jersey.client.ClientRuntime$2.lambda$response$0(ClientRuntime.java:173)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:288)
at org.glassfish.jersey.client.ClientRuntime$2.response(ClientRuntime.java:173)
at org.apache.pulsar.client.admin.internal.http.AsyncHttpConnector.lambda$apply$1(AsyncHttpConnector.java:210)
at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
at org.apache.pulsar.client.admin.internal.http.AsyncHttpConnector.lambda$retryOperation$3(AsyncHttpConnector.java:251)
at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
at org.asynchttpclient.netty.NettyResponseFuture.loadContent(NettyResponseFuture.java:222)
at org.asynchttpclient.netty.NettyResponseFuture.done(NettyResponseFuture.java:257)
at org.asynchttpclient.netty.handler.AsyncHttpClientHandler.finishUpdate(AsyncHttpClientHandler.java:241)
at org.asynchttpclient.netty.handler.HttpHandler.handleChunk(HttpHandler.java:114)
at org.asynchttpclient.netty.handler.HttpHandler.handleRead(HttpHandler.java:143)
at org.asynchttpclient.netty.handler.AsyncHttpClientHandler.channelRead(AsyncHttpClientHandler.java:78)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:436)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:324)
at io.netty.handler.codec.ByteToMessageDecoder.channelInputClosed(ByteToMessageDecoder.java:383)
at io.netty.handler.codec.ByteToMessageDecoder.channelInactive(ByteToMessageDecoder.java:354)
at io.netty.handler.codec.http.HttpClientCodec$Decoder.channelInactive(HttpClientCodec.java:311)
at io.netty.channel.CombinedChannelDuplexHandler.channelInactive(CombinedChannelDuplexHandler.java:221)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:262)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:248)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:241)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelInactive(DefaultChannelPipeline.java:1405)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:262)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:248)
at io.netty.channel.DefaultChannelPipeline.fireChannelInactive(DefaultChannelPipeline.java:901)
at io.netty.channel.AbstractChannel$AbstractUnsafe$8.run(AbstractChannel.java:818)
at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164)
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:472)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:497)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
Caused by: javax.ws.rs.ServerErrorException: HTTP 502 Bad Gateway
at org.glassfish.jersey.client.JerseyInvocation.createExceptionForFamily(JerseyInvocation.java:941)
at org.glassfish.jersey.client.JerseyInvocation.convertToException(JerseyInvocation.java:921)
at org.glassfish.jersey.client.JerseyInvocation.access$500(JerseyInvocation.java:77)
... 55 more
02:26:22.699 [docker-java-stream--1705812860:org.apache.pulsar.tests.integration.containers.ChaosContainer$1@82] INFO org.apache.pulsar.tests.integration.containers.ChaosContainer - 2021-01-30 02:26:22,696 INFO success: broker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
02:26:23.230 [docker-java-stream-585686204:org.apache.pulsar.tests.integration.utils.DockerUtils$2@221] INFO org.apache.pulsar.tests.integration.utils.DockerUtils - DOCKER.exec(PulsarFunctionsProcessTest-qhxlj-pulsar-functions-worker-process-gdowa-0:/pulsar/bin/pulsar-admin functions localrun --broker-service-url pulsar://pulsar-broker-0:6650 --tenant public --namespace default --name localRunTest --className exclamation_function.ExclamationFunction --inputs persistent://public/default/test-function-local-run-PYTHON-input-defkxkby --output test-function-local-run-PYTHON-output-goncqvke --py /pulsar/examples/python-examples/exclamation_function.py): STDOUT: 02:26:23.228 [function-timer-thread-3-1] ERROR org.apache.pulsar.functions.runtime.process.ProcessRuntime - Extracted Process death exception
java.lang.RuntimeException:
at org.apache.pulsar.functions.runtime.process.ProcessRuntime.tryExtractingDeathException(ProcessRuntime.java:388) ~[org.apache.pulsar-pulsar-functions-runtime-2.8.0-SNAPSHOT.jar:2.8.0-SNAPSHOT]
at org.apache.pulsar.functions.runtime.process.ProcessRuntime.isAlive(ProcessRuntime.java:375) ~[org.apache.pulsar-pulsar-functions-runtime-2.8.0-SNAPSHOT.jar:2.8.0-SNAPSHOT]
at org.apache.pulsar.functions.runtime.RuntimeSpawner.lambda$start$0(RuntimeSpawner.java:86) ~[org.apache.pulsar-pulsar-functions-runtime-2.8.0-SNAPSHOT.jar:2.8.0-SNAPSHOT]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_282]
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [?:1.8.0_282]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) [?:1.8.0_282
02:26:23.230 [docker-java-stream-585686204:org.apache.pulsar.tests.integration.utils.DockerUtils$2@221] INFO org.apache.pulsar.tests.integration.utils.DockerUtils - DOCKER.exec(PulsarFunctionsProcessTest-qhxlj-pulsar-functions-worker-process-gdowa-0:/pulsar/bin/pulsar-admin functions localrun --broker-service-url pulsar://pulsar-broker-0:6650 --tenant public --namespace default --name localRunTest --className exclamation_function.ExclamationFunction --inputs persistent://public/default/test-function-local-run-PYTHON-input-defkxkby --output test-function-local-run-PYTHON-output-goncqvke --py /pulsar/examples/python-examples/exclamation_function.py): STDOUT: ]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) [?:1.8.0_282]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_282]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_282]
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) [io.netty-netty-common-4.1.51.Final.jar:4.1.51.Final]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_282]
02:26:23.228 [function-timer-thread-3-1] ERROR org.apache.pulsar.functions.runtime.RuntimeSpawner - public/default/localRunTest-java.lang.RuntimeException: Function Container is dead with exception.. restarting
02:26:23.256 [docker-java-stream-585686204:org.apache.pulsar.tests.integration.utils.DockerUtils$2@221] INFO org.apache.pulsar.tests.integration.utils.DockerUtils - DOCKER.exec(PulsarFunctionsProcessTest-qhxlj-pulsar-functions-worker-process-gdowa-0:/pulsar/bin/pulsar-admin functions localrun --broker-service-url pulsar://pulsar-broker-0:6650 --tenant public --namespace default --name localRunTest --className exclamation_function.ExclamationFunction --inputs persistent://public/default/test-function-local-run-PYTHON-input-defkxkby --output test-function-local-run-PYTHON-output-goncqvke --py /pulsar/examples/python-examples/exclamation_function.py): STDOUT: 02:26:23.254 [function-timer-thread-3-1] INFO org.apache.pulsar.functions.runtime.process.ProcessRuntime - Creating function log directory /pulsar/logs/functions/public/default/localRunTest
02:26:23.254 [function-timer-thread-3-1] INFO org.apache.pulsar.functions.runtime.process.ProcessRuntime - Created or found function log directory /pulsar/logs/functions/public/default/localRunTest
02:26:23.254 [function-timer-thread-3-1] INFO org.apache.pulsar.functions.runtime.process.ProcessRuntime - ProcessBuilder starting the process with args python /pulsar/instances/python-instance/python_instance_main.py --py /pulsar/examples/python-examples/exclamation_function.py --logging_directory /pulsar/logs/functions --logging_file localRunTest --logging_config_file /pulsar/conf/functions-logging/logging_config.ini --instance_id 0 --function_id 72018aaf-e9b1-491a-b65f-6a3d111bd603 --function_version 87b0e0b0-5a0d-4d46-857a-62e545763377 --function_details '{"tenant":"public","namespace":"default","name":"localRunTest","cla
02:26:23.257 [docker-java-stream-585686204:org.apache.pulsar.tests.integration.utils.DockerUtils$2@221] INFO org.apache.pulsar.tests.integration.utils.DockerUtils - DOCKER.exec(PulsarFunctionsProcessTest-qhxlj-pulsar-functions-worker-process-gdowa-0:/pulsar/bin/pulsar-admin functions localrun --broker-service-url pulsar://pulsar-broker-0:6650 --tenant public --namespace default --name localRunTest --className exclamation_function.ExclamationFunction --inputs persistent://public/default/test-function-local-run-PYTHON-input-defkxkby --output test-function-local-run-PYTHON-output-goncqvke --py /pulsar/examples/python-examples/exclamation_function.py): STDOUT: ssName":"exclamation_function.ExclamationFunction","runtime":"PYTHON","autoAck":true,"parallelism":1,"source":{"inputSpecs":{"persistent://public/default/test-function-local-run-PYTHON-input-defkxkby":{}},"cleanupSubscription":true},"sink":{"topic":"test-function-local-run-PYTHON-output-goncqvke","forwardSourceMessageProperty":
true},"resources":{"cpu":1.0,"ram":"1073741824","disk":"10737418240"},"componentType":"FUNCTION"}' --pulsar_serviceurl pulsar://pulsar-broker-0:6650 --use_tls false --tls_allow_insecure false --hostname_verification_enabled false --max_buffered_tuples 1024 --port 39577 --metrics_port 36073 --expected_healthcheck_interval 30 --secrets_provider secretsprovider.ClearTextSecretsProvider --cluster_name local
02:26:23.258 [docker-java-stream-585686204:org.apache.pulsar.tests.integration.utils.DockerUtils$2@221] INFO org.apache.pulsar.tests.integration.utils.DockerUtils - DOCKER.exec(PulsarFunctionsProcessTest-qhxlj-pulsar-functions-worker-process-gdowa-0:/pulsar/bin/pulsar-admin functions localrun --broker-service-url pulsar://pulsar-broker-0:6650 --tenant public --namespace default --name localRunTest --className exclamation_function.ExclamationFunction --inputs persistent://public/default/test-function-local-run-PYTHON-input-defkxkby --output test-function-local-run-PYTHON-output-goncqvke --py /pulsar/examples/python-examples/exclamation_function.py): STDOUT: 02:26:23.257 [function-timer-thread-3-1] INFO org.apache.pulsar.functions.runtime.process.ProcessRuntime - Started process successfully
02:26:23.261 [docker-java-stream-585686204:org.apache.pulsar.tests.integration.utils.DockerUtils$2@221] INFO org.apache.pulsar.tests.integration.utils.DockerUtils - DOCKER.exec(PulsarFunctionsProcessTest-qhxlj-pulsar-functions-worker-process-gdowa-0:/pulsar/bin/pulsar-admin functions localrun --broker-service-url pulsar://pulsar-broker-0:6650 --tenant public --namespace default --name localRunTest --className exclamation_function.ExclamationFunction --inputs persistent://public/default/test-function-local-run-PYTHON-input-defkxkby --output test-function-local-run-PYTHON-output-goncqvke --py /pulsar/examples/python-examples/exclamation_function.py): STDOUT: 02:26:23.260 [Timer-0] INFO org.apache.pulsar.functions.LocalRunner - {
"numRestarts": "2",
"instanceId": "0"
}
02:26:23.538 [docker-java-stream--2109383626:org.apache.pulsar.tests.integration.containers.ChaosContainer$1@82] INFO org.apache.pulsar.tests.integration.containers.ChaosContainer - 2021-01-30 02:26:23,535 INFO success: broker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
02:26:23.549 [docker-java-stream-1855909964:org.apache.pulsar.tests.integration.utils.DockerUtils$2@221] INFO org.apache.pulsar.tests.integration.utils.DockerUtils - DOCKER.exec(PulsarFunctionsProcessTest-qhxlj-pulsar-functions-worker-process-gdowa-1:/pulsar/bin/pulsar-admin functions localrun --broker-service-url pulsar://pulsar-broker-0:6650 --tenant public --namespace default --name localRunTest --className org.apache.pulsar.functions.api.examples.ExclamationFunction --inputs persistent://public/default/test-function-local-run-JAVA-input-qdydxvjv --output test-function-local-run-JAVA-output-qvwqdytr --jar /pulsar/examples/java-test-functions.jar): STDOUT: 02:26:23.541 [pulsar-timer-5-1] INFO org.apache.pulsar.client.impl.ConnectionHandler - [test-function-local-run-JAVA-output-qvwqdytr] [PulsarFunctionsProcessTest-qhxlj-0-10] Reconnecting after connection was closed
02:26:23.558 [docker-java-stream-1855909964:org.apache.pulsar.tests.integration.utils.DockerUtils$2@221] INFO org.apache.pulsar.tests.integration.utils.DockerUtils - DOCKER.exec(PulsarFunctionsProcessTest-qhxlj-pulsar-functions-worker-process-gdowa-1:/pulsar/bin/pulsar-admin functions localrun --broker-service-url pulsar://pulsar-broker-0:6650 --tenant public --namespace default --name localRunTest --className org.apache.pulsar.functions.api.examples.ExclamationFunction --inputs persistent://public/default/test-function-local-run-JAVA-input-qdydxvjv --output test-function-local-run-JAVA-output-qvwqdytr --jar /pulsar/examples/java-test-functions.jar): STDOUT: 02:26:23.554 [pulsar-client-io-1-2] WARN org.apache.pulsar.client.impl.ConnectionPool - Failed to open connection to pulsar-broker-0:6650 : io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: pulsar-broker-0/172.18.0.6:6650
02:26:23.558 [docker-java-stream-1855909964:org.apache.pulsar.tests.integration.utils.DockerUtils$2@221] INFO org.apache.pulsar.tests.integration.utils.DockerUtils - DOCKER.exec(PulsarFunctionsProcessTest-qhxlj-pulsar-functions-worker-process-gdowa-1:/pulsar/bin/pulsar-admin functions localrun --broker-service-url pulsar://pulsar-broker-0:6650 --tenant public --namespace default --name localRunTest --className org.apache.pulsar.functions.api.examples.ExclamationFunction --inputs persistent://public/default/test-function-local-run-JAVA-input-qdydxvjv --output test-function-local-run-JAVA-output-qvwqdytr --jar /pulsar/examples/java-test-functions.jar): STDOUT: 02:26:23.554 [pulsar-client-io-1-2] WARN org.apache.pulsar.client.impl.ConnectionHandler - [test-function-local-run-JAVA-output-qvwqdytr] [PulsarFunctionsProcessTest-qhxlj-0-10] Error connecting to broker: org.apache.pulsar.client.api.PulsarClientException: java.util.concurrent.CompletionException: io.netty.channel.AbstractC
hannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: pulsar-broker-0/172.18.0.6:6650
02:26:23.558 [docker-java-stream-1855909964:org.apache.pulsar.tests.integration.utils.DockerUtils$2@221] INFO org.apache.pulsar.tests.integration.utils.DockerUtils - DOCKER.exec(PulsarFunctionsProcessTest-qhxlj-pulsar-functions-worker-process-gdowa-1:/pulsar/bin/pulsar-admin functions localrun --broker-service-url pulsar://pulsar-broker-0:6650 --tenant public --namespace default --name localRunTest --className org.apache.pulsar.functions.api.examples.ExclamationFunction --inputs persistent://public/default/test-function-local-run-JAVA-input-qdydxvjv --output test-function-local-run-JAVA-output-qvwqdytr --jar /pulsar/examples/java-test-functions.jar): STDOUT: 02:26:23.554 [pulsar-client-io-1-2] WARN org.apache.pulsar.client.impl.ConnectionHandler - [test-function-local-run-JAVA-output-qvwqdytr] [PulsarFunctionsProcessTest-qhxlj-0-10] Could not get connection to broker: org.apache.pulsar.client.api.PulsarClientException: java.util.concurrent.CompletionException: io.netty.channel.A
bstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: pulsar-broker-0/172.18.0.6:6650 -- Will try again in 2.943 s
02:26:23.573 [docker-java-stream-1855909964:org.apache.pulsar.tests.integration.utils.DockerUtils$2@221] INFO org.apache.pulsar.tests.integration.utils.DockerUtils - DOCKER.exec(PulsarFunctionsProcessTest-qhxlj-pulsar-functions-worker-process-gdowa-1:/pulsar/bin/pulsar-admin functions localrun --broker-service-url pulsar://pulsar-broker-0:6650 --tenant public --namespace default --name localRunTest --className org.apache.pulsar.functions.api.examples.ExclamationFunction --inputs persistent://public/default/test-function-local-run-JAVA-input-qdydxvjv --output test-function-local-run-JAVA-output-qvwqdytr --jar /pulsar/examples/java-test-functions.jar): STDOUT: 02:26:23.566 [pulsar-timer-5-1] INFO org.apache.pulsar.client.impl.ConnectionHandler - [persistent://public/default/test-function-local-run-JAVA-input-qdydxvjv] [public/default/localRunTest] Reconnecting after connection was closed
02:26:23.573 [docker-java-stream-1855909964:org.apache.pulsar.tests.integration.utils.DockerUtils$2@221] INFO org.apache.pulsar.tests.integration.utils.DockerUtils - DOCKER.exec(PulsarFunctionsProcessTest-qhxlj-pulsar-functions-worker-process-gdowa-1:/pulsar/bin/pulsar-admin functions localrun --broker-service-url pulsar://pulsar-broker-0:6650 --tenant public --namespace default --name localRunTest --className org.apache.pulsar.functions.api.examples.ExclamationFunction --inputs persistent://public/default/test-function-local-run-JAVA-input-qdydxvjv --output test-function-local-run-JAVA-output-qvwqdytr --jar /pulsar/examples/java-test-functions.jar): STDOUT: 02:26:23.570 [pulsar-client-io-1-2] WARN org.apache.pulsar.client.impl.ConnectionPool - Failed to open connection to pulsar-broker-0:6650 : io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: pulsar-broker-0/172.18.0.6:6650
02:26:23.573 [docker-java-stream-1855909964:org.apache.pulsar.tests.integration.utils.DockerUtils$2@221] INFO org.apache.pulsar.tests.integration.utils.DockerUtils - DOCKER.exec(PulsarFunctionsProcessTest-qhxlj-pulsar-functions-worker-process-gdowa-1:/pulsar/bin/pulsar-admin functions localrun --broker-service-url pulsar://pulsar-broker-0:6650 --tenant public --namespace default --name localRunTest --className org.apache.pulsar.functions.api.examples.ExclamationFunction --inputs persistent://public/default/test-function-local-run-JAVA-input-qdydxvjv --output test-function-local-run-JAVA-output-qvwqdytr --jar /pulsar/examples/java-test-functions.jar): STDOUT: 02:26:23.570 [pulsar-client-io-1-2] WARN org.apache.pulsar.client.impl.ConnectionHandler - [persistent://public/default/test-function-local-run-JAVA-input-qdydxvjv] [public/default/localRunTest] Error connecting to broker: org.apache.pulsar.client.api.PulsarClientException: java.util.concurrent.CompletionException: io.netty.
channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: pulsar-broker-0/172.18.0.6:6650
02:26:23.573 [docker-java-stream-1855909964:org.apache.pulsar.tests.integration.utils.DockerUtils$2@221] INFO org.apache.pulsar.tests.integration.utils.DockerUtils - DOCKER.exec(PulsarFunctionsProcessTest-qhxlj-pulsar-functions-worker-process-gdowa-1:/pulsar/bin/pulsar-admin functions localrun --broker-service-url pulsar://pulsar-broker-0:6650 --tenant public --namespace default --name localRunTest --className org.apache.pulsar.functions.api.examples.ExclamationFunction --inputs persistent://public/default/test-function-local-run-JAVA-input-qdydxvjv --output test-function-local-run-JAVA-output-qvwqdytr --jar /pulsar/examples/java-test-functions.jar): STDOUT: 02:26:23.571 [pulsar-client-io-1-2] WARN org.apache.pulsar.client.impl.ConnectionHandler - [persistent://public/default/test-function-local-run-JAVA-input-qdydxvjv] [public/default/localRunTest] Could not get connection to broker: org.apache.pulsar.client.api.PulsarClientException: java.util.concurrent.CompletionException: i
o.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: pulsar-broker-0/172.18.0.6:6650 -- Will try again in 3.079 s
02:26:23.680 [docker-java-stream--145340668:org.apache.pulsar.tests.integration.utils.DockerUtils$2@221] INFO org.apache.pulsar.tests.integration.utils.DockerUtils - DOCKER.exec(PulsarFunctionsProcessTest-qhxlj-pulsar-broker-0:tail -f /var/log/pulsar/broker.log): STDOUT: [AppClassLoader@18b4aac2] info AspectJ Weaver Version 1.9.2 built on Wednesday Oct 24, 2018 at 15:43:33 GMT
</pre></code>
</details>
```
org.apache.pulsar.client.admin.PulsarAdminException$ServerSideErrorException: HTTP 502 Bad Gateway
at org.apache.pulsar.client.admin.internal.BaseResource.getApiException(BaseResource.java:207)
at org.apache.pulsar.client.admin.internal.BaseResource$1.failed(BaseResource.java:131)
at org.glassfish.jersey.client.JerseyInvocation$1.failed(JerseyInvocation.java:839)
at org.glassfish.jersey.client.JerseyInvocation$1.completed(JerseyInvocation.java:820)
at org.glassfish.jersey.client.ClientRuntime.processResponse(ClientRuntime.java:229)
at org.glassfish.jersey.client.ClientRuntime.access$200(ClientRuntime.java:62)
at org.glassfish.jersey.client.ClientRuntime$2.lambda$response$0(ClientRuntime.java:173)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:288)
at org.glassfish.jersey.client.ClientRuntime$2.response(ClientRuntime.java:173)
```
Usage tip: To enable automatic navigation to failure message, open the following links with CTRL/CMD-click.
[example failure 2021-01-13T23:36:56.3767235Z](https://github.com/apache/pulsar/runs/1698382464?check_suite_focus=true#step:13:1009)
[example failure 2021-01-13T23:36:56.3453305Z](https://github.com/apache/pulsar/runs/1698382464?check_suite_focus=true#step:13:943)
<details>
<summary>Full exception stacktrace</summary>
<code><pre>
org.apache.pulsar.client.admin.PulsarAdminException$ServerSideErrorException: HTTP 502 Bad Gateway
at org.apache.pulsar.client.admin.internal.BaseResource.getApiException(BaseResource.java:207)
at org.apache.pulsar.client.admin.internal.BaseResource$1.failed(BaseResource.java:131)
at org.glassfish.jersey.client.JerseyInvocation$1.failed(JerseyInvocation.java:839)
at org.glassfish.jersey.client.JerseyInvocation$1.completed(JerseyInvocation.java:820)
at org.glassfish.jersey.client.ClientRuntime.processResponse(ClientRuntime.java:229)
at org.glassfish.jersey.client.ClientRuntime.access$200(ClientRuntime.java:62)
at org.glassfish.jersey.client.ClientRuntime$2.lambda$response$0(ClientRuntime.java:173)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:288)
at org.glassfish.jersey.client.ClientRuntime$2.response(ClientRuntime.java:173)
at org.apache.pulsar.client.admin.internal.http.AsyncHttpConnector.lambda$apply$1(AsyncHttpConnector.java:210)
at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
at org.apache.pulsar.client.admin.internal.http.AsyncHttpConnector.lambda$retryOperation$3(AsyncHttpConnector.java:251)
at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
at org.asynchttpclient.netty.NettyResponseFuture.loadContent(NettyResponseFuture.java:222)
at org.asynchttpclient.netty.NettyResponseFuture.done(NettyResponseFuture.java:257)
at org.asynchttpclient.netty.handler.AsyncHttpClientHandler.finishUpdate(AsyncHttpClientHandler.java:241)
at org.asynchttpclient.netty.handler.HttpHandler.handleChunk(HttpHandler.java:114)
at org.asynchttpclient.netty.handler.HttpHandler.handleRead(HttpHandler.java:143)
at org.asynchttpclient.netty.handler.AsyncHttpClientHandler.channelRead(AsyncHttpClientHandler.java:78)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:436)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:324)
at io.netty.handler.codec.ByteToMessageDecoder.channelInputClosed(ByteToMessageDecoder.java:383)
at io.netty.handler.codec.ByteToMessageDecoder.channelInactive(ByteToMessageDecoder.java:354)
at io.netty.handler.codec.http.HttpClientCodec$Decoder.channelInactive(HttpClientCodec.java:311)
at io.netty.channel.CombinedChannelDuplexHandler.channelInactive(CombinedChannelDuplexHandler.java:221)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:262)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:248)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:241)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelInactive(DefaultChannelPipeline.java:1405)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:262)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:248)
at io.netty.channel.DefaultChannelPipeline.fireChannelInactive(DefaultChannelPipeline.java:901)
at io.netty.channel.AbstractChannel$AbstractUnsafe$8.run(AbstractChannel.java:818)
at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164)
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:472)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:497)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
Caused by: javax.ws.rs.ServerErrorException: HTTP 502 Bad Gateway
at org.glassfish.jersey.client.JerseyInvocation.createExceptionForFamily(JerseyInvocation.java:941)
at org.glassfish.jersey.client.JerseyInvocation.convertToException(JerseyInvocation.java:921)
at org.glassfish.jersey.client.JerseyInvocation.access$500(JerseyInvocation.java:77)
... 55 more
</pre></code>
</details>
[example failure 2020-12-04T02:22:03.9080570Z](https://github.com/apache/pulsar/runs/1496303240?check_suite_focus=true#step:14:706)
[example failure 2020-12-04T02:22:03.8900090Z](https://github.com/apache/pulsar/runs/1496303240?check_suite_focus=true#step:14:640)
[example failure 2020-12-04T02:22:03.8602668Z](https://github.com/apache/pulsar/runs/1496303240?check_suite_focus=true#step:14:574)
<details>
<summary>Full exception stacktrace</summary>
<code><pre>
org.apache.pulsar.client.admin.PulsarAdminException$ServerSideErrorException: HTTP 502 Bad Gateway
at org.apache.pulsar.client.admin.internal.BaseResource.getApiException(BaseResource.java:207)
at org.apache.pulsar.client.admin.internal.BaseResource$1.failed(BaseResource.java:131)
at org.glassfish.jersey.client.JerseyInvocation$1.failed(JerseyInvocation.java:839)
at org.glassfish.jersey.client.JerseyInvocation$1.completed(JerseyInvocation.java:820)
at org.glassfish.jersey.client.ClientRuntime.processResponse(ClientRuntime.java:229)
at org.glassfish.jersey.client.ClientRuntime.access$200(ClientRuntime.java:62)
at org.glassfish.jersey.client.ClientRuntime$2.lambda$response$0(ClientRuntime.java:173)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:288)
at org.glassfish.jersey.client.ClientRuntime$2.response(ClientRuntime.java:173)
at org.apache.pulsar.client.admin.internal.http.AsyncHttpConnector.lambda$apply$1(AsyncHttpConnector.java:208)
at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
at org.apache.pulsar.client.admin.internal.http.AsyncHttpConnector.lambda$retryOperation$3(AsyncHttpConnector.java:249)
at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
at org.asynchttpclient.netty.NettyResponseFuture.loadContent(NettyResponseFuture.java:222)
at org.asynchttpclient.netty.NettyResponseFuture.done(NettyResponseFuture.java:257)
at org.asynchttpclient.netty.handler.AsyncHttpClientHandler.finishUpdate(AsyncHttpClientHandler.java:241)
at org.asynchttpclient.netty.handler.HttpHandler.handleChunk(HttpHandler.java:114)
at org.asynchttpclient.netty.handler.HttpHandler.handleRead(HttpHandler.java:143)
at org.asynchttpclient.netty.handler.AsyncHttpClientHandler.channelRead(AsyncHttpClientHandler.java:78)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:436)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:324)
at io.netty.handler.codec.ByteToMessageDecoder.channelInputClosed(ByteToMessageDecoder.java:383)
at io.netty.handler.codec.ByteToMessageDecoder.channelInactive(ByteToMessageDecoder.java:354)
at io.netty.handler.codec.http.HttpClientCodec$Decoder.channelInactive(HttpClientCodec.java:311)
at io.netty.channel.CombinedChannelDuplexHandler.channelInactive(CombinedChannelDuplexHandler.java:221)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:262)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:248)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:241)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelInactive(DefaultChannelPipeline.java:1405)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:262)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:248)
at io.netty.channel.DefaultChannelPipeline.fireChannelInactive(DefaultChannelPipeline.java:901)
at io.netty.channel.AbstractChannel$AbstractUnsafe$8.run(AbstractChannel.java:818)
at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164)
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:472)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:497)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
Caused by: javax.ws.rs.ServerErrorException: HTTP 502 Bad Gateway
at org.glassfish.jersey.client.JerseyInvocation.createExceptionForFamily(JerseyInvocation.java:941)
at org.glassfish.jersey.client.JerseyInvocation.convertToException(JerseyInvocation.java:921)
at org.glassfish.jersey.client.JerseyInvocation.access$500(JerseyInvocation.java:77)
... 55 more
</pre></code>
</details>
```
org.apache.pulsar.client.admin.PulsarAdminException$ServerSideErrorException: HTTP 500 Internal Server Error
at org.apache.pulsar.client.admin.internal.BaseResource.getApiException(BaseResource.java:205)
at org.apache.pulsar.client.admin.internal.BaseResource$1.failed(BaseResource.java:129)
at org.glassfish.jersey.client.JerseyInvocation$1.failed(JerseyInvocation.java:839)
at org.glassfish.jersey.client.JerseyInvocation$1.completed(JerseyInvocation.java:820)
at org.glassfish.jersey.client.ClientRuntime.processResponse(ClientRuntime.java:229)
at org.glassfish.jersey.client.ClientRuntime.access$200(ClientRuntime.java:62)
at org.glassfish.jersey.client.ClientRuntime$2.lambda$response$0(ClientRuntime.java:173)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:288)
at org.glassfish.jersey.client.ClientRuntime$2.response(ClientRuntime.java:173)
```
Usage tip: To enable automatic navigation to failure message, open the following links with CTRL/CMD-click.
[example failure 2021-01-25T23:34:18.9377215Z](https://github.com/apache/pulsar/runs/1762435763?check_suite_focus=true#step:12:31480)
[example failure 2021-01-25T23:34:18.9105823Z](https://github.com/apache/pulsar/runs/1762435763?check_suite_focus=true#step:12:31416)
<details>
<summary>Full exception stacktrace</summary>
<code><pre>
org.apache.pulsar.client.admin.PulsarAdminException$ServerSideErrorException: HTTP 500 Internal Server Error
at org.apache.pulsar.client.admin.internal.BaseResource.getApiException(BaseResource.java:205)
at org.apache.pulsar.client.admin.internal.BaseResource$1.failed(BaseResource.java:129)
at org.glassfish.jersey.client.JerseyInvocation$1.failed(JerseyInvocation.java:839)
at org.glassfish.jersey.client.JerseyInvocation$1.completed(JerseyInvocation.java:820)
at org.glassfish.jersey.client.ClientRuntime.processResponse(ClientRuntime.java:229)
at org.glassfish.jersey.client.ClientRuntime.access$200(ClientRuntime.java:62)
at org.glassfish.jersey.client.ClientRuntime$2.lambda$response$0(ClientRuntime.java:173)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:288)
at org.glassfish.jersey.client.ClientRuntime$2.response(ClientRuntime.java:173)
at org.apache.pulsar.client.admin.internal.http.AsyncHttpConnector.lambda$apply$1(AsyncHttpConnector.java:210)
at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
at org.apache.pulsar.client.admin.internal.http.AsyncHttpConnector.lambda$retryOperation$3(AsyncHttpConnector.java:251)
at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
at org.asynchttpclient.netty.NettyResponseFuture.loadContent(NettyResponseFuture.java:222)
at org.asynchttpclient.netty.NettyResponseFuture.done(NettyResponseFuture.java:257)
at org.asynchttpclient.netty.handler.AsyncHttpClientHandler.finishUpdate(AsyncHttpClientHandler.java:241)
at org.asynchttpclient.netty.handler.HttpHandler.handleChunk(HttpHandler.java:114)
at org.asynchttpclient.netty.handler.HttpHandler.handleRead(HttpHandler.java:143)
at org.asynchttpclient.netty.handler.AsyncHttpClientHandler.channelRead(AsyncHttpClientHandler.java:78)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:436)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:324)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:296)
at io.netty.channel.CombinedChannelDuplexHandler.channelRead(CombinedChannelDuplexHandler.java:251)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
Caused by: javax.ws.rs.InternalServerErrorException: HTTP 500 Internal Server Error
at org.glassfish.jersey.client.JerseyInvocation.convertToException(JerseyInvocation.java:914)
at org.glassfish.jersey.client.JerseyInvocation.access$500(JerseyInvocation.java:77)
... 54 more
</pre></code>
</details>
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] codelipenghui commented on issue #9456: Flaky-test: TestProxy
Posted by GitBox <gi...@apache.org>.
codelipenghui commented on issue #9456:
URL: https://github.com/apache/pulsar/issues/9456#issuecomment-1058893614
The issue had no activity for 30 days, mark with Stale label.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org