You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Huang Xingbo (Jira)" <ji...@apache.org> on 2022/07/20 06:22:00 UTC
[jira] [Closed] (FLINK-28305) SQL Client end-to-end test failed with ElasticsearchException
[ https://issues.apache.org/jira/browse/FLINK-28305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Huang Xingbo closed FLINK-28305.
--------------------------------
Fix Version/s: 1.14.6
Assignee: Huang Xingbo
Resolution: Fixed
I have merged the commit 6ab358e87525d41526648fd6e802179e9ceed2f3 in release-1.14 to clean up the python environment.
I will continue to pay attention to the CI to see whether this problem have been solved
> SQL Client end-to-end test failed with ElasticsearchException
> -------------------------------------------------------------
>
> Key: FLINK-28305
> URL: https://issues.apache.org/jira/browse/FLINK-28305
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Client
> Affects Versions: 1.14.5
> Reporter: Huang Xingbo
> Assignee: Huang Xingbo
> Priority: Critical
> Labels: test-stability
> Fix For: 1.14.6
>
>
> {code:java}
> 2022-06-29T19:14:39.0384925Z Jun 29 19:14:38 java.lang.RuntimeException: An error occurred in ElasticsearchSink.
> 2022-06-29T19:14:39.0385547Z Jun 29 19:14:38 at org.apache.flink.streaming.connectors.elasticsearch.ElasticsearchSinkBase.checkErrorAndRethrow(ElasticsearchSinkBase.java:427) ~[?:?]
> 2022-06-29T19:14:39.0386327Z Jun 29 19:14:38 at org.apache.flink.streaming.connectors.elasticsearch.ElasticsearchSinkBase.checkAsyncErrorsAndRequests(ElasticsearchSinkBase.java:432) ~[?:?]
> 2022-06-29T19:14:39.0387078Z Jun 29 19:14:38 at org.apache.flink.streaming.connectors.elasticsearch.ElasticsearchSinkBase.invoke(ElasticsearchSinkBase.java:329) ~[?:?]
> 2022-06-29T19:14:39.0388071Z Jun 29 19:14:38 at org.apache.flink.table.runtime.operators.sink.SinkOperator.processElement(SinkOperator.java:65) ~[flink-table_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0389189Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.tasks.OneInputStreamTask$StreamTaskNetworkOutput.emitRecord(OneInputStreamTask.java:233) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0390354Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.processElement(AbstractStreamTaskNetworkInput.java:134) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0391515Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.emitNext(AbstractStreamTaskNetworkInput.java:105) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0392712Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0393822Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:495) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0394861Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:203) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0395885Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:806) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0396858Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:758) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0397824Z Jun 29 19:14:38 at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0398882Z Jun 29 19:14:38 at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0400103Z Jun 29 19:14:38 at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:766) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0401000Z Jun 29 19:14:38 at org.apache.flink.runtime.taskmanager.Task.run(Task.java:575) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0401575Z Jun 29 19:14:38 at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_332]
> 2022-06-29T19:14:39.0402051Z Jun 29 19:14:38 Suppressed: java.lang.RuntimeException: An error occurred in ElasticsearchSink.
> 2022-06-29T19:14:39.0402682Z Jun 29 19:14:38 at org.apache.flink.streaming.connectors.elasticsearch.ElasticsearchSinkBase.checkErrorAndRethrow(ElasticsearchSinkBase.java:427) ~[?:?]
> 2022-06-29T19:14:39.0403421Z Jun 29 19:14:38 at org.apache.flink.streaming.connectors.elasticsearch.ElasticsearchSinkBase.close(ElasticsearchSinkBase.java:366) ~[?:?]
> 2022-06-29T19:14:39.0404395Z Jun 29 19:14:38 at org.apache.flink.api.common.functions.util.FunctionUtils.closeFunction(FunctionUtils.java:41) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0405470Z Jun 29 19:14:38 at org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.close(AbstractUdfStreamOperator.java:114) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0406549Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.tasks.StreamOperatorWrapper.close(StreamOperatorWrapper.java:141) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0407648Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.closeAllOperators(RegularOperatorChain.java:127) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0408717Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.tasks.StreamTask.closeAllOperators(StreamTask.java:1032) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0409755Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.tasks.StreamTask.runAndSuppressThrowable(StreamTask.java:1018) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0410752Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.tasks.StreamTask.cleanUp(StreamTask.java:925) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0411732Z Jun 29 19:14:38 at org.apache.flink.runtime.taskmanager.Task.lambda$restoreAndInvoke$0(Task.java:940) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0412711Z Jun 29 19:14:38 at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0413665Z Jun 29 19:14:38 at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:940) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0414726Z Jun 29 19:14:38 at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:766) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0415607Z Jun 29 19:14:38 at org.apache.flink.runtime.taskmanager.Task.run(Task.java:575) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0416179Z Jun 29 19:14:38 at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_332]
> 2022-06-29T19:14:39.0417155Z Jun 29 19:14:38 Caused by: org.apache.flink.elasticsearch7.shaded.org.elasticsearch.ElasticsearchException: Elasticsearch exception [type=cluster_block_exception, reason=index [my_users] blocked by: [FORBIDDEN/12/index read-only / allow delete (api)];]
> 2022-06-29T19:14:39.0418020Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.ElasticsearchException.innerFromXContent(ElasticsearchException.java:496) ~[?:?]
> 2022-06-29T19:14:39.0418792Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.ElasticsearchException.fromXContent(ElasticsearchException.java:407) ~[?:?]
> 2022-06-29T19:14:39.0419560Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.action.bulk.BulkItemResponse.fromXContent(BulkItemResponse.java:138) ~[?:?]
> 2022-06-29T19:14:39.0420302Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.action.bulk.BulkResponse.fromXContent(BulkResponse.java:196) ~[?:?]
> 2022-06-29T19:14:39.0421041Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.client.RestHighLevelClient.parseEntity(RestHighLevelClient.java:1793) ~[?:?]
> 2022-06-29T19:14:39.0421853Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.client.RestHighLevelClient.lambda$performRequestAsyncAndParseEntity$10(RestHighLevelClient.java:1581) ~[?:?]
> 2022-06-29T19:14:39.0422676Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.client.RestHighLevelClient$1.onSuccess(RestHighLevelClient.java:1663) ~[?:?]
> 2022-06-29T19:14:39.0423465Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.client.RestClient$FailureTrackingResponseListener.onSuccess(RestClient.java:590) ~[?:?]
> 2022-06-29T19:14:39.0424215Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.client.RestClient$1.completed(RestClient.java:333) ~[?:?]
> 2022-06-29T19:14:39.0424907Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.client.RestClient$1.completed(RestClient.java:327) ~[?:?]
> 2022-06-29T19:14:39.0425605Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.concurrent.BasicFuture.completed(BasicFuture.java:122) ~[?:?]
> 2022-06-29T19:14:39.0426411Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.client.DefaultClientExchangeHandlerImpl.responseCompleted(DefaultClientExchangeHandlerImpl.java:181) ~[?:?]
> 2022-06-29T19:14:39.0427309Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.nio.protocol.HttpAsyncRequestExecutor.processResponse(HttpAsyncRequestExecutor.java:448) ~[?:?]
> 2022-06-29T19:14:39.0428140Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.nio.protocol.HttpAsyncRequestExecutor.inputReady(HttpAsyncRequestExecutor.java:338) ~[?:?]
> 2022-06-29T19:14:39.0428965Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.DefaultNHttpClientConnection.consumeInput(DefaultNHttpClientConnection.java:265) ~[?:?]
> 2022-06-29T19:14:39.0429771Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.client.InternalIODispatch.onInputReady(InternalIODispatch.java:81) ~[?:?]
> 2022-06-29T19:14:39.0430553Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.client.InternalIODispatch.onInputReady(InternalIODispatch.java:39) ~[?:?]
> 2022-06-29T19:14:39.0431331Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.reactor.AbstractIODispatch.inputReady(AbstractIODispatch.java:114) ~[?:?]
> 2022-06-29T19:14:39.0432205Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.reactor.BaseIOReactor.readable(BaseIOReactor.java:162) ~[?:?]
> 2022-06-29T19:14:39.0432961Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvent(AbstractIOReactor.java:337) ~[?:?]
> 2022-06-29T19:14:39.0433744Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvents(AbstractIOReactor.java:315) ~[?:?]
> 2022-06-29T19:14:39.0434792Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:276) ~[?:?]
> 2022-06-29T19:14:39.0435534Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104) ~[?:?]
> 2022-06-29T19:14:39.0459721Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591) ~[?:?]
> 2022-06-29T19:14:39.0460527Z Jun 29 19:14:38 ... 1 more
> 2022-06-29T19:14:39.0461628Z Jun 29 19:14:38 Caused by: org.apache.flink.elasticsearch7.shaded.org.elasticsearch.ElasticsearchException: Elasticsearch exception [type=cluster_block_exception, reason=index [my_users] blocked by: [FORBIDDEN/12/index read-only / allow delete (api)];]
> 2022-06-29T19:14:39.0462516Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.ElasticsearchException.innerFromXContent(ElasticsearchException.java:496) ~[?:?]
> 2022-06-29T19:14:39.0463295Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.ElasticsearchException.fromXContent(ElasticsearchException.java:407) ~[?:?]
> 2022-06-29T19:14:39.0464052Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.action.bulk.BulkItemResponse.fromXContent(BulkItemResponse.java:138) ~[?:?]
> 2022-06-29T19:14:39.0464810Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.action.bulk.BulkResponse.fromXContent(BulkResponse.java:196) ~[?:?]
> 2022-06-29T19:14:39.0465563Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.client.RestHighLevelClient.parseEntity(RestHighLevelClient.java:1793) ~[?:?]
> 2022-06-29T19:14:39.0466397Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.client.RestHighLevelClient.lambda$performRequestAsyncAndParseEntity$10(RestHighLevelClient.java:1581) ~[?:?]
> 2022-06-29T19:14:39.0467225Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.client.RestHighLevelClient$1.onSuccess(RestHighLevelClient.java:1663) ~[?:?]
> 2022-06-29T19:14:39.0468016Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.client.RestClient$FailureTrackingResponseListener.onSuccess(RestClient.java:590) ~[?:?]
> 2022-06-29T19:14:39.0468773Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.client.RestClient$1.completed(RestClient.java:333) ~[?:?]
> 2022-06-29T19:14:39.0469464Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.client.RestClient$1.completed(RestClient.java:327) ~[?:?]
> 2022-06-29T19:14:39.0470155Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.concurrent.BasicFuture.completed(BasicFuture.java:122) ~[?:?]
> 2022-06-29T19:14:39.0470967Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.client.DefaultClientExchangeHandlerImpl.responseCompleted(DefaultClientExchangeHandlerImpl.java:181) ~[?:?]
> 2022-06-29T19:14:39.0471854Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.nio.protocol.HttpAsyncRequestExecutor.processResponse(HttpAsyncRequestExecutor.java:448) ~[?:?]
> 2022-06-29T19:14:39.0472688Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.nio.protocol.HttpAsyncRequestExecutor.inputReady(HttpAsyncRequestExecutor.java:338) ~[?:?]
> 2022-06-29T19:14:39.0473770Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.DefaultNHttpClientConnection.consumeInput(DefaultNHttpClientConnection.java:265) ~[?:?]
> 2022-06-29T19:14:39.0474587Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.client.InternalIODispatch.onInputReady(InternalIODispatch.java:81) ~[?:?]
> 2022-06-29T19:14:39.0475633Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.client.InternalIODispatch.onInputReady(InternalIODispatch.java:39) ~[?:?]
> 2022-06-29T19:14:39.0476411Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.reactor.AbstractIODispatch.inputReady(AbstractIODispatch.java:114) ~[?:?]
> 2022-06-29T19:14:39.0477277Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.reactor.BaseIOReactor.readable(BaseIOReactor.java:162) ~[?:?]
> 2022-06-29T19:14:39.0478054Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvent(AbstractIOReactor.java:337) ~[?:?]
> 2022-06-29T19:14:39.0478967Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvents(AbstractIOReactor.java:315) ~[?:?]
> 2022-06-29T19:14:39.0479884Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:276) ~[?:?]
> 2022-06-29T19:14:39.0480637Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104) ~[?:?]
> 2022-06-29T19:14:39.0481424Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591) ~[?:?]
> 2022-06-29T19:14:39.0481994Z Jun 29 19:14:38 ... 1 more
> 2022-06-29T19:14:39.0482845Z Jun 29 19:14:38 2022-06-29 19:14:37,877 INFO org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager [] - Clearing resource requirements of job 5ef97af7fdd0c4b551549dfceac18104
> 2022-06-29T19:14:39.0484012Z Jun 29 19:14:38 2022-06-29 19:14:37,879 INFO org.apache.flink.runtime.executiongraph.failover.flip1.RestartPipelinedRegionFailoverStrategy [] - Calculating tasks to restart to recover the failed task df8d2cd231aa2f7a73136c030b1a8da4_0.
> 2022-06-29T19:14:39.0485681Z Jun 29 19:14:38 2022-06-29 19:14:37,880 INFO org.apache.flink.runtime.executiongraph.failover.flip1.RestartPipelinedRegionFailoverStrategy [] - 2 tasks should be restarted to recover the failed task df8d2cd231aa2f7a73136c030b1a8da4_0.
> 2022-06-29T19:14:39.0486975Z Jun 29 19:14:38 2022-06-29 19:14:37,881 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job insert-into_default_catalog.default_database.ElasticsearchAppendSinkTable (5ef97af7fdd0c4b551549dfceac18104) switched from state RUNNING to FAILING.
> 2022-06-29T19:14:39.0487770Z Jun 29 19:14:38 org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
> 2022-06-29T19:14:39.0488762Z Jun 29 19:14:38 at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0489968Z Jun 29 19:14:38 at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0491102Z Jun 29 19:14:38 at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:252) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0492170Z Jun 29 19:14:38 at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:242) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0493277Z Jun 29 19:14:38 at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:233) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0494715Z Jun 29 19:14:38 at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:684) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0495748Z Jun 29 19:14:38 at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:79) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0496761Z Jun 29 19:14:38 at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:444) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0497414Z Jun 29 19:14:38 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_332]
> 2022-06-29T19:14:39.0497973Z Jun 29 19:14:38 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_332]
> 2022-06-29T19:14:39.0498613Z Jun 29 19:14:38 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_332]
> 2022-06-29T19:14:39.0499182Z Jun 29 19:14:38 at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_332]
> 2022-06-29T19:14:39.0500434Z Jun 29 19:14:38 at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:316) ~[flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0501693Z Jun 29 19:14:38 at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83) ~[flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0502871Z Jun 29 19:14:38 at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:314) ~[flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0504007Z Jun 29 19:14:38 at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217) ~[flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0505167Z Jun 29 19:14:38 at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78) ~[flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0506301Z Jun 29 19:14:38 at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163) ~[flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0507347Z Jun 29 19:14:38 at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) [flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0508336Z Jun 29 19:14:38 at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) [flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0509323Z Jun 29 19:14:38 at scala.PartialFunction.applyOrElse(PartialFunction.scala:123) [flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0510309Z Jun 29 19:14:38 at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122) [flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0511318Z Jun 29 19:14:38 at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) [flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0512335Z Jun 29 19:14:38 at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) [flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0513356Z Jun 29 19:14:38 at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) [flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0514378Z Jun 29 19:14:38 at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) [flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0515347Z Jun 29 19:14:38 at akka.actor.Actor.aroundReceive(Actor.scala:537) [flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0516410Z Jun 29 19:14:38 at akka.actor.Actor.aroundReceive$(Actor.scala:535) [flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0517381Z Jun 29 19:14:38 at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220) [flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0518558Z Jun 29 19:14:38 at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580) [flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0519542Z Jun 29 19:14:38 at akka.actor.ActorCell.invoke(ActorCell.scala:548) [flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0520481Z Jun 29 19:14:38 at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) [flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0521421Z Jun 29 19:14:38 at akka.dispatch.Mailbox.run(Mailbox.scala:231) [flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0522345Z Jun 29 19:14:38 at akka.dispatch.Mailbox.exec(Mailbox.scala:243) [flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0522979Z Jun 29 19:14:38 at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) [?:1.8.0_332]
> 2022-06-29T19:14:39.0523555Z Jun 29 19:14:38 at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056) [?:1.8.0_332]
> 2022-06-29T19:14:39.0524137Z Jun 29 19:14:38 at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692) [?:1.8.0_332]
> 2022-06-29T19:14:39.0524708Z Jun 29 19:14:38 at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) [?:1.8.0_332]
> 2022-06-29T19:14:39.0525253Z Jun 29 19:14:38 Caused by: java.lang.RuntimeException: An error occurred in ElasticsearchSink.
> 2022-06-29T19:14:39.0525874Z Jun 29 19:14:38 at org.apache.flink.streaming.connectors.elasticsearch.ElasticsearchSinkBase.checkErrorAndRethrow(ElasticsearchSinkBase.java:427) ~[?:?]
> 2022-06-29T19:14:39.0526657Z Jun 29 19:14:38 at org.apache.flink.streaming.connectors.elasticsearch.ElasticsearchSinkBase.checkAsyncErrorsAndRequests(ElasticsearchSinkBase.java:432) ~[?:?]
> 2022-06-29T19:14:39.0527410Z Jun 29 19:14:38 at org.apache.flink.streaming.connectors.elasticsearch.ElasticsearchSinkBase.invoke(ElasticsearchSinkBase.java:329) ~[?:?]
> 2022-06-29T19:14:39.0528401Z Jun 29 19:14:38 at org.apache.flink.table.runtime.operators.sink.SinkOperator.processElement(SinkOperator.java:65) ~[flink-table_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0529506Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.tasks.OneInputStreamTask$StreamTaskNetworkOutput.emitRecord(OneInputStreamTask.java:233) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0530680Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.processElement(AbstractStreamTaskNetworkInput.java:134) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0531847Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.emitNext(AbstractStreamTaskNetworkInput.java:105) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0532961Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0534005Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:495) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0535053Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:203) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0536089Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:806) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0537211Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:758) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0538184Z Jun 29 19:14:38 at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0539134Z Jun 29 19:14:38 at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0540046Z Jun 29 19:14:38 at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:766) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0540924Z Jun 29 19:14:38 at org.apache.flink.runtime.taskmanager.Task.run(Task.java:575) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0541485Z Jun 29 19:14:38 at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_332]
> 2022-06-29T19:14:39.0541967Z Jun 29 19:14:38 Suppressed: java.lang.RuntimeException: An error occurred in ElasticsearchSink.
> 2022-06-29T19:14:39.0542603Z Jun 29 19:14:38 at org.apache.flink.streaming.connectors.elasticsearch.ElasticsearchSinkBase.checkErrorAndRethrow(ElasticsearchSinkBase.java:427) ~[?:?]
> 2022-06-29T19:14:39.0543337Z Jun 29 19:14:38 at org.apache.flink.streaming.connectors.elasticsearch.ElasticsearchSinkBase.close(ElasticsearchSinkBase.java:366) ~[?:?]
> 2022-06-29T19:14:39.0544308Z Jun 29 19:14:38 at org.apache.flink.api.common.functions.util.FunctionUtils.closeFunction(FunctionUtils.java:41) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0545383Z Jun 29 19:14:38 at org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.close(AbstractUdfStreamOperator.java:114) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0546464Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.tasks.StreamOperatorWrapper.close(StreamOperatorWrapper.java:141) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0547559Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.closeAllOperators(RegularOperatorChain.java:127) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0548606Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.tasks.StreamTask.closeAllOperators(StreamTask.java:1032) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0549639Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.tasks.StreamTask.runAndSuppressThrowable(StreamTask.java:1018) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0550635Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.tasks.StreamTask.cleanUp(StreamTask.java:925) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0551615Z Jun 29 19:14:38 at org.apache.flink.runtime.taskmanager.Task.lambda$restoreAndInvoke$0(Task.java:940) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0552611Z Jun 29 19:14:38 at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0553575Z Jun 29 19:14:38 at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:940) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0554892Z Jun 29 19:14:38 at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:766) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0555837Z Jun 29 19:14:38 at org.apache.flink.runtime.taskmanager.Task.run(Task.java:575) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0556411Z Jun 29 19:14:38 at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_332]
> 2022-06-29T19:14:39.0557388Z Jun 29 19:14:38 Caused by: org.apache.flink.elasticsearch7.shaded.org.elasticsearch.ElasticsearchException: Elasticsearch exception [type=cluster_block_exception, reason=index [my_users] blocked by: [FORBIDDEN/12/index read-only / allow delete (api)];]
> 2022-06-29T19:14:39.0558455Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.ElasticsearchException.innerFromXContent(ElasticsearchException.java:496) ~[?:?]
> 2022-06-29T19:14:39.0559232Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.ElasticsearchException.fromXContent(ElasticsearchException.java:407) ~[?:?]
> 2022-06-29T19:14:39.0559999Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.action.bulk.BulkItemResponse.fromXContent(BulkItemResponse.java:138) ~[?:?]
> 2022-06-29T19:14:39.0560747Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.action.bulk.BulkResponse.fromXContent(BulkResponse.java:196) ~[?:?]
> 2022-06-29T19:14:39.0561492Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.client.RestHighLevelClient.parseEntity(RestHighLevelClient.java:1793) ~[?:?]
> 2022-06-29T19:14:39.0562322Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.client.RestHighLevelClient.lambda$performRequestAsyncAndParseEntity$10(RestHighLevelClient.java:1581) ~[?:?]
> 2022-06-29T19:14:39.0563270Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.client.RestHighLevelClient$1.onSuccess(RestHighLevelClient.java:1663) ~[?:?]
> 2022-06-29T19:14:39.0576211Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.client.RestClient$FailureTrackingResponseListener.onSuccess(RestClient.java:590) ~[?:?]
> 2022-06-29T19:14:39.0577089Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.client.RestClient$1.completed(RestClient.java:333) ~[?:?]
> 2022-06-29T19:14:39.0577791Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.client.RestClient$1.completed(RestClient.java:327) ~[?:?]
> 2022-06-29T19:14:39.0578496Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.concurrent.BasicFuture.completed(BasicFuture.java:122) ~[?:?]
> 2022-06-29T19:14:39.0579331Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.client.DefaultClientExchangeHandlerImpl.responseCompleted(DefaultClientExchangeHandlerImpl.java:181) ~[?:?]
> 2022-06-29T19:14:39.0580224Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.nio.protocol.HttpAsyncRequestExecutor.processResponse(HttpAsyncRequestExecutor.java:448) ~[?:?]
> 2022-06-29T19:14:39.0581044Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.nio.protocol.HttpAsyncRequestExecutor.inputReady(HttpAsyncRequestExecutor.java:338) ~[?:?]
> 2022-06-29T19:14:39.0581870Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.DefaultNHttpClientConnection.consumeInput(DefaultNHttpClientConnection.java:265) ~[?:?]
> 2022-06-29T19:14:39.0582689Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.client.InternalIODispatch.onInputReady(InternalIODispatch.java:81) ~[?:?]
> 2022-06-29T19:14:39.0583493Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.client.InternalIODispatch.onInputReady(InternalIODispatch.java:39) ~[?:?]
> 2022-06-29T19:14:39.0584262Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.reactor.AbstractIODispatch.inputReady(AbstractIODispatch.java:114) ~[?:?]
> 2022-06-29T19:14:39.0585017Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.reactor.BaseIOReactor.readable(BaseIOReactor.java:162) ~[?:?]
> 2022-06-29T19:14:39.0585771Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvent(AbstractIOReactor.java:337) ~[?:?]
> 2022-06-29T19:14:39.0586546Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvents(AbstractIOReactor.java:315) ~[?:?]
> 2022-06-29T19:14:39.0587322Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:276) ~[?:?]
> 2022-06-29T19:14:39.0588299Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104) ~[?:?]
> 2022-06-29T19:14:39.0589098Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591) ~[?:?]
> 2022-06-29T19:14:39.0589669Z Jun 29 19:14:38 ... 1 more
> 2022-06-29T19:14:39.0590752Z Jun 29 19:14:38 Caused by: org.apache.flink.elasticsearch7.shaded.org.elasticsearch.ElasticsearchException: Elasticsearch exception [type=cluster_block_exception, reason=index [my_users] blocked by: [FORBIDDEN/12/index read-only / allow delete (api)];]
> 2022-06-29T19:14:39.0591642Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.ElasticsearchException.innerFromXContent(ElasticsearchException.java:496) ~[?:?]
> 2022-06-29T19:14:39.0592434Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.ElasticsearchException.fromXContent(ElasticsearchException.java:407) ~[?:?]
> 2022-06-29T19:14:39.0593196Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.action.bulk.BulkItemResponse.fromXContent(BulkItemResponse.java:138) ~[?:?]
> 2022-06-29T19:14:39.0593935Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.action.bulk.BulkResponse.fromXContent(BulkResponse.java:196) ~[?:?]
> 2022-06-29T19:14:39.0594676Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.client.RestHighLevelClient.parseEntity(RestHighLevelClient.java:1793) ~[?:?]
> 2022-06-29T19:14:39.0595509Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.client.RestHighLevelClient.lambda$performRequestAsyncAndParseEntity$10(RestHighLevelClient.java:1581) ~[?:?]
> 2022-06-29T19:14:39.0596352Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.client.RestHighLevelClient$1.onSuccess(RestHighLevelClient.java:1663) ~[?:?]
> 2022-06-29T19:14:39.0597144Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.client.RestClient$FailureTrackingResponseListener.onSuccess(RestClient.java:590) ~[?:?]
> 2022-06-29T19:14:39.0597889Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.client.RestClient$1.completed(RestClient.java:333) ~[?:?]
> 2022-06-29T19:14:39.0598697Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.client.RestClient$1.completed(RestClient.java:327) ~[?:?]
> 2022-06-29T19:14:39.0599402Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.concurrent.BasicFuture.completed(BasicFuture.java:122) ~[?:?]
> 2022-06-29T19:14:39.0600208Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.client.DefaultClientExchangeHandlerImpl.responseCompleted(DefaultClientExchangeHandlerImpl.java:181) ~[?:?]
> 2022-06-29T19:14:39.0601451Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.nio.protocol.HttpAsyncRequestExecutor.processResponse(HttpAsyncRequestExecutor.java:448) ~[?:?]
> 2022-06-29T19:14:39.0602310Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.nio.protocol.HttpAsyncRequestExecutor.inputReady(HttpAsyncRequestExecutor.java:338) ~[?:?]
> 2022-06-29T19:14:39.0603127Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.DefaultNHttpClientConnection.consumeInput(DefaultNHttpClientConnection.java:265) ~[?:?]
> 2022-06-29T19:14:39.0603927Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.client.InternalIODispatch.onInputReady(InternalIODispatch.java:81) ~[?:?]
> 2022-06-29T19:14:39.0604709Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.client.InternalIODispatch.onInputReady(InternalIODispatch.java:39) ~[?:?]
> 2022-06-29T19:14:39.0605477Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.reactor.AbstractIODispatch.inputReady(AbstractIODispatch.java:114) ~[?:?]
> 2022-06-29T19:14:39.0606364Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.reactor.BaseIOReactor.readable(BaseIOReactor.java:162) ~[?:?]
> 2022-06-29T19:14:39.0607123Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvent(AbstractIOReactor.java:337) ~[?:?]
> 2022-06-29T19:14:39.0607908Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvents(AbstractIOReactor.java:315) ~[?:?]
> 2022-06-29T19:14:39.0608673Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:276) ~[?:?]
> 2022-06-29T19:14:39.0609399Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104) ~[?:?]
> 2022-06-29T19:14:39.0610193Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591) ~[?:?]
> 2022-06-29T19:14:39.0610854Z Jun 29 19:14:38 at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_332]
> 2022-06-29T19:14:39.0611795Z Jun 29 19:14:38 2022-06-29 19:14:37,890 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding the results produced by task execution 505af083caeb63496e86df5e472f21d0.
> 2022-06-29T19:14:39.0612982Z Jun 29 19:14:38 2022-06-29 19:14:37,895 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job insert-into_default_catalog.default_database.ElasticsearchAppendSinkTable (5ef97af7fdd0c4b551549dfceac18104) switched from state FAILING to FAILED.
> 2022-06-29T19:14:39.0613767Z Jun 29 19:14:38 org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
> 2022-06-29T19:14:39.0614755Z Jun 29 19:14:38 at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0615982Z Jun 29 19:14:38 at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0617122Z Jun 29 19:14:38 at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:252) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0618187Z Jun 29 19:14:38 at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:242) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0619282Z Jun 29 19:14:38 at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:233) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0620362Z Jun 29 19:14:38 at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:684) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0621419Z Jun 29 19:14:38 at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:79) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0622423Z Jun 29 19:14:38 at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:444) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0623077Z Jun 29 19:14:38 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_332]
> 2022-06-29T19:14:39.0623635Z Jun 29 19:14:38 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_332]
> 2022-06-29T19:14:39.0624269Z Jun 29 19:14:38 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_332]
> 2022-06-29T19:14:39.0624899Z Jun 29 19:14:38 at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_332]
> 2022-06-29T19:14:39.0625955Z Jun 29 19:14:38 at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:316) ~[flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0627169Z Jun 29 19:14:38 at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83) ~[flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0628340Z Jun 29 19:14:38 at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:314) ~[flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0629460Z Jun 29 19:14:38 at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217) ~[flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0630623Z Jun 29 19:14:38 at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78) ~[flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0631770Z Jun 29 19:14:38 at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163) ~[flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0632819Z Jun 29 19:14:38 at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) [flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0633812Z Jun 29 19:14:38 at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) [flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0634812Z Jun 29 19:14:38 at scala.PartialFunction.applyOrElse(PartialFunction.scala:123) [flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0635805Z Jun 29 19:14:38 at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122) [flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0636829Z Jun 29 19:14:38 at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) [flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0637846Z Jun 29 19:14:38 at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) [flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0638969Z Jun 29 19:14:38 at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) [flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0639983Z Jun 29 19:14:38 at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) [flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0640959Z Jun 29 19:14:38 at akka.actor.Actor.aroundReceive(Actor.scala:537) [flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0641899Z Jun 29 19:14:38 at akka.actor.Actor.aroundReceive$(Actor.scala:535) [flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0642882Z Jun 29 19:14:38 at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220) [flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0643869Z Jun 29 19:14:38 at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580) [flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0644826Z Jun 29 19:14:38 at akka.actor.ActorCell.invoke(ActorCell.scala:548) [flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0645787Z Jun 29 19:14:38 at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) [flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0646718Z Jun 29 19:14:38 at akka.dispatch.Mailbox.run(Mailbox.scala:231) [flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0647709Z Jun 29 19:14:38 at akka.dispatch.Mailbox.exec(Mailbox.scala:243) [flink-rpc-akka_7fea9212-b1dc-4182-8bf4-548cb601f5cb.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0648410Z Jun 29 19:14:38 at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) [?:1.8.0_332]
> 2022-06-29T19:14:39.0648988Z Jun 29 19:14:38 at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056) [?:1.8.0_332]
> 2022-06-29T19:14:39.0649573Z Jun 29 19:14:38 at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692) [?:1.8.0_332]
> 2022-06-29T19:14:39.0650154Z Jun 29 19:14:38 at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) [?:1.8.0_332]
> 2022-06-29T19:14:39.0650700Z Jun 29 19:14:38 Caused by: java.lang.RuntimeException: An error occurred in ElasticsearchSink.
> 2022-06-29T19:14:39.0651335Z Jun 29 19:14:38 at org.apache.flink.streaming.connectors.elasticsearch.ElasticsearchSinkBase.checkErrorAndRethrow(ElasticsearchSinkBase.java:427) ~[?:?]
> 2022-06-29T19:14:39.0652104Z Jun 29 19:14:38 at org.apache.flink.streaming.connectors.elasticsearch.ElasticsearchSinkBase.checkAsyncErrorsAndRequests(ElasticsearchSinkBase.java:432) ~[?:?]
> 2022-06-29T19:14:39.0652859Z Jun 29 19:14:38 at org.apache.flink.streaming.connectors.elasticsearch.ElasticsearchSinkBase.invoke(ElasticsearchSinkBase.java:329) ~[?:?]
> 2022-06-29T19:14:39.0653852Z Jun 29 19:14:38 at org.apache.flink.table.runtime.operators.sink.SinkOperator.processElement(SinkOperator.java:65) ~[flink-table_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0654973Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.tasks.OneInputStreamTask$StreamTaskNetworkOutput.emitRecord(OneInputStreamTask.java:233) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0656147Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.processElement(AbstractStreamTaskNetworkInput.java:134) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0657309Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.emitNext(AbstractStreamTaskNetworkInput.java:105) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0658450Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0659486Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:495) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0660536Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:203) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0661583Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:806) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0662547Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:758) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0663531Z Jun 29 19:14:38 at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0664492Z Jun 29 19:14:38 at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0665410Z Jun 29 19:14:38 at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:766) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0666300Z Jun 29 19:14:38 at org.apache.flink.runtime.taskmanager.Task.run(Task.java:575) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0666878Z Jun 29 19:14:38 at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_332]
> 2022-06-29T19:14:39.0667356Z Jun 29 19:14:38 Suppressed: java.lang.RuntimeException: An error occurred in ElasticsearchSink.
> 2022-06-29T19:14:39.0668101Z Jun 29 19:14:38 at org.apache.flink.streaming.connectors.elasticsearch.ElasticsearchSinkBase.checkErrorAndRethrow(ElasticsearchSinkBase.java:427) ~[?:?]
> 2022-06-29T19:14:39.0668829Z Jun 29 19:14:38 at org.apache.flink.streaming.connectors.elasticsearch.ElasticsearchSinkBase.close(ElasticsearchSinkBase.java:366) ~[?:?]
> 2022-06-29T19:14:39.0669807Z Jun 29 19:14:38 at org.apache.flink.api.common.functions.util.FunctionUtils.closeFunction(FunctionUtils.java:41) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0670882Z Jun 29 19:14:38 at org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.close(AbstractUdfStreamOperator.java:114) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0671966Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.tasks.StreamOperatorWrapper.close(StreamOperatorWrapper.java:141) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0673057Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.closeAllOperators(RegularOperatorChain.java:127) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0674126Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.tasks.StreamTask.closeAllOperators(StreamTask.java:1032) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0675169Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.tasks.StreamTask.runAndSuppressThrowable(StreamTask.java:1018) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0676176Z Jun 29 19:14:38 at org.apache.flink.streaming.runtime.tasks.StreamTask.cleanUp(StreamTask.java:925) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0677190Z Jun 29 19:14:38 at org.apache.flink.runtime.taskmanager.Task.lambda$restoreAndInvoke$0(Task.java:940) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0678175Z Jun 29 19:14:38 at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0679223Z Jun 29 19:14:38 at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:940) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0680132Z Jun 29 19:14:38 at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:766) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0681028Z Jun 29 19:14:38 at org.apache.flink.runtime.taskmanager.Task.run(Task.java:575) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
> 2022-06-29T19:14:39.0681602Z Jun 29 19:14:38 at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_332]
> 2022-06-29T19:14:39.0682580Z Jun 29 19:14:38 Caused by: org.apache.flink.elasticsearch7.shaded.org.elasticsearch.ElasticsearchException: Elasticsearch exception [type=cluster_block_exception, reason=index [my_users] blocked by: [FORBIDDEN/12/index read-only / allow delete (api)];]
> 2022-06-29T19:14:39.0683468Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.ElasticsearchException.innerFromXContent(ElasticsearchException.java:496) ~[?:?]
> 2022-06-29T19:14:39.0684252Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.ElasticsearchException.fromXContent(ElasticsearchException.java:407) ~[?:?]
> 2022-06-29T19:14:39.0685017Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.action.bulk.BulkItemResponse.fromXContent(BulkItemResponse.java:138) ~[?:?]
> 2022-06-29T19:14:39.0685770Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.action.bulk.BulkResponse.fromXContent(BulkResponse.java:196) ~[?:?]
> 2022-06-29T19:14:39.0686513Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.client.RestHighLevelClient.parseEntity(RestHighLevelClient.java:1793) ~[?:?]
> 2022-06-29T19:14:39.0687329Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.client.RestHighLevelClient.lambda$performRequestAsyncAndParseEntity$10(RestHighLevelClient.java:1581) ~[?:?]
> 2022-06-29T19:14:39.0688293Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.client.RestHighLevelClient$1.onSuccess(RestHighLevelClient.java:1663) ~[?:?]
> 2022-06-29T19:14:39.0689078Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.client.RestClient$FailureTrackingResponseListener.onSuccess(RestClient.java:590) ~[?:?]
> 2022-06-29T19:14:39.0689831Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.client.RestClient$1.completed(RestClient.java:333) ~[?:?]
> 2022-06-29T19:14:39.0690515Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.elasticsearch.client.RestClient$1.completed(RestClient.java:327) ~[?:?]
> 2022-06-29T19:14:39.0691211Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.concurrent.BasicFuture.completed(BasicFuture.java:122) ~[?:?]
> 2022-06-29T19:14:39.0692018Z Jun 29 19:14:38 at org.apache.flink.elasticsearch7.shaded.org.apache.http.impl.nio.client.DefaultClientExchangeHandlerImpl.responseCompleted(DefaultClientExchangeHandlerImpl.java:181) ~[?:?]
> 2022-06-29T19:14:39.0693088Z Jun 29 19:14:38 2022-06-29 19:14:09,618 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner [] - --------------------------------------------------------------------------------
> 2022-06-29T19:14:39.0693967Z Jun 29 19:14:38 2022-06-29 19:14:09,620 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner [] - Preconfiguration:
> 2022-06-29T19:14:39.0694727Z Jun 29 19:14:38 2022-06-29 19:14:09,620 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner [] -
> {code}
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=37377&view=logs&j=c88eea3b-64a0-564d-0031-9fdcd7b8abee&t=070ff179-953e-5bda-71fa-d6599415701c
--
This message was sent by Atlassian Jira
(v8.20.10#820010)