You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by "zxylmqx (via GitHub)" <gi...@apache.org> on 2023/05/26 08:47:49 UTC
[GitHub] [seatunnel] zxylmqx opened a new issue, #4838: 当我使用zeta引擎时提交第二个cdc任务会停止所有cdc任务
zxylmqx opened a new issue, #4838:
URL: https://github.com/apache/seatunnel/issues/4838
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
### What happened
使用zeta引擎+mysqlcdc，同步mysql数据到doris时，提交一个任务可以正常运行，提交第二个任务会出现两个任务都不工作的情况，查看job详情，状态依然是running，但是已经不同步数据了
### SeaTunnel Version
2.3.1
### SeaTunnel Config
```conf
seatunnel:
engine:
backup-count: 2
queue-type: blockingqueue
print-execution-info-interval: 10
print-job-metrics-info-interval: 10
slot-service:
dynamic-slot: true
checkpoint:
interval: 30000
timeout: 20000
max-concurrent: 5
tolerable-failure: 2
storage:
type: hdfs
max-retained: 3
plugin-config:
namespace: /tmp/seatunnel/checkpoint_snapshot
storage.type: hdfs
fs.defaultFS: hdfs://bigdata:8022 # Ensure that the directory has written permission
```
### Running Command
```shell
${SEATUNNEL_HOME}/bin/seatunnel.sh --config /tmp/dolphinscheduler/exec/process/yinghuo-common/9648406837856/9650140382816_23/2190/5162/seatunnel_2190_5162.conf --deploy-mode cluster -n debezium_source
```
### Error Exception
```log
2023-05-26 16:23:00,831 INFO com.hazelcast.spi.impl.operationservice.impl.InvocationMonitor - [bigdata07]:5801 [seatunnel_mycluster] [5.1] Invocations:3 timeouts:1 backup-timeouts:0
2023-05-26 16:23:00,832 WARN org.apache.seatunnel.engine.server.dag.physical.SubPlan - Job debezium_source (714388703002230790), Pipeline: [(1/1)] checkpoint have error, cancel the pipeline
2023-05-26 16:23:00,833 WARN com.hazelcast.internal.server.tcp.TcpServerConnection - [bigdata07]:5801 [seatunnel_mycluster] [5.1] Connection[id=65, /[10.6.1.219:5801](http://10.6.1.219:5801/)->/[10.6.1.16:39014](http://10.6.1.16:39014/), qualifier=null, endpoint=[bigdata05]:5801, remoteUuid=02a08838-4c85-4e91-882b-881f537228d2, alive=false, connectionType=MEMBER, planeIndex=0] closed. Reason: Exception in Connection[id=65, /[10.6.1.219:5801](http://10.6.1.219:5801/)->/[10.6.1.16:39014](http://10.6.1.16:39014/), qualifier=null, endpoint=[bigdata05]:5801, remoteUuid=02a08838-4c85-4e91-882b-881f537228d2, alive=true, connectionType=MEMBER, planeIndex=0], thread=checkpoint-coordinator-1/714388703002230790
java.nio.channels.ClosedByInterruptException: null
at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:202) ~[?:1.8.0_352]
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:477) ~[?:1.8.0_352]
at com.hazelcast.internal.networking.nio.NioOutboundPipeline.flushToSocket(NioOutboundPipeline.java:439) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.internal.networking.nio.NioOutboundPipeline.process(NioOutboundPipeline.java:324) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.internal.networking.nio.NioOutboundPipeline.executePipeline(NioOutboundPipeline.java:240) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.internal.networking.nio.NioOutboundPipeline.write(NioOutboundPipeline.java:218) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.internal.networking.nio.NioChannel.write(NioChannel.java:79) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.internal.server.tcp.TcpServerConnection.write(TcpServerConnection.java:222) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationservice.impl.OutboundOperationHandler.send(OutboundOperationHandler.java:59) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationservice.impl.Invocation.doInvokeRemote(Invocation.java:612) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationservice.impl.Invocation.doInvoke(Invocation.java:582) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationservice.impl.Invocation.invoke0(Invocation.java:541) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationservice.impl.Invocation.invoke(Invocation.java:241) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationservice.impl.InvocationBuilderImpl.invoke(InvocationBuilderImpl.java:61) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.map.impl.proxy.MapProxySupport.invokeOperation(MapProxySupport.java:478) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.map.impl.proxy.MapProxySupport.getInternal(MapProxySupport.java:371) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.map.impl.proxy.MapProxyImpl.get(MapProxyImpl.java:123) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex.getExecutionState(PhysicalVertex.java:470) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.dag.physical.SubPlan.cancelTask(SubPlan.java:405) ~[seatunnel-starter.jar:2.3.1]
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_352]
at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384) ~[?:1.8.0_352]
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) ~[?:1.8.0_352]
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) ~[?:1.8.0_352]
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) ~[?:1.8.0_352]
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:1.8.0_352]
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566) ~[?:1.8.0_352]
at org.apache.seatunnel.engine.server.dag.physical.SubPlan.cancelPipelineTasks(SubPlan.java:381) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.dag.physical.SubPlan.cancelPipeline(SubPlan.java:367) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.dag.physical.SubPlan.handleCheckpointError(SubPlan.java:555) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.master.JobMaster.lambda$handleCheckpointError$2(JobMaster.java:328) ~[seatunnel-starter.jar:2.3.1]
at java.util.ArrayList.forEach(ArrayList.java:1259) ~[?:1.8.0_352]
at org.apache.seatunnel.engine.server.master.JobMaster.handleCheckpointError(JobMaster.java:325) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointManager.handleCheckpointError(CheckpointManager.java:175) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.handleCoordinatorError(CheckpointCoordinator.java:221) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.handleCoordinatorError(CheckpointCoordinator.java:211) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.lambda$null$7(CheckpointCoordinator.java:382) ~[seatunnel-starter.jar:2.3.1]
at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) ~[?:1.8.0_352]
at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) ~[?:1.8.0_352]
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) ~[?:1.8.0_352]
at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) ~[?:1.8.0_352]
at org.apache.seatunnel.engine.common.utils.PassiveCompletableFuture.internalCompleteExceptionally(PassiveCompletableFuture.java:74) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.common.utils.PassiveCompletableFuture.lambda$new$0(PassiveCompletableFuture.java:31) ~[seatunnel-starter.jar:2.3.1]
at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) ~[?:1.8.0_352]
at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) ~[?:1.8.0_352]
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) ~[?:1.8.0_352]
at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) ~[?:1.8.0_352]
at org.apache.seatunnel.engine.server.checkpoint.PendingCheckpoint.abortCheckpoint(PendingCheckpoint.java:173) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.lambda$cleanPendingCheckpoint$19(CheckpointCoordinator.java:550) ~[seatunnel-starter.jar:2.3.1]
at java.util.concurrent.ConcurrentHashMap$ValuesView.forEach(ConcurrentHashMap.java:4705) ~[?:1.8.0_352]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.cleanPendingCheckpoint(CheckpointCoordinator.java:548) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.handleCoordinatorError(CheckpointCoordinator.java:216) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.handleCoordinatorError(CheckpointCoordinator.java:211) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.lambda$null$7(CheckpointCoordinator.java:382) ~[seatunnel-starter.jar:2.3.1]
at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) ~[?:1.8.0_352]
at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) ~[?:1.8.0_352]
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) ~[?:1.8.0_352]
at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) ~[?:1.8.0_352]
at org.apache.seatunnel.engine.common.utils.PassiveCompletableFuture.internalCompleteExceptionally(PassiveCompletableFuture.java:74) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.common.utils.PassiveCompletableFuture.lambda$new$0(PassiveCompletableFuture.java:31) ~[seatunnel-starter.jar:2.3.1]
at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) ~[?:1.8.0_352]
at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) ~[?:1.8.0_352]
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) ~[?:1.8.0_352]
at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) ~[?:1.8.0_352]
at org.apache.seatunnel.engine.server.checkpoint.PendingCheckpoint.abortCheckpoint(PendingCheckpoint.java:173) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.lambda$cleanPendingCheckpoint$19(CheckpointCoordinator.java:550) ~[seatunnel-starter.jar:2.3.1]
at java.util.concurrent.ConcurrentHashMap$ValuesView.forEach(ConcurrentHashMap.java:4705) ~[?:1.8.0_352]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.cleanPendingCheckpoint(CheckpointCoordinator.java:548) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.handleCoordinatorError(CheckpointCoordinator.java:216) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.handleCoordinatorError(CheckpointCoordinator.java:211) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.lambda$null$7(CheckpointCoordinator.java:382) ~[seatunnel-starter.jar:2.3.1]
at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) ~[?:1.8.0_352]
at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) ~[?:1.8.0_352]
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) ~[?:1.8.0_352]
at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) ~[?:1.8.0_352]
at org.apache.seatunnel.engine.common.utils.PassiveCompletableFuture.internalCompleteExceptionally(PassiveCompletableFuture.java:74) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.common.utils.PassiveCompletableFuture.lambda$new$0(PassiveCompletableFuture.java:31) ~[seatunnel-starter.jar:2.3.1]
at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) ~[?:1.8.0_352]
at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) ~[?:1.8.0_352]
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) ~[?:1.8.0_352]
at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) ~[?:1.8.0_352]
at org.apache.seatunnel.engine.server.checkpoint.PendingCheckpoint.abortCheckpoint(PendingCheckpoint.java:173) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.lambda$cleanPendingCheckpoint$19(CheckpointCoordinator.java:550) ~[seatunnel-starter.jar:2.3.1]
at java.util.concurrent.ConcurrentHashMap$ValuesView.forEach(ConcurrentHashMap.java:4705) ~[?:1.8.0_352]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.cleanPendingCheckpoint(CheckpointCoordinator.java:548) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.handleCoordinatorError(CheckpointCoordinator.java:216) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.handleCoordinatorError(CheckpointCoordinator.java:211) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.lambda$null$7(CheckpointCoordinator.java:382) ~[seatunnel-starter.jar:2.3.1]
at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) ~[?:1.8.0_352]
at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) ~[?:1.8.0_352]
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) ~[?:1.8.0_352]
at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) ~[?:1.8.0_352]
at org.apache.seatunnel.engine.common.utils.PassiveCompletableFuture.internalCompleteExceptionally(PassiveCompletableFuture.java:74) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.common.utils.PassiveCompletableFuture.lambda$new$0(PassiveCompletableFuture.java:31) ~[seatunnel-starter.jar:2.3.1]
at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) ~[?:1.8.0_352]
at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) ~[?:1.8.0_352]
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) ~[?:1.8.0_352]
at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) ~[?:1.8.0_352]
at org.apache.seatunnel.engine.server.checkpoint.PendingCheckpoint.abortCheckpoint(PendingCheckpoint.java:173) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.lambda$cleanPendingCheckpoint$19(CheckpointCoordinator.java:550) ~[seatunnel-starter.jar:2.3.1]
at java.util.concurrent.ConcurrentHashMap$ValuesView.forEach(ConcurrentHashMap.java:4705) ~[?:1.8.0_352]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.cleanPendingCheckpoint(CheckpointCoordinator.java:548) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.handleCoordinatorError(CheckpointCoordinator.java:216) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.lambda$null$9(CheckpointCoordinator.java:436) ~[seatunnel-starter.jar:2.3.1]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_352]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_352]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) ~[?:1.8.0_352]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) ~[?:1.8.0_352]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_352]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_352]
at java.lang.Thread.run(Thread.java:750) [?:1.8.0_352]
2023-05-26 16:23:00,834 INFO com.hazelcast.internal.server.tcp.TcpServerConnection - [bigdata07]:5801 [seatunnel_mycluster] [5.1] Initialized new cluster connection between /[10.6.1.219:5801](http://10.6.1.219:5801/) and /[10.6.1.16:47142](http://10.6.1.16:47142/)
2023-05-26 16:23:01,223 INFO com.hazelcast.internal.diagnostics.HealthMonitor - [bigdata07]:5801 [seatunnel_mycluster] [5.1] processors=16, physical.memory.total=123.8G, physical.memory.free=2.4G, swap.space.total=0, swap.space.free=0, heap.memory.used=1.7G, heap.memory.free=322.9M, heap.memory.total=2.0G, heap.memory.max=2.0G, heap.memory.used/total=84.21%, heap.memory.used/max=84.21%, minor.gc.count=20828, minor.gc.time=137944ms, major.gc.count=5, major.gc.time=2090ms, load.process=4.34%, load.system=7.67%, load.systemAverage=1.80, thread.count=224, thread.peakCount=236, cluster.timeDiff=0, event.q.size=0, executor.q.async.size=0, executor.q.client.size=0, executor.q.client.query.size=0, executor.q.client.blocking.size=0, executor.q.query.size=0, executor.q.scheduled.size=0, executor.q.io.size=0, executor.q.system.size=0, executor.q.operations.size=0, executor.q.priorityOperation.size=0, operations.completed.count=1134122, executor.q.mapLoad.size=0, executor.q.mapLoadAllKeys.si
ze=0, executor.q.cluster.size=0, executor.q.response.size=0, operations.running.count=0, operations.pending.invocations.percentage=0.00%, operations.pending.invocations.count=0, proxy.count=41, clientEndpoint.count=2, connection.active.count=0, client.connection.count=0, connection.count=0
```
### Flink or Spark Version
_No response_
### Java or Scala Version
_No response_
### Screenshots
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [seatunnel] zxylmqx commented on issue #4838: 当我使用zeta引擎时提交第二个cdc任务会停止所有cdc任务
Posted by "zxylmqx (via GitHub)" <gi...@apache.org>.
zxylmqx commented on issue #4838:
URL: https://github.com/apache/seatunnel/issues/4838#issuecomment-1566723445
已经指定了不同的[sink.label.prefix]，而且这个是传入的变量，保证每次启动都是唯一的，目前将checkpoint从hdfs变成了locol，错误变成了
2023-05-29 15:07:42,928 INFO org.apache.seatunnel.engine.server.dag.physical.SubPlan - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)] turn from state DEPLOYING to RUNNING.
2023-05-29 15:07:43,010 ERROR org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator - task running failed
java.util.concurrent.CompletionException: org.apache.seatunnel.common.utils.SeaTunnelException: java.io.EOFException
at com.hazelcast.spi.impl.AbstractInvocationFuture.returnOrThrowWithJoinConventions(AbstractInvocationFuture.java:819) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.AbstractInvocationFuture.resolveAndThrowWithJoinConvention(AbstractInvocationFuture.java:835) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.AbstractInvocationFuture.join(AbstractInvocationFuture.java:553) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.restoreTaskState(CheckpointCoordinator.java:250) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.lambda$reportedTask$1(CheckpointCoordinator.java:189) ~[seatunnel-starter.jar:2.3.1]
at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1640) ~[?:1.8.0_352]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_352]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_352]
at java.lang.Thread.run(Thread.java:750) [?:1.8.0_352]
Caused by: org.apache.seatunnel.common.utils.SeaTunnelException: java.io.EOFException
at org.apache.seatunnel.engine.server.checkpoint.operation.NotifyTaskRestoreOperation.lambda$run$0(NotifyTaskRestoreOperation.java:100) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.common.utils.RetryUtils.retryWithException(RetryUtils.java:48) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.checkpoint.operation.NotifyTaskRestoreOperation.run(NotifyTaskRestoreOperation.java:85) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationservice.Operation.call(Operation.java:189) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.call(OperationRunnerImpl.java:273) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.run(OperationRunnerImpl.java:248) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.run(OperationRunnerImpl.java:471) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationexecutor.impl.OperationThread.process(OperationThread.java:197) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationexecutor.impl.OperationThread.process(OperationThread.java:137) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationexecutor.impl.OperationThread.executeRun(OperationThread.java:123) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.internal.util.executor.HazelcastManagedThread.run(HazelcastManagedThread.java:102) ~[seatunnel-starter.jar:2.3.1]
Caused by: java.io.EOFException
at java.io.DataInputStream.readFully(DataInputStream.java:197) ~[?:1.8.0_352]
at java.io.DataInputStream.readLong(DataInputStream.java:416) ~[?:1.8.0_352]
at org.apache.seatunnel.connectors.doris.sink.writer.DorisSinkStateSerializer.deserialize(DorisSinkStateSerializer.java:45) ~[?:?]
at org.apache.seatunnel.connectors.doris.sink.writer.DorisSinkStateSerializer.deserialize(DorisSinkStateSerializer.java:29) ~[?:?]
at org.apache.seatunnel.engine.server.task.flow.SinkFlowLifeCycle.lambda$null$2(SinkFlowLifeCycle.java:239) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.common.utils.ExceptionUtil.sneaky(ExceptionUtil.java:138) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.task.flow.SinkFlowLifeCycle.lambda$restoreState$3(SinkFlowLifeCycle.java:235) ~[seatunnel-starter.jar:2.3.1]
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_352]
at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384) ~[?:1.8.0_352]
at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:647) ~[?:1.8.0_352]
at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:272) ~[?:1.8.0_352]
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_352]
at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) ~[?:1.8.0_352]
at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384) ~[?:1.8.0_352]
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) ~[?:1.8.0_352]
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) ~[?:1.8.0_352]
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) ~[?:1.8.0_352]
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:1.8.0_352]
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566) ~[?:1.8.0_352]
at org.apache.seatunnel.engine.server.task.flow.SinkFlowLifeCycle.restoreState(SinkFlowLifeCycle.java:240) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.task.SeaTunnelTask.lambda$restoreState$14(SeaTunnelTask.java:383) ~[seatunnel-starter.jar:2.3.1]
at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183) ~[?:1.8.0_352]
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_352]
at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) ~[?:1.8.0_352]
at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384) ~[?:1.8.0_352]
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) ~[?:1.8.0_352]
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) ~[?:1.8.0_352]
at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150) ~[?:1.8.0_352]
at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:173) ~[?:1.8.0_352]
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:1.8.0_352]
at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:485) ~[?:1.8.0_352]
at org.apache.seatunnel.engine.server.task.SeaTunnelTask.restoreState(SeaTunnelTask.java:380) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.checkpoint.operation.NotifyTaskRestoreOperation.lambda$run$0(NotifyTaskRestoreOperation.java:96) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.common.utils.RetryUtils.retryWithException(RetryUtils.java:48) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.checkpoint.operation.NotifyTaskRestoreOperation.run(NotifyTaskRestoreOperation.java:85) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationservice.Operation.call(Operation.java:189) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.call(OperationRunnerImpl.java:273) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.run(OperationRunnerImpl.java:248) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.run(OperationRunnerImpl.java:471) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationexecutor.impl.OperationThread.process(OperationThread.java:197) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationexecutor.impl.OperationThread.process(OperationThread.java:137) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationexecutor.impl.OperationThread.executeRun(OperationThread.java:123) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.internal.util.executor.HazelcastManagedThread.run(HazelcastManagedThread.java:102) ~[seatunnel-starter.jar:2.3.1]
2023-05-29 15:07:43,010 INFO org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator - start clean pending checkpoint cause CheckpointCoordinator inside have error.
2023-05-29 15:07:43,010 WARN org.apache.seatunnel.engine.server.dag.physical.SubPlan - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)] checkpoint have error, cancel the pipeline
2023-05-29 15:07:43,011 INFO org.apache.seatunnel.engine.server.dag.physical.SubPlan - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)] turn from state RUNNING to CANCELING.
2023-05-29 15:07:43,014 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SplitEnumerator (1/1)] turn from state RUNNING to CANCELING.
2023-05-29 15:07:43,014 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SourceTask (2/2)] turn from state RUNNING to CANCELING.
2023-05-29 15:07:43,015 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Send cancel Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SplitEnumerator (1/1)] operator to member [bigdata07]:5801
2023-05-29 15:07:43,015 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SourceTask (1/2)] turn from state RUNNING to CANCELING.
2023-05-29 15:07:43,018 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Send cancel Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SourceTask (2/2)] operator to member [bigdata07]:5801
2023-05-29 15:07:43,019 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Send cancel Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SourceTask (1/2)] operator to member [bigdata07]:5801
2023-05-29 15:07:43,019 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SplitEnumerator (1/1)] turn to end state CANCELED.
2023-05-29 15:07:43,019 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SourceTask (2/2)] turn to end state CANCELED.
2023-05-29 15:07:43,019 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SourceTask (2/2)] end with state CANCELED
2023-05-29 15:07:43,019 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SplitEnumerator (1/1)] end with state CANCELED
2023-05-29 15:07:43,021 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SourceTask (1/2)] turn to end state CANCELED.
2023-05-29 15:07:43,021 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SourceTask (1/2)] end with state CANCELED
2023-05-29 15:07:43,022 INFO org.apache.seatunnel.engine.server.dag.physical.SubPlan - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)] end with state FAILED
2023-05-29 15:07:43,022 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalPlan - Can restore pipeline Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)]
2023-05-29 15:07:43,022 INFO org.apache.seatunnel.engine.server.dag.physical.SubPlan - Restore time 2, pipeline Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)]
2023-05-29 15:07:43,023 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SplitEnumerator (1/1)] turn to state CREATED.
2023-05-29 15:07:43,024 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SourceTask (1/2)] turn to state CREATED.
2023-05-29 15:07:43,024 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SourceTask (2/2)] turn to state CREATED.
2023-05-29 15:07:43,025 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - The task Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SourceTask (1/2)] is in state CREATED when init state future
2023-05-29 15:07:43,025 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - The task Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SourceTask (2/2)] is in state CREATED when init state future
2023-05-29 15:07:43,025 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - The task Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SplitEnumerator (1/1)] is in state CREATED when init state future
2023-05-29 15:07:43,025 INFO org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator - received restore CheckpointCoordinator with alreadyStarted= false
2023-05-29 15:07:43,025 INFO org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator - start clean pending checkpoint cause CheckpointCoordinator reset.
2023-05-29 15:07:43,025 INFO org.apache.seatunnel.engine.server.dag.physical.SubPlan - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)] turn from state CREATED to SCHEDULED.
2023-05-29 15:07:43,026 INFO org.apache.seatunnel.engine.server.resourcemanager.AbstractResourceManager - received slot active check success, profile: SlotProfile{worker=[bigdata07]:5801, slotID=1, ownerJobID=715450079284035585, assigned=true, resourceProfile=ResourceProfile{cpu=CPU{core=0}, heapMemory=Memory{bytes=0}}, sequence='0c2626d6-416f-4f79-9e44-2e98873f8751'}
2023-05-29 15:07:43,026 INFO org.apache.seatunnel.engine.server.scheduler.PipelineBaseScheduler - use active old profile: SlotProfile{worker=[bigdata07]:5801, slotID=1, ownerJobID=715450079284035585, assigned=true, resourceProfile=ResourceProfile{cpu=CPU{core=0}, heapMemory=Memory{bytes=0}}, sequence='0c2626d6-416f-4f79-9e44-2e98873f8751'} for task Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SplitEnumerator (1/1)]
2023-05-29 15:07:43,026 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SplitEnumerator (1/1)] turn from state CREATED to SCHEDULED.
2023-05-29 15:07:43,027 INFO org.apache.seatunnel.engine.server.resourcemanager.AbstractResourceManager - received slot active check success, profile: SlotProfile{worker=[bigdata07]:5801, slotID=2, ownerJobID=715450079284035585, assigned=true, resourceProfile=ResourceProfile{cpu=CPU{core=0}, heapMemory=Memory{bytes=0}}, sequence='0c2626d6-416f-4f79-9e44-2e98873f8751'}
2023-05-29 15:07:43,027 INFO org.apache.seatunnel.engine.server.scheduler.PipelineBaseScheduler - use active old profile: SlotProfile{worker=[bigdata07]:5801, slotID=2, ownerJobID=715450079284035585, assigned=true, resourceProfile=ResourceProfile{cpu=CPU{core=0}, heapMemory=Memory{bytes=0}}, sequence='0c2626d6-416f-4f79-9e44-2e98873f8751'} for task Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SourceTask (1/2)]
2023-05-29 15:07:43,028 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SourceTask (1/2)] turn from state CREATED to SCHEDULED.
2023-05-29 15:07:43,028 INFO org.apache.seatunnel.engine.server.resourcemanager.AbstractResourceManager - received slot active check success, profile: SlotProfile{worker=[bigdata07]:5801, slotID=3, ownerJobID=715450079284035585, assigned=true, resourceProfile=ResourceProfile{cpu=CPU{core=0}, heapMemory=Memory{bytes=0}}, sequence='0c2626d6-416f-4f79-9e44-2e98873f8751'}
2023-05-29 15:07:43,028 INFO org.apache.seatunnel.engine.server.scheduler.PipelineBaseScheduler - use active old profile: SlotProfile{worker=[bigdata07]:5801, slotID=3, ownerJobID=715450079284035585, assigned=true, resourceProfile=ResourceProfile{cpu=CPU{core=0}, heapMemory=Memory{bytes=0}}, sequence='0c2626d6-416f-4f79-9e44-2e98873f8751'} for task Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SourceTask (2/2)]
2023-05-29 15:07:43,028 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SourceTask (2/2)] turn from state CREATED to SCHEDULED.
2023-05-29 15:07:43,029 INFO org.apache.seatunnel.engine.server.dag.physical.SubPlan - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)] turn from state SCHEDULED to DEPLOYING.
2023-05-29 15:07:43,030 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SplitEnumerator (1/1)] turn from state SCHEDULED to DEPLOYING.
2023-05-29 15:07:43,031 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SourceTask (1/2)] turn from state SCHEDULED to DEPLOYING.
2023-05-29 15:07:43,032 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SourceTask (2/2)] turn from state SCHEDULED to DEPLOYING.
2023-05-29 15:07:43,066 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SourceTask (1/2)] turn from state DEPLOYING to RUNNING.
2023-05-29 15:07:43,073 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SplitEnumerator (1/1)] turn from state DEPLOYING to RUNNING.
2023-05-29 15:07:43,074 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SourceTask (2/2)] turn from state DEPLOYING to RUNNING.
2023-05-29 15:07:43,074 INFO org.apache.seatunnel.engine.server.dag.physical.SubPlan - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)] turn from state DEPLOYING to RUNNING.
2023-05-29 15:07:43,151 ERROR org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator - task running failed
java.util.concurrent.CompletionException: org.apache.seatunnel.common.utils.SeaTunnelException: java.io.EOFException
at com.hazelcast.spi.impl.AbstractInvocationFuture.returnOrThrowWithJoinConventions(AbstractInvocationFuture.java:819) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.AbstractInvocationFuture.resolveAndThrowWithJoinConvention(AbstractInvocationFuture.java:835) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.AbstractInvocationFuture.join(AbstractInvocationFuture.java:553) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.restoreTaskState(CheckpointCoordinator.java:250) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.lambda$reportedTask$1(CheckpointCoordinator.java:189) ~[seatunnel-starter.jar:2.3.1]
at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1640) ~[?:1.8.0_352]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_352]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_352]
at java.lang.Thread.run(Thread.java:750) [?:1.8.0_352]
Caused by: org.apache.seatunnel.common.utils.SeaTunnelException: java.io.EOFException
at org.apache.seatunnel.engine.server.checkpoint.operation.NotifyTaskRestoreOperation.lambda$run$0(NotifyTaskRestoreOperation.java:100) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.common.utils.RetryUtils.retryWithException(RetryUtils.java:48) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.checkpoint.operation.NotifyTaskRestoreOperation.run(NotifyTaskRestoreOperation.java:85) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationservice.Operation.call(Operation.java:189) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.call(OperationRunnerImpl.java:273) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.run(OperationRunnerImpl.java:248) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.run(OperationRunnerImpl.java:471) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationexecutor.impl.OperationThread.process(OperationThread.java:197) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationexecutor.impl.OperationThread.process(OperationThread.java:137) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationexecutor.impl.OperationThread.executeRun(OperationThread.java:123) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.internal.util.executor.HazelcastManagedThread.run(HazelcastManagedThread.java:102) ~[seatunnel-starter.jar:2.3.1]
Caused by: java.io.EOFException
at java.io.DataInputStream.readFully(DataInputStream.java:197) ~[?:1.8.0_352]
at java.io.DataInputStream.readLong(DataInputStream.java:416) ~[?:1.8.0_352]
at org.apache.seatunnel.connectors.doris.sink.writer.DorisSinkStateSerializer.deserialize(DorisSinkStateSerializer.java:45) ~[?:?]
at org.apache.seatunnel.connectors.doris.sink.writer.DorisSinkStateSerializer.deserialize(DorisSinkStateSerializer.java:29) ~[?:?]
at org.apache.seatunnel.engine.server.task.flow.SinkFlowLifeCycle.lambda$null$2(SinkFlowLifeCycle.java:239) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.common.utils.ExceptionUtil.sneaky(ExceptionUtil.java:138) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.task.flow.SinkFlowLifeCycle.lambda$restoreState$3(SinkFlowLifeCycle.java:235) ~[seatunnel-starter.jar:2.3.1]
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_352]
at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384) ~[?:1.8.0_352]
at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:647) ~[?:1.8.0_352]
at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:272) ~[?:1.8.0_352]
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_352]
at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) ~[?:1.8.0_352]
at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384) ~[?:1.8.0_352]
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) ~[?:1.8.0_352]
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) ~[?:1.8.0_352]
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) ~[?:1.8.0_352]
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:1.8.0_352]
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566) ~[?:1.8.0_352]
at org.apache.seatunnel.engine.server.task.flow.SinkFlowLifeCycle.restoreState(SinkFlowLifeCycle.java:240) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.task.SeaTunnelTask.lambda$restoreState$14(SeaTunnelTask.java:383) ~[seatunnel-starter.jar:2.3.1]
at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183) ~[?:1.8.0_352]
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_352]
at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) ~[?:1.8.0_352]
at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384) ~[?:1.8.0_352]
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) ~[?:1.8.0_352]
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) ~[?:1.8.0_352]
at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150) ~[?:1.8.0_352]
at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:173) ~[?:1.8.0_352]
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:1.8.0_352]
at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:485) ~[?:1.8.0_352]
at org.apache.seatunnel.engine.server.task.SeaTunnelTask.restoreState(SeaTunnelTask.java:380) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.checkpoint.operation.NotifyTaskRestoreOperation.lambda$run$0(NotifyTaskRestoreOperation.java:96) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.common.utils.RetryUtils.retryWithException(RetryUtils.java:48) ~[seatunnel-starter.jar:2.3.1]
at org.apache.seatunnel.engine.server.checkpoint.operation.NotifyTaskRestoreOperation.run(NotifyTaskRestoreOperation.java:85) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationservice.Operation.call(Operation.java:189) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.call(OperationRunnerImpl.java:273) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.run(OperationRunnerImpl.java:248) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.run(OperationRunnerImpl.java:471) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationexecutor.impl.OperationThread.process(OperationThread.java:197) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationexecutor.impl.OperationThread.process(OperationThread.java:137) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.spi.impl.operationexecutor.impl.OperationThread.executeRun(OperationThread.java:123) ~[seatunnel-starter.jar:2.3.1]
at com.hazelcast.internal.util.executor.HazelcastManagedThread.run(HazelcastManagedThread.java:102) ~[seatunnel-starter.jar:2.3.1]
2023-05-29 15:07:43,151 INFO org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator - start clean pending checkpoint cause CheckpointCoordinator inside have error.
2023-05-29 15:07:43,152 WARN org.apache.seatunnel.engine.server.dag.physical.SubPlan - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)] checkpoint have error, cancel the pipeline
2023-05-29 15:07:43,153 INFO org.apache.seatunnel.engine.server.dag.physical.SubPlan - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)] turn from state RUNNING to CANCELING.
2023-05-29 15:07:43,156 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SplitEnumerator (1/1)] turn from state RUNNING to CANCELING.
2023-05-29 15:07:43,157 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SourceTask (2/2)] turn from state RUNNING to CANCELING.
2023-05-29 15:07:43,158 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SourceTask (1/2)] turn from state RUNNING to CANCELING.
2023-05-29 15:07:43,160 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Send cancel Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SourceTask (2/2)] operator to member [bigdata07]:5801
2023-05-29 15:07:43,160 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Send cancel Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SplitEnumerator (1/1)] operator to member [bigdata07]:5801
2023-05-29 15:07:43,160 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Send cancel Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SourceTask (1/2)] operator to member [bigdata07]:5801
2023-05-29 15:07:43,161 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SourceTask (2/2)] turn to end state CANCELED.
2023-05-29 15:07:43,161 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SourceTask (2/2)] end with state CANCELED
2023-05-29 15:07:43,161 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SplitEnumerator (1/1)] turn to end state CANCELED.
2023-05-29 15:07:43,161 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SplitEnumerator (1/1)] end with state CANCELED
2023-05-29 15:07:43,162 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SourceTask (1/2)] turn to end state CANCELED.
2023-05-29 15:07:43,162 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC-default]-SourceTask (1/2)] end with state CANCELED
2023-05-29 15:07:43,193 INFO org.apache.seatunnel.engine.server.master.JobMaster - release the pipeline Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)] resource
2023-05-29 15:07:43,197 INFO org.apache.seatunnel.engine.server.dag.physical.SubPlan - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)] end with state FAILED
2023-05-29 15:07:43,197 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalPlan - cancel job Job cus_basic_applet (715450079284035585) because makeJobEndWhenPipelineEnded is true
2023-05-29 15:07:43,199 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalPlan - Job cus_basic_applet (715450079284035585) turn from state RUNNING to CANCELLING.
2023-05-29 15:07:43,200 WARN org.apache.seatunnel.engine.server.dag.physical.SubPlan - Job cus_basic_applet (715450079284035585), Pipeline: [(1/1)] is in end state FAILED, can not be cancel
2023-05-29 15:07:43,201 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalPlan - Job cus_basic_applet (715450079284035585) turn from state CANCELLING to FAILING.
2023-05-29 15:07:43,202 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalPlan - Job cus_basic_applet (715450079284035585) turn from state FAILING to FAILED.
2023-05-29 15:07:43,224 INFO com.hazelcast.internal.server.tcp.TcpServerConnection - [bigdata05]:5801 [seatunnel_mycluster] [5.1] Connection[id=6, /10.6.1.16:5801->/10.6.1.16:45233, qualifier=null, endpoint=[10.6.1.16]:45233, remoteUuid=9b983f15-396a-4d6e-a9bf-2fb02eb9db82, alive=false, connectionType=JVM, planeIndex=-1] closed. Reason: Connection closed by the other side
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [seatunnel] Carl-Zhou-CN commented on issue #4838: 当我使用zeta引擎时提交第二个cdc任务会停止所有cdc任务
Posted by "Carl-Zhou-CN (via GitHub)" <gi...@apache.org>.
Carl-Zhou-CN commented on issue #4838:
URL: https://github.com/apache/seatunnel/issues/4838#issuecomment-1566707145
Can you try using different Doris Sinks' [sink.label.prefix]
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [seatunnel] Carl-Zhou-CN commented on issue #4838: 当我使用zeta引擎时提交第二个cdc任务会停止所有cdc任务
Posted by "Carl-Zhou-CN (via GitHub)" <gi...@apache.org>.
Carl-Zhou-CN commented on issue #4838:
URL: https://github.com/apache/seatunnel/issues/4838#issuecomment-1566751580
link #4837
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [seatunnel] Carl-Zhou-CN commented on issue #4838: 当我使用zeta引擎时提交第二个cdc任务会停止所有cdc任务
Posted by "Carl-Zhou-CN (via GitHub)" <gi...@apache.org>.
Carl-Zhou-CN commented on issue #4838:
URL: https://github.com/apache/seatunnel/issues/4838#issuecomment-1566747606
Thank you for providing it. I will investigate it
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [seatunnel] zhongjiajie closed issue #4838: 当我使用zeta引擎时提交第二个cdc任务会停止所有cdc任务
Posted by "zhongjiajie (via GitHub)" <gi...@apache.org>.
zhongjiajie closed issue #4838: 当我使用zeta引擎时提交第二个cdc任务会停止所有cdc任务
URL: https://github.com/apache/seatunnel/issues/4838
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org