You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by "Xuzhengz (via GitHub)" <gi...@apache.org> on 2023/09/26 05:58:56 UTC
[GitHub] [seatunnel] Xuzhengz opened a new issue, #5558: [Bug] [zeta engine] Cancel the task, but the task remains in a CANCELLING state
Xuzhengz opened a new issue, #5558:
URL: https://github.com/apache/seatunnel/issues/5558
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
### What happened
根据connector-socket新建的udp连接器，取消任务，但是此任务一直处理CANCELLING状态，如何使该任务正常关闭？
### SeaTunnel Version
2.3.3
### SeaTunnel Config
```conf
{
"env": {
"execution.parallelism": "2",
"job.mode": "STREAMING",
"checkpoint.interval": "5000"
},
"preHandler": [],
"source": [
{
"plugin_name": "UDP",
"port": "8879",
"fields": {
"id": "0-4",
"name": "4-8"
},
"result_table_name": "ot_fe2386adf0b6457291b38607b8d5880f"
}
],
"transform": [],
"sink": [
{
"source_table_name": "ot_fe2386adf0b6457291b38607b8d5880f",
"plugin_name": "console"
}
]
}
```
### Running Command
```shell
bin/seatunnel.sh -c demo.json
```
### Error Exception
```log
2023-09-26 13:41:17,948 WARN org.apache.seatunnel.engine.server.dag.physical.SubPlan - Job udp-console.json (758925063209615361), Pipeline: [(1/1)] checkpoint have error, cancel the pipeline
2023-09-26 13:41:17,957 WARN org.apache.seatunnel.engine.server.dag.physical.SubPlan - Job udp-console.json (758925063209615361), Pipeline: [(1/1)] checkpoint have error, cancel the pipeline
2023-09-26 13:41:17,981 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job udp-console.json (758925063209615361), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-UDP-ot_fe2386adf0b6457291b38607b8d5880f]-SourceTask (1/1)] state from CREATED to CANCELED
2023-09-26 13:41:17,980 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job udp-console.json (758925063209615361), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-UDP-ot_fe2386adf0b6457291b38607b8d5880f]-SplitEnumerator (1/1)] state from CREATED to CANCELED
2023-09-26 13:41:17,985 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job udp-console.json (758925063209615361), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-UDP-ot_fe2386adf0b6457291b38607b8d5880f]-SourceTask (1/1)] state from SCHEDULED to CANCELED
2023-09-26 13:41:17,985 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job udp-console.json (758925063209615361), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-UDP-ot_fe2386adf0b6457291b38607b8d5880f]-SplitEnumerator (1/1)] state from SCHEDULED to CANCELED
2023-09-26 13:41:17,985 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job udp-console.json (758925063209615361), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-UDP-ot_fe2386adf0b6457291b38607b8d5880f]-SourceTask (1/1)] state from DEPLOYING to CANCELED
2023-09-26 13:41:17,985 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job udp-console.json (758925063209615361), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-UDP-ot_fe2386adf0b6457291b38607b8d5880f]-SplitEnumerator (1/1)] state from DEPLOYING to CANCELED
2023-09-26 13:41:17,985 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job udp-console.json (758925063209615361), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-UDP-ot_fe2386adf0b6457291b38607b8d5880f]-SourceTask (1/1)] state from RUNNING to CANCELING
2023-09-26 13:41:17,985 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job udp-console.json (758925063209615361), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-UDP-ot_fe2386adf0b6457291b38607b8d5880f]-SplitEnumerator (1/1)] state from RUNNING to CANCELING
2023-09-26 13:41:17,984 WARN org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - The task Job udp-console.json (758925063209615361), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-UDP-ot_fe2386adf0b6457291b38607b8d5880f]-SourceTask (1/1)] state in Imap is RUNNING, not equals expected state CREATED
2023-09-26 13:41:17,985 WARN org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - The task Job udp-console.json (758925063209615361), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-UDP-ot_fe2386adf0b6457291b38607b8d5880f]-SplitEnumerator (1/1)] state in Imap is RUNNING, not equals expected state CREATED
2023-09-26 13:41:17,985 WARN org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - The task Job udp-console.json (758925063209615361), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-UDP-ot_fe2386adf0b6457291b38607b8d5880f]-SourceTask (1/1)] state in Imap is RUNNING, not equals expected state SCHEDULED
2023-09-26 13:41:17,985 WARN org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - The task Job udp-console.json (758925063209615361), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-UDP-ot_fe2386adf0b6457291b38607b8d5880f]-SplitEnumerator (1/1)] state in Imap is RUNNING, not equals expected state SCHEDULED
2023-09-26 13:41:17,985 WARN org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - The task Job udp-console.json (758925063209615361), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-UDP-ot_fe2386adf0b6457291b38607b8d5880f]-SourceTask (1/1)] state in Imap is RUNNING, not equals expected state DEPLOYING
2023-09-26 13:41:17,985 WARN org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - The task Job udp-console.json (758925063209615361), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-UDP-ot_fe2386adf0b6457291b38607b8d5880f]-SplitEnumerator (1/1)] state in Imap is RUNNING, not equals expected state DEPLOYING
2023-09-26 13:41:18,009 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job udp-console.json (758925063209615361), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-UDP-ot_fe2386adf0b6457291b38607b8d5880f]-SplitEnumerator (1/1)] turn from state RUNNING to CANCELING.
2023-09-26 13:41:18,011 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job udp-console.json (758925063209615361), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-UDP-ot_fe2386adf0b6457291b38607b8d5880f]-SourceTask (1/1)] turn from state RUNNING to CANCELING.
```
### Zeta or Flink or Spark Version
_No response_
### Java or Scala Version
1.8
### Screenshots
<img width="1442" alt="image" src="https://github.com/apache/seatunnel/assets/90698333/851a5e10-394a-4114-b5fe-f53246f7a95e">
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [seatunnel] Xuzhengz commented on issue #5558: [Bug] [zeta engine] Cancel the task, but the task remains in a CANCELLING state
Posted by "Xuzhengz (via GitHub)" <gi...@apache.org>.
Xuzhengz commented on issue #5558:
URL: https://github.com/apache/seatunnel/issues/5558#issuecomment-1736536158
The reason has been found, as udp's reception is a blocking method, source cannot receive the end
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [seatunnel] Xuzhengz closed issue #5558: [Bug] [zeta engine] Cancel the task, but the task remains in a CANCELLING state
Posted by "Xuzhengz (via GitHub)" <gi...@apache.org>.
Xuzhengz closed issue #5558: [Bug] [zeta engine] Cancel the task, but the task remains in a CANCELLING state
URL: https://github.com/apache/seatunnel/issues/5558
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org