You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by "sudufly (via GitHub)" <gi...@apache.org> on 2023/05/11 05:38:20 UTC
[GitHub] [incubator-seatunnel] sudufly opened a new issue, #4733: [Bug] [Flink] kafkaConsumer not works when checkpoint is opened
sudufly opened a new issue, #4733:
URL: https://github.com/apache/incubator-seatunnel/issues/4733
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
### What happened
1.kafkaConsumer not works when checkpoint is opened
2.is seatunnel support savepoint or recover from savepoint with flink engine
![Uploading image.png…]()
![Uploading image.png…]()
### SeaTunnel Version
2.3.1
### SeaTunnel Config
```conf
#SEATUNNEL_HOME=D:\code\apache\incubator-seatunnel\plugins
env {
execution.parallelism = 1
job.mode = "STREAMING"
spark.master = local
execution.checkpoint.data-uri = "file:///D:/data/checkpoint/flink"
checkpoint.interval = 1000
execution.checkpoint.interval = 1000
}
source {
Kafka {
topic = "telematics-gps"
format = json
bootstrap.servers = "172.18.1.200:9092"
result_table_name = "gpsView"
}
Kafka {
topic = "telematics-base"
format = json
bootstrap.servers = "172.18.1.200:9092"
result_table_name = "baseView"
schema = {
fields {
hydraulicOilTemperature = "double"
totalServiceMeter=double
test = int
dataTime = String
}
}
}
}
transform{
sql{
query= "select dataTime, hydraulicOilTemperature, test from baseView"
source_table_name="baseView"
result_table_name = "sqlView"
}
}
sink {
Console {
source_table_name="gpsView"
}
Console {
source_table_name="sqlView"
}
Http {
source_table_name="sqlView"
url = "http://127.0.0.1:8888/test"
}
}
```
### Running Command
```shell
xxx
```
### Error Exception
```log
Resetting generation and member id due to: consumer pro-actively leaving the group
Request joining group due to: consumer pro-actively leaving the group
App info kafka.consumer for seatunnel-consumer-1180559240 unregistered
```
### Flink or Spark Version
_No response_
### Java or Scala Version
_No response_
### Screenshots
_No response_
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] sudufly commented on issue #4733: [Bug] [Flink] kafkaConsumer not works when checkpoint is opened
Posted by "sudufly (via GitHub)" <gi...@apache.org>.
sudufly commented on issue #4733:
URL: https://github.com/apache/incubator-seatunnel/issues/4733#issuecomment-1543368318
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] sudufly closed issue #4733: [Bug] [Flink] kafkaConsumer not works when checkpoint is opened
Posted by "sudufly (via GitHub)" <gi...@apache.org>.
sudufly closed issue #4733: [Bug] [Flink] kafkaConsumer not works when checkpoint is opened
URL: https://github.com/apache/incubator-seatunnel/issues/4733
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] sudufly commented on issue #4733: [Bug] [Flink] kafkaConsumer not works when checkpoint is opened
Posted by "sudufly (via GitHub)" <gi...@apache.org>.
sudufly commented on issue #4733:
URL: https://github.com/apache/incubator-seatunnel/issues/4733#issuecomment-1543368126
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org