You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by "ocean-zhc (via GitHub)" <gi...@apache.org> on 2023/07/02 07:17:28 UTC
[GitHub] [seatunnel] ocean-zhc opened a new issue, #5006: [Bug] [kafka source] 无法设置max.poll.records参数
ocean-zhc opened a new issue, #5006:
URL: https://github.com/apache/seatunnel/issues/5006
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
### What happened
source kafka kafka.config 设置 `max.poll.records` 参数,取消则正常!
### SeaTunnel Version
2.3.2
2.3.2-SNAPSHOT
### SeaTunnel Config
```conf
env {
execution.parallelism = 1
job.mode = "STREAMING"
execution.planner = blink
job.name = "kafka_console_test"
execution.checkpoint.interval = 60000
}
source {
Kafka {
result_table_name = "kafka_table"
schema = {
fields {
name = "string"
age = "int"
}
}
topic = "topic1"
bootstrap.servers = "local:19092"
kafka.config = {
client.id = client_1
max.poll.records = 10000
auto.offset.reset = "earliest"
enable.auto.commit = "false"
}
}
}
transform {
}
sink {
Hive {
table_name = "default.user1"
metastore_uri = "thrift://centos4:9083"
}
}
```
### Running Command
```shell
./bin/start-seatunnel-flink-15-connector-v2.sh --config ./config/kafka2hive.conf
```
### Error Exception
```log

```
### Flink or Spark Version
_No response_
### Java or Scala Version
_No response_
### Screenshots

### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [seatunnel] liugddx commented on issue #5006: [Bug] [kafka source] 无法设置max.poll.records参数
Posted by "liugddx (via GitHub)" <gi...@apache.org>.
liugddx commented on issue #5006:
URL: https://github.com/apache/seatunnel/issues/5006#issuecomment-1618836124
I tried it and found no problem, can you try it with `jdk1.8.351` or later.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [seatunnel] ocean-zhc commented on issue #5006: [Bug] [kafka source] 无法设置max.poll.records参数
Posted by "ocean-zhc (via GitHub)" <gi...@apache.org>.
ocean-zhc commented on issue #5006:
URL: https://github.com/apache/seatunnel/issues/5006#issuecomment-1622848776
tks!I'm OK!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [seatunnel] ocean-zhc commented on issue #5006: [Bug] [kafka source] 无法设置max.poll.records参数
Posted by "ocean-zhc (via GitHub)" <gi...@apache.org>.
ocean-zhc commented on issue #5006:
URL: https://github.com/apache/seatunnel/issues/5006#issuecomment-1623308900
> jdk1.8.351
<img width="1183" alt="企业微信截图_d0f14283-94d8-4022-84dc-b353a1aa0cba" src="https://github.com/apache/seatunnel/assets/46189785/4e387cab-1851-405f-8b82-64b006329350">
<img width="1267" alt="image" src="https://github.com/apache/seatunnel/assets/46189785/21901a63-b394-4bc1-bb73-0ea0240e32f0">
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [kafka source] 无法设置max.poll.records参数 [seatunnel]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #5006:
URL: https://github.com/apache/seatunnel/issues/5006#issuecomment-1765466041
This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [kafka source] 无法设置max.poll.records参数 [seatunnel]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #5006:
URL: https://github.com/apache/seatunnel/issues/5006#issuecomment-3071526966
This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [seatunnel] ocean-zhc commented on issue #5006: [Bug] [kafka source] 无法设置max.poll.records参数
Posted by "ocean-zhc (via GitHub)" <gi...@apache.org>.
ocean-zhc commented on issue #5006:
URL: https://github.com/apache/seatunnel/issues/5006#issuecomment-1632196494
max.poll.records = "10000" can solved!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [kafka source] 无法设置max.poll.records参数 [seatunnel]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #5006: [Bug] [kafka source] 无法设置max.poll.records参数
URL: https://github.com/apache/seatunnel/issues/5006
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org