You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@kafka.apache.org by 张治文 <18...@163.com> on 2022/12/13 11:23:38 UTC

About a little white question

Hello!

Recently, I have an error in the process of using logstash to consume kafka and send it to bigquery
```
[2022-12-13T17:06:33,453][ERROR][org.apache.kafka.clients.consumer.internals.ConsumerCoordinator][main][1f6dc206229592c94cf83964f9811eb491c35bc7029e9096c5e53f3d890cc9be] [Consumer clientId=logstash-bigquery-1-1, groupId=logstash_kafka] Offset commit failed on partition t8891Maxwell-1 at offset 287782251: The coordinator is not aware of this member.
[2022-12-13T17:06:33,468][ERROR][org.apache.kafka.clients.consumer.internals.ConsumerCoordinator][main][1f6dc206229592c94cf83964f9811eb491c35bc7029e9096c5e53f3d890cc9be] [Consumer clientId=logstash-bigquery-1-0, groupId=logstash_kafka] Offset commit failed on partition t8891Maxwell-0 at offset 348040251: The coordinator is not aware of this member.
[2022-12-13T17:06:33,504][ERROR][org.apache.kafka.clients.consumer.internals.ConsumerCoordinator][main][1f6dc206229592c94cf83964f9811eb491c35bc7029e9096c5e53f3d890cc9be] [Consumer clientId=logstash-bigquery-1-2, groupId=logstash_kafka] Offset commit failed on partition t8891Maxwell-2 at offset 388240573: The coordinator is not aware of this member.
[2022-12-13T17:06:33,611][ERROR][logstash.outputs.googlebigquery][main][72c588fb8630f5bb82aa0a103e0dc346fe6a973fe474640ab339fad5fa6a5dcc] Error uploading data. {:exception=>com.google.cloud.bigquery.BigQueryException: Error writing request body to server}
```
kafka_2.12-3.3.1,I have 3 partitions and I am sure there is only one consumer group, do you know how to solve it？