You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Logeshwaran (Jira)" <ji...@apache.org> on 2021/09/14 12:08:00 UTC

[jira] [Created] (BEAM-12880) KafkaIO Connector-updating/overwriting consumer groupid with random prefix

Logeshwaran created BEAM-12880:
----------------------------------

             Summary: KafkaIO Connector-updating/overwriting consumer groupid with random prefix
                 Key: BEAM-12880
                 URL: https://issues.apache.org/jira/browse/BEAM-12880
             Project: Beam
          Issue Type: Bug
          Components: io-java-kafka, runner-dataflow
    Affects Versions: 2.27.0
            Reporter: Logeshwaran


Apache beam version: 2.27

Connector: KafkaIO

cloud service : GCP Dataflow

language : JAVA11

we are trying to read the avro messages from confluent kafka topic using dataflow service as a consumer. (Using KafkaIO Connector)

While trying to access the schema registry using provided (schema url, subject, version, ssl configuration(keystore,truststore..etc))  details , we are getting the below error.

 
{color:#ef6950}Error message from worker: org.apache.kafka.common.errors.GroupAuthorizationException:{color}
 {color:#ef6950}Not authorized to access group: initialOffset_offset_consumer_1179967555_kafka-connectivity-test{color}
 
Expected Result : Consumer groupid should not change also should able to connect kafka consumer.
 
Actual Result: 
Though the provided groupid was : kafka-connectivity-test, some how it is changing the value to  initialOffset_offset_consumer_1179967555_kafka-connectivity-test.
 
PFA related code snippets. 
 
!image-2021-09-14-17-34-21-672.png!
 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)