You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Alexey Romanenko (Jira)" <ji...@apache.org> on 2021/03/09 18:24:00 UTC
[jira] [Assigned] (BEAM-11851) ConfluentSchemaRegistryProvider
fails when authentication is required
[ https://issues.apache.org/jira/browse/BEAM-11851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alexey Romanenko reassigned BEAM-11851:
---------------------------------------
Assignee: Alexey Romanenko
> ConfluentSchemaRegistryProvider fails when authentication is required
> ---------------------------------------------------------------------
>
> Key: BEAM-11851
> URL: https://issues.apache.org/jira/browse/BEAM-11851
> Project: Beam
> Issue Type: Bug
> Components: io-java-kafka
> Affects Versions: 2.27.0
> Reporter: Maxim Ivanov
> Assignee: Alexey Romanenko
> Priority: P2
>
> When configuring KafkaIO.reader with ConfluentSchemaRegistryProvider as value deserializer with `basic.auth.credentials.source=AUTH_INO` and `basic.auth.user.info=user:password` properties, it fails to start the pipepline
> {code:java}
> [error] java.lang.RuntimeException: Unable to get latest schema metadata for subject: identity_users_v2-value
> [error] at org.apache.beam.sdk.io.kafka.ConfluentSchemaRegistryDeserializerProvider.getSchemaMetadata(ConfluentSchemaRegistryDeserializerProvider.java:119)
> [error] at org.apache.beam.sdk.io.kafka.ConfluentSchemaRegistryDeserializerProvider.getAvroSchema(ConfluentSchemaRegistryDeserializerProvider.java:110)
> [error] at org.apache.beam.sdk.io.kafka.ConfluentSchemaRegistryDeserializerProvider.getCoder(ConfluentSchemaRegistryDeserializerProvider.java:106)
> [error] at org.apache.beam.sdk.io.kafka.KafkaIO$Read.getValueCoder(KafkaIO.java:1147)
> [error] at org.apache.beam.sdk.io.kafka.KafkaIO$Read.expand(KafkaIO.java:1052)
> [error] at org.apache.beam.sdk.io.kafka.KafkaIO$Read.expand(KafkaIO.java:481)
> [error] at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:547)
> [error] at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:498)
> [error] at org.apache.beam.sdk.values.PBegin.apply(PBegin.java:56)
> [error] at org.apache.beam.sdk.Pipeline.apply(Pipeline.java:191) {code}
>
> I suspect that it because it reconfigured KafkaAvroDeserializer only in getDeserializer, but doesn't do so in getCoder.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)