[jira] [Comment Edited] (NIFI-8785) AvroReader controller can't get confluent schema IDs except only the latest

["Arsen Tavitov (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/NIFI-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17382070#comment-17382070 ] 

Arsen Tavitov edited comment on NIFI-8785 at 7/16/21, 1:23 PM:
---------------------------------------------------------------

[~pvillard] I have attached flow definition .json file.

The idea was to use ConsumeKafka ---> UpdateRecord flow so we can add some additional records to flow file in UpdateRecord Processor.

For demo purpose we decided to go with ConsumeKafka_2_6 ---> ConvertRecord flow. But you are right, ConsumeKafkaRecord is even more simpler. We have tested this processor too and got the same error.

Unfortunately, I am unable for some reason to attach screenshot with this error to the issue, but both ConvertRecord and  ConsumeKafkaRecord processors return the same "could not get Schema with id: <schema id>" error.


was (Author: atavitov):
[~pvillard] I have attached flow definition .json file.

The idea was to use ConsumeKafka ---> UpdateRecord flow so we can add some additional records to flow file in UpdateRecord Processor.

For demo purpose we decided to go with ConsumeKafka_2_6 ---> ConvertRecord flow. But you are right, ConsumeKafkaRecord is even more simple. We have tested this processor too and got the same error.

Unfortunately, I am unable for some reason to attach screenshot with this error to the issue, but both ConvertRecord and  ConsumeKafkaRecord processors return the same "could not get Schema with id: <schema id>" error.

> AvroReader controller can't get confluent schema IDs except only the latest
> ---------------------------------------------------------------------------
>
>                 Key: NIFI-8785
>                 URL: https://issues.apache.org/jira/browse/NIFI-8785
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Extensions
>    Affects Versions: 1.12.1
>         Environment: CentOS7
>            Reporter: Arsen Tavitov
>            Priority: Major
>         Attachments: Kafka_Confluent_Schema_Suffering.json, nifi-app.rar
>
>
> While trying to read Confluent Schema Registry Avro files(from Kafka) with different schema IDs with AvroReader controller error "could not get Schema with id: <schema id>" appears.
> NiFi version: 1.12.1
>  Confluent Schema Registry version: 5.5.2
> Using the following test flow in Nifi
> ConsumeKafka_2_6 1.12.1 ---> ConvertRecord 1.12.1
> In ConvertRecord processor we are using AvroReader controller as record reader.
>  AvroReader controller properties:
>  * schema access strategy: confluent content-encoded schema reference
>  * schema registry: Confluent Schema Registry controller 
>  * schema name: ${schema.name} (default value)
>  * schema version: no value set
>  * schema branch: no value set
>  * schema text: ${schema.text} (default value)
>  * cash size: 1000 (default value)
> Similar issue:
> [https://community.cloudera.com/t5/Support-Questions/Nifi-ConsumeKafakRecord-0-11-Throws-Error-quot-Could-not/td-p/185636] 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)