You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@nifi.apache.org by "Daniel Stieglitz (Jira)" <ji...@apache.org> on 2022/10/07 20:59:00 UTC

[jira] [Comment Edited] (NIFI-10428) Allow for loading Avro record schema from files

    [ https://issues.apache.org/jira/browse/NIFI-10428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17614255#comment-17614255 ] 

Daniel Stieglitz edited comment on NIFI-10428 at 10/7/22 8:58 PM:
------------------------------------------------------------------

[~john.wise] [~mike.thomsen] I am almost done developing my first cut at this. I am not using dynamic properties. I am just using a directory where I can scan for schemas, validate them and load them into a ConcurrentHashMap. The drawback I am realizing now is that there is no way to know what is in the registry unless I log at intervals. Is that a major drawback? If it is, do either you have any suggestions how I can improve on that?


was (Author: JIRAUSER294662):
[~john.wise] [~mike.thomsen] I am almost done developing my first cut at this. I am not using dynamic properties. I am just using a directory where I can scan for schemas, validate them and load them into a ConcurrentHashMap. The drawback I am realizing now is that there is no way to know what is in the registry unless I log at intervals. Is that a major drawback? If it is do either you have any suggestions how I can improve on that?

> Allow for loading Avro record schema from files
> -----------------------------------------------
>
>                 Key: NIFI-10428
>                 URL: https://issues.apache.org/jira/browse/NIFI-10428
>             Project: Apache NiFi
>          Issue Type: New Feature
>          Components: Core Framework
>    Affects Versions: 1.18.0
>            Reporter: Daniel Stieglitz
>            Assignee: Daniel Stieglitz
>            Priority: Major
>              Labels: Record, avro, registry, schema
>
> The various record reader and writer controllers XML, CSV, JSON and AVRO, etc can load schemas from a registry service.  The AvroSchemaRegistry can only load its schema from a text property.  It would be useful to have a file based Avro schema registry, with a configurable refresh interval to allow for adding, removing or updates to schema files.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)