You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@nifi.apache.org by "Tony Kurc (JIRA)" <ji...@apache.org> on 2015/10/19 02:40:05 UTC

[jira] [Commented] (NIFI-945) New property (wrap as array) in avro2json converter

    [ https://issues.apache.org/jira/browse/NIFI-945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962714#comment-14962714 ] 

Tony Kurc commented on NIFI-945:
--------------------------------

reviewing pull request

> New property (wrap as array) in avro2json converter
> ---------------------------------------------------
>
>                 Key: NIFI-945
>                 URL: https://issues.apache.org/jira/browse/NIFI-945
>             Project: Apache NiFi
>          Issue Type: Improvement
>          Components: Core Framework
>            Reporter: Joe Mészáros
>            Assignee: Tony Kurc
>            Priority: Minor
>              Labels: avro, improvement, json
>
> Create a new property (wrap as array) in ConvertAvroToJson, which determines how stream of records is exposed: either as a sequence of single Objects (false), writing every Object to a new line, or as an array of Objects. Default value is true, meaning that the Avro content is exposed as a sequence of root-level Object entries. False value is useful, when you want to write your records as single instances to a target component (e.g. Kafka).
> Let's assume you have an Avro content as stream of events: {noformat}({"id":"user1", "item":"itemX", "action": "buy"}, {"id":"user2", "item":"itemY", "action": "like"}){noformat}
> If wrap as array is false, the converter will expose the records as sequence of single JSON objects:
> {noformat}
> {"id":"user1", "item":"itemX", "action": "buy"}
> {"id":"user2", "item":"itemY", "action": "like"}
> ...
> {"id":"userN", ...}
> {noformat}
> Please bear in mind, that the final output is not a valid JSON content. You can then forward this content e.g. to Kafka, where every record will be a single Kafka message.
> If wrap as array is true, the output looks like this:
> {noformat}
> [{"id":"user1", "item":"itemX", "action": "buy"},{"id":"user2", "item":"itemY", "action": "like"},...,{"id":"userN", ...}]
> {noformat}
> It is useful when you want to convert your Avro content to a valid JSON array.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)