You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@nifi.apache.org by "Alan Jackoway (JIRA)" <ji...@apache.org> on 2015/07/07 23:24:04 UTC

[jira] [Created] (NIFI-751) Add Processor To Convert Avro Formats

Alan Jackoway created NIFI-751:
----------------------------------

             Summary: Add Processor To Convert Avro Formats
                 Key: NIFI-751
                 URL: https://issues.apache.org/jira/browse/NIFI-751
             Project: Apache NiFi
          Issue Type: Improvement
          Components: Extensions
    Affects Versions: 0.1.0
            Reporter: Alan Jackoway


When working with data from external sources, such as complex WSDL, I frequently wind up with complex nested data that is difficult to work with even when converted to Avro format. Specifically, I often have two needs:

* Converting types of data, usually from string to long, double, etc. when APIs give only string data back.
* Flattening data by taking fields out of nested records and putting them on the top level of the Avro file.

Unfortunately the Kite JSONToAvro processor only supports exact conversions from JSON to a matching Avro schema and will not do data transformations of this type. Proposed processor to come.

Discussed this with [~rdblue], so tagging him here as I don't have permission to set a CC for some reason.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)