You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@nifi.apache.org by ma...@apache.org on 2021/04/19 16:57:05 UTC

[nifi] branch main updated (77c3532 -> a509571)

This is an automated email from the ASF dual-hosted git repository.

markap14 pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/nifi.git.


    from 77c3532  NIFI-8421 This closes #4996. increase commit frequency to ensure we commit often during these tests to minimize race conditions
     add a509571  NIFI-8365 Fix JSON AbstractJsonRowRecordReader to handle deep CHOICE-typed records properly: change the logic that selects the first  compatible schema which can have missing fields compared to the real value and search for a more strict match first and fallback to the existing logic only if not one found. - AbstractJsonRowRecordReader - Handle (meaning log a warning and not fail completely) multi-array CHOICE type when data has extra fields (not defined by the schema) a [...]

No new revisions were added by this update.

Summary of changes:
 .../serialization/record/util/DataTypeUtils.java   |  27 +-
 .../java/org/apache/nifi/util/EqualsWrapper.java   | 162 ++++++++
 .../java/org/apache/nifi/avro/AvroTypeUtil.java    |   4 +
 .../org/apache/nifi/avro/TestAvroTypeUtil.java     | 103 +++++
 .../nifi-record-serialization-services/pom.xml     |   5 +
 .../nifi/json/AbstractJsonRowRecordReader.java     |  44 ++-
 .../nifi/json/TestJsonTreeRowRecordReader.java     | 431 +++++++++++++++++++--
 .../schema/inference/TestFieldTypeInference.java   |  29 ++
 ...oice-of-different-arrays-with-extra-fields.json |  28 ++
 ...oice-of-embedded-arrays-and-single-records.json |  35 ++
 .../json/choice-of-embedded-similar-records.json   |  16 +
 ...-merged-embedded-arrays-and-single-records.json |  40 ++
 .../src/test/resources/json/similar-records.json   |  14 +
 13 files changed, 905 insertions(+), 33 deletions(-)
 create mode 100644 nifi-mock/src/main/java/org/apache/nifi/util/EqualsWrapper.java
 create mode 100644 nifi-nar-bundles/nifi-standard-services/nifi-record-serialization-services-bundle/nifi-record-serialization-services/src/test/resources/json/choice-of-different-arrays-with-extra-fields.json
 create mode 100644 nifi-nar-bundles/nifi-standard-services/nifi-record-serialization-services-bundle/nifi-record-serialization-services/src/test/resources/json/choice-of-embedded-arrays-and-single-records.json
 create mode 100644 nifi-nar-bundles/nifi-standard-services/nifi-record-serialization-services-bundle/nifi-record-serialization-services/src/test/resources/json/choice-of-embedded-similar-records.json
 create mode 100644 nifi-nar-bundles/nifi-standard-services/nifi-record-serialization-services-bundle/nifi-record-serialization-services/src/test/resources/json/choice-of-merged-embedded-arrays-and-single-records.json
 create mode 100644 nifi-nar-bundles/nifi-standard-services/nifi-record-serialization-services-bundle/nifi-record-serialization-services/src/test/resources/json/similar-records.json