You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Matt Burgess (JIRA)" <ji...@apache.org> on 2018/08/06 15:50:00 UTC

[jira] [Created] (NIFI-5491) PutHive3Streaming incorrectly handles bytes, shorts, and nested structs

Matt Burgess created NIFI-5491:
----------------------------------

             Summary: PutHive3Streaming incorrectly handles bytes, shorts, and nested structs
                 Key: NIFI-5491
                 URL: https://issues.apache.org/jira/browse/NIFI-5491
             Project: Apache NiFi
          Issue Type: Bug
          Components: Extensions
            Reporter: Matt Burgess


When trying to insert a record into a Hive table using PutHive3Streaming, if the table contains columns of types byte, short, or struct, then an error occurs and the records cannot be written.

This is due to a mismatch between the data types used in the NiFi Record API and the Hive ORC writer and StructObjectInspector. For byte and short, NiFi currently maintains an Integer value but Hive expects a Byte or Short, respectively. For structs, NiFi maintains a Map value but Hive expects a List or array.

NiFiRecordSerDe should handle the conversion of values for use by Hive Streaming.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)