[jira] [Created] (NIFI-5351) FetchParquet Conversion Error

["Joe Trite (JIRA)" <ji...@apache.org>]

Joe Trite created NIFI-5351:
-------------------------------

             Summary: FetchParquet Conversion Error
                 Key: NIFI-5351
                 URL: https://issues.apache.org/jira/browse/NIFI-5351
             Project: Apache NiFi
          Issue Type: Bug
          Components: Extensions
    Affects Versions: 1.6.0
         Environment: RHEL 7.5, Java 1.8.0_161
            Reporter: Joe Trite


FetchParquet is throwing an error when the schema contains a decimal.

Here is the data type of the field throwing the error:  
optional fixed_len_byte_array(16) amt (DECIMAL(38,10));
 
Here is the error:
2018-06-28 22:56:57,030 ERROR [Timer-Driven Process Thread-3] o.a.nifi.processors.parquet.FetchParquet FetchParquet[id=9280c518-6a92-363f-893a-5a03feb45ebc] Failed to retrieve content from /data/000157_0 for StandardFlowFileRecord[uuid=112b6e45-011a-44ac-b258-97f52a505597,claim=,offset=0,name=000157_0,size=0] due to org.apache.nifi.serialization.record.util.IllegalTypeConversionException: Cannot convert value [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 90, -13, 16, 122, 64, 0] of type class org.apache.avro.generic.GenericData$Fixed because no compatible types exist in the UNION for field amt; routing to failure: org.apache.nifi.serialization.record.util.IllegalTypeConversionException: Cannot convert value [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 90, -13, 16, 122, 64, 0] of type class org.apache.avro.generic.GenericData$Fixed because no compatible types exist in the UNION for field amt
org.apache.nifi.serialization.record.util.IllegalTypeConversionException: Cannot convert value [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 90, -13, 16, 122, 64, 0] of type class org.apache.avro.generic.GenericData$Fixed because no compatible types exist in the UNION for field amt
        at org.apache.nifi.avro.AvroTypeUtil.convertUnionFieldValue(AvroTypeUtil.java:759)
        at org.apache.nifi.avro.AvroTypeUtil.normalizeValue(AvroTypeUtil.java:844)
        at org.apache.nifi.avro.AvroTypeUtil.convertAvroRecordToMap(AvroTypeUtil.java:710)
        at org.apache.nifi.processors.parquet.record.AvroParquetHDFSRecordReader.nextRecord(AvroParquetHDFSRecordReader.java:62)
        at org.apache.nifi.processors.hadoop.AbstractFetchHDFSRecord.lambda$null$0(AbstractFetchHDFSRecord.java:197)
        at org.apache.nifi.controller.repository.StandardProcessSession.write(StandardProcessSession.java:2621)
        at org.apache.nifi.processors.hadoop.AbstractFetchHDFSRecord.lambda$onTrigger$1(AbstractFetchHDFSRecord.java:193)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:360)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1678)
        at org.apache.nifi.processors.hadoop.AbstractFetchHDFSRecord.onTrigger(AbstractFetchHDFSRecord.java:177)
        at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
        at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1147)
        at org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:175)
        at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:117)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)