You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "David Sargrad (JIRA)" <ji...@apache.org> on 2019/04/24 14:11:00 UTC
[jira] [Commented] (NIFI-6216) NIFI ConvertRecord Processor throws
exception
[ https://issues.apache.org/jira/browse/NIFI-6216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16825189#comment-16825189 ]
David Sargrad commented on NIFI-6216:
-------------------------------------
I've further isolated the problem. I've reduced the size of the input data set as follows. In the following image you see 4 flow file generators, the original, and then 3 others named: AAL2195 GOOD, N214CS GOOD, N214CS and AAL2195 BAD. The ConvertRecord processor works with either of the XML contained within AAL2195 GOOD, or N214CS Good flow files separately. However there are some subtle differences between those records such that the ConvertRecord fails when they come together. I've attached a template to allow this to be reproduced [^ConvertRecord_Problem_Further_Isolated.xml]
!image-2019-04-24-10-06-28-020.png!
> NIFI ConvertRecord Processor throws exception
> ---------------------------------------------
>
> Key: NIFI-6216
> URL: https://issues.apache.org/jira/browse/NIFI-6216
> Project: Apache NiFi
> Issue Type: Bug
> Components: Core Framework
> Affects Versions: 1.9.2
> Reporter: David Sargrad
> Priority: Major
> Attachments: ConvertRecord_Failure_Recreation.xml, ConvertRecord_Problem_Further_Isolated.xml, image-2019-04-15-14-29-39-872.png, image-2019-04-24-10-06-28-020.png
>
>
> ConvertRecord is throwing an exception on some of my data. I am using ConvertRecord in a schema inference mode.
>
> It doesnt always fail, for much of the data that i pass into the flow it infers and processes the data properly. However some of the data causes this failure.
>
> I am using an XMLReader and a JSONRecordSetWriter.
>
> The exception is seen in the log as follows
> {code:java}
> 2019-04-12 09:49:26,810 ERROR [Timer-Driven Process Thread-6] o.a.n.processors.standard.ConvertRecord ConvertRecord[id=016a1079-25cf-16fd-fbfa-785d65603736] Failed to write MapRecord[{dpTransitionFix=MTU, star=MapRecord[{routeType=STAR, routeName=VKTRY2}], departureFixAndTime=MapRecord[{fixName=MTU, arrTime=2019-04-12T14:06:55Z}], starTransitionFix=MDANO, rvsmData=MapRecord[{futureCompliance=true, equipped=true, currentCompliance=true}], routeOfFlight=KSLC.RUGGD1.MTU..HBU..PNH..MDANO.VKTRY2.KDFW/1551, dp=MapRecord[{routeType=DIRECT, routeName=RUGGD1}], diversionIndicator=NO_DIVERSION, eta=MapRecord[{etaType=ESTIMATED, timeValue=2019-04-12T15:50:43Z}], etd=MapRecord[{timeValue=2019-04-12T13:47:00Z, etdType=ESTIMATED}], nextPosition=MapRecord[{longitudeDecimal=-111.9777733, latitudeDecimal=40.7883933}], flightTraversalData2=MapRecord[{waypoint=[Ljava.lang.Object;@6aca8e9d, fix=[Ljava.lang.Object;@35df6693, airway=[Ljava.lang.Object;@4300900c, center=[Ljava.lang.Object;@550b388b, sector=[Ljava.lang.Object;@6b0bfad1}], arrivalFixAndTime=MapRecord[{fixName=VKTRY, arrTime=2019-04-12T15:40:09Z}]}] with schema [] as a JSON Object due to java.lang.ClassCastException: java.lang.ClassCastExceptionjava.lang.ClassCastException: null 2019-04-12 09:49:26,810 ERROR [Timer-Driven Process Thread-6] o.a.n.processors.standard.ConvertRecord ConvertRecord[id=016a1079-25cf-16fd-fbfa-785d65603736] Failed to write MapRecord[{dpTransitionFix=MTU, star=MapRecord[{routeType=STAR, routeName=VKTRY2}], departureFixAndTime=MapRecord[{fixName=MTU, arrTime=2019-04-12T14:06:55Z}], starTransitionFix=MDANO, rvsmData=MapRecord[{futureCompliance=true, equipped=true, currentCompliance=true}], routeOfFlight=KSLC.RUGGD1.MTU..HBU..PNH..MDANO.VKTRY2.KDFW/1551, dp=MapRecord[{routeType=DIRECT, routeName=RUGGD1}], diversionIndicator=NO_DIVERSION, eta=MapRecord[{etaType=ESTIMATED, timeValue=2019-04-12T15:50:43Z}], etd=MapRecord[{timeValue=2019-04-12T13:47:00Z, etdType=ESTIMATED}], nextPosition=MapRecord[{longitudeDecimal=-111.9777733, latitudeDecimal=40.7883933}], flightTraversalData2=MapRecord[{waypoint=[Ljava.lang.Object;@6aca8e9d, fix=[Ljava.lang.Object;@35df6693, airway=[Ljava.lang.Object;@4300900c, center=[Ljava.lang.Object;@550b388b, sector=[Ljava.lang.Object;@6b0bfad1}], arrivalFixAndTime=MapRecord[{fixName=VKTRY, arrTime=2019-04-12T15:40:09Z}]}] with schema [] as a JSON Object due to java.lang.ClassCastException: java.lang.ClassCastExceptionjava.lang.ClassCastException: null
> {code}
>
> I've created a simple template to allow recreation of the problem. See attached.
> !image-2019-04-15-14-29-39-872.png![^ConvertRecord_Failure_Recreation.xml]
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)