[jira] [Commented] (NIFI-7477) Get the details in ValidateRecord as an attribute

["Matt Burgess (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/NIFI-7477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17114146#comment-17114146 ] 

Matt Burgess commented on NIFI-7477:
------------------------------------

The record-based processors (including ValidateRecord) are capable of handling many thousands or millions of records in a single flow file. Would the attribute contain only the first validation error, the first N errors up to a certain size, or something else? We don't want to allow putting every single error in an attribute as this could cause NiFi to run out of memory quickly.

> Get the details in ValidateRecord as an attribute
> -------------------------------------------------
>
>                 Key: NIFI-7477
>                 URL: https://issues.apache.org/jira/browse/NIFI-7477
>             Project: Apache NiFi
>          Issue Type: Improvement
>          Components: Extensions
>    Affects Versions: 1.11.4
>            Reporter: Jairo Henao
>            Priority: Minor
>              Labels: features
>
> When validation fails in ValidateRecord, the details are not easy to access. Details are sent as an event to Provenance. To obtain them, we should invoke the NIFI REST-API or export them via the Site-to-Site Reporting Task.
> The ValidateRecord processor should optionally allow us to configure an attribute to leave the details text here.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)