[jira] [Commented] (NIFI-8437) RecordReader 'Infer Schema' for large records may throw BufferedInputStream error

["Matthew Lannan (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/NIFI-8437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17324014#comment-17324014 ] 

Matthew Lannan commented on NIFI-8437:
--------------------------------------

Not sure it warrants a code change, it may suffice to just provide a warning in the processor's PropertyDescriptor. e.g. Can not infer schema for records larger than 10MB(or whatever the threshold is).

> RecordReader 'Infer Schema' for large records may throw BufferedInputStream error
> ---------------------------------------------------------------------------------
>
>                 Key: NIFI-8437
>                 URL: https://issues.apache.org/jira/browse/NIFI-8437
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Core Framework
>    Affects Versions: 1.12.1
>         Environment: Mac, BigSur 11.2.3, 32MB RAM, 8 Core Intel i9, 1 TB storage
>            Reporter: Matthew Lannan
>            Priority: Major
>              Labels: easyfix, newbie
>         Attachments: Nifi-stack-trace.txt, PDF_Encode_Decode_template-with-bug.xml
>
>
> In the RecordReader(s), if the Schema Access Strategy is set to Infer Schema and the record is a single large record(tested with record ~50MB), the InferSchemaAccessStrategy will error.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)