[GitHub] [nifi] bbende opened a new pull request #3679: NIFI-6089 Add Parquet record reader and writer

[GitBox <gi...@apache.org>]

bbende opened a new pull request #3679: NIFI-6089 Add Parquet record reader and writer
URL: https://github.com/apache/nifi/pull/3679
 
 
   NIFI-5755 Allow PutParquet processor to specify avro write configuration
   
   This PR adds ParquetReader and ParquetRecordSetWriter, and also added some additional configuration to the PutParquet processor that was also needed in the record writer.
   
   In order to implement the ParquetReader, the Parquet API requires knowledge of the inputLength ahead of time, which currently wasn't available to the RecordReaderFactory method that didn't have a FlowFile passed in. 
   
   To work around this I added an optional `long inputLength` parameter to that method and updated all the corresponding places in our code where it is called. The only place where we really don't know the input length is when reading from an unbound stream like ListenTCPRecord.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services