[jira] [Created] (NIFI-11269) Adding snappy support for SplitAvro

["john-alan (Jira)" <ji...@apache.org>]

john-alan created NIFI-11269:
--------------------------------

             Summary: Adding snappy support for SplitAvro
                 Key: NIFI-11269
                 URL: https://issues.apache.org/jira/browse/NIFI-11269
             Project: Apache NiFi
          Issue Type: Improvement
          Components: Core Framework
    Affects Versions: 1.20.0
            Reporter: john-alan


I'm using nifi to split a very big avro file (~500MB), but the processor is throwing this error:
{code:java}
SplitAvro[id=d5f27b12-0186-1000-89b6-3171f53ce832] Processing halted: yielding [1 sec]: org.apache.avro.AvroRuntimeException: Unrecognized codec: snappy{code}
I'm using NiFi 1.20.0 
The thing is that in 1.13.2 it worked fine. After upgrading to 1.20.0 the problem accrued.
 
After searching for a bit I've found this solution:
Add to nifi/nifi-nar-bundles/nifi-avro-bundle/nifi-avro-processors/pom.xml this dependency:
{code:java}
<dependency>
            <groupId>org.xerial.snappy</groupId>
            <artifactId>snappy-java</artifactId>
            <version>1.1.8.4</version>
</dependency>{code}
After build and run this actually works! Would be very nice to add this to the next patch.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)