[jira] [Resolved] (NIFI-11269) Adding snappy support for SplitAvro

["David Handermann (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/NIFI-11269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

David Handermann resolved NIFI-11269.
-------------------------------------
    Fix Version/s: 2.0.0
                   1.21.0
         Assignee: john-alan
       Resolution: Fixed

> Adding snappy support for SplitAvro
> -----------------------------------
>
>                 Key: NIFI-11269
>                 URL: https://issues.apache.org/jira/browse/NIFI-11269
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Core Framework
>    Affects Versions: 1.20.0
>            Reporter: john-alan
>            Assignee: john-alan
>            Priority: Major
>             Fix For: 2.0.0, 1.21.0
>
>   Original Estimate: 1h
>          Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> I'm using nifi to split a very big avro file (~500MB), but the processor is throwing this error:
> {code:java}
> SplitAvro[id=d5f27b12-0186-1000-89b6-3171f53ce832] Processing halted: yielding [1 sec]: org.apache.avro.AvroRuntimeException: Unrecognized codec: snappy{code}
> I'm using NiFi 1.20.0 
> The thing is that in 1.13.2 it worked fine. After upgrading to 1.20.0 the problem accrued.
>  
> After searching for a bit I've found this solution:
> Add to nifi/nifi-nar-bundles/nifi-avro-bundle/nifi-avro-processors/pom.xml this dependency:
> {code:java}
> <dependency>
>             <groupId>org.xerial.snappy</groupId>
>             <artifactId>snappy-java</artifactId>
>             <version>1.1.8.4</version>
> </dependency>{code}
> After build and run this actually works! Would be very nice to add this to the next patch.
>  
> This is a deal breaker because I want to upgrade to 1.20.0 from 1.13.2 and can't because of this error.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)