You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@nifi.apache.org by jo...@apache.org on 2021/12/13 18:15:43 UTC

[nifi] branch support/nifi-1.15 updated: NIFI-9380 Exclude snappy-java used in parquet bundle and rely on snappy-java from Hadoop libs NAR

This is an automated email from the ASF dual-hosted git repository.

joewitt pushed a commit to branch support/nifi-1.15
in repository https://gitbox.apache.org/repos/asf/nifi.git


The following commit(s) were added to refs/heads/support/nifi-1.15 by this push:
     new f776381  NIFI-9380 Exclude snappy-java used in parquet bundle and rely on snappy-java from Hadoop libs NAR
f776381 is described below

commit f7763816162c9add026cd7043efc33f5219ab7dd
Author: Bryan Bende <bb...@gmail.com>
AuthorDate: Tue Nov 16 10:04:01 2021 -0500

    NIFI-9380 Exclude snappy-java used in parquet bundle and rely on snappy-java from Hadoop libs NAR
---
 .../nifi-parquet-bundle/nifi-parquet-processors/pom.xml          | 9 +++++++++
 1 file changed, 9 insertions(+)

diff --git a/nifi-nar-bundles/nifi-parquet-bundle/nifi-parquet-processors/pom.xml b/nifi-nar-bundles/nifi-parquet-bundle/nifi-parquet-processors/pom.xml
index 0ba8edc..e87e3f0 100644
--- a/nifi-nar-bundles/nifi-parquet-bundle/nifi-parquet-processors/pom.xml
+++ b/nifi-nar-bundles/nifi-parquet-bundle/nifi-parquet-processors/pom.xml
@@ -63,10 +63,19 @@
             <artifactId>jackson-databind</artifactId>
             <version>${jackson.version}</version>
         </dependency>
+        <!-- NOTE: parquet-avro 1.12.0 brings in snappy-java 1.1.8, but hadoop-libraries depends on an older version so we
+            have to exclude it here otherwise it creates incompatible class errors
+         -->
         <dependency>
             <groupId>org.apache.parquet</groupId>
             <artifactId>parquet-avro</artifactId>
             <version>1.12.0</version>
+            <exclusions>
+                <exclusion>
+                    <groupId>org.xerial.snappy</groupId>
+                    <artifactId>snappy-java</artifactId>
+                </exclusion>
+            </exclusions>
         </dependency>
         <dependency>
             <groupId>org.apache.nifi</groupId>