[druid] branch master updated: Add avro dependency to parquet extension (#9124)

[jo...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

jonwei pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/druid.git


The following commit(s) were added to refs/heads/master by this push:
     new bdd0d0d  Add avro dependency to parquet extension (#9124)
bdd0d0d is described below

commit bdd0d0d8a50f0b27e5b54cd8c88596b3cffbbd9f
Author: Suneet Saldanha <44...@users.noreply.github.com>
AuthorDate: Fri Jan 3 21:11:13 2020 -0500

    Add avro dependency to parquet extension (#9124)
    
    * Add avro dependency to parquet extension
    
    If the parquet extension is loaded and an ingestionSpec uses the older format
    specifying a 'parser' instead of using an 'inputFormat' the job fails
    with the following error
    
    java.lang.TypeNotPresentException: Type org.apache.avro.generic.GenericRecord not present
    
    This change removes the exclusion of the avro package so that the missing
    class can be found.
    
    * Address review comments and add dependency version
---
 extensions-core/parquet-extensions/pom.xml | 14 +-------------
 1 file changed, 1 insertion(+), 13 deletions(-)

diff --git a/extensions-core/parquet-extensions/pom.xml b/extensions-core/parquet-extensions/pom.xml
index 6fa3197..e3cd27d 100644
--- a/extensions-core/parquet-extensions/pom.xml
+++ b/extensions-core/parquet-extensions/pom.xml
@@ -81,10 +81,6 @@
       <version>${parquet.version}</version>
       <exclusions>
         <exclusion>
-          <groupId>org.apache.avro</groupId>
-          <artifactId>avro</artifactId>
-        </exclusion>
-        <exclusion>
           <groupId>commons-pool</groupId>
           <artifactId>commons-pool</artifactId>
         </exclusion>
@@ -146,10 +142,6 @@
           <artifactId>aopalliance</artifactId>
         </exclusion>
         <exclusion>
-          <groupId>org.apache.avro</groupId>
-          <artifactId>avro</artifactId>
-        </exclusion>
-        <exclusion>
           <groupId>org.apache.commons</groupId>
           <artifactId>commons-compress</artifactId>
         </exclusion>
@@ -210,10 +202,6 @@
           <artifactId>audience-annotations</artifactId>
         </exclusion>
         <exclusion>
-          <groupId>org.apache.avro</groupId>
-          <artifactId>avro</artifactId>
-        </exclusion>
-        <exclusion>
           <groupId>commons-codec</groupId>
           <artifactId>commons-codec</artifactId>
         </exclusion>
@@ -414,7 +402,7 @@
     <dependency>
       <groupId>org.apache.avro</groupId>
       <artifactId>avro</artifactId>
-      <scope>provided</scope>
+      <version>${avro.version}</version>
     </dependency>
     <dependency>
       <groupId>junit</groupId>


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org