You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by jo...@apache.org on 2020/01/04 19:53:35 UTC
[druid] branch 0.17.0 updated: Add avro dependency to parquet
extension (#9124) (#9127)
This is an automated email from the ASF dual-hosted git repository.
jonwei pushed a commit to branch 0.17.0
in repository https://gitbox.apache.org/repos/asf/druid.git
The following commit(s) were added to refs/heads/0.17.0 by this push:
new eabbc31 Add avro dependency to parquet extension (#9124) (#9127)
eabbc31 is described below
commit eabbc312aae8c53782ca1da2aa08ab5c5b03dcf7
Author: Suneet Saldanha <44...@users.noreply.github.com>
AuthorDate: Sat Jan 4 14:53:23 2020 -0500
Add avro dependency to parquet extension (#9124) (#9127)
* Add avro dependency to parquet extension
If the parquet extension is loaded and an ingestionSpec uses the older format
specifying a 'parser' instead of using an 'inputFormat' the job fails
with the following error
java.lang.TypeNotPresentException: Type org.apache.avro.generic.GenericRecord not present
This change removes the exclusion of the avro package so that the missing
class can be found.
* Address review comments and add dependency version
---
extensions-core/parquet-extensions/pom.xml | 14 +-------------
1 file changed, 1 insertion(+), 13 deletions(-)
diff --git a/extensions-core/parquet-extensions/pom.xml b/extensions-core/parquet-extensions/pom.xml
index 076aa43..2530bf2 100644
--- a/extensions-core/parquet-extensions/pom.xml
+++ b/extensions-core/parquet-extensions/pom.xml
@@ -81,10 +81,6 @@
<version>${parquet.version}</version>
<exclusions>
<exclusion>
- <groupId>org.apache.avro</groupId>
- <artifactId>avro</artifactId>
- </exclusion>
- <exclusion>
<groupId>commons-pool</groupId>
<artifactId>commons-pool</artifactId>
</exclusion>
@@ -146,10 +142,6 @@
<artifactId>aopalliance</artifactId>
</exclusion>
<exclusion>
- <groupId>org.apache.avro</groupId>
- <artifactId>avro</artifactId>
- </exclusion>
- <exclusion>
<groupId>org.apache.commons</groupId>
<artifactId>commons-compress</artifactId>
</exclusion>
@@ -210,10 +202,6 @@
<artifactId>audience-annotations</artifactId>
</exclusion>
<exclusion>
- <groupId>org.apache.avro</groupId>
- <artifactId>avro</artifactId>
- </exclusion>
- <exclusion>
<groupId>commons-codec</groupId>
<artifactId>commons-codec</artifactId>
</exclusion>
@@ -414,7 +402,7 @@
<dependency>
<groupId>org.apache.avro</groupId>
<artifactId>avro</artifactId>
- <scope>provided</scope>
+ <version>${avro.version}</version>
</dependency>
<dependency>
<groupId>junit</groupId>
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org