You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by fj...@apache.org on 2019/11/28 21:12:56 UTC
[incubator-druid] branch master updated: add hdfs client dependency
for native batch parquet when using hdfs (#8964)
This is an automated email from the ASF dual-hosted git repository.
fjy pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-druid.git
The following commit(s) were added to refs/heads/master by this push:
new 6997b16 add hdfs client dependency for native batch parquet when using hdfs (#8964)
6997b16 is described below
commit 6997b167b1b3e857e1c0db7d56d3ae833732f9c4
Author: Clint Wylie <cw...@apache.org>
AuthorDate: Thu Nov 28 13:12:45 2019 -0800
add hdfs client dependency for native batch parquet when using hdfs (#8964)
---
extensions-core/parquet-extensions/pom.xml | 14 ++++++++++++++
1 file changed, 14 insertions(+)
diff --git a/extensions-core/parquet-extensions/pom.xml b/extensions-core/parquet-extensions/pom.xml
index 936028e..582c70b 100644
--- a/extensions-core/parquet-extensions/pom.xml
+++ b/extensions-core/parquet-extensions/pom.xml
@@ -121,6 +121,12 @@
<version>${project.parent.version}</version>
<scope>provided</scope>
</dependency>
+ <!-- needed if using native batch with hdfs input source -->
+ <dependency>
+ <groupId>org.apache.hadoop</groupId>
+ <artifactId>hadoop-hdfs-client</artifactId>
+ <scope>runtime</scope>
+ </dependency>
<!--
for native batch indexing with Parquet files, we require a small number of classes provided by hadoop-common and
hadoop-mapreduce-client-core. However, both of these jars have a very large set of dependencies, the majority of
@@ -140,6 +146,10 @@
<artifactId>aopalliance</artifactId>
</exclusion>
<exclusion>
+ <groupId>org.apache.avro</groupId>
+ <artifactId>avro</artifactId>
+ </exclusion>
+ <exclusion>
<groupId>org.apache.commons</groupId>
<artifactId>commons-compress</artifactId>
</exclusion>
@@ -200,6 +210,10 @@
<artifactId>audience-annotations</artifactId>
</exclusion>
<exclusion>
+ <groupId>org.apache.avro</groupId>
+ <artifactId>avro</artifactId>
+ </exclusion>
+ <exclusion>
<groupId>commons-codec</groupId>
<artifactId>commons-codec</artifactId>
</exclusion>
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org