You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by sr...@apache.org on 2021/10/30 16:24:59 UTC
[spark] branch master updated: [SPARK-37102][BUILD] Removed
redundant exclusions in `hadoop-cloud` module
This is an automated email from the ASF dual-hosted git repository.
srowen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 6906328 [SPARK-37102][BUILD] Removed redundant exclusions in `hadoop-cloud` module
6906328 is described below
commit 6906328dc49560e460f2c0eddbf60c9c3d279236
Author: Vasily Malakhin <vm...@gmail.com>
AuthorDate: Sat Oct 30 11:23:35 2021 -0500
[SPARK-37102][BUILD] Removed redundant exclusions in `hadoop-cloud` module
### What changes were proposed in this pull request?
Redundant exclusions were removed for hadoop-cloud module so the build output contains required dependency for hadoop-azure artifact (ackson-mapper-asl).
### Why are the changes needed?
Currently Hadoop ABFS connector (for Azure Data Lake Storage Gen2) is broken due to missing dependency. So required dependencies for hadoop-azure artifact should be included into distribution output if hadoop-cloud module enabled.
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
Unfortunately Microsoft does not provide support for Data Lake Storage Gen2 within azurite emulator - so the change was tested manually and the diff was checked to see if anything else was picked up for build outputs (before and after the change). So the only change is inclusion of jackson-mapper-asl-1.9.13.jar.
Closes #34383 from vmalakhin/SPARK-37102.
Lead-authored-by: Vasily Malakhin <vm...@gmail.com>
Co-authored-by: vmalakhin <49...@users.noreply.github.com>
Signed-off-by: Sean Owen <sr...@gmail.com>
---
hadoop-cloud/pom.xml | 16 ----------------
1 file changed, 16 deletions(-)
diff --git a/hadoop-cloud/pom.xml b/hadoop-cloud/pom.xml
index fe62443..2e95b57 100644
--- a/hadoop-cloud/pom.xml
+++ b/hadoop-cloud/pom.xml
@@ -86,14 +86,6 @@
<artifactId>commons-logging</artifactId>
</exclusion>
<exclusion>
- <groupId>org.codehaus.jackson</groupId>
- <artifactId>jackson-mapper-asl</artifactId>
- </exclusion>
- <exclusion>
- <groupId>org.codehaus.jackson</groupId>
- <artifactId>jackson-core-asl</artifactId>
- </exclusion>
- <exclusion>
<groupId>com.fasterxml.jackson.core</groupId>
<artifactId>jackson-core</artifactId>
</exclusion>
@@ -185,10 +177,6 @@
<artifactId>hadoop-common</artifactId>
</exclusion>
<exclusion>
- <groupId>org.codehaus.jackson</groupId>
- <artifactId>jackson-mapper-asl</artifactId>
- </exclusion>
- <exclusion>
<groupId>com.fasterxml.jackson.core</groupId>
<artifactId>jackson-core</artifactId>
</exclusion>
@@ -272,10 +260,6 @@
<artifactId>hadoop-common</artifactId>
</exclusion>
<exclusion>
- <groupId>org.codehaus.jackson</groupId>
- <artifactId>jackson-mapper-asl</artifactId>
- </exclusion>
- <exclusion>
<groupId>com.fasterxml.jackson.core</groupId>
<artifactId>jackson-core</artifactId>
</exclusion>
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org