You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/09/10 00:57:00 UTC
[jira] [Commented] (SPARK-35959) Add a new Maven profile
"no-shaded-client" for older Hadoop 3.x versions
[ https://issues.apache.org/jira/browse/SPARK-35959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17412889#comment-17412889 ]
Hyukjin Kwon commented on SPARK-35959:
--------------------------------------
[~csun], just to clarify, is this a blocker for Spark 3.2?
> Add a new Maven profile "no-shaded-client" for older Hadoop 3.x versions
> -------------------------------------------------------------------------
>
> Key: SPARK-35959
> URL: https://issues.apache.org/jira/browse/SPARK-35959
> Project: Spark
> Issue Type: Improvement
> Components: Build
> Affects Versions: 3.2.0
> Reporter: Chao Sun
> Priority: Blocker
>
> Currently Spark uses Hadoop shaded client by default. However, if Spark users want to build Spark with older version of Hadoop, such as 3.1.x, the shaded client cannot be used (currently it only support Hadoop 3.2.2+ and 3.3.1+). Therefore, this proposes to offer a new Maven profile "no-shaded-client" for this use case.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org