You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2019/03/08 10:40:00 UTC
[jira] [Comment Edited] (SPARK-27044) Maven dependency resolution
does not support classifiers
[ https://issues.apache.org/jira/browse/SPARK-27044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16787762#comment-16787762 ]
Jungtaek Lim edited comment on SPARK-27044 at 3/8/19 10:39 AM:
---------------------------------------------------------------
It's like "hive-exec" with default classifier vs "core" classifier. Former includes all transitive dependencies (without relocating) whereas latter just have itself and let Maven deal with transitive dependencies.
I've some experience regarding this: if no one minds I would like to work on this. [~gsomogyi] Are you OK with this? It's perfectly OK if you already took a step on this.
was (Author: kabhwan):
It's like "hive-exec" with default classifier vs "core" classifier. Former includes all transitive dependencies (without relocating) whereas latter just have itself and let Maven deal with transitive dependencies.
I've some experience regarding this: if no one minds I would like to work on this. [~gsomogyi] Are you OK with this? Or did you already take a step on this?
> Maven dependency resolution does not support classifiers
> --------------------------------------------------------
>
> Key: SPARK-27044
> URL: https://issues.apache.org/jira/browse/SPARK-27044
> Project: Spark
> Issue Type: Bug
> Components: Spark Submit
> Affects Versions: 2.4.0
> Reporter: Mathias Herberts
> Priority: Major
>
> The spark-submit --packages option allows dependencies to be specified using the maven syntax group:artifact:version, but it does not support specifying a classifier as group:artifact:version:classifier
> This makes it impossible to fetch 'uber' versions of packages for example as they are usually specified using a classifier.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org