You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Yuming Wang (JIRA)" <ji...@apache.org> on 2019/04/18 07:09:00 UTC
[jira] [Comment Edited] (SPARK-27475)
dev/deps/spark-deps-hadoop-3.2 is incorrect
[ https://issues.apache.org/jira/browse/SPARK-27475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820787#comment-16820787 ]
Yuming Wang edited comment on SPARK-27475 at 4/18/19 7:08 AM:
--------------------------------------------------------------
sbt can do it, but some result is incorrect. It added {{jetty-*-9.4.12.jar}}:
{code:java}
build/sbt "show assembly/compile:dependencyClasspath" -Phadoop-3.2 | grep "Attributed(" | awk -F "/" '{print $NF}' | sed 's/'\)'//g' | sort | grep -v spark
{code}
was (Author: q79969786):
sbt can do it, but some result is incorrect. It added {{jetty-*-9.4.12.jar}}:
{code:java}
build/sbt "show assembly/compile:dependencyClasspath" -Phadoop-3.2 | grep "Attributed(" | rev | sed \ 's/^.//' | cut -d "/" -f 1 | rev | sort | grep -v spark
{code}
> dev/deps/spark-deps-hadoop-3.2 is incorrect
> -------------------------------------------
>
> Key: SPARK-27475
> URL: https://issues.apache.org/jira/browse/SPARK-27475
> Project: Spark
> Issue Type: Sub-task
> Components: Build
> Affects Versions: 3.0.0
> Reporter: Yuming Wang
> Priority: Major
>
> parquet-hadoop-bundle-1.6.0.jar should be parquet-hadoop-bundle-1.8.1.jar.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org