You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Yuming Wang (JIRA)" <ji...@apache.org> on 2019/04/18 07:09:00 UTC

[jira] [Comment Edited] (SPARK-27475) dev/deps/spark-deps-hadoop-3.2 is incorrect

    [ https://issues.apache.org/jira/browse/SPARK-27475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820787#comment-16820787 ] 

Yuming Wang edited comment on SPARK-27475 at 4/18/19 7:08 AM:
--------------------------------------------------------------

sbt can do it, but some result is incorrect. It added {{jetty-*-9.4.12.jar}}: 
{code:java}
build/sbt  "show assembly/compile:dependencyClasspath" -Phadoop-3.2 | grep "Attributed(" | awk -F "/" '{print $NF}' | sed 's/'\)'//g' | sort | grep -v spark
{code}



was (Author: q79969786):
sbt can do it, but some result is incorrect. It added {{jetty-*-9.4.12.jar}}: 
{code:java}
build/sbt  "show assembly/compile:dependencyClasspath" -Phadoop-3.2 | grep "Attributed(" | rev | sed \ 's/^.//' | cut -d "/" -f 1 | rev | sort | grep -v spark
{code}


> dev/deps/spark-deps-hadoop-3.2 is incorrect
> -------------------------------------------
>
>                 Key: SPARK-27475
>                 URL: https://issues.apache.org/jira/browse/SPARK-27475
>             Project: Spark
>          Issue Type: Sub-task
>          Components: Build
>    Affects Versions: 3.0.0
>            Reporter: Yuming Wang
>            Priority: Major
>
> parquet-hadoop-bundle-1.6.0.jar should be parquet-hadoop-bundle-1.8.1.jar.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org