You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Yang Jie (Jira)" <ji...@apache.org> on 2021/04/19 06:55:00 UTC
[jira] [Commented] (SPARK-35134) setup.py will copy different
version netty jars into deps/jars when execute PySpark pip packaging tests
[ https://issues.apache.org/jira/browse/SPARK-35134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17324745#comment-17324745 ]
Yang Jie commented on SPARK-35134:
----------------------------------
execute
mvn dependency:tree -Phadoop-3.2 -Phive-2.3 -Phadoop-cloud -Pmesos -Pyarn -Pkinesis-asl -Phive-thriftserver -Pspark-ganglia-lgpl -Pkubernetes -Phive
there was no netty 4.1.50 dependency in the results.
> setup.py will copy different version netty jars into deps/jars when execute PySpark pip packaging tests
> -------------------------------------------------------------------------------------------------------
>
> Key: SPARK-35134
> URL: https://issues.apache.org/jira/browse/SPARK-35134
> Project: Spark
> Issue Type: Bug
> Components: Tests
> Affects Versions: 3.2.0
> Reporter: Yang Jie
> Priority: Major
>
> [https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137500/console]
>
> copying deps/jars/netty-all-4.1.51.Final.jar -> pyspark-3.2.0.dev0/deps/jars
> copying deps/jars/netty-buffer-4.1.50.Final.jar -> pyspark-3.2.0.dev0/deps/jars
> copying deps/jars/netty-codec-4.1.50.Final.jar -> pyspark-3.2.0.dev0/deps/jars
> copying deps/jars/netty-common-4.1.50.Final.jar -> pyspark-3.2.0.dev0/deps/jars
> copying deps/jars/netty-handler-4.1.50.Final.jar -> pyspark-3.2.0.dev0/deps/jars
> copying deps/jars/netty-resolver-4.1.50.Final.jar -> pyspark-3.2.0.dev0/deps/jars
> copying deps/jars/netty-transport-4.1.50.Final.jar -> pyspark-3.2.0.dev0/deps/jars
> copying deps/jars/netty-transport-native-epoll-4.1.50.Final.jar -> pyspark-3.2.0.dev0/deps/jars
>
> Master relies on netty 4.1.51 but there will copy 4.1.51 and 4.1.50 to pyspark-3.2.0.dev0/deps/jars
>
> -------------------------------------
>
> [https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137547/console]
>
> copying deps/jars/netty-all-4.1.63.Final.jar -> pyspark-3.2.0.dev0/deps/jars
> copying deps/jars/netty-buffer-4.1.50.Final.jar -> pyspark-3.2.0.dev0/deps/jars
> copying deps/jars/netty-codec-4.1.50.Final.jar -> pyspark-3.2.0.dev0/deps/jars
> copying deps/jars/netty-common-4.1.50.Final.jar -> pyspark-3.2.0.dev0/deps/jars
> copying deps/jars/netty-handler-4.1.50.Final.jar -> pyspark-3.2.0.dev0/deps/jars
> copying deps/jars/netty-resolver-4.1.50.Final.jar -> pyspark-3.2.0.dev0/deps/jars
> copying deps/jars/netty-transport-4.1.50.Final.jar -> pyspark-3.2.0.dev0/deps/jars
> copying deps/jars/netty-transport-native-epoll-4.1.50.Final.jar -> pyspark-3.2.0.dev0/deps/jars
>
> SPARK-35132 try to upgrade netty to 4.1.63.Final, but still copy 4.1.63 and 4.1.50 to pyspark-3.2.0.dev0/deps/jars
>
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org