You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2020/10/29 16:25:00 UTC

[jira] [Commented] (SPARK-33279) Spark 3.0 failure due to lack of Arrow dependency

    [ https://issues.apache.org/jira/browse/SPARK-33279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223002#comment-17223002 ] 

Dongjoon Hyun commented on SPARK-33279:
---------------------------------------

cc [~hyukjin.kwon] and [~bryanc]

> Spark 3.0 failure due to lack of Arrow dependency
> -------------------------------------------------
>
>                 Key: SPARK-33279
>                 URL: https://issues.apache.org/jira/browse/SPARK-33279
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 3.0.0
>            Reporter: Liya Fan
>            Priority: Major
>
> A recent change in Arrow has split the arrow-memory module into 3, so client code must add a dependency of arrow-memory-netty (or arrow-memory-unsafe).
> This has been done in the master branch of Spark, but not in the branch-3.0 branch, this is causing the build in branch-3.0 to fail (https://github.com/ursa-labs/crossbow/actions?query=branch:actions-681-github-test-conda-python-3.7-spark-branch-3.0)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org