You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@datafu.apache.org by "Eyal Allweil (Jira)" <ji...@apache.org> on 2023/12/21 13:44:00 UTC

[jira] [Resolved] (DATAFU-172) Multimap tests fail on second run with Spark 3

     [ https://issues.apache.org/jira/browse/DATAFU-172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Eyal Allweil resolved DATAFU-172.
---------------------------------
      Assignee: Eyal Allweil
    Resolution: Fixed

This is solved in our [initial Spark 3 commit|https://github.com/apache/datafu/pull/38].

> Multimap tests fail on second run with Spark 3
> ----------------------------------------------
>
>                 Key: DATAFU-172
>                 URL: https://issues.apache.org/jira/browse/DATAFU-172
>             Project: DataFu
>          Issue Type: Test
>    Affects Versions: 2.0.0
>            Reporter: Eyal Allweil
>            Assignee: Eyal Allweil
>            Priority: Major
>             Fix For: 2.0.0
>
>
> When running _UdafTests_ in datafu-spark with Spark 3, three tests - {_}mapmerge{_}, {_}multiarrayset all nulls{_}, and _multiarrayset max keys_ fail upon second run with this error:
>  
> {code:java}
> org.apache.spark.sql.AnalysisException: Can not create the managed table('`default`.`mapmerge_table`'). The associated location('file:/Users/eyal/git/datafu/datafu-spark/spark-warehouse/mapmerge_table') already exists.;
>  
> {code}
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)