[jira] [Commented] (KUDU-3440) Add support for Spark 3.3

["Marton Greber (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KUDU-3440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17683131#comment-17683131 ] 

Marton Greber commented on KUDU-3440:
-------------------------------------

Attached a sample patch, which makes Kudu-Spark work with Spark 3.3 . (however this is not backwards compatible)

Needed to update the scala version because of :
{code:java}
org.apache.kudu.backup.TestKuduBackup > testRandomBackupAndRestore FAILED
java.lang.NoClassDefFoundError: org/apache/commons/net/util/Base64{code}

> Add support for Spark 3.3
> -------------------------
>
>                 Key: KUDU-3440
>                 URL: https://issues.apache.org/jira/browse/KUDU-3440
>             Project: Kudu
>          Issue Type: Improvement
>            Reporter: Marton Greber
>            Priority: Minor
>         Attachments: spark_3_3.patch
>
>
> As it turns out Kudu-Spark bindings are not compatible upwards of 3.2.
> The reason being is that in Spark 3.3, compareBinary() has been moved from org.apache.spark.sql.catalyst.util.TypeUtils to org.apache.spark.unsafe.types.ByteArray.
> As of now there is no support for Spark 3.3 with Kudu, because of this breaking change.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)