You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@sedona.apache.org by "Adam Binford (Jira)" <ji...@apache.org> on 2021/10/18 14:42:00 UTC

[jira] [Created] (SEDONA-67) Support Spark 3.2

Adam Binford created SEDONA-67:
----------------------------------

             Summary: Support Spark 3.2
                 Key: SEDONA-67
                 URL: https://issues.apache.org/jira/browse/SEDONA-67
             Project: Apache Sedona
          Issue Type: Improvement
            Reporter: Adam Binford


An initial attempt to build master with Spark 3.2 revealed at least two things that need to be addressed:
 * The API for registering SQL functions changed (https://github.com/apache/spark/pull/32587)
 * A change in TreeNode added a new required function `withNewChildrenInternal` that all the expressions are now missing (https://github.com/apache/spark/pull/32030)

Need to figure out if it's possible to fix these in a backward compatible way so it still supports all 3.0+ versions, try to create a separate release for 3.2+, or only support the latest Spark version.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)