[jira] [Resolved] (SPARK-49569) Introduce Shim for missing spark/core classes

["Herman van Hövell (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-49569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Herman van Hövell resolved SPARK-49569.
---------------------------------------
    Fix Version/s: 4.0.0
       Resolution: Fixed

Issue resolved by pull request 48065
[https://github.com/apache/spark/pull/48065]

> Introduce Shim for missing spark/core classes
> ---------------------------------------------
>
>                 Key: SPARK-49569
>                 URL: https://issues.apache.org/jira/browse/SPARK-49569
>             Project: Spark
>          Issue Type: New Feature
>          Components: Connect, SQL
>    Affects Versions: 4.0.0
>            Reporter: Herman van Hövell
>            Assignee: Herman van Hövell
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 4.0.0
>
>
> Introduce shims for SparkContext, RDD, and QueryExecution. This will have to be a in a separate module, and is supposed to be a compile time dependency for sql/api project, and an actual dependency for an independent Spark Connect Client.
> We need these three classes to support all user facing API in the sql/api project. This will allow us to make the classes the primary interface for Scala Dataset operations.
> For connect these methods will throw an (actionable) error, and for the classic client they will just work. On the connect side in the future we can use this to build better errors, and provide (method specific) mitigations. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org