[jira] [Commented] (SPARK-45023) SPIP: Python Stored Procedures

["Abhinav Kumar (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-45023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17776963#comment-17776963 ] 

Abhinav Kumar commented on SPARK-45023:
---------------------------------------

Not sure where we are with this. Looks like we are not progressing with this. I do see value of SQL based Stored Procedure (to begin with just grouped sqls) - user can reveal the intent of usage and Spark can optimize holistically. Should we discuss and modify proposal accordingly? Please suggest.

> SPIP: Python Stored Procedures
> ------------------------------
>
>                 Key: SPARK-45023
>                 URL: https://issues.apache.org/jira/browse/SPARK-45023
>             Project: Spark
>          Issue Type: Improvement
>          Components: PySpark, SQL
>    Affects Versions: 4.0.0
>            Reporter: Allison Wang
>            Priority: Major
>
> Stored procedures are an extension of the ANSI SQL standard. They play a crucial role in improving the capabilities of SQL by encapsulating complex logic into reusable routines. 
> This proposal aims to extend Spark SQL by introducing support for stored procedures, starting with Python as the procedural language. This addition will allow users to execute procedural programs, leveraging programming constructs of Python to perform tasks with complex logic. Additionally, users can persist these procedural routines in catalogs such as HMS for future reuse. By providing this functionality, we intend to seamlessly empower Spark users to integrate with Python routines within their SQL workflows.
> {*}SPIP{*}: [https://docs.google.com/document/d/1ce2EZrf2BxHu7TjfGn4TgToK3TBYYzRkmsIVcfmkNzE/edit?usp=sharing]
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org