You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Ed Elliott (Jira)" <ji...@apache.org> on 2024/01/27 08:05:00 UTC

[jira] [Created] (SPARK-46884) Spark Connect add property in ExecutePlanRequest for job description

Ed Elliott created SPARK-46884:
----------------------------------

             Summary: Spark Connect add property in ExecutePlanRequest for job description
                 Key: SPARK-46884
                 URL: https://issues.apache.org/jira/browse/SPARK-46884
             Project: Spark
          Issue Type: Improvement
          Components: Connect
    Affects Versions: 3.5.0
            Reporter: Ed Elliott


A representation of the execution request is added as the job description when using Spark Connect.

I would like to add a property to the ExecutePlanRequest that allows client applications to set the string instead of the description being generated by the Spark Connect server.

Having the new property means that we can get things like the client app's stack trace in the job description, which would match the point of the client application.

I have created a small wip PR (I need to figure out how to test it).

The new property could be optional to be backwards compatible and not a breaking change.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org