You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Ed Elliott (Jira)" <ji...@apache.org> on 2024/01/27 08:05:00 UTC
[jira] [Created] (SPARK-46884) Spark Connect add property in ExecutePlanRequest for job description
Ed Elliott created SPARK-46884:
----------------------------------
Summary: Spark Connect add property in ExecutePlanRequest for job description
Key: SPARK-46884
URL: https://issues.apache.org/jira/browse/SPARK-46884
Project: Spark
Issue Type: Improvement
Components: Connect
Affects Versions: 3.5.0
Reporter: Ed Elliott
A representation of the execution request is added as the job description when using Spark Connect.
I would like to add a property to the ExecutePlanRequest that allows client applications to set the string instead of the description being generated by the Spark Connect server.
Having the new property means that we can get things like the client app's stack trace in the job description, which would match the point of the client application.
I have created a small wip PR (I need to figure out how to test it).
The new property could be optional to be backwards compatible and not a breaking change.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org