You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Niranjan Jayakar (Jira)" <ji...@apache.org> on 2023/02/20 15:32:00 UTC
[jira] [Updated] (SPARK-42502) scala: accept user_agent in spark connect's connection string
[ https://issues.apache.org/jira/browse/SPARK-42502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Niranjan Jayakar updated SPARK-42502:
-------------------------------------
Description:
Currently, the Spark Connect service's {{client_type}} attribute (which is really user agent) is set to {{_SPARK_CONNECT_PYTHON}} to signify PySpark.
Accept an optional {{user_agent}} parameter in the connection string and plumb this down to the Spark Connect service.
This enables partners using Spark Connect to set their application as the user agent,
which then allows visibility and measurement of integrations and usages of spark
connect.
This is already done for the Python client: https://github.com/apache/spark/commit/b887d3de954ae5b2482087fe08affcc4ac60c669
was:
Currently, the Spark Connect service's {{client_type}} attribute (which is really user agent) is set to {{_SPARK_CONNECT_PYTHON}} to signify PySpark.
Accept an optional {{user_agent}} parameter in the connection string and plumb this down to the Spark Connect service.
This enables partners using Spark Connect to set their application as the user agent,
which then allows visibility and measurement of integrations and usages of spark
connect.
> scala: accept user_agent in spark connect's connection string
> -------------------------------------------------------------
>
> Key: SPARK-42502
> URL: https://issues.apache.org/jira/browse/SPARK-42502
> Project: Spark
> Issue Type: New Feature
> Components: Connect
> Affects Versions: 3.3.2
> Reporter: Niranjan Jayakar
> Assignee: Niranjan Jayakar
> Priority: Major
> Fix For: 3.4.0
>
>
> Currently, the Spark Connect service's {{client_type}} attribute (which is really user agent) is set to {{_SPARK_CONNECT_PYTHON}} to signify PySpark.
> Accept an optional {{user_agent}} parameter in the connection string and plumb this down to the Spark Connect service.
> This enables partners using Spark Connect to set their application as the user agent,
> which then allows visibility and measurement of integrations and usages of spark
> connect.
> This is already done for the Python client: https://github.com/apache/spark/commit/b887d3de954ae5b2482087fe08affcc4ac60c669
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org