[jira] [Assigned] (SPARK-51264) JDBC write keeps driver connection open unnecessarily

["Uroš Bojanić (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-51264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Uroš Bojanić reassigned SPARK-51264:
------------------------------------

    Assignee: Xinyao Zhang

> JDBC write keeps driver connection open unnecessarily
> -----------------------------------------------------
>
>                 Key: SPARK-51264
>                 URL: https://issues.apache.org/jira/browse/SPARK-51264
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 2.1.0, 2.2.0, 2.3.0, 2.4.0, 3.0.0, 3.1.0, 3.2.0, 3.3.0, 3.4.0, 3.5.0, 4.0.0
>            Reporter: Ángel Álvarez Pascua
>            Assignee: Xinyao Zhang
>            Priority: Major
>              Labels: pull-request-available
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> A JDBC connection is created in {{org.apache.spark.sql.execution.datasources.jdbc.JdbcRelationProvider}} to truncate, drop, or create the table. However, this connection remains open and idle throughout the entire save process, which can last minutes or hours.
>  
> This causes unnecessary resource consumption on both the Spark driver and the database. Additionally, the idle connection is at risk of being dropped by the database, firewall, or proxy. Best practices recommend releasing resources as soon as they are no longer needed.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org