You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Huaxin Gao (Jira)" <ji...@apache.org> on 2021/11/13 17:22:00 UTC

[jira] [Resolved] (SPARK-37307) Don't obtain JDBC connection for empty partition

     [ https://issues.apache.org/jira/browse/SPARK-37307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Huaxin Gao resolved SPARK-37307.
--------------------------------
    Fix Version/s: 3.2.1
                   3.3.0
         Assignee: Sean R. Owen
       Resolution: Fixed

> Don't obtain JDBC connection for empty partition
> ------------------------------------------------
>
>                 Key: SPARK-37307
>                 URL: https://issues.apache.org/jira/browse/SPARK-37307
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 3.2.0
>            Reporter: Sean R. Owen
>            Assignee: Sean R. Owen
>            Priority: Minor
>             Fix For: 3.2.1, 3.3.0
>
>
> In JdbcUtils.scala:savePartition, the code obtains a database connection even when there is no data in the partition. It works correctly and returns it, but, may be advantageous to simply skip that and other overhead if nothing will be written at all.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org