You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Takeshi Yamamuro (Jira)" <ji...@apache.org> on 2020/10/14 12:59:00 UTC

[jira] [Resolved] (SPARK-25547) Pluggable jdbc connection factory

     [ https://issues.apache.org/jira/browse/SPARK-25547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Takeshi Yamamuro resolved SPARK-25547.
--------------------------------------
    Resolution: Duplicate

> Pluggable jdbc connection factory
> ---------------------------------
>
>                 Key: SPARK-25547
>                 URL: https://issues.apache.org/jira/browse/SPARK-25547
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 2.3.1
>            Reporter: Frank Sauer
>            Priority: Major
>
> The ability to provide a custom connectionFactoryProvider via JDBCOptions so that JdbcUtils.createConnectionFactory can produce a custom connection factory would be very useful. In our case we needed to have the ability to load balance connections to an AWS Aurora Postgres cluster by round-robining through the endpoints of the read replicas since their own loan balancing was insufficient. We got away with it by copying most of the spark jdbc package and provide this feature there and changing the format from jdbc to our new package. However it would be nice  if this were supported out of the box via a new option in JDBCOptions providing the classname for a ConnectionFactoryProvider. I'm creating this Jira in order to submit a PR which I have ready to go.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org