You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@beam.apache.org by "Koka, Deepthi via dev" <de...@beam.apache.org> on 2022/07/28 15:17:28 UTC

Oracle Database Connection Pool creation from Beam

Hi Team,

We have an issue with the Oracle connections being used up and we have tried to implement a pooled data source using PooledDataSourceFactory, somehow we are ending up with "Invalid Universal Connection Pool Configuration: oracle.ucp.UniversalConnectionPoolException: Universal Connection Pool already exists in the Universal Connection Pool Manager.

Can you please suggest us a standard way of using Pooled data sources in Apache beam?

Regards,
Deepthi.

----------------------------------------------------------------------
This email and any files transmitted with it are confidential and intended solely for the use of the addressee. If you are not the intended addressee, then you have received this email in error and any use, dissemination, forwarding, printing, or copying of this email is strictly prohibited. Please notify us immediately of your unintended receipt by reply and then delete this email and your reply. Tyson Foods, Inc. and its subsidiaries and affiliates will not be held liable to any person resulting from the unintended or unauthorized use of any information contained in this email or as a result of any additions or deletions of information originally contained in this email.

Re: Oracle Database Connection Pool creation from Beam

Posted by Alexey Romanenko <ar...@gmail.com>.

Additionally to what Moritz said, I just wanted to give an example of using JdbcIO.PoolableDataSourceProvider taken from JdbcIO Javadoc:

To customize the building of the DataSource we can provide a SerializableFunction. For example if you need to provide a PoolingDataSource from an existing JdbcIO.DataSourceConfiguration: you can use a JdbcIO.PoolableDataSourceProvider:


 pipeline.apply(JdbcIO.<KV<Integer, String>>read()
   .withDataSourceProviderFn(JdbcIO.PoolableDataSourceProvider.of(
       JdbcIO.DataSourceConfiguration.create(
           "com.mysql.jdbc.Driver", "jdbc:mysql://hostname:3306/mydb",
           "username", "password")))
    // ...
 ); 

Did you try this? If yes, could you provide more details about your error?

—
Alexey

> On 29 Jul 2022, at 10:40, Moritz Mack <mm...@talend.com> wrote:
> 
> Could you share some more details what you’ve tried so far?
> I suppose you are using the JdbcIO, right? Have you looked at JdbcIO.PoolableDataSourceProvider?
>  
> / Moritz
>  
>  
> On 28.07.22, 17:35, "Koka, Deepthi via dev" <dev@beam.apache.org <ma...@beam.apache.org>> wrote:
> Hi Team, We have an issue with the Oracle connections being used up and we have tried to implement a pooled data source using PooledDataSourceFactory, somehow we are ending up with “Invalid Universal Connection Pool Configuration:⁠ oracle.⁠ucp.⁠UniversalConnectionPoolException:⁠
> Hi Team,
>  
> We have an issue with the Oracle connections being used up and we have tried to implement a pooled data source using PooledDataSourceFactory, somehow we are ending up with “Invalid Universal Connection Pool Configuration: oracle.ucp.UniversalConnectionPoolException: Universal Connection Pool already exists in the Universal Connection Pool Manager.
>  
> Can you please suggest us a standard way of using Pooled data sources in Apache beam?
>  
> Regards,
> Deepthi.
> This email and any files transmitted with it are confidential and intended solely for the use of the addressee. If you are not the intended addressee, then you have received this email in error and any use, dissemination, forwarding, printing, or copying of this email is strictly prohibited. Please notify us immediately of your unintended receipt by reply and then delete this email and your reply. Tyson Foods, Inc. and its subsidiaries and affiliates will not be held liable to any person resulting from the unintended or unauthorized use of any information contained in this email or as a result of any additions or deletions of information originally contained in this email.
> As a recipient of an email from Talend, your contact personal data will be on our systems. Please see our privacy notice. <https://www.talend.com/privacy/>

Re: Oracle Database Connection Pool creation from Beam

Posted by Moritz Mack <mm...@talend.com>.

Could you share some more details what you’ve tried so far?
I suppose you are using the JdbcIO, right? Have you looked at JdbcIO.PoolableDataSourceProvider?

/ Moritz

On 28.07.22, 17:35, "Koka, Deepthi via dev" <de...@beam.apache.org> wrote:
Hi Team, We have an issue with the Oracle connections being used up and we have tried to implement a pooled data source using PooledDataSourceFactory, somehow we are ending up with “Invalid Universal Connection Pool Configuration:⁠ oracle.⁠ucp.⁠UniversalConnectionPoolException:⁠

Hi Team,

We have an issue with the Oracle connections being used up and we have tried to implement a pooled data source using PooledDataSourceFactory, somehow we are ending up with “Invalid Universal Connection Pool Configuration: oracle.ucp.UniversalConnectionPoolException: Universal Connection Pool already exists in the Universal Connection Pool Manager.

Can you please suggest us a standard way of using Pooled data sources in Apache beam?

Regards,
Deepthi.
________________________________
This email and any files transmitted with it are confidential and intended solely for the use of the addressee. If you are not the intended addressee, then you have received this email in error and any use, dissemination, forwarding, printing, or copying of this email is strictly prohibited. Please notify us immediately of your unintended receipt by reply and then delete this email and your reply. Tyson Foods, Inc. and its subsidiaries and affiliates will not be held liable to any person resulting from the unintended or unauthorized use of any information contained in this email or as a result of any additions or deletions of information originally contained in this email.

As a recipient of an email from Talend, your contact personal data will be on our systems. Please see our privacy notice. <https://www.talend.com/privacy/>