You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Ismaël Mejía (Jira)" <ji...@apache.org> on 2020/05/19 15:31:00 UTC

[jira] [Updated] (BEAM-9629) JdbcIO seems to run out of connections in the connection pool and freezes pipeline

     [ https://issues.apache.org/jira/browse/BEAM-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ismaël Mejía updated BEAM-9629:
-------------------------------
    Fix Version/s:     (was: 2.22.0)
                   2.23.0

> JdbcIO seems to run out of connections in the connection pool and freezes pipeline
> ----------------------------------------------------------------------------------
>
>                 Key: BEAM-9629
>                 URL: https://issues.apache.org/jira/browse/BEAM-9629
>             Project: Beam
>          Issue Type: Bug
>          Components: io-java-jdbc
>    Affects Versions: 2.19.0
>         Environment: Dataflow, Direct Runner on macOS Catalina.
>            Reporter: Boris Shilov
>            Assignee: Ismaël Mejía
>            Priority: P2
>              Labels: performance
>             Fix For: 2.23.0
>
>
> Greetings,
> I am using JdbcIO via the Scala wrappers provided in the Scio project. I am trying to read a few dozen tables in parallel from MySQL, but above 8 concurrent SELECT operations the pipeline freezes. With help of the Scio maintainers we've been able to isolate the issue as likely originating in JdbcIO running out of connections in the connection pool and idling indefinitely. The issue occurs both on the Direct Runner and Dataflow.
> Please see linked issue for more context: https://github.com/spotify/scio/issues/2774



--
This message was sent by Atlassian Jira
(v8.3.4#803005)