You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Chamikara Madhusanka Jayalath (Jira)" <ji...@apache.org> on 2021/05/18 00:10:00 UTC

[jira] [Commented] (BEAM-10858) beam.io.jdbc not working on Google Cloud Dataflow

    [ https://issues.apache.org/jira/browse/BEAM-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17346505#comment-17346505 ] 

Chamikara Madhusanka Jayalath commented on BEAM-10858:
------------------------------------------------------

I'll close this for now but please reopen if needed.

> beam.io.jdbc not working on Google Cloud Dataflow
> -------------------------------------------------
>
>                 Key: BEAM-10858
>                 URL: https://issues.apache.org/jira/browse/BEAM-10858
>             Project: Beam
>          Issue Type: Bug
>          Components: cross-language, extensions-java-gcp, runner-py-interactive
>    Affects Versions: 2.23.0
>         Environment: Apache Beam 2.25.0.dev0 Jupyter Notebook running on Google Cloud Dataflow
>            Reporter: Ehab El Badrawi
>            Priority: P3
>              Labels: Clarified, GCP, MySQL, cross-platform, dataflow, java, jdbc, python
>
> Using the JDBC python wrapper to connect to an external server is failing on Cloud Dataflow.
> The error produced is;
> RuntimeError: /root/apache-beam-custom/packages/beam/sdks/java/extensions/schemaio-expansion-service/build/libs/beam-sdks-java-extensions-schemaio-expansion-service-2.25.0-SNAPSHOT.jar not found. Please build the server with cd /root/apache-beam-custom/packages/beam; ./gradlew :sdks:java:extensions:schemaio-expansion-service:shadowJar
> You can recreate the issue by running the below
> {code:java}
> from apache_beam.io import jdbc
> jdbc.ReadFromJdbc(
>  table_name='[tablename]',
>  driver_class_name='com.mysql.cj.jdbc.Driver',
>  jdbc_url='jdbc:mysql://[host]:3306/[databasename]',
>  username='[username]',
>  password='[password]'){code}
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)