You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Chamikara Madhusanka Jayalath (Jira)" <ji...@apache.org> on 2021/05/18 00:10:00 UTC
[jira] [Commented] (BEAM-10858) beam.io.jdbc not working on Google
Cloud Dataflow
[ https://issues.apache.org/jira/browse/BEAM-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17346505#comment-17346505 ]
Chamikara Madhusanka Jayalath commented on BEAM-10858:
------------------------------------------------------
I'll close this for now but please reopen if needed.
> beam.io.jdbc not working on Google Cloud Dataflow
> -------------------------------------------------
>
> Key: BEAM-10858
> URL: https://issues.apache.org/jira/browse/BEAM-10858
> Project: Beam
> Issue Type: Bug
> Components: cross-language, extensions-java-gcp, runner-py-interactive
> Affects Versions: 2.23.0
> Environment: Apache Beam 2.25.0.dev0 Jupyter Notebook running on Google Cloud Dataflow
> Reporter: Ehab El Badrawi
> Priority: P3
> Labels: Clarified, GCP, MySQL, cross-platform, dataflow, java, jdbc, python
>
> Using the JDBC python wrapper to connect to an external server is failing on Cloud Dataflow.
> The error produced is;
> RuntimeError: /root/apache-beam-custom/packages/beam/sdks/java/extensions/schemaio-expansion-service/build/libs/beam-sdks-java-extensions-schemaio-expansion-service-2.25.0-SNAPSHOT.jar not found. Please build the server with cd /root/apache-beam-custom/packages/beam; ./gradlew :sdks:java:extensions:schemaio-expansion-service:shadowJar
> You can recreate the issue by running the below
> {code:java}
> from apache_beam.io import jdbc
> jdbc.ReadFromJdbc(
> table_name='[tablename]',
> driver_class_name='com.mysql.cj.jdbc.Driver',
> jdbc_url='jdbc:mysql://[host]:3306/[databasename]',
> username='[username]',
> password='[password]'){code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)