You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Ritesh Ghorse (Jira)" <ji...@apache.org> on 2022/01/21 22:55:00 UTC
[jira] [Created] (BEAM-13717) Can't use java logical types defined in Java JDBC IO in XLang JDBC pipeline for Go and Python
Ritesh Ghorse created BEAM-13717:
------------------------------------
Summary: Can't use java logical types defined in Java JDBC IO in XLang JDBC pipeline for Go and Python
Key: BEAM-13717
URL: https://issues.apache.org/jira/browse/BEAM-13717
Project: Beam
Issue Type: Bug
Components: io-java-jdbc
Reporter: Ritesh Ghorse
Currently, we can't use the logical types defined in [java JDBC IO|[https://github.com/apache/beam/blob/master/sdks/java/io/jdbc/src/main/java/org/apache/beam/sdk/io/jdbc/LogicalTypes.java]] in XLang pipelines for JDBC IO in Go SDK as it throws the following error:
{code:java}
unmarshalling coder jFYvjSCanTRowCoder_length_prefixed_windowed
unmarshalling coder jFYvjSCanTRowCoder_length_prefixed
cannot convert schema field role_name to field
caused by:
unknown logical type: beam:logical_type:javasdk:v1 {code}
This is the structure of table and its corresponding struct:
{code:java}
// roles=> CREATE TABLE roles(
// role_id serial PRIMARY KEY,
// role_name VARCHAR (255) UNIQUE
// );
type JdbcTestRow struct {
Role_id int32 `beam:"role_id"`
Role_name string `beam:"role_name"`
} {code}
Similar error seems to be appearing on Python SDK pipeline based on this stack overflow question: ([https://stackoverflow.com/questions/68758361/error-beamlogical-typejavasdkv1-while-using-apache-beam-io-jdbc-readfromjdbc])
--
This message was sent by Atlassian Jira
(v8.20.1#820001)