You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Ritesh Ghorse (Jira)" <ji...@apache.org> on 2022/01/21 22:55:00 UTC

[jira] [Created] (BEAM-13717) Can't use java logical types defined in Java JDBC IO in XLang JDBC pipeline for Go and Python

Ritesh Ghorse created BEAM-13717:
------------------------------------

             Summary: Can't use java logical types defined in Java JDBC IO in XLang JDBC pipeline for Go and Python
                 Key: BEAM-13717
                 URL: https://issues.apache.org/jira/browse/BEAM-13717
             Project: Beam
          Issue Type: Bug
          Components: io-java-jdbc
            Reporter: Ritesh Ghorse


Currently, we can't use the logical types defined in [java JDBC IO|[https://github.com/apache/beam/blob/master/sdks/java/io/jdbc/src/main/java/org/apache/beam/sdk/io/jdbc/LogicalTypes.java]] in XLang pipelines for JDBC IO in Go SDK as it throws the following error:
{code:java}
  unmarshalling coder jFYvjSCanTRowCoder_length_prefixed_windowed
        unmarshalling coder jFYvjSCanTRowCoder_length_prefixed
cannot convert schema field role_name to field
        caused by:
unknown logical type: beam:logical_type:javasdk:v1 {code}
This is the structure of table and its corresponding struct:
{code:java}
// roles=> CREATE TABLE roles(
//         role_id serial PRIMARY KEY,
//         role_name VARCHAR (255) UNIQUE
//  );

type JdbcTestRow struct {
        Role_id   int32  `beam:"role_id"`
        Role_name string `beam:"role_name"`
} {code}
Similar error seems to be appearing on Python SDK pipeline based on this stack overflow question: ([https://stackoverflow.com/questions/68758361/error-beamlogical-typejavasdkv1-while-using-apache-beam-io-jdbc-readfromjdbc])



--
This message was sent by Atlassian Jira
(v8.20.1#820001)