You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Brian Hulette (Jira)" <ji...@apache.org> on 2022/04/21 00:20:00 UTC

[jira] [Commented] (BEAM-13717) Can't use java logical types defined in Java JDBC IO in XLang JDBC pipeline for Go and Python

    [ https://issues.apache.org/jira/browse/BEAM-13717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525353#comment-17525353 ] 

Brian Hulette commented on BEAM-13717:
--------------------------------------

If all of those logical types are necessary to represent types in JDBC, I think we'll just need to specify URNs for them and add implementations for them in the other SDKs.

> Can't use java logical types defined in Java JDBC IO in XLang JDBC pipeline for Go and Python
> ---------------------------------------------------------------------------------------------
>
>                 Key: BEAM-13717
>                 URL: https://issues.apache.org/jira/browse/BEAM-13717
>             Project: Beam
>          Issue Type: Bug
>          Components: io-java-jdbc
>            Reporter: Ritesh Ghorse
>            Assignee: Pablo Estrada
>            Priority: P2
>
> Currently, we can't use the logical types defined in [java JDBC IO|https://github.com/apache/beam/blob/master/sdks/java/io/jdbc/src/main/java/org/apache/beam/sdk/io/jdbc/LogicalTypes.java] in XLang pipelines for JDBC IO in Go SDK as it throws the following error:
> {code:java}
>   unmarshalling coder jFYvjSCanTRowCoder_length_prefixed_windowed
>         unmarshalling coder jFYvjSCanTRowCoder_length_prefixed
> cannot convert schema field role_name to field
>         caused by:
> unknown logical type: beam:logical_type:javasdk:v1 {code}
> This is the structure of table and its corresponding struct:
> {code:java}
> // roles=> CREATE TABLE roles(
> //         role_id serial PRIMARY KEY,
> //         role_name VARCHAR (255) UNIQUE
> //  );
> type JdbcTestRow struct {
>         Role_id   int32  `beam:"role_id"`
>         Role_name string `beam:"role_name"`
> } {code}
> Similar error seems to be appearing on Python SDK pipeline based on this stack overflow question: ([https://stackoverflow.com/questions/68758361/error-beamlogical-typejavasdkv1-while-using-apache-beam-io-jdbc-readfromjdbc])



--
This message was sent by Atlassian Jira
(v8.20.7#820007)