You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Rahul Patwari (Jira)" <ji...@apache.org> on 2019/09/24 09:11:00 UTC

[jira] [Updated] (BEAM-8307) Support for Logical types introduced by JdbcIO Transform in SqlTransform

     [ https://issues.apache.org/jira/browse/BEAM-8307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rahul Patwari updated BEAM-8307:
--------------------------------
    Attachment: exception.txt

> Support for Logical types introduced by JdbcIO Transform in SqlTransform
> ------------------------------------------------------------------------
>
>                 Key: BEAM-8307
>                 URL: https://issues.apache.org/jira/browse/BEAM-8307
>             Project: Beam
>          Issue Type: Bug
>          Components: dsl-sql
>    Affects Versions: 2.15.0
>            Reporter: Rahul Patwari
>            Assignee: Rahul Patwari
>            Priority: Major
>         Attachments: exception.txt
>
>
> An exception is thrown when SqlTransform is used with JdcIO. PFA - a file which contains the Exception StackTrace. 
> Schema of the Source Table:
> _CREATE TABLE actor (_
>  _actor_id SMALLINT UNSIGNED NOT NULL AUTO_INCREMENT,_
>  _first_name VARCHAR(45) NOT NULL,_
>  _last_name VARCHAR(45) NOT NULL,_
>  _last_update TIMESTAMP NOT NULL DEFAULT CURRENT_TIMESTAMP ON UPDATE CURRENT_TIMESTAMP,_
>  _PRIMARY KEY (actor_id),_
>  _KEY idx_actor_last_name (last_name)_
> _)ENGINE=InnoDB DEFAULT CHARSET=utf8;_ 
>  
> Many of the Jdbc Types are converted to Logical_Types in Beam.
> Refer: [https://github.com/apache/beam/blob/113461a4275eb28a101e416897ccd607aa51f83f/sdks/java/io/jdbc/src/main/java/org/apache/beam/sdk/io/jdbc/SchemaUtil.java#L102]
> The initial observation is that this code: [https://github.com/apache/beam/blob/113461a4275eb28a101e416897ccd607aa51f83f/sdks/java/extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/impl/utils/CalciteUtils.java#L207] is returning null.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)