You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Rahul Patwari (Jira)" <ji...@apache.org> on 2019/09/24 09:10:00 UTC

[jira] [Created] (BEAM-8307) Support for Logical types introduced by JdbcIO Transform in SqlTransform

Rahul Patwari created BEAM-8307:
-----------------------------------

             Summary: Support for Logical types introduced by JdbcIO Transform in SqlTransform
                 Key: BEAM-8307
                 URL: https://issues.apache.org/jira/browse/BEAM-8307
             Project: Beam
          Issue Type: Bug
          Components: dsl-sql
    Affects Versions: 2.15.0
            Reporter: Rahul Patwari
            Assignee: Rahul Patwari


An exception is thrown when SqlTransform is used with JdcIO. PFA - a file which contains the Exception StackTrace. 

Schema of the Source Table:

_CREATE TABLE actor (_
 _actor_id SMALLINT UNSIGNED NOT NULL AUTO_INCREMENT,_
 _first_name VARCHAR(45) NOT NULL,_
 _last_name VARCHAR(45) NOT NULL,_
 _last_update TIMESTAMP NOT NULL DEFAULT CURRENT_TIMESTAMP ON UPDATE CURRENT_TIMESTAMP,_
 _PRIMARY KEY (actor_id),_
 _KEY idx_actor_last_name (last_name)_
_)ENGINE=InnoDB DEFAULT CHARSET=utf8;_ 

 

Many of the Jdbc Types are converted to Logical_Types in Beam.

Refer: [https://github.com/apache/beam/blob/113461a4275eb28a101e416897ccd607aa51f83f/sdks/java/io/jdbc/src/main/java/org/apache/beam/sdk/io/jdbc/SchemaUtil.java#L102]

The initial observation is that this code: [https://github.com/apache/beam/blob/113461a4275eb28a101e416897ccd607aa51f83f/sdks/java/extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/impl/utils/CalciteUtils.java#L207] is returning null.

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)