You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Rahul Patwari (Jira)" <ji...@apache.org> on 2019/09/24 09:10:00 UTC
[jira] [Created] (BEAM-8307) Support for Logical types introduced
by JdbcIO Transform in SqlTransform
Rahul Patwari created BEAM-8307:
-----------------------------------
Summary: Support for Logical types introduced by JdbcIO Transform in SqlTransform
Key: BEAM-8307
URL: https://issues.apache.org/jira/browse/BEAM-8307
Project: Beam
Issue Type: Bug
Components: dsl-sql
Affects Versions: 2.15.0
Reporter: Rahul Patwari
Assignee: Rahul Patwari
An exception is thrown when SqlTransform is used with JdcIO. PFA - a file which contains the Exception StackTrace.
Schema of the Source Table:
_CREATE TABLE actor (_
_actor_id SMALLINT UNSIGNED NOT NULL AUTO_INCREMENT,_
_first_name VARCHAR(45) NOT NULL,_
_last_name VARCHAR(45) NOT NULL,_
_last_update TIMESTAMP NOT NULL DEFAULT CURRENT_TIMESTAMP ON UPDATE CURRENT_TIMESTAMP,_
_PRIMARY KEY (actor_id),_
_KEY idx_actor_last_name (last_name)_
_)ENGINE=InnoDB DEFAULT CHARSET=utf8;_
Many of the Jdbc Types are converted to Logical_Types in Beam.
Refer: [https://github.com/apache/beam/blob/113461a4275eb28a101e416897ccd607aa51f83f/sdks/java/io/jdbc/src/main/java/org/apache/beam/sdk/io/jdbc/SchemaUtil.java#L102]
The initial observation is that this code: [https://github.com/apache/beam/blob/113461a4275eb28a101e416897ccd607aa51f83f/sdks/java/extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/impl/utils/CalciteUtils.java#L207] is returning null.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)