You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Jingsong Lee (Jira)" <ji...@apache.org> on 2020/07/10 03:27:00 UTC

[jira] [Commented] (FLINK-18547) the filesystem sql connector can't work well

    [ https://issues.apache.org/jira/browse/FLINK-18547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17155067#comment-17155067 ] 

Jingsong Lee commented on FLINK-18547:
--------------------------------------

Discussed offline, not a problem.

> the filesystem sql connector can't work well
> --------------------------------------------
>
>                 Key: FLINK-18547
>                 URL: https://issues.apache.org/jira/browse/FLINK-18547
>             Project: Flink
>          Issue Type: Bug
>          Components: Connectors / FileSystem
>    Affects Versions: 1.11.0
>            Reporter: tinny cat
>            Priority: Critical
>
> The options ‘partition.time-extractor.kind’,‘partition.time-extractor.class’,‘partition.time-extractor.timestamp-pattern’ ,Configuration does not take effect,beacause the configurations are not associated with TableBucketAssigner. Resulting in failure to get the correct BucketId
> {code:sql}
> CREATE TABLE binlog_send_m (
>   binlog_tm BIGINT comment '数据库日志(binlog)写入时间',
>   extract_tm BIGINT comment '数据抽取时间',
>   db_operation STRING comment '数据库操作: INSERT,UPDATE,DELETE'
> ) PARTITIONED BY (extract_tm) WITH (
>   'connector'='filesystem',
>   'path' = '/path/wherver',
>   'format' = 'csv',
>   'partition.time-extractor.kind'='default',
>   'partition.time-extractor.timestamp-pattern'= '$extract_tm'
> )
> {code}
> The values of bukcketId are as follows:
> extract_tm = xxxxxxx
> extract_tm = xxxxx
> debuging in DefaultPartTimeExtractor, it is not be run.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)