You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bahir.apache.org by "liufangliang (Jira)" <ji...@apache.org> on 2020/05/27 06:42:00 UTC
[jira] [Created] (BAHIR-234) add ClickHouse Connector for Flink
liufangliang created BAHIR-234:
----------------------------------
Summary: add ClickHouse Connector for Flink
Key: BAHIR-234
URL: https://issues.apache.org/jira/browse/BAHIR-234
Project: Bahir
Issue Type: New Feature
Components: Flink Streaming Connectors
Affects Versions: Flink-1.0
Reporter: liufangliang
[ClickHouse website : https://clickhouse.tech/|https://clickhouse.tech/]
ClickHouse is a column-oriented database management system (DBMS) for online analytical processing of queries (OLAP)
we can add flink connector for ClickHouse，including Streaming Implement & Table API & SQL.
CREATE TABLE test (
d BIGINT,
s VARCHAR(10)
) WITH (
'connector.properties.bootstrap.servers'='localhost:9092',
'connector.properties.group.id'='testclickhouse',
'connector.properties.zookeeper.connect'='localhost:2181',
'connector.startup-mode'='latest-offset',
'connector.topic'='flinksql',
'connector.type'='kafka',
'connector.version'='universal',
'format.type'='json',
'format.derive-schema' = 'true',
'update-mode'='append'
);
CREATE TABLE test2 (
usrname STRING,
size BIGINT
) WITH (
'connector.type'='clickhouse',
'connector.version'='1',
'connector.property-version'='1',
'connector.address'='localhost:8123',
'connector.database'='test',
'connector.table'='insert_test',
'connector.username'='admin',
'connector.password'='admin',
'connector.commit.batch.size'='1',
'connector.commit.padding'='2000',
'connector.commit.retry.attempts'='3',
'connector.commit.retry.interval'='3000',
'connector.commit.ignore.error'='FALSE'
);
insert into test2 select s as usrname ,d as size from test ;
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
Re: [jira] [Created] (BAHIR-234) add ClickHouse Connector for Flink
Posted by 刘方亮 <li...@gmail.com>.
Is there a discussion ? I am ready to complete this feature
> 在 2020年5月27日，下午2:42，liufangliang (Jira) <ji...@apache.org> 写道：
>
> liufangliang created BAHIR-234:
> ----------------------------------
>
> Summary: add ClickHouse Connector for Flink
> Key: BAHIR-234
> URL: https://issues.apache.org/jira/browse/BAHIR-234
> Project: Bahir
> Issue Type: New Feature
> Components: Flink Streaming Connectors
> Affects Versions: Flink-1.0
> Reporter: liufangliang
>
>
> [ClickHouse website : https://clickhouse.tech/|https://clickhouse.tech/]
>
> ClickHouse is a column-oriented database management system (DBMS) for online analytical processing of queries (OLAP)
>
> we can add flink connector for ClickHouse，including Streaming Implement & Table API & SQL.
>
>
> CREATE TABLE test (
> d BIGINT,
> s VARCHAR(10)
> ) WITH (
> 'connector.properties.bootstrap.servers'='localhost:9092',
> 'connector.properties.group.id'='testclickhouse',
> 'connector.properties.zookeeper.connect'='localhost:2181',
> 'connector.startup-mode'='latest-offset',
> 'connector.topic'='flinksql',
> 'connector.type'='kafka',
> 'connector.version'='universal',
> 'format.type'='json',
> 'format.derive-schema' = 'true',
> 'update-mode'='append'
> );
>
> CREATE TABLE test2 (
> usrname STRING,
> size BIGINT
>
> ) WITH (
> 'connector.type'='clickhouse',
> 'connector.version'='1',
> 'connector.property-version'='1',
> 'connector.address'='localhost:8123',
> 'connector.database'='test',
> 'connector.table'='insert_test',
> 'connector.username'='admin',
> 'connector.password'='admin',
> 'connector.commit.batch.size'='1',
> 'connector.commit.padding'='2000',
> 'connector.commit.retry.attempts'='3',
> 'connector.commit.retry.interval'='3000',
> 'connector.commit.ignore.error'='FALSE'
> );
>
> insert into test2 select s as usrname ,d as size from test ;
>
>
>
>
>
> --
> This message was sent by Atlassian Jira
> (v8.3.4#803005)