You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@community.apache.org by "Li Wei (Jira)" <ji...@apache.org> on 2022/03/15 14:52:00 UTC

[jira] [Updated] (COMDEV-457) GSOC : Support connect to Clickhouse in Apache RocketMQ Streams

     [ https://issues.apache.org/jira/browse/COMDEV-457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Li Wei updated COMDEV-457:
--------------------------
    Summary: GSOC : Support connect to Clickhouse in Apache RocketMQ Streams  (was: GSOC : Support sink to Clickhouse in Apache RocketMQ Streams)

> GSOC : Support connect to Clickhouse in Apache RocketMQ Streams
> ---------------------------------------------------------------
>
>                 Key: COMDEV-457
>                 URL: https://issues.apache.org/jira/browse/COMDEV-457
>             Project: Community Development
>          Issue Type: New Feature
>          Components: GSoC/Mentoring ideas
>            Reporter: Li Wei
>            Priority: Major
>              Labels: Clickhouse, RocketMQ, Sink, gsoc2022, mentor
>
> Apache RocketMQ™ is a unified messaging engine, lightweight data processing platform,
>  * [Apache RocketMQ | https://rocketmq.apache.org]
> Apache RocketMQ Streams is a Lightweight Streaming Project for RocketMQ , which can be deployed separately or in cluster mode.
> Various types of data input and output: source supports RocketMQ while sink supports databases and RocketMQ, etc.
>  * [Apache RocketMQ Streams | https://github.com/apache/rocketmq-streams]
> ClickHouse® is a column-oriented database management system (DBMS) for online analytical processing of queries (OLAP). built by the creators of the fastest OLAP database on Earth
>  * [ClickHouse | https://clickhouse.com/docs/en/]
> - True Column-Oriented Database Management System
> - Data Compression¶
> - Disk Storage of Data
> - Parallel Processing on Multiple Cores
> - Distributed Processing on Multiple Servers
> - SQL Support
> - Vector Computation Engine
> - Real-time Data Updates
> - Primary Index 
> - Secondary Indexes
> - Suitable for Online Queries
> - Support for Approximated Calculations
> - Adaptive Join Algorithm
> - Data Replication and Data Integrity Support
> - Role-Based Access Control
> - Features that Can Be Considered Disadvantages
> The Clickhouse Sink in RocketMQ allows moving data from RocketMQ to Clickhouse. It writes data from topics in RocketMQ to tables in Clickhouse.
> So, in this project, you need to implement a sink based on RocketMQ Streams API, and will executed on RocketMQ Streams runtime.
> You should learn before applying for this topic
>  - [Apache RocketMQ |https://rocketmq.apache.org/]
>  - [Clickhouse Docs| https://clickhouse.com/docs/en/]
>  - [Clickhouse on Github | https://github.com/ClickHouse/ClickHouse/]
>  - [Apache RocketMQ Streams | https://github.com/apache/rocketmq-streams]
> Mentor
>  - [tigerlee@apache.org |mailto:tigerlee@apache.org]



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@community.apache.org
For additional commands, e-mail: dev-help@community.apache.org