[jira] [Created] (COMDEV-457) GSOC : Support sink to Clickhouse in Apache RocketMQ Streams

["Li Wei (Jira)" <ji...@apache.org>]

Li Wei created COMDEV-457:
-----------------------------

             Summary: GSOC : Support sink to Clickhouse in Apache RocketMQ Streams
                 Key: COMDEV-457
                 URL: https://issues.apache.org/jira/browse/COMDEV-457
             Project: Community Development
          Issue Type: New Feature
          Components: GSoC/Mentoring ideas
            Reporter: Li Wei


Apache RocketMQ™ is a unified messaging engine, lightweight data processing platform,
 * [Apache RocketMQ | https://rocketmq.apache.org]

Apache RocketMQ Streams is a Lightweight Streaming Project for RocketMQ , which can be deployed separately or in cluster mode.
Various types of data input and output: source supports RocketMQ while sink supports databases and RocketMQ, etc.
 * [Apache RocketMQ Streams | https://github.com/apache/rocketmq-streams]

ClickHouse® is a column-oriented database management system (DBMS) for online analytical processing of queries (OLAP). built by the creators of the fastest OLAP database on Earth

 * [ClickHouse | https://clickhouse.com/docs/en/]

- True Column-Oriented Database Management System
- Data Compression¶
- Disk Storage of Data
- Parallel Processing on Multiple Cores
- Distributed Processing on Multiple Servers
- SQL Support
- Vector Computation Engine
- Real-time Data Updates
- Primary Index 
- Secondary Indexes
- Suitable for Online Queries
- Support for Approximated Calculations
- Adaptive Join Algorithm
- Data Replication and Data Integrity Support
- Role-Based Access Control
- Features that Can Be Considered Disadvantages


The Clickhouse Sink in RocketMQ allows moving data from RocketMQ to Clickhouse. It writes data from topics in RocketMQ to tables in Clickhouse.

So, in this project, you need to implement a sink based on RocketMQ Streams API, and will executed on RocketMQ Streams runtime.

You should learn before applying for this topic
 - [Apache RocketMQ |https://rocketmq.apache.org/]
 - [Clickhouse Docs| https://clickhouse.com/docs/en/]
 - [Clickhouse on Github | https://github.com/ClickHouse/ClickHouse/]
 - [Apache RocketMQ Streams | https://github.com/apache/rocketmq-streams]

Mentor
 - [tigerlee@apache.org |mailto:tigerlee@apache.org]



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@community.apache.org
For additional commands, e-mail: dev-help@community.apache.org