[jira] [Created] (COMDEV-512) [GSoC][Doris] Supports BigQuery/Apache Kudu/Apache Cassandra/Apache Druid in Federated Queries

["Zhijing Lu (Jira)" <ji...@apache.org>]

Zhijing Lu created COMDEV-512:
---------------------------------

             Summary: [GSoC][Doris] Supports BigQuery/Apache Kudu/Apache Cassandra/Apache Druid in Federated Queries 
                 Key: COMDEV-512
                 URL: https://issues.apache.org/jira/browse/COMDEV-512
             Project: Community Development
          Issue Type: Task
          Components: GSoC/Mentoring ideas
            Reporter: Zhijing Lu


*Apache Doris*
Apache Doris is a real-time analytical database based on MPP architecture. As a unified platform that supports multiple data processing scenarios, it ensures high performance for low-latency and high-throughput queries, allows for easy federated queries on data lakes, and supports various data ingestion methods.
Page: https://doris.apache.org
Github: [https://github.com/apache/doris]
h3. *Background*
Apache Doris supports acceleration of queries on external data sources to meet users' needs for federated queries and analysis.
Currently, Apache Doris supports multiple external catalogs including those from Hive, Iceberg, Hudi, and JDBC. Developers can connect more data sources to Apache Doris based on a unified framework.
h4. *Objective*
 * 
Enable Apache Doris to access one or more of these data sources via the Multi-Catalog feature: BigQuery/Kudu/Cassandra/Druid;
 * 
Compile relevant documentation. See an example here: [https://doris.apache.org/docs/dev/lakehouse/multi-catalog/hive]

*Task*
{*}Phase One{*}:
 * 
Get familiar with the Multi-Catalog structure of Apache Doris, including the metadata synchronization mechanism in FE and the data reading mechanism of BE.
 * 
Investigate how metadata should be acquired and how data access works regarding the picked data source(s); produce the corresponding design documentation.

{*}Phase Two{*}:
 * Develop connections to the picked data source(s) and implement access to metadata and data.
h3. *Learning Material*

{*}Page{*}: [https://doris.apache.org|https://doris.apache.org/]
{*}Github{*}: [https://github.com/apache/doris]
h3. Mentor
 * Mentor: Mingyu Chen, Apache Doris PMC Member & Committer, [chenmingyu@apache.org |mailto:yangyongqiang@apache.org]
 * Mentor: Calvin Kirs, Apache Dolphinscheduler PMC & Committer, [CalvinKirs@apache.org|mailto:CalvinKirs@apache.org]
 * Mailing List: dev@doris.apache.org



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@community.apache.org
For additional commands, e-mail: dev-help@community.apache.org