You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@community.apache.org by "Maxim Solodovnik (Jira)" <ji...@apache.org> on 2023/03/13 04:58:00 UTC
[jira] [Updated] (COMDEV-511) [GSoC][Doris]Dictionary Encoding Acceleration
[ https://issues.apache.org/jira/browse/COMDEV-511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Maxim Solodovnik updated COMDEV-511:
------------------------------------
Labels: Doris Mentor full-time gsoc2023 (was: ApacheDoris Mentor full-time gsoc2023)
> [GSoC][Doris]Dictionary Encoding Acceleration
> ---------------------------------------------
>
> Key: COMDEV-511
> URL: https://issues.apache.org/jira/browse/COMDEV-511
> Project: Community Development
> Issue Type: Task
> Components: GSoC/Mentoring ideas
> Reporter: Zhijing Lu
> Priority: Major
> Labels: Doris, Mentor, full-time, gsoc2023
>
> *Apache Doris*
> Apache Doris is a real-time analytical database based on MPP architecture. As a unified platform that supports multiple data processing scenarios, it ensures high performance for low-latency and high-throughput queries, allows for easy federated queries on data lakes, and supports various data ingestion methods.
> {*}Page{*}: [https://doris.apache.org|https://doris.apache.org/]
> {*}Github{*}: [https://github.com/apache/doris]
> h3. *Background*
> In Apache Doris, dictionary encoding is performed during data writing and compaction. Dictionary encoding will be implemented on string data types by default. The dictionary size of a column for one segment is 1M at most. The dictionary encoding technology accelerates strings during queries, converting them into INT, for example.
>
> h3. *Task*
> * Phase One: Get familiar with the implementation of Apache Doris dictionary encoding; learning how Apache Doris dictionary encoding accelerates queries.
> * Phase Two: Evaluate the effectiveness of full dictionary encoding and figure out how to optimize memory in such a case.
> h3. *Learning Material*
> {*}Page{*}: [https://doris.apache.org|https://doris.apache.org/]
> {*}Github{*}: [https://github.com/apache/doris]
> h3. Mentor
> * Mentor: Chen Zhang, Apache Doris Committer, [zhangechen@apache.org |mailto:yangyongqiang@apache.org]
> * Mentor: Zhijing Lu, Apache Doris Committer, [luzhijing@apache.org|mailto:lihaopeng@apache.org]
> * Mailing List: dev@doris.apache.org
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@community.apache.org
For additional commands, e-mail: dev-help@community.apache.org