[jira] [Commented] (IOTDB-566) Apache IoTDB with Heterogeneous Replica [distributed]

["Jialin Qiao (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/IOTDB-566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17068659#comment-17068659 ] 

Jialin Qiao commented on IOTDB-566:
-----------------------------------

Hi, I'd like to work on this. Here is my proposal [https://docs.google.com/document/d/1sWa-6qLfrTfEqv8E5FodRe218n_3JzcI095g-dk03AE/edit]

> Apache IoTDB with Heterogeneous Replica  [distributed]
> ------------------------------------------------------
>
>                 Key: IOTDB-566
>                 URL: https://issues.apache.org/jira/browse/IOTDB-566
>             Project: Apache IoTDB
>          Issue Type: Task
>          Components: Core/Cluster
>            Reporter: Xiangdong Huang
>            Priority: Major
>              Labels: IoTDB, gsoc2020, mentor
>
> Apache IoTDB is a high-performance time-series database. Its cluster mode is in development. 
> As we know, IoTDB uses a columnar file format, called TsFile, which is similar with Parquet. In such a columnar file, the order of columns will impact the query performance hugely. We call the order of columns in the file as the physical layout of the file.
>  
> In the distributed version of IoTDB, the data is replicated multiple times for data reliability, and a read operation can be routed to any one of them such that the query load is spread across the nodes.
> If a query runs slowly on one node because of an unsuitable physical layout, rather than the overhead of the node, routing the query to other nodes is of no use. This is because the physical layout of the data on the disk on all nodes is the same.
>  
> The proposal is for:
> Accelerate queries by organizing different replicas into different layout according to the query history. 
> Then we need to:
>  * collect the query history and find out which queries are frequent;
>  * find an algorithm to get the best physical layout for the queries.
> It is totally predictable that this feature will improve the performance of IoTDB and make it unique with other distributed systems.
>  
> You need to know:
>  * Java
>  * Quorum based replica control
>  * Some stream algorithms
> Mentor:
> hxd@apache.org
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)