[jira] [Created] (COMDEV-411) Apache IoTDB: use netty as the memory buffer pool to reduce GC problem and take full use of memory

["Xiangdong Huang (Jira)" <ji...@apache.org>]

Xiangdong Huang created COMDEV-411:
--------------------------------------

             Summary: Apache IoTDB: use netty as the memory buffer pool to reduce GC problem and take full use of memory
                 Key: COMDEV-411
                 URL: https://issues.apache.org/jira/browse/COMDEV-411
             Project: Community Development
          Issue Type: Task
          Components: GSoC/Mentoring ideas
            Reporter: Xiangdong Huang


Apache IoTDB [1] is an Open Source IoT database designed to meet the rigorous data, storage, and analytics requirements of large-scale Internet of Things (IoT) and Industrial Internet of Things (IIoT) applications.

 

Memory control is very very important for DBMS.

 

Currently, we are using a customized memory buffer pool, which contains a pool of int[], a pool of long[], a pool of boolean[] and as well as float[] and double[].

 

However, there are two things left:
 # it is complex to implement a buffer pool for String[] or byte[][], as the size of String and byte[] are variable.
 # We are using HeapByteBuffer, while in many cases, directByteBuffer is more efficient.

As Netty has provided a high efficient buffer pool, we'd like to try to migrate the current buffer pool to the Netty implementation.

 

Things you should know:
 # Know Java well
 # Know Netty well
 # read codes of IoTDB (mainly in StorageEngine, StorageGroupProcessor and related classes)

 

 

 

 

 

 

 

 

 

 

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@community.apache.org
For additional commands, e-mail: dev-help@community.apache.org