[jira] [Assigned] (IOTDB-1020) [Distributed] Split the persist log buffer to better absorb ingestion

["Houliang Qi (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/IOTDB-1020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Houliang Qi reassigned IOTDB-1020:
----------------------------------

    Assignee: Houliang Qi

> [Distributed] Split the persist log buffer to better absorb ingestion
> ---------------------------------------------------------------------
>
>                 Key: IOTDB-1020
>                 URL: https://issues.apache.org/jira/browse/IOTDB-1020
>             Project: Apache IoTDB
>          Issue Type: Improvement
>            Reporter: Houliang Qi
>            Assignee: Houliang Qi
>            Priority: Major
>              Labels: pull-request-available
>
> In the current implementation, we provide only one persist raft log buffer for each SyncLogDequeSerializer, which means if the buffer is full, we will have to wait until the buffer is flushed before we can write the next log, thus creating spikes in ingestions.
> So, it is beneficial to split the WAL buffer into a working one and a flushing one, and if the last flush has completed before we ran out of the current working one, we can directly swap them, and continue writes.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)