You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@iotdb.apache.org by GitBox <gi...@apache.org> on 2021/08/18 03:59:26 UTC

[GitHub] [iotdb] HeimingZ opened a new pull request #3777: [IOTDB-1496][IOTDB-1569][To rel/0.12] Timed flush memtable & Timed close TsFileProcessor

HeimingZ opened a new pull request #3777:
URL: https://github.com/apache/iotdb/pull/3777


   If we open a TsFileProcessor and then never write to it, this TsFileProcessor will become a zombie because nothing can trigger a flush or close operation. So, i am implementing timed flush memtable [1] and timed close TsFileProcessor [2]. Timed flush memtable is used to flush inactive memtables periodically according to their created time. Timed close TsFileProcessor is used to close inactive TsFileProcessors&nbsp;periodically according to how long they don't process write operations.
   
   
   I add 9 params to control above two functions, and these 9 params all can be hot loaded by 'load configuration' command.
   
   
   1. enable_timed_flush_seq_memtable: whether to timed flush sequence tsfiles' memtables.
   2. seq_memtable_flush_interval_in_ms: when a sequence memTable's created time is older than current time minus this, the memtable is flushed to disk.
   3. seq_memtable_flush_check_interval_in_ms: the interval to check whether the sequence&nbsp;memtables need flushing.
   4. enable_timed_flush_unseq_memtable: whether to timed flush unsequence tsfiles' memtables.
   5. unseq_memtable_flush_interval_in_ms: when an unsequence memTable's created time is older than current time minus this, the memtable is flushed to disk.
   6. unseq_memtable_flush_check_interval_in_ms: the interval to check whether the unsequence&nbsp;memtables need flushing.
   7. enable_timed_close_tsfile: whether to timed close TsfileProcessors.
   8. close_tsfile_interval_after_flushing_in_ms: when TsfileProcessor's last working memtable flush time is older than current time minus this and its working memtable is null, this TsfileProcessor will be closed.
   9. close_tsfile_check_interval_in_ms: the interval to check whether the TsfileProcessors&nbsp;need closing.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@iotdb.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [iotdb] HeimingZ commented on pull request #3777: [IOTDB-1496][IOTDB-1569][To rel/0.12] Timed flush memtable & Timed close TsFileProcessor

Posted by GitBox <gi...@apache.org>.
HeimingZ commented on pull request #3777:
URL: https://github.com/apache/iotdb/pull/3777#issuecomment-901874589


   > Update the release note?
   
   Updated.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@iotdb.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [iotdb] HTHou commented on pull request #3777: [IOTDB-1496][IOTDB-1569][To rel/0.12] Timed flush memtable & Timed close TsFileProcessor

Posted by GitBox <gi...@apache.org>.
HTHou commented on pull request #3777:
URL: https://github.com/apache/iotdb/pull/3777#issuecomment-901846740


   Update the release note?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@iotdb.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [iotdb] qiaojialin merged pull request #3777: [IOTDB-1496][IOTDB-1569][To rel/0.12] Timed flush memtable & Timed close TsFileProcessor

Posted by GitBox <gi...@apache.org>.
qiaojialin merged pull request #3777:
URL: https://github.com/apache/iotdb/pull/3777


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@iotdb.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org