You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@iotdb.apache.org by Wei Shao <ko...@163.com> on 2020/09/08 09:52:05 UTC
[IOTDB-829] Accelerate delete timeseries
Hi,
I am currently working on JIRA issue: [1].
When deleting data from multiple timeseries, a successful deletion will leave a record in mods file for each timeseries.
Suppose we executing "delete from root.sg1.d1.*" or "delete timeseries root.sg1.d1.* " when d1 contains N measurements.
We would write at most N lines of records in each mods file, however, this may cause performance issue if N is very large.
My optimization plan is:
In Mods files, we record exact the same path string that user specified. For example, "delete from root.sg1.d1.sd1.*" will write "root.sg1.d1.sd1.*" into mods file as path.
In this way, for each timeseries path in delete statement, we access each Mods file once at most.
As a tradeoff, a path string matching is needed during query, to check if the timeseries has any modifications in mods files.
Any suggestions are welcome.
Thanks,
[1] https://issues.apache.org/jira/projects/IOTDB/issues/IOTDB-829?
---------------------
Wei Shao