You are viewing a plain text version of this content. The canonical link for it is here.

Posted to reviews@iotdb.apache.org by GitBox <gi...@apache.org> on 2021/07/06 10:18:28 UTC

[GitHub] [iotdb] zhanglingzhe0820 opened a new pull request #3515: [IOTDB-1469][To rel/0.12]fix cross space compaction loss data bug

zhanglingzhe0820 opened a new pull request #3515:
URL: https://github.com/apache/iotdb/pull/3515


   # Behavior
   Some data lost after cross space compaction.
   Before compaction:
   ![image](https://user-images.githubusercontent.com/24886743/124583393-92cf2e00-de85-11eb-8c63-bc8c94507d18.png)
   After compaction:
   ![image](https://user-images.githubusercontent.com/24886743/124583426-9a8ed280-de85-11eb-8023-60ff33336951.png)
   Use the data below and execute cross space compaction can reproduce this problem.
   https://cloud.tsinghua.edu.cn/f/4c320559a2574ca9b0d5/?dl=1
   
   # Problem
   In cross compaction, there is a logic: If none of the seq files has a timeseries, then data of this timeseries will be compacted into the last seq file. However, if the seq file miss the device of the timeseries, all these logic will be passed.
   e.g.
   compact 3 seqFile and 1 unseqFile
   seqFile1: d1.s1:0-100 d1.s2:0-100
   seqFile2: d1.s1:100-200
   seqFile3: d2.s1:0-100
   unseqFile1: d1.s3:0-100
   the d1.s3 in unseqFile1 will loss.
   
   # Solution
   1. Even the seq file miss the device of the timeseries, do not return.
   2. Solve a bug of filterNoDataPaths.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@iotdb.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [iotdb] mychaow merged pull request #3515: [IOTDB-1469][To rel/0.12]fix cross space compaction loss data bug

Posted by GitBox <gi...@apache.org>.

mychaow merged pull request #3515:
URL: https://github.com/apache/iotdb/pull/3515


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@iotdb.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org