You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@iotdb.apache.org by GitBox <gi...@apache.org> on 2021/03/01 08:56:21 UTC

[GitHub] [iotdb] zhanglingzhe0820 opened a new pull request #2750: [To rel/0.11] cherry-pick [ISSUE-2746] Fix data overlapped bug after unseq compaction

zhanglingzhe0820 opened a new pull request #2750:
URL: https://github.com/apache/iotdb/pull/2750


   ## Behavior
   Unseq compaction causes the overlap of seq files which lead to out-of-order query.
   The query behaves like below.
   ![image](https://user-images.githubusercontent.com/24886743/109408656-66cb0a00-79c6-11eb-85b2-45ccb21ba4f5.png)
   
   ## Reason
   The unseq compaction selector tries to find unseq files which overlap with some unsealed files.
   
   However, the unsealed file's endTime is always Long.MIN_VALUE which will be ignored because [Long.MIN_VALUE, Long.MIN_VALUE) never overlap with other files .
   
   As a result, the unseq compaction can not select an overlapped file if the file is unsealed. In this case, the unseq file's remaining data will be appended to the end of the last sealed seq file which is overlapped with the unsealed file.
   
   ## Solution
   When selecting the overlapped seq files with an unseq file, if we encounter an unsealed seq file, the unseq file will be excluded from this unseq merge task.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [iotdb] qiaojialin merged pull request #2750: [To rel/0.11] cherry-pick [ISSUE-2746] Fix data overlapped bug after unseq compaction

Posted by GitBox <gi...@apache.org>.
qiaojialin merged pull request #2750:
URL: https://github.com/apache/iotdb/pull/2750


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org