[GitHub] [iotdb] choubenson opened a new pull request, #10105: [To rel/1.2][IOTDB-5972]Limit the number of all source files in compaction

["choubenson (via GitHub)" <gi...@apache.org>]

choubenson opened a new pull request, #10105:
URL: https://github.com/apache/iotdb/pull/10105

   Control the number of files of all compaction threads in the system to prevent too many open file handles.
   
   Now we have control the number of files in a single compaction task, but not strictly. For example, in cross-space compaction, if an unseq file has a large time span and overlaps with too many seq files, it is allowed to execute the task and may increase a huge number of open file handles. The improvement method is to control the total number of source files of the compaction threads in the system, check the number of files before the task starts, wait if it exceeds the threshold, and exit after timeout.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@iotdb.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [iotdb] xingtanzjr merged pull request #10105: [To rel/1.2][IOTDB-5972]Limit the number of all source files in compaction

["xingtanzjr (via GitHub)" <gi...@apache.org>]

xingtanzjr merged PR #10105:
URL: https://github.com/apache/iotdb/pull/10105


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@iotdb.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org