[GitHub] [iotdb] MiniSho opened a new pull request, #10715: [IOTDB-6088] Load: Optimize the schema creation process

["MiniSho (via GitHub)" <gi...@apache.org>]

MiniSho opened a new pull request, #10715:
URL: https://github.com/apache/iotdb/pull/10715

   ## Description
   The load phase loads all the schemas of one device into memory at once, which causes createMultiTimeseries to be too large when the amount of tsfile is huge.
   ![image](https://github.com/apache/iotdb/assets/42286868/b9a99736-47c2-4291-a2b7-ad288f4cc35f)
   
   ## Solution
   1. granularity changed from `devices` to `timeseries`
   2. set threshold to limit the number of timeseries when creating a schema once
   3. add logger to show the load progress info


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@iotdb.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [iotdb] SteveYurongSu merged pull request #10715: [IOTDB-6088] Load: Optimize the schema creation process & Avoid OOM and ratis createMultiTimeseriesPlan bufferSize too large

["SteveYurongSu (via GitHub)" <gi...@apache.org>]

SteveYurongSu merged PR #10715:
URL: https://github.com/apache/iotdb/pull/10715


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@iotdb.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org