You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@iotdb.apache.org by "MiniSho (via GitHub)" <gi...@apache.org> on 2023/08/19 03:24:57 UTC
[GitHub] [iotdb] MiniSho opened a new pull request, #10913: [IOTDB-6123] Pipe: Optimize the slow transfer problem of log mode
MiniSho opened a new pull request, #10913:
URL: https://github.com/apache/iotdb/pull/10913
## Description
As you can see from the graph, WAL's serialization and deserialization consume a lot of CPU, about 25%, which becomes the focus of our optimization attention.
<img width="1713" alt="image" src="https://github.com/apache/iotdb/assets/42286868/e45d0d1b-0702-4c4e-8d8e-34b0a2e61e40">
## Solution
We perform the following optimizations for log mode:
* When no pattern is set, i.e., the extractor's default pattern is used, we don't need to serialize and deserialize the WAL, but instead transfer the read binary data directly to the receiver
* Expansion of allocated memory
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@iotdb.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [iotdb] SteveYurongSu merged pull request #10913: [IOTDB-6123] Pipe: reduce the de/ser to slove the slow log transfer problem
Posted by "SteveYurongSu (via GitHub)" <gi...@apache.org>.
SteveYurongSu merged PR #10913:
URL: https://github.com/apache/iotdb/pull/10913
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@iotdb.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [iotdb] SzyWilliam commented on pull request #10913: [IOTDB-6123] Pipe: Optimize the slow transfer problem of log mode
Posted by "SzyWilliam (via GitHub)" <gi...@apache.org>.
SzyWilliam commented on PR #10913:
URL: https://github.com/apache/iotdb/pull/10913#issuecomment-1685022742
MPGA!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@iotdb.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [iotdb] Cpaulyz commented on pull request #10913: [IOTDB-6123] Pipe: Optimize the slow transfer problem of log mode
Posted by "Cpaulyz (via GitHub)" <gi...@apache.org>.
Cpaulyz commented on PR #10913:
URL: https://github.com/apache/iotdb/pull/10913#issuecomment-1685470558
MPGA!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@iotdb.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org