You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@opendal.apache.org by "wcy-fdu (via GitHub)" <gi...@apache.org> on 2024/03/19 10:12:19 UTC
[I] How to monitor real write IO latency [opendal]
wcy-fdu opened a new issue, #4380:
URL: https://github.com/apache/opendal/issues/4380
Under current implementation, a writer will write into in memory buffer inside OpenDAL first, and writer will commit the buffer to real object storage when buffer reaches the specified size like 8MB. From a user perspective, observability is poor here. For example, if the writer continues to write small files for a period of time, what is observed is that the latency of a certain write is too high, but the specific details cannot be known.
A straightforward idea is to expose a metric to record the latency of each write operation, but under the current design, this metric and the real http request must be many-to-one.
Open this issue for more idea or discussion~
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] How to monitor real write IO latency [opendal]
Posted by "Xuanwo (via GitHub)" <gi...@apache.org>.
Xuanwo closed issue #4380: How to monitor real write IO latency
URL: https://github.com/apache/opendal/issues/4380
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] How to monitor real write IO latency [opendal]
Posted by "Xuanwo (via GitHub)" <gi...@apache.org>.
Xuanwo commented on issue #4380:
URL: https://github.com/apache/opendal/issues/4380#issuecomment-2047649677
Hi, as we discussed before. If you want do monitor real write IO latency, you can by pass opendal's buffer logic. In this way, every write API call will map to a real request.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org