Re: [PR] feat: Implement etcd-logger plugin [apisix]

["Baoyuantop (via GitHub)" <gi...@apache.org>]

Baoyuantop commented on PR #12631:
URL: https://github.com/apache/apisix/pull/12631#issuecomment-3327108205

   Hi @mdnfiras, do you need to use etcd as a logger? 
   
   Technically speaking, etcd is not suitable for log storage.
   
   Writes to etcd must undergo Raft consensus, requiring majority node confirmation for all write operations. This results in high write latency and limited throughput (suitable for configuration/metadata but unsuitable for high-frequency writes like logs). Log systems typically require thousands to millions of writes per second, which etcd cannot handle.
   
   When etcd's data volume becomes excessively large, performance degrades sharply and may even compromise cluster stability. The official recommendation is to keep data volumes at the GB level, whereas logs routinely reach TB/PB scales.
   
   etcd only supports range queries based on keys and lacks the search, filtering, and aggregation capabilities required for log analysis.
   
   Could you elaborate on your proposal?
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org