Re: [I] [multistage] Add Features to Detect Queries Causing High CPU or Heap Utilization [pinot]

["jadami10 (via GitHub)" <gi...@apache.org>]

jadami10 commented on issue #16705:
URL: https://github.com/apache/pinot/issues/16705#issuecomment-3246732998

   Our plan is to proxy all queries through 1 service and try to use "fingerprints" to block/identify the root cause. Inspired from how you all have approached this.
   
   It could also be done inside Pinot itself. It's mainly an anomaly detection problem. But given the high QPS we run with, adding more logs is unlikely to be productive. At some point, you can only do so much with semi-structured text regardless of what logging vendor you are using. And it's harder to respond in near-realtime.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org