You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by GitBox <gi...@apache.org> on 2022/09/27 17:02:56 UTC

[GitHub] [pinot] lakshmanan-v opened a new issue, #9473: Add protections to limit the impact of rogue queries

lakshmanan-v opened a new issue, #9473:
URL: https://github.com/apache/pinot/issues/9473

   When a rogue query does an expensive/resource intensive operations (full table scan on a very large table), it may consume more resources and affect the health of the servers (out of memory, high cpu etc). The effects are more pronounced when multiple bad queries land around the same time window.
   
   We could add some protection at table level to limit the max segments (count / %) scanned per query.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


[GitHub] [pinot] mcvsubbu commented on issue #9473: Add protections to limit the impact of rogue queries

Posted by GitBox <gi...@apache.org>.
mcvsubbu commented on issue #9473:
URL: https://github.com/apache/pinot/issues/9473#issuecomment-1259800111

   cc: @vvivekiyer , @siddharthteotia 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


[GitHub] [pinot] vvivekiyer commented on issue #9473: Add protections to limit the impact of rogue queries

Posted by GitBox <gi...@apache.org>.
vvivekiyer commented on issue #9473:
URL: https://github.com/apache/pinot/issues/9473#issuecomment-1259802063

   cc: @jasperjiaguo  and @siddharthteotia 
   We have an on-going effort where we try to protect the cluster from such cases to improve resiliency. Please refer to issues #9055 and #8618 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


[GitHub] [pinot] lakshmanan-v commented on issue #9473: Add protections to limit the impact of rogue queries

Posted by GitBox <gi...@apache.org>.
lakshmanan-v commented on issue #9473:
URL: https://github.com/apache/pinot/issues/9473#issuecomment-1259797880

   cc @elonazoulay @weixiangsun 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


[GitHub] [pinot] siddharthteotia commented on issue #9473: Add protections to limit the impact of rogue queries

Posted by "siddharthteotia (via GitHub)" <gi...@apache.org>.
siddharthteotia commented on issue #9473:
URL: https://github.com/apache/pinot/issues/9473#issuecomment-1411641054

   Support for query killing on brokers and servers has been completed as part of https://github.com/apache/pinot/issues/9055


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org