You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@kylin.apache.org by "Dayue Gao (JIRA)" <ji...@apache.org> on 2017/09/05 08:29:00 UTC

[jira] [Created] (KYLIN-2847) avoid doing useless work by checking query deadline

Dayue Gao created KYLIN-2847:
--------------------------------

             Summary: avoid doing useless work by checking query deadline
                 Key: KYLIN-2847
                 URL: https://issues.apache.org/jira/browse/KYLIN-2847
             Project: Kylin
          Issue Type: Improvement
          Components: Query Engine, Storage - HBase
    Affects Versions: v2.1.0
            Reporter: Dayue Gao
            Assignee: Dayue Gao


Under high load, requests can spend a long time waiting in RPC queue, probably longer than query timeout. However, current coprocessor timeout mechanism doesn't take RPC queue time into account. As a result, handling these requests not only waste server resources while doing nothing useful, but can also cause cascading failure when server crashes and client retries.

To recover from server overload ASAP, we should check query deadline at each stages of query processing, and avoid spending resources on query that will exceed their deadline.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)