You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Tim Armstrong (Jira)" <ji...@apache.org> on 2020/11/19 19:15:00 UTC
[jira] [Assigned] (IMPALA-9716) Add jitter to the exponential
backoff in status reporting
[ https://issues.apache.org/jira/browse/IMPALA-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tim Armstrong reassigned IMPALA-9716:
-------------------------------------
Assignee: Tim Armstrong (was: Thomas Tauber-Marshall)
> Add jitter to the exponential backoff in status reporting
> ---------------------------------------------------------
>
> Key: IMPALA-9716
> URL: https://issues.apache.org/jira/browse/IMPALA-9716
> Project: IMPALA
> Issue Type: Improvement
> Components: Distributed Exec
> Affects Versions: Impala 4.0
> Reporter: Thomas Tauber-Marshall
> Assignee: Tim Armstrong
> Priority: Major
> Fix For: Impala 4.0
>
>
> When status reports fail, we use exponential backoff when retrying sending them. However, currently the backoff is deterministic, leading to a thundering herd problem where all of the backends for a particular query may try to report at the same time, the coordinator is overwhelmed and rejects some of the rpcs, then the backends all backoff by the same amount and retry sending at the same time, leading the coordinator to be overwhelmed again.
> We can help solve this by adding some random jitter to the exponential backoff time.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org