You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "zhi tang (Jira)" <ji...@apache.org> on 2021/03/21 16:17:00 UTC
[jira] [Commented] (IMPALA-10599) The coordinator should avoid
distributing query fragments to exception nodes.
[ https://issues.apache.org/jira/browse/IMPALA-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17305708#comment-17305708 ]
zhi tang commented on IMPALA-10599:
-----------------------------------
Because multi-component mixed deployment is a common practice in production environments, many internal and external factors can affect the health state of the executor (IO, memory, etc.). For example, many times due to an abnormal IO state of an executor, there will be a slow scan process, affecting the efficiency of the whole query.When query fragments are distributed to unhealthy executors, it is likely to result in slow queries.It is necessary for the coordinator to distribute the query fragments based on the health of the executor.
> The coordinator should avoid distributing query fragments to exception nodes.
> -----------------------------------------------------------------------------
>
> Key: IMPALA-10599
> URL: https://issues.apache.org/jira/browse/IMPALA-10599
> Project: IMPALA
> Issue Type: Improvement
> Components: Distributed Exec
> Affects Versions: Impala 3.2.0, Impala 3.4.0
> Environment: LSB Version: core-4.1-amd64
> Distributor ID: CentOS
> Description: CentOS release 7.4.1708.7
> Release: 7.4.1708.7
> impala version: 3.2.0
> Reporter: zhi tang
> Priority: Major
> Labels: features
>
> When I join[shuffle] with unbalanced fields, there will be data-skewed nodes during execution.This will result in the skewed node being under high load for a long time, because the query is likely to be endless.If other queries are committed or running during this time, they may be rejected or an exception thrown.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org