You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Michael Ho (JIRA)" <ji...@apache.org> on 2018/10/18 18:47:00 UTC
[jira] [Resolved] (IMPALA-1717) Reduce backend TCP connections
per-node to be independent of the number of backends
[ https://issues.apache.org/jira/browse/IMPALA-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Michael Ho resolved IMPALA-1717.
--------------------------------
Resolution: Duplicate
Fix Version/s: Impala 2.12.0
> Reduce backend TCP connections per-node to be independent of the number of backends
> -----------------------------------------------------------------------------------
>
> Key: IMPALA-1717
> URL: https://issues.apache.org/jira/browse/IMPALA-1717
> Project: IMPALA
> Issue Type: New Feature
> Components: Distributed Exec
> Affects Versions: Impala 2.1
> Reporter: Henry Robinson
> Priority: Minor
> Labels: performance
> Fix For: Impala 2.12.0
>
>
> We currently use up to {{|nodes|*|fragments|}} TCP connections per backend. Eventually, we should use a fixed number of connections over which all data stream sending can be multiplexed, but we will probably need to move away from Thrift before that happens, because we will need non-blocking IO to avoid deadlocks.
> In the meantime, we can use a fixed-size thread-pool per fragment, and at least only be linear in the number of fragments.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org