You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@impala.apache.org by "Michael Smith (Jira)" <ji...@apache.org> on 2024/06/03 23:36:00 UTC

[jira] [Created] (IMPALA-13130) Under heavy load, Impala does not prioritize data stream operations

Michael Smith created IMPALA-13130:
--------------------------------------

             Summary: Under heavy load, Impala does not prioritize data stream operations
                 Key: IMPALA-13130
                 URL: https://issues.apache.org/jira/browse/IMPALA-13130
             Project: IMPALA
          Issue Type: Bug
            Reporter: Michael Smith


Under heavy load - where Impala reaches max memory for the DataStreamService and applies backpressure via https://github.com/apache/impala/blob/4.4.0/be/src/rpc/impala-service-pool.cc#L191-L199 - DataStreamService does not differentiate between types of requests and may reject requests that could help reduce load.

The DataStreamService deals with TransmitData, PublishFilter, UpdateFilter, UpdateFilterFromRemote, and EndDataStream. It seems like we should prioritize completing EndDataStream, especially under heavy load, to complete work and release resources more quickly.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)