[jira] [Created] (IMPALA-12358) Skip scheduling runtime filter that unlikely to meet RUNTIME_FILTER_WAIT_TIME_MS constraint

["Riza Suminto (Jira)" <ji...@apache.org>]

Riza Suminto created IMPALA-12358:
-------------------------------------

             Summary: Skip scheduling runtime filter that unlikely to meet RUNTIME_FILTER_WAIT_TIME_MS constraint
                 Key: IMPALA-12358
                 URL: https://issues.apache.org/jira/browse/IMPALA-12358
             Project: IMPALA
          Issue Type: Improvement
          Components: Frontend
            Reporter: Riza Suminto


A scan node will wait for a runtime filter arrival for [RUNTIME_FILTER_WAIT_TIME_MS|https://impala.apache.org/docs/build/html/topics/impala_runtime_filter_wait_time_ms.html]. If the runtime filter is not arrived within this period, the scan node will stop waiting and start scanning. Late runtime filter can still be applied if the scanning has not finished yet upon filter arrival. However, planner should predict to some degree if a certain runtime filter is likely to be late. If it does, then skip scheduling such a filter.

The prediction can be based on either of:
 * total volume of all scans from the build side of join.
 * the distance between the join node and the furthest fragment in the build side direction.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org