You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Pranav Yogi Lodha (Jira)" <ji...@apache.org> on 2025/02/14 19:31:00 UTC
[jira] [Created] (IMPALA-13760) AssertionError in TestRuntimeFilters.test_basic_filters
Pranav Yogi Lodha created IMPALA-13760:
------------------------------------------
Summary: AssertionError in TestRuntimeFilters.test_basic_filters
Key: IMPALA-13760
URL: https://issues.apache.org/jira/browse/IMPALA-13760
Project: IMPALA
Issue Type: Bug
Reporter: Pranav Yogi Lodha
h3. Error Message
{noformat}
AssertionError: Did not find matches for lines in runtime profile: EXPECTED LINES: row_regex: .*REMOTE.*ms.*ms.*true ACTUAL PROFILE: Query (id=c240144e50156fdf:4a5d42ea00000000): Summary: Session ID: 01416e6b603bb5cc:0218894cee8302ab Session Type: BEESWAX Start Time: 2025-02-13 22:12:29.699446000 End Time: 2025-02-13 22:12:29.754395000 Duration: 54.949ms (54949 us) Query Type: QUERY Query State: FINISHED Impala Query State: FINISHED Query Status: OK Impala Version: impalad version 4.3.0-SNAPSHOT RELEASE (build 438cff1063dc1ce98f3a35224954a3194cf6c748) User: jenkins Connected User: jenkins Delegated User: Network Address: 127.0.0.1:48608 Default Db: functional_text_gzip Sql Statement: select STRAIGHT_JOIN count(*) from alltypes a join [SHUFFLE] alltypestiny b on a.month = b.month + 10000 Coordinator: impala-ec2-rhel88-m7g-4xlarge-ondemand-1ba5.vpc.cloudera.com:27000 Query Options (set by configuration): ABORT_ON_ERROR=1,DISABLE_CODEGEN=1,EXEC_SINGLE_NODE_ROWS_THRESHOLD=0,RUNTIME_FILTER_WAIT_TIME_MS=60000,MT_DOP=1,DISABLE_CODEGEN_ROWS_THRESHOLD=0,TIMEZONE=America/Los_Angeles,CLIENT_IDENTIFIER=query_test/test_runtime_filters.py::TestRuntimeFilters::()::test_basic_filters[mt_dop:1|protocol:beeswax|exec_option:{'test_replan':1;'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':True;'abort_on_error':1;'exec_single_no,MINMAX_FILTER_PARTITION_COLUMNS=0,TEST_REPLAN=1 Query Options (set by configuration and planner):
Stacktrace
query_test/test_runtime_filters.py:79: in test_basic_filters test_file_vars={'$RUNTIME_FILTER_WAIT_TIME_MS' : str(WAIT_TIME_MS)}) /data/jenkins/workspace/impala-cdh_main-exhaustive-release-arm/repos/Impala/tests/common/impala_test_suite.py:845: in run_test_case update_section=pytest.config.option.update_results) /data/jenkins/workspace/impala-cdh_main-exhaustive-release-arm/repos/Impala/tests/common/test_result_verifier.py:685: in verify_runtime_profile actual)) E AssertionError: Did not find matches for lines in runtime profile: E EXPECTED LINES: E row_regex: .*REMOTE.*ms.*ms.*true E E ACTUAL PROFILE: E Query (id=c240144e50156fdf:4a5d42ea00000000): E Summary: E Session ID: 01416e6b603bb5cc:0218894cee8302ab E Session Type: BEESWAX E Start Time: 2025-02-13 22:12:29.699446000 E End Time: 2025-02-13 22:12:29.754395000 E Duration: 54.949ms (54949 us) E Query Type: QUERY E Query State: FINISHED E Impala Query State: FINISHED E Query Status: OK E Impala Version: impalad version 4.3.0-SNAPSHOT RELEASE (build 438cff1063dc1ce98f3a35224954a3194cf6c748) E User: jenkins E Connected User: jenkins E Delegated User: E Network Address: 127.0.0.1:48608 E Default Db: functional_text_gzip E Sql Statement: select STRAIGHT_JOIN count(*) from alltypes a E join [SHUFFLE] alltypestiny b E on a.month = b.month + 10000 E Coordinator: impala-ec2-rhel88-m7g-4xlarge-ondemand-1ba5.vpc.cloudera.com:27000 E Query Options (set by configuration): ABORT_ON_ERROR=1,DISABLE_CODEGEN=1,EXEC_SINGLE_NODE_ROWS_THRESHOLD=0,RUNTIME_FILTER_WAIT_TIME_MS=60000,MT_DOP=1,DISABLE_CODEGEN_ROWS_THRESHOLD=0,TIMEZONE=America/Los_Angeles,CLIENT_IDENTIFIER=query_test/test_runtime_filters.py::TestRuntimeFilters::()::test_basic_filters[mt_dop:1|protocol:beeswax|exec_option:{'test_replan':1;'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':True;'abort_on_error':1;'exec_single_no,MINMAX_FILTER_PARTITION_COLUMNS=0,TEST_REPLAN=1 E Query Options (set by configuration and planner): ABORT_ON_ERROR=1,DISABLE_CODEGEN=1,EXEC_SINGLE_NODE_ROWS_THRESHOLD=0,RUNTIME_FILTER_WAIT_TIME_MS=60000,MT_DOP=1,DISABLE_CODEGEN_ROWS_THRESHOLD=0,TIMEZONE=America/Los_Angeles,CLIENT_IDENTIFIER=query_test/test_runtime_filters.py::TestRuntimeFilters::()::test_basic_filters[mt_dop:1|protocol:beeswax|exec_option:{'test_replan':1;'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':True;'abort_on_error':1;'exec_single_no,SPOOL_QUERY_RESULTS=0,MINMAX_FILTER_THRESHOLD=0.5,MINMAX_FILTERING_LEVEL=PAGE,MINMAX_FILTER_PARTITION_COLUMNS=0,TEST_REPLAN=1 E Plan: E ---------------- E Max Per-Host Resource Reservation: Memory=3.95MB Threads=5 E Per-Host Resource Estimates: Memory=36MB E WARNING: The following tables are missing relevant table and/or column statistics. E functional_text_gzip.alltypestiny E Analyzed query: SELECT /* +straight_join */ count(*) FROM E functional_text_gzip.alltypes a INNER JOIN /* +SHUFFLE */ E functional_text_gzip.alltypestiny b ON CAST(a.`month` AS BIGINT) = E CAST(b.`month` AS BIGINT) + CAST(10000 AS BIGINT) E E F03:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 E | Per-Instance Resources: mem-estimate=32.00KB mem-reservation=0B thread-reservation=1 E PLAN-ROOT SINK E | output exprs: count(*) E | mem-estimate=0B mem-reservation=0B thread-reservation=0 E | E 07:AGGREGATE [FINALIZE] E | output: count:merge(*) E | mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 E | tuple-ids=2 row-size=8B cardinality=1 E | in pipelines: 07(GETNEXT), 03(OPEN) E | E 06:EXCHANGE [UNPARTITIONED] E | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 E | tuple-ids=2 row-size=8B cardinality=1 E | in pipelines: 03(GETNEXT) E | E F02:PLAN FRAGMENT [HASH(a.`month`)] hosts=3 instances=3 E Per-Instance Resources: mem-estimate=64.00KB mem-reservation=0B thread-reservation=1 E 03:AGGREGATE E | output: count(*) E | mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 E | tuple-ids=2 row-size=8B cardinality=1 E | in pipelines: 03(GETNEXT), 00(OPEN) E | E 02:HASH JOIN [INNER JOIN, PARTITIONED] E | hash-table-id=00 E | hash predicates: a.`month` = b.`month` + 10000 E | fk/pk conjuncts: assumed fk/pk E | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 E | tuple-ids=0,1 row-size=8B cardinality=3.57K E | in pipelines: 00(GETNEXT), 01(OPEN) E | E |--F04:PLAN FRAGMENT [HASH(a.`month`)] hosts=3 instances=3 E | | Per-Instance Resources: mem-estimate=2.95MB mem-reservation=2.94MB thread-reservation=1 runtime-filters-memory=1.00MB E | JOIN BUILD E | | join-table-id=00 plan-id=01 cohort-id=01 E | | build expressions: b.`month` + 10000 E | | runtime filters: RF000[bloom] <- b.`month` + 10000 E | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 E | | E | 05:EXCHANGE [HASH(b.`month` + 10000)] E | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 E | | tuple-ids=1 row-size=4B cardinality=15 E | | in pipelines: 01(GETNEXT) E | | E | F01:PLAN FRAGMENT [RANDOM] hosts=3 instances=3 E | Per-Instance Resources: mem-estimate=16.09MB mem-reservation=8.00KB thread-reservation=1 E | 01:SCAN HDFS [functional_text_gzip.alltypestiny b, RANDOM] E | HDFS partitions=4/4 files=4 size=328B E | stored statistics: E | table: rows=unavailable size=unavailable E | partitions: 0/4 rows=15 E | columns: all E | extrapolated-rows=disabled max-scan-range-rows=unavailable E | mem-estimate=16.00MB mem-reservation=8.00KB thread-reservation=0 E | tuple-ids=1 row-size=4B cardinality=15 E | in pipelines: 01(GETNEXT) E | E 04:EXCHANGE [HASH(a.`month`)] E | mem-estimate=28.65KB mem-reservation=0B thread-reservation=0 E | tuple-ids=0 row-size=4B cardinality=3.57K E | in pipelines: 00(GETNEXT) E | E F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3 E Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB E Per-Instance Resources: mem-estimate=16.09MB mem-reservation=8.00KB thread-reservation=1 E 00:SCAN HDFS [functional_text_gzip.alltypes a, RANDOM] E HDFS partitions=24/24 files=24 size=77.88KB E runtime filters: RF000[bloom] -> a.`month` E stored statistics: E table: rows=unavailable size=unavailable E partitions: 0/24 rows=3.57K E columns: all E extrapolated-rows=disabled max-scan-range-rows=unavailable E mem-estimate=16.00MB mem-reservation=8.00KB thread-reservation=0 E tuple-ids=0 row-size=4B cardinality=3.57K E in pipelines: 00(GETNEXT) E ---------------- E Estimated Per-Host Mem: 37994496 E Tables Missing Stats: fntime_filters.test
-- executing against localhost:21000
SET RUNTIME_FILTER_MODE=OFF;
-- 2025-02-13 22:12:23,624 INFO MainThread: Started query 0b45130cb197cee2:37d6007200000000
-- executing against localhost:21000
{noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)