You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Jason Fehr (Jira)" <ji...@apache.org> on 2025/09/02 22:50:00 UTC

[jira] [Closed] (IMPALA-14379) TestStatsExtrapolation.test_stats_extrapolation Failure in GVO Builds

     [ https://issues.apache.org/jira/browse/IMPALA-14379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jason Fehr closed IMPALA-14379.
-------------------------------
    Resolution: Invalid

This test failure was caused by a new test in IMPALA-13237: [Patch 8] - OpenTelemetry Traces for DML/DDL Queries and Handle Leading Comments:  https://gerrit.cloudera.org/c/23279

The specific issue is the tests "test_compute_stats" and "test_compute_incremental_stats" run compute stats queries on the "functional.alltypes" table.  This gives Impala the information it needs to accurately calculate number of rows.  Thus, extrapolated rows is much less than 7.3K

> TestStatsExtrapolation.test_stats_extrapolation Failure in GVO Builds
> ---------------------------------------------------------------------
>
>                 Key: IMPALA-14379
>                 URL: https://issues.apache.org/jira/browse/IMPALA-14379
>             Project: IMPALA
>          Issue Type: Bug
>            Reporter: Jason Fehr
>            Assignee: Zoltán Borók-Nagy
>            Priority: Major
>              Labels: broken-build
>
> Gerrit verify builds are failing because of the test failure TestStatsExtrapolation.test_stats_extrapolation.  See [example here|https://jenkins.impala.io/job/ubuntu-20.04-from-scratch/6554/testReport/junit/custom_cluster.test_stats_extrapolation/TestStatsExtrapolation/test_stats_extrapolation__table_format__text_none_____protocol__hs2_____exec_option____test_replan___1___batch_size___0___num_nodes___0___disable_codegen_rows_threshold___5000___disable_codegen___False___abort_on_error___1___exec_single_node_rows_threshold___0___/].
> {noformat}
> custom_cluster.test_stats_extrapolation.TestStatsExtrapolation.test_stats_extrapolation["table_format: text/none" | "protocol: hs2" | "exec_option: {'test_replan': 1, 'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 5000, 'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0}"]
> {noformat}
> *Error Message*
> {noformat}
> assert 'extrapolated-rows=7.30K' in 'Max Per-Host Resource Reservation: Memory=4.03MB Threads=3 Per-Host Resource Estimates: Memory=165MB Codegen disabled... mem-reservation=32.00KB thread-reservation=1    tuple-ids=0 row-size=89B cardinality=620    in pipelines: 00(GETNEXT)'  +  where 'Max Per-Host Resource Reservation: Memory=4.03MB Threads=3 Per-Host Resource Estimates: Memory=165MB Codegen disabled... mem-reservation=32.00KB thread-reservation=1    tuple-ids=0 row-size=89B cardinality=620    in pipelines: 00(GETNEXT)' = <built-in method join of str object at 0x7fc7ed465f80>(['Max Per-Host Resource Reservation: Memory=4.03MB Threads=3', 'Per-Host Resource Estimates: Memory=165MB', 'Codegen d... 'Analyzed query: SELECT * FROM functional.alltypes', '', 'F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1', ...])  +    where <built-in method join of str object at 0x7fc7ed465f80> = ' '.join  +    and   ['Max Per-Host Resource Reservation: Memory=4.03MB Threads=3', 'Per-Host Resource Estimates: Memory=165MB', 'Codegen d... 'Analyzed query: SELECT * FROM functional.alltypes', '', 'F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1', ...] = <tests.common.impala_connection.ImpylaHS2ResultSet object at 0x7fc7e8765310>.data
> {noformat}
> *Stack Trace*
> {noformat}
> custom_cluster/test_stats_extrapolation.py:49: in test_stats_extrapolation
>     assert "extrapolated-rows=7.30K" in " ".join(explain_result.data)
> E   assert 'extrapolated-rows=7.30K' in 'Max Per-Host Resource Reservation: Memory=4.03MB Threads=3 Per-Host Resource Estimates: Memory=165MB Codegen disabled... mem-reservation=32.00KB thread-reservation=1    tuple-ids=0 row-size=89B cardinality=620    in pipelines: 00(GETNEXT)'
> E    +  where 'Max Per-Host Resource Reservation: Memory=4.03MB Threads=3 Per-Host Resource Estimates: Memory=165MB Codegen disabled... mem-reservation=32.00KB thread-reservation=1    tuple-ids=0 row-size=89B cardinality=620    in pipelines: 00(GETNEXT)' = <built-in method join of str object at 0x7fc7ed465f80>(['Max Per-Host Resource Reservation: Memory=4.03MB Threads=3', 'Per-Host Resource Estimates: Memory=165MB', 'Codegen d... 'Analyzed query: SELECT * FROM functional.alltypes', '', 'F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1', ...])
> E    +    where <built-in method join of str object at 0x7fc7ed465f80> = ' '.join
> E    +    and   ['Max Per-Host Resource Reservation: Memory=4.03MB Threads=3', 'Per-Host Resource Estimates: Memory=165MB', 'Codegen d... 'Analyzed query: SELECT * FROM functional.alltypes', '', 'F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1', ...] = <tests.common.impala_connection.ImpylaHS2ResultSet object at 0x7fc7e8765310>.data
> {noformat}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)