You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Attila Jeges (JIRA)" <ji...@apache.org> on 2019/04/15 15:12:00 UTC

[jira] [Commented] (IMPALA-8415) test_corrupt_stats exhaustive test failed

    [ https://issues.apache.org/jira/browse/IMPALA-8415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16818052#comment-16818052 ] 

Attila Jeges commented on IMPALA-8415:
--------------------------------------

I think, IMPALA-6050 breaks test_stats_extrapolation too:
 
{code}
metadata/test_stats_extrapolation.py:44: in test_stats_extrapolation
    self.run_test_case('QueryTest/stats-extrapolation', vector, unique_database)
common/impala_test_suite.py:506: in run_test_case
    self.__verify_results_and_errors(vector, test_section, result, use_db)
common/impala_test_suite.py:361: in __verify_results_and_errors
    replace_filenames_with_placeholder)
common/test_result_verifier.py:449: in verify_raw_results
    VERIFIER_MAP[verifier](expected, actual)
common/test_result_verifier.py:271: in verify_query_result_is_equal
    assert expected_results == actual_results
E   assert Comparing QueryTestResults (expected vs actual):
E     row_regex:.*Max Per-Host Resource Reservation: Memory=.* == 'Max Per-Host Resource Reservation: Memory=8.00KB Threads=2'
E     row_regex:.*Per-Host Resource Estimates: Memory=.* == 'Per-Host Resource Estimates: Memory=16MB'
E     'Codegen disabled by planner' == 'Codegen disabled by planner'
E     row_regex:.*Analyzed query: SELECT id FROM test_stats_extrapolation_.*.alltypes.* == 'Analyzed query: SELECT id FROM test_stats_extrapolation_5c6bdfd.alltypes'
E     '' == ''
E     'F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1' == 'F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1'
E     row_regex:.*Per-Host Resources: mem-estimate=.* mem-reservation=.* == '|  Per-Host Resources: mem-estimate=16.00MB mem-reservation=8.00KB thread-reservation=2'
E     'PLAN-ROOT SINK' == 'PLAN-ROOT SINK'
E     row_regex:.*mem-estimate=.* mem-reservation=.* == '|  mem-estimate=0B mem-reservation=0B thread-reservation=0'
E     '|' == '|'
E     '00:SCAN HDFS [test_stats_extrapolation_5c6bdfd.alltypes]' != '00:SCAN S3 [test_stats_extrapolation_5c6bdfd.alltypes]'
E     row_regex:.*partitions=12/12 files=12 size=.* == '   S3 partitions=12/12 files=12 size=87.78KB'
E     '   stored statistics:' == '   stored statistics:'
E     row_regex:.*table: rows=3.65K size=.* == '     table: rows=3.65K size=87.78KB'
E     '     partitions: 0/12 rows=unavailable' == '     partitions: 0/12 rows=unavailable'
E     '     columns: all' == '     columns: all'
E     row_regex:.* extrapolated-rows=3.65K .* == '   extrapolated-rows=3.65K max-scan-range-rows=307'
E     row_regex:.*mem-estimate=.* mem-reservation=.* == '   mem-estimate=16.00MB mem-reservation=8.00KB thread-reservation=1'
E     '   tuple-ids=0 row-size=4B cardinality=3.65K' == '   tuple-ids=0 row-size=4B cardinality=3.65K'
E     '   in pipelines: 00(GETNEXT)' == '   in pipelines: 00(GETNEXT)'
{code}

> test_corrupt_stats exhaustive test failed
> -----------------------------------------
>
>                 Key: IMPALA-8415
>                 URL: https://issues.apache.org/jira/browse/IMPALA-8415
>             Project: IMPALA
>          Issue Type: Test
>          Components: Backend
>    Affects Versions: Impala 3.2.0
>            Reporter: Attila Jeges
>            Assignee: Sahil Takiar
>            Priority: Critical
>              Labels: broken-build
>
> IMPALA-6050 broke test_corrupt_stats exhaustive test:
> {code:java}
> metadata/test_compute_stats.py:238: in test_corrupt_stats
>     self.run_test_case('QueryTest/corrupt-stats', vector, unique_database)
> common/impala_test_suite.py:517: in run_test_case
>     self.__verify_results_and_errors(vector, test_section, result, use_db)
> common/impala_test_suite.py:370: in __verify_results_and_errors
>     replace_filenames_with_placeholder)
> common/test_result_verifier.py:449: in verify_raw_results
>     VERIFIER_MAP[verifier](expected, actual)
> common/test_result_verifier.py:239: in verify_query_result_is_subset
>     assert expected_literal_strings <= actual_literal_strings
> E   assert Items in expected results not found in actual results:
> E     '   partitions=1/2 files=1 size=24B'
> E     Items in actual results:
> E     '02:EXCHANGE [UNPARTITIONED]'
> E     'Max Per-Host Resource Reservation: Memory=8.00KB Threads=3'
> E     '|  output: count(*)'
> E     '|  row-size=8B cardinality=0'
> E     'test_corrupt_stats_bb50e9c7.corrupted'
> E     'WARNING: The following tables have potentially corrupt table statistics.'
> E     'Per-Host Resource Estimates: Memory=52MB'
> E     '03:AGGREGATE [FINALIZE]'
> E     '   partition predicates: org = 1'
> E     'PLAN-ROOT SINK'
> E     ''
> E     '|  output: count:merge(*)'
> E     '   HDFS partitions=1/2 files=1 size=24B'
> E     '   row-size=0B cardinality=0'
> E     '|'
> E     '00:SCAN HDFS [test_corrupt_stats_bb50e9c7.corrupted]'
> E     '01:AGGREGATE'
> E     'Drop and re-compute statistics to resolve this problem.'
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org