You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Csaba Ringhofer (Jira)" <ji...@apache.org> on 2022/06/01 15:41:00 UTC
[jira] [Commented] (IMPALA-11160) TestAcid.test_acid_compute_stats failed in ubuntu-16.04-dockerised-tests
[ https://issues.apache.org/jira/browse/IMPALA-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17544984#comment-17544984 ]
Csaba Ringhofer commented on IMPALA-11160:
------------------------------------------
I could reproduce it in Impala shell too.
It doesn't need hms event polling, only local catalog mode:
{code}
bin/start-impala-cluster.py --catalogd_args="--catalog_topic_mode=minimal" --impalad_args="--use_local_catalog=1"
{code}
Running this leads to intermittently showing "false" for the incrementalness of a partition in some cases:
{code}
drop table if exists default.pt;
create table default.pt (x int) partitioned by (p int);
insert into default.pt partition (p=1) values (1);
compute stats default.pt;
drop table default.pt;
create table default.pt (x int) partitioned by (p int);
insert into default.pt partition (p=1) values (1);
compute incremental stats default.pt;
show partitions default.pt;
{code}
My guess is that Impala needs to wait for a catalog topic update before it gets the new value for partitions, as I couldn't reproduce the issue with sync_ddl=1, but it is also possible that this simple fixed things because it was slower.
> TestAcid.test_acid_compute_stats failed in ubuntu-16.04-dockerised-tests
> ------------------------------------------------------------------------
>
> Key: IMPALA-11160
> URL: https://issues.apache.org/jira/browse/IMPALA-11160
> Project: IMPALA
> Issue Type: Bug
> Reporter: Zoltán Borók-Nagy
> Assignee: Csaba Ringhofer
> Priority: Major
> Labels: broken-build
>
> h3. Error Message
> {noformat}
> query_test/test_acid.py:220: in test_acid_compute_stats self.run_test_case('QueryTest/acid-compute-stats', vector, use_db=unique_database) common/impala_test_suite.py:718: in run_test_case self.__verify_results_and_errors(vector, test_section, result, use_db) common/impala_test_suite.py:554: in __verify_results_and_errors replace_filenames_with_placeholder) common/test_result_verifier.py:469: in verify_raw_results VERIFIER_MAP[verifier](expected, actual) common/test_result_verifier.py:278: in verify_query_result_is_equal assert expected_results == actual_results E assert Comparing QueryTestResults (expected vs actual): E '1',1,1,'2B','NOT CACHED','NOT CACHED',regex:.*,'true',regex:.* != '1',1,1,'2B','NOT CACHED','NOT CACHED','TEXT','false','hdfs://192.168.124.1:20500/test-warehouse/managed/test_acid_compute_stats_69ccf940.db/pt/p=1' E 'Total',1,1,'2B','0B','','','','' == 'Total',1,1,'2B','0B','','','',''
> {noformat}
> h3. Stacktrace
> {noformat}
> query_test/test_acid.py:220: in test_acid_compute_stats
> self.run_test_case('QueryTest/acid-compute-stats', vector, use_db=unique_database)
> common/impala_test_suite.py:718: in run_test_case
> self.__verify_results_and_errors(vector, test_section, result, use_db)
> common/impala_test_suite.py:554: in __verify_results_and_errors
> replace_filenames_with_placeholder)
> common/test_result_verifier.py:469: in verify_raw_results
> VERIFIER_MAP[verifier](expected, actual)
> common/test_result_verifier.py:278: in verify_query_result_is_equal
> assert expected_results == actual_results
> E assert Comparing QueryTestResults (expected vs actual):
> E '1',1,1,'2B','NOT CACHED','NOT CACHED',regex:.*,'true',regex:.* != '1',1,1,'2B','NOT CACHED','NOT CACHED','TEXT','false','hdfs://192.168.124.1:20500/test-warehouse/managed/test_acid_compute_stats_69ccf940.db/pt/p=1'
> E 'Total',1,1,'2B','0B','','','','' == 'Total',1,1,'2B','0B','','','',''
> {noformat}
> It happend in https://jenkins.impala.io/job/ubuntu-16.04-dockerised-tests/5359/
> *Please click on "Don't keep this build forever" once this issue is resolved*
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org