You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Attila Jeges (Jira)" <ji...@apache.org> on 2020/03/26 17:26:00 UTC
[jira] [Updated] (IMPALA-9555) TestDateQueries.test_queries failing
because Hive3 switched back to the hybrid Julian Gregorian calendar
[ https://issues.apache.org/jira/browse/IMPALA-9555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Attila Jeges updated IMPALA-9555:
---------------------------------
Description:
TestDateQueries.test_queries is failing after upgrading the CDP GBN with the following error:
{code}
query_test.test_date_queries.TestDateQueries.test_queries[protocol: beeswax | exec_option: {'disable_codegen_rows_threshold': 0, 'disable_codegen': 'true', 'batch_size': 1} | table_format: avro/snap/block] (from pytest)
Error Message
query_test/test_date_queries.py:60: in test_queries self.run_test_case('QueryTest/avro_date', vector) common/impala_test_suite.py:690: in run_test_case self.__verify_results_and_errors(vector, test_section, result, use_db) common/impala_test_suite.py:523: in __verify_results_and_errors replace_filenames_with_placeholder) common/test_result_verifier.py:456: in verify_raw_results VERIFIER_MAP[verifier](expected, actual) common/test_result_verifier.py:278: in verify_query_result_is_equal assert expected_results == actual_results E assert Comparing QueryTestResults (expected vs actual): E 0,0001-01-01,0001-01-01 != 10,1399-06-27,2017-11-28 E 1,0001-01-01,0001-12-31 != 11,1399-06-27,NULL E 10,1399-06-27,2017-11-28 != 12,1399-06-27,2018-12-31 E 11,1399-06-27,NULL != 20,2017-11-27,0001-06-19 E 12,1399-06-27,2018-12-31 != 21,2017-11-27,0001-06-20 E 2,0001-01-01,0002-01-01 != 22,2017-11-27,0001-06-21 E 20,2017-11-27,0001-06-21 != 23,2017-11-27,0001-06-22 E 21,2017-11-27,0001-06-22 != 24,2017-11-27,0001-06-23 E 22,2017-11-27,0001-06-23 != 25,2017-11-27,0001-06-24 E 23,2017-11-27,0001-06-24 != 26,2017-11-27,0001-06-25 E 24,2017-11-27,0001-06-25 != 27,2017-11-27,0001-06-26 E 25,2017-11-27,0001-06-26 != 28,2017-11-27,0001-06-27 E 26,2017-11-27,0001-06-27 != 29,2017-11-27,2017-11-28 E 27,2017-11-27,0001-06-28 != 30,9999-12-31,9999-12-01 E 28,2017-11-27,0001-06-29 != 31,9999-12-31,9999-12-31 E 29,2017-11-27,2017-11-28 != None E 3,0001-01-01,1399-12-31 != None E 30,9999-12-31,9999-12-01 != None E 31,9999-12-31,9999-12-31 != None E 4,0001-01-01,2017-11-28 != None E 5,0001-01-01,9999-12-31 != None E 6,0001-01-01,NULL != None E Number of rows returned (expected vs actual): 22 != 15
Stacktrace
query_test/test_date_queries.py:60: in test_queries
self.run_test_case('QueryTest/avro_date', vector)
common/impala_test_suite.py:690: in run_test_case
self.__verify_results_and_errors(vector, test_section, result, use_db)
common/impala_test_suite.py:523: in __verify_results_and_errors
replace_filenames_with_placeholder)
common/test_result_verifier.py:456: in verify_raw_results
VERIFIER_MAP[verifier](expected, actual)
common/test_result_verifier.py:278: in verify_query_result_is_equal
assert expected_results == actual_results
E assert Comparing QueryTestResults (expected vs actual):
E 0,0001-01-01,0001-01-01 != 10,1399-06-27,2017-11-28
E 1,0001-01-01,0001-12-31 != 11,1399-06-27,NULL
E 10,1399-06-27,2017-11-28 != 12,1399-06-27,2018-12-31
E 11,1399-06-27,NULL != 20,2017-11-27,0001-06-19
E 12,1399-06-27,2018-12-31 != 21,2017-11-27,0001-06-20
E 2,0001-01-01,0002-01-01 != 22,2017-11-27,0001-06-21
E 20,2017-11-27,0001-06-21 != 23,2017-11-27,0001-06-22
E 21,2017-11-27,0001-06-22 != 24,2017-11-27,0001-06-23
E 22,2017-11-27,0001-06-23 != 25,2017-11-27,0001-06-24
E 23,2017-11-27,0001-06-24 != 26,2017-11-27,0001-06-25
E 24,2017-11-27,0001-06-25 != 27,2017-11-27,0001-06-26
E 25,2017-11-27,0001-06-26 != 28,2017-11-27,0001-06-27
E 26,2017-11-27,0001-06-27 != 29,2017-11-27,2017-11-28
E 27,2017-11-27,0001-06-28 != 30,9999-12-31,9999-12-01
E 28,2017-11-27,0001-06-29 != 31,9999-12-31,9999-12-31
E 29,2017-11-27,2017-11-28 != None
E 3,0001-01-01,1399-12-31 != None
E 30,9999-12-31,9999-12-01 != None
E 31,9999-12-31,9999-12-31 != None
E 4,0001-01-01,2017-11-28 != None
E 5,0001-01-01,9999-12-31 != None
E 6,0001-01-01,NULL != None
E Number of rows returned (expected vs actual): 22 != 15
Standard Error
ERROR:test_configuration:Comparing QueryTestResults (expected vs actual):
0,0001-01-01,0001-01-01 != 10,1399-06-27,2017-11-28
1,0001-01-01,0001-12-31 != 11,1399-06-27,NULL
10,1399-06-27,2017-11-28 != 12,1399-06-27,2018-12-31
11,1399-06-27,NULL != 20,2017-11-27,0001-06-19
12,1399-06-27,2018-12-31 != 21,2017-11-27,0001-06-20
2,0001-01-01,0002-01-01 != 22,2017-11-27,0001-06-21
20,2017-11-27,0001-06-21 != 23,2017-11-27,0001-06-22
21,2017-11-27,0001-06-22 != 24,2017-11-27,0001-06-23
22,2017-11-27,0001-06-23 != 25,2017-11-27,0001-06-24
23,2017-11-27,0001-06-24 != 26,2017-11-27,0001-06-25
24,2017-11-27,0001-06-25 != 27,2017-11-27,0001-06-26
25,2017-11-27,0001-06-26 != 28,2017-11-27,0001-06-27
26,2017-11-27,0001-06-27 != 29,2017-11-27,2017-11-28
27,2017-11-27,0001-06-28 != 30,9999-12-31,9999-12-01
28,2017-11-27,0001-06-29 != 31,9999-12-31,9999-12-31
29,2017-11-27,2017-11-28 != None
3,0001-01-01,1399-12-31 != None
30,9999-12-31,9999-12-01 != None
31,9999-12-31,9999-12-31 != None
4,0001-01-01,2017-11-28 != None
5,0001-01-01,9999-12-31 != None
6,0001-01-01,NULL != None
Number of rows returned (expected vs actual): 22 != 15
{code}
Looks like HIVE-22589 introduced a new set of Hive3 configuration options, including {{hive.avro.proleptic.gregorian}} which is {{false}} by default.
was:
TestDateQueries.test_queries is failing after upgrading the CDP GBN with the following error:
{code}
query_test.test_date_queries.TestDateQueries.test_queries[protocol: beeswax | exec_option: {'disable_codegen_rows_threshold': 0, 'disable_codegen': 'true', 'batch_size': 1} | table_format: avro/snap/block] (from pytest)
Error Message
query_test/test_date_queries.py:60: in test_queries self.run_test_case('QueryTest/avro_date', vector) common/impala_test_suite.py:690: in run_test_case self.__verify_results_and_errors(vector, test_section, result, use_db) common/impala_test_suite.py:523: in __verify_results_and_errors replace_filenames_with_placeholder) common/test_result_verifier.py:456: in verify_raw_results VERIFIER_MAP[verifier](expected, actual) common/test_result_verifier.py:278: in verify_query_result_is_equal assert expected_results == actual_results E assert Comparing QueryTestResults (expected vs actual): E 0,0001-01-01,0001-01-01 != 10,1399-06-27,2017-11-28 E 1,0001-01-01,0001-12-31 != 11,1399-06-27,NULL E 10,1399-06-27,2017-11-28 != 12,1399-06-27,2018-12-31 E 11,1399-06-27,NULL != 20,2017-11-27,0001-06-19 E 12,1399-06-27,2018-12-31 != 21,2017-11-27,0001-06-20 E 2,0001-01-01,0002-01-01 != 22,2017-11-27,0001-06-21 E 20,2017-11-27,0001-06-21 != 23,2017-11-27,0001-06-22 E 21,2017-11-27,0001-06-22 != 24,2017-11-27,0001-06-23 E 22,2017-11-27,0001-06-23 != 25,2017-11-27,0001-06-24 E 23,2017-11-27,0001-06-24 != 26,2017-11-27,0001-06-25 E 24,2017-11-27,0001-06-25 != 27,2017-11-27,0001-06-26 E 25,2017-11-27,0001-06-26 != 28,2017-11-27,0001-06-27 E 26,2017-11-27,0001-06-27 != 29,2017-11-27,2017-11-28 E 27,2017-11-27,0001-06-28 != 30,9999-12-31,9999-12-01 E 28,2017-11-27,0001-06-29 != 31,9999-12-31,9999-12-31 E 29,2017-11-27,2017-11-28 != None E 3,0001-01-01,1399-12-31 != None E 30,9999-12-31,9999-12-01 != None E 31,9999-12-31,9999-12-31 != None E 4,0001-01-01,2017-11-28 != None E 5,0001-01-01,9999-12-31 != None E 6,0001-01-01,NULL != None E Number of rows returned (expected vs actual): 22 != 15
Stacktrace
query_test/test_date_queries.py:60: in test_queries
self.run_test_case('QueryTest/avro_date', vector)
common/impala_test_suite.py:690: in run_test_case
self.__verify_results_and_errors(vector, test_section, result, use_db)
common/impala_test_suite.py:523: in __verify_results_and_errors
replace_filenames_with_placeholder)
common/test_result_verifier.py:456: in verify_raw_results
VERIFIER_MAP[verifier](expected, actual)
common/test_result_verifier.py:278: in verify_query_result_is_equal
assert expected_results == actual_results
E assert Comparing QueryTestResults (expected vs actual):
E 0,0001-01-01,0001-01-01 != 10,1399-06-27,2017-11-28
E 1,0001-01-01,0001-12-31 != 11,1399-06-27,NULL
E 10,1399-06-27,2017-11-28 != 12,1399-06-27,2018-12-31
E 11,1399-06-27,NULL != 20,2017-11-27,0001-06-19
E 12,1399-06-27,2018-12-31 != 21,2017-11-27,0001-06-20
E 2,0001-01-01,0002-01-01 != 22,2017-11-27,0001-06-21
E 20,2017-11-27,0001-06-21 != 23,2017-11-27,0001-06-22
E 21,2017-11-27,0001-06-22 != 24,2017-11-27,0001-06-23
E 22,2017-11-27,0001-06-23 != 25,2017-11-27,0001-06-24
E 23,2017-11-27,0001-06-24 != 26,2017-11-27,0001-06-25
E 24,2017-11-27,0001-06-25 != 27,2017-11-27,0001-06-26
E 25,2017-11-27,0001-06-26 != 28,2017-11-27,0001-06-27
E 26,2017-11-27,0001-06-27 != 29,2017-11-27,2017-11-28
E 27,2017-11-27,0001-06-28 != 30,9999-12-31,9999-12-01
E 28,2017-11-27,0001-06-29 != 31,9999-12-31,9999-12-31
E 29,2017-11-27,2017-11-28 != None
E 3,0001-01-01,1399-12-31 != None
E 30,9999-12-31,9999-12-01 != None
E 31,9999-12-31,9999-12-31 != None
E 4,0001-01-01,2017-11-28 != None
E 5,0001-01-01,9999-12-31 != None
E 6,0001-01-01,NULL != None
E Number of rows returned (expected vs actual): 22 != 15
Standard Error
ERROR:test_configuration:Comparing QueryTestResults (expected vs actual):
0,0001-01-01,0001-01-01 != 10,1399-06-27,2017-11-28
1,0001-01-01,0001-12-31 != 11,1399-06-27,NULL
10,1399-06-27,2017-11-28 != 12,1399-06-27,2018-12-31
11,1399-06-27,NULL != 20,2017-11-27,0001-06-19
12,1399-06-27,2018-12-31 != 21,2017-11-27,0001-06-20
2,0001-01-01,0002-01-01 != 22,2017-11-27,0001-06-21
20,2017-11-27,0001-06-21 != 23,2017-11-27,0001-06-22
21,2017-11-27,0001-06-22 != 24,2017-11-27,0001-06-23
22,2017-11-27,0001-06-23 != 25,2017-11-27,0001-06-24
23,2017-11-27,0001-06-24 != 26,2017-11-27,0001-06-25
24,2017-11-27,0001-06-25 != 27,2017-11-27,0001-06-26
25,2017-11-27,0001-06-26 != 28,2017-11-27,0001-06-27
26,2017-11-27,0001-06-27 != 29,2017-11-27,2017-11-28
27,2017-11-27,0001-06-28 != 30,9999-12-31,9999-12-01
28,2017-11-27,0001-06-29 != 31,9999-12-31,9999-12-31
29,2017-11-27,2017-11-28 != None
3,0001-01-01,1399-12-31 != None
30,9999-12-31,9999-12-01 != None
31,9999-12-31,9999-12-31 != None
4,0001-01-01,2017-11-28 != None
5,0001-01-01,9999-12-31 != None
6,0001-01-01,NULL != None
Number of rows returned (expected vs actual): 22 != 15
{code}
Looks like HIVE-22589 introduced a new set of Hive configuration options, including {{hive.avro.proleptic.gregorian}} which is {{false}} by default.
> TestDateQueries.test_queries failing because Hive3 switched back to the hybrid Julian Gregorian calendar
> --------------------------------------------------------------------------------------------------------
>
> Key: IMPALA-9555
> URL: https://issues.apache.org/jira/browse/IMPALA-9555
> Project: IMPALA
> Issue Type: Bug
> Reporter: Attila Jeges
> Priority: Critical
>
> TestDateQueries.test_queries is failing after upgrading the CDP GBN with the following error:
> {code}
> query_test.test_date_queries.TestDateQueries.test_queries[protocol: beeswax | exec_option: {'disable_codegen_rows_threshold': 0, 'disable_codegen': 'true', 'batch_size': 1} | table_format: avro/snap/block] (from pytest)
> Error Message
> query_test/test_date_queries.py:60: in test_queries self.run_test_case('QueryTest/avro_date', vector) common/impala_test_suite.py:690: in run_test_case self.__verify_results_and_errors(vector, test_section, result, use_db) common/impala_test_suite.py:523: in __verify_results_and_errors replace_filenames_with_placeholder) common/test_result_verifier.py:456: in verify_raw_results VERIFIER_MAP[verifier](expected, actual) common/test_result_verifier.py:278: in verify_query_result_is_equal assert expected_results == actual_results E assert Comparing QueryTestResults (expected vs actual): E 0,0001-01-01,0001-01-01 != 10,1399-06-27,2017-11-28 E 1,0001-01-01,0001-12-31 != 11,1399-06-27,NULL E 10,1399-06-27,2017-11-28 != 12,1399-06-27,2018-12-31 E 11,1399-06-27,NULL != 20,2017-11-27,0001-06-19 E 12,1399-06-27,2018-12-31 != 21,2017-11-27,0001-06-20 E 2,0001-01-01,0002-01-01 != 22,2017-11-27,0001-06-21 E 20,2017-11-27,0001-06-21 != 23,2017-11-27,0001-06-22 E 21,2017-11-27,0001-06-22 != 24,2017-11-27,0001-06-23 E 22,2017-11-27,0001-06-23 != 25,2017-11-27,0001-06-24 E 23,2017-11-27,0001-06-24 != 26,2017-11-27,0001-06-25 E 24,2017-11-27,0001-06-25 != 27,2017-11-27,0001-06-26 E 25,2017-11-27,0001-06-26 != 28,2017-11-27,0001-06-27 E 26,2017-11-27,0001-06-27 != 29,2017-11-27,2017-11-28 E 27,2017-11-27,0001-06-28 != 30,9999-12-31,9999-12-01 E 28,2017-11-27,0001-06-29 != 31,9999-12-31,9999-12-31 E 29,2017-11-27,2017-11-28 != None E 3,0001-01-01,1399-12-31 != None E 30,9999-12-31,9999-12-01 != None E 31,9999-12-31,9999-12-31 != None E 4,0001-01-01,2017-11-28 != None E 5,0001-01-01,9999-12-31 != None E 6,0001-01-01,NULL != None E Number of rows returned (expected vs actual): 22 != 15
> Stacktrace
> query_test/test_date_queries.py:60: in test_queries
> self.run_test_case('QueryTest/avro_date', vector)
> common/impala_test_suite.py:690: in run_test_case
> self.__verify_results_and_errors(vector, test_section, result, use_db)
> common/impala_test_suite.py:523: in __verify_results_and_errors
> replace_filenames_with_placeholder)
> common/test_result_verifier.py:456: in verify_raw_results
> VERIFIER_MAP[verifier](expected, actual)
> common/test_result_verifier.py:278: in verify_query_result_is_equal
> assert expected_results == actual_results
> E assert Comparing QueryTestResults (expected vs actual):
> E 0,0001-01-01,0001-01-01 != 10,1399-06-27,2017-11-28
> E 1,0001-01-01,0001-12-31 != 11,1399-06-27,NULL
> E 10,1399-06-27,2017-11-28 != 12,1399-06-27,2018-12-31
> E 11,1399-06-27,NULL != 20,2017-11-27,0001-06-19
> E 12,1399-06-27,2018-12-31 != 21,2017-11-27,0001-06-20
> E 2,0001-01-01,0002-01-01 != 22,2017-11-27,0001-06-21
> E 20,2017-11-27,0001-06-21 != 23,2017-11-27,0001-06-22
> E 21,2017-11-27,0001-06-22 != 24,2017-11-27,0001-06-23
> E 22,2017-11-27,0001-06-23 != 25,2017-11-27,0001-06-24
> E 23,2017-11-27,0001-06-24 != 26,2017-11-27,0001-06-25
> E 24,2017-11-27,0001-06-25 != 27,2017-11-27,0001-06-26
> E 25,2017-11-27,0001-06-26 != 28,2017-11-27,0001-06-27
> E 26,2017-11-27,0001-06-27 != 29,2017-11-27,2017-11-28
> E 27,2017-11-27,0001-06-28 != 30,9999-12-31,9999-12-01
> E 28,2017-11-27,0001-06-29 != 31,9999-12-31,9999-12-31
> E 29,2017-11-27,2017-11-28 != None
> E 3,0001-01-01,1399-12-31 != None
> E 30,9999-12-31,9999-12-01 != None
> E 31,9999-12-31,9999-12-31 != None
> E 4,0001-01-01,2017-11-28 != None
> E 5,0001-01-01,9999-12-31 != None
> E 6,0001-01-01,NULL != None
> E Number of rows returned (expected vs actual): 22 != 15
> Standard Error
> ERROR:test_configuration:Comparing QueryTestResults (expected vs actual):
> 0,0001-01-01,0001-01-01 != 10,1399-06-27,2017-11-28
> 1,0001-01-01,0001-12-31 != 11,1399-06-27,NULL
> 10,1399-06-27,2017-11-28 != 12,1399-06-27,2018-12-31
> 11,1399-06-27,NULL != 20,2017-11-27,0001-06-19
> 12,1399-06-27,2018-12-31 != 21,2017-11-27,0001-06-20
> 2,0001-01-01,0002-01-01 != 22,2017-11-27,0001-06-21
> 20,2017-11-27,0001-06-21 != 23,2017-11-27,0001-06-22
> 21,2017-11-27,0001-06-22 != 24,2017-11-27,0001-06-23
> 22,2017-11-27,0001-06-23 != 25,2017-11-27,0001-06-24
> 23,2017-11-27,0001-06-24 != 26,2017-11-27,0001-06-25
> 24,2017-11-27,0001-06-25 != 27,2017-11-27,0001-06-26
> 25,2017-11-27,0001-06-26 != 28,2017-11-27,0001-06-27
> 26,2017-11-27,0001-06-27 != 29,2017-11-27,2017-11-28
> 27,2017-11-27,0001-06-28 != 30,9999-12-31,9999-12-01
> 28,2017-11-27,0001-06-29 != 31,9999-12-31,9999-12-31
> 29,2017-11-27,2017-11-28 != None
> 3,0001-01-01,1399-12-31 != None
> 30,9999-12-31,9999-12-01 != None
> 31,9999-12-31,9999-12-31 != None
> 4,0001-01-01,2017-11-28 != None
> 5,0001-01-01,9999-12-31 != None
> 6,0001-01-01,NULL != None
> Number of rows returned (expected vs actual): 22 != 15
> {code}
> Looks like HIVE-22589 introduced a new set of Hive3 configuration options, including {{hive.avro.proleptic.gregorian}} which is {{false}} by default.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org