You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Dimitris Tsirogiannis (JIRA)" <ji...@apache.org> on 2017/11/29 18:33:00 UTC
[jira] [Resolved] (IMPALA-6001) Integration job failed in
TestDdlStatements.test_functions_ddl - one extra function in actual output
[ https://issues.apache.org/jira/browse/IMPALA-6001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dimitris Tsirogiannis resolved IMPALA-6001.
-------------------------------------------
Resolution: Fixed
Change-Id: I3a2cddee5d565384e9de0e61b3b7d0d9075e0dce
Reviewed-on: http://gerrit.cloudera.org:8080/8667
Reviewed-by: Dimitris Tsirogiannis <dt...@cloudera.com>
Tested-by: Impala Public Jenkins
---
M be/src/catalog/catalog-server.cc
M be/src/catalog/catalog-server.h
M be/src/catalog/catalog-util.cc
M be/src/catalog/catalog-util.h
M be/src/catalog/catalog.cc
M be/src/catalog/catalog.h
M be/src/scheduling/admission-controller.cc
M be/src/scheduling/admission-controller.h
M be/src/scheduling/scheduler-test-util.cc
M be/src/scheduling/scheduler.cc
M be/src/service/impala-server.cc
M be/src/statestore/statestore.cc
M be/src/statestore/statestore.h
M common/thrift/CatalogInternalService.thrift
M common/thrift/StatestoreService.thrift
M fe/src/main/java/org/apache/impala/catalog/CatalogDeltaLog.java
M fe/src/main/java/org/apache/impala/catalog/CatalogServiceCatalog.java
M fe/src/main/java/org/apache/impala/catalog/ImpaladCatalog.java
M fe/src/main/java/org/apache/impala/service/CatalogOpExecutor.java
M fe/src/main/java/org/apache/impala/service/JniCatalog.java
M tests/statestore/test_statestore.py
21 files changed, 441 insertions(+), 480 deletions(-)
> Integration job failed in TestDdlStatements.test_functions_ddl - one extra function in actual output
> ----------------------------------------------------------------------------------------------------
>
> Key: IMPALA-6001
> URL: https://issues.apache.org/jira/browse/IMPALA-6001
> Project: IMPALA
> Issue Type: Bug
> Components: Frontend
> Affects Versions: Impala 2.10.0
> Reporter: Alexander Behm
> Assignee: Dimitris Tsirogiannis
> Priority: Blocker
> Labels: broken-build
>
> TestDdlStatements.test_functions_ddl failed.
> What's weird is that the following function was already deleted and seems to have re-appeared:
> {code}
> 'INT','fn()','NATIVE','true'
> {code}
> Relevant Jenkins snippet below:
> {code}
> 15:35:55.450 =================================== FAILURES ===================================
> 15:35:55.450 TestDdlStatements.test_functions_ddl[exec_option: {'sync_ddl': 1, 'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format: text/none-unique_database0]
> 15:35:55.450 [gw3] linux2 -- Python 2.6.6 /data/jenkins/workspace/impala-asf-master-exhaustive-integration/repos/Impala/bin/../infra/python/env/bin/python
> 15:35:55.450 metadata/test_ddl.py:324: in test_functions_ddl
> 15:35:55.450 multiple_impalad=self._use_multiple_impalad(vector))
> 15:35:55.450 common/impala_test_suite.py:420: in run_test_case
> 15:35:55.450 self.__verify_results_and_errors(vector, test_section, result, use_db)
> 15:35:55.450 common/impala_test_suite.py:293: in __verify_results_and_errors
> 15:35:55.450 replace_filenames_with_placeholder)
> 15:35:55.450 common/test_result_verifier.py:404: in verify_raw_results
> 15:35:55.450 VERIFIER_MAP[verifier](expected, actual)
> 15:35:55.450 common/test_result_verifier.py:231: in verify_query_result_is_equal
> 15:35:55.450 assert expected_results == actual_results
> 15:35:55.450 E assert Comparing QueryTestResults (expected vs actual):
> 15:35:55.450 E 'DOUBLE','fn(INT)','NATIVE','true' == 'DOUBLE','fn(INT)','NATIVE','true'
> 15:35:55.450 E 'INT','fn(INT, STRING)','NATIVE','true' != 'INT','fn()','NATIVE','true'
> 15:35:55.450 E 'INT','fn(STRING, INT)','NATIVE','true' != 'INT','fn(INT, STRING)','NATIVE','true'
> 15:35:55.450 E 'INT','fn2(INT)','NATIVE','true' != 'INT','fn(STRING, INT)','NATIVE','true'
> 15:35:55.450 E None != 'INT','fn2(INT)','NATIVE','true'
> 15:35:55.450 E Number of rows returned (expected vs actual): 4 != 5
> 15:35:55.450 ---------------------------- Captured stderr setup -----------------------------
> 15:35:55.450 SET sync_ddl=True;
> 15:35:55.450 -- executing against localhost:21000
> 15:35:55.450 DROP DATABASE IF EXISTS `test_functions_ddl_baf0bb91` CASCADE;
> 15:35:55.450
> 15:35:55.450 SET sync_ddl=True;
> 15:35:55.450 -- executing against localhost:21000
> 15:35:55.450 CREATE DATABASE `test_functions_ddl_baf0bb91`;
> 15:35:55.450
> 15:35:55.450 MainThread: Created database "test_functions_ddl_baf0bb91" for test ID "metadata/test_ddl.py::TestDdlStatements::()::test_functions_ddl[exec_option: {'sync_ddl': 1, 'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format: text/none-unique_database0]"
> 15:35:55.450 ----------------------------- Captured stderr call -----------------------------
> 15:35:55.450 -- connecting to: localhost:21000
> 15:35:55.450 -- connecting to: localhost:21001
> 15:35:55.450 -- connecting to: localhost:21002
> 15:35:55.450 -- executing against localhost:21000
> 15:35:55.450 use test_functions_ddl_baf0bb91;
> 15:35:55.450
> 15:35:55.450 SET sync_ddl=1;
> 15:35:55.450 SET batch_size=0;
> 15:35:55.450 SET num_nodes=0;
> 15:35:55.450 SET disable_codegen_rows_threshold=0;
> 15:35:55.450 SET disable_codegen=False;
> 15:35:55.450 SET abort_on_error=1;
> 15:35:55.450 SET exec_single_node_rows_threshold=0;
> 15:35:55.450 -- executing against localhost:21001
> 15:35:55.450 use test_functions_ddl_baf0bb91;
> 15:35:55.450
> 15:35:55.450 SET sync_ddl=1;
> 15:35:55.450 SET batch_size=0;
> 15:35:55.450 SET num_nodes=0;
> 15:35:55.450 SET disable_codegen_rows_threshold=0;
> 15:35:55.450 SET disable_codegen=False;
> 15:35:55.450 SET abort_on_error=1;
> 15:35:55.450 SET exec_single_node_rows_threshold=0;
> 15:35:55.450 -- executing against localhost:21002
> 15:35:55.450 use test_functions_ddl_baf0bb91;
> 15:35:55.450
> 15:35:55.450 SET sync_ddl=1;
> 15:35:55.450 SET batch_size=0;
> 15:35:55.450 SET num_nodes=0;
> 15:35:55.450 SET disable_codegen_rows_threshold=0;
> 15:35:55.450 SET disable_codegen=False;
> 15:35:55.450 SET abort_on_error=1;
> 15:35:55.450 SET exec_single_node_rows_threshold=0;
> 15:35:55.450 -- executing against localhost:21000
> 15:35:55.450 create function test_functions_ddl_baf0bb91.fn() RETURNS int
> 15:35:55.450 LOCATION '/test-warehouse/libTestUdfs.so' SYMBOL='Fn';
> 15:35:55.450
> 15:35:55.450 -- executing against localhost:21002
> 15:35:55.450 create function test_functions_ddl_baf0bb91.fn(int) RETURNS double
> 15:35:55.450 LOCATION '/test-warehouse/libTestUdfs.so' SYMBOL='Fn';
> 15:35:55.450
> 15:35:55.450 -- executing against localhost:21002
> 15:35:55.450 create function test_functions_ddl_baf0bb91.fn(int, string) RETURNS int
> 15:35:55.450 LOCATION '/test-warehouse/libTestUdfs.so' SYMBOL='Fn';
> 15:35:55.450
> 15:35:55.450 -- executing against localhost:21001
> 15:35:55.450 create function test_functions_ddl_baf0bb91.fn(string, int) RETURNS int
> 15:35:55.450 LOCATION '/test-warehouse/libTestUdfs.so' SYMBOL='Fn';
> 15:35:55.450
> 15:35:55.450 -- executing against localhost:21000
> 15:35:55.450 create function test_functions_ddl_baf0bb91.fn2(int) RETURNS int
> 15:35:55.450 LOCATION '/test-warehouse/libTestUdfs.so' SYMBOL='Fn2';
> 15:35:55.450
> 15:35:55.450 -- executing against localhost:21002
> 15:35:55.450 create function test_functions_ddl_baf0bb91.fn2(int, string) RETURNS int
> 15:35:55.450 LOCATION '/test-warehouse/libTestUdfs.so' SYMBOL='Fn2';
> 15:35:55.450
> 15:35:55.450 -- executing against localhost:21002
> 15:35:55.450 create function test_functions_ddl_baf0bb91.fn_var_arg(int...) RETURNS int
> 15:35:55.450 LOCATION '/test-warehouse/libTestUdfs.so' SYMBOL='VarSum';
> 15:35:55.450
> 15:35:55.450 -- executing against localhost:21001
> 15:35:55.450 create aggregate function test_functions_ddl_baf0bb91.agg_fn(int) RETURNS bigint
> 15:35:55.450 LOCATION '/test-warehouse/libudasample.so' UPDATE_FN='CountUpdate';
> 15:35:55.450
> 15:35:55.450 -- executing against localhost:21001
> 15:35:55.450 create aggregate function test_functions_ddl_baf0bb91.agg_fn(int, string) RETURNS int
> 15:35:55.450 LOCATION '/test-warehouse/libTestUdas.so' UPDATE_FN='TwoArgUpdate';
> 15:35:55.450
> 15:35:55.450 -- executing against localhost:21002
> 15:35:55.450 show functions in test_functions_ddl_baf0bb91;
> 15:35:55.450
> 15:35:55.450 -- executing against localhost:21000
> 15:35:55.450 show aggregate functions in test_functions_ddl_baf0bb91;
> 15:35:55.450
> 15:35:55.450 -- executing against localhost:21002
> 15:35:55.450 show analytic functions in test_functions_ddl_baf0bb91;
> 15:35:55.450
> 15:35:55.450 -- executing against localhost:21002
> 15:35:55.450 show create function test_functions_ddl_baf0bb91.fn_var_arg;
> 15:35:55.450
> 15:35:55.450 -- executing against localhost:21000
> 15:35:55.450 show create aggregate function test_functions_ddl_baf0bb91.agg_fn;
> 15:35:55.450
> 15:35:55.450 -- executing against localhost:21002
> 15:35:55.450 show create function _impala_builtins.sin;
> 15:35:55.450
> 15:35:55.450 -- executing against localhost:21002
> 15:35:55.450 show create aggregate function _impala_builtins.avg;
> 15:35:55.450
> 15:35:55.450 -- executing against localhost:21002
> 15:35:55.450 drop function test_functions_ddl_baf0bb91.fn2(int, string);
> 15:35:55.450
> 15:35:55.450 -- executing against localhost:21000
> 15:35:55.450 show functions;
> 15:35:55.450
> 15:35:55.450 -- executing against localhost:21002
> 15:35:55.450 drop function if exists test_functions_ddl_baf0bb91.fn2(int, string);
> 15:35:55.450
> 15:35:55.450 -- executing against localhost:21000
> 15:35:55.450 show functions in test_functions_ddl_baf0bb91;
> 15:35:55.450
> 15:35:55.450 -- executing against localhost:21000
> 15:35:55.450 show functions in test_functions_ddl_baf0bb91;
> 15:35:55.450
> 15:35:55.450 -- executing against localhost:21000
> 15:35:55.450 drop function fn();
> 15:35:55.450
> 15:35:55.450 -- executing against localhost:21000
> 15:35:55.450 show functions;
> 15:35:55.450
> 15:35:55.450 -- executing against localhost:21001
> 15:35:55.450 drop function fn_var_arg(INT...);
> 15:35:55.450
> 15:35:55.450 -- executing against localhost:21001
> 15:35:55.450 show functions;
> 15:35:55.450
> 15:35:55.450 MainThread: Comparing QueryTestResults (expected vs actual):
> 15:35:55.450 'DOUBLE','fn(INT)','NATIVE','true' == 'DOUBLE','fn(INT)','NATIVE','true'
> 15:35:55.450 'INT','fn(INT, STRING)','NATIVE','true' != 'INT','fn()','NATIVE','true'
> 15:35:55.450 'INT','fn(STRING, INT)','NATIVE','true' != 'INT','fn(INT, STRING)','NATIVE','true'
> 15:35:55.450 'INT','fn2(INT)','NATIVE','true' != 'INT','fn(STRING, INT)','NATIVE','true'
> 15:35:55.450 None != 'INT','fn2(INT)','NATIVE','true'
> 15:35:55.450 Number of rows returned (expected vs actual): 4 != 5
> 15:35:55.450 ===== 1 failed, 11076 passed, 187 skipped, 304 xfailed in 31819.49 seconds =====
> 15:35:55.494 ============================= test session starts ==============================
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)