You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@impala.apache.org by Quanlong Huang <hu...@126.com> on 2017/12/09 00:00:31 UTC
Build failure in TestAdmissionController
Hi all,
I'm working on the ORC support feature (IMPALA-5717). However, I encounter the following test errors not related to my patch:
ERROR at setup of TestGrantRevoke.test_role_update[exec_option: {'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_th
reshold': 0} | table_format: text/none]
authorization/test_grant_revoke.py:47: in setup_method
self.__test_cleanup()
authorization/test_grant_revoke.py:72: in __test_cleanup
self.client.execute("grant role grant_revoke_test_admin to group %s" % group_name)
common/impala_connection.py:160: in execute
return self.__beeswax_client.execute(sql_stmt, user=user)
beeswax/impala_beeswax.py:173: in execute
handle = self.__execute_query(query_string.strip(), user=user)
beeswax/impala_beeswax.py:339: in __execute_query
handle = self.execute_query_async(query_string, user=user)
beeswax/impala_beeswax.py:335: in execute_query_async
return self.__do_rpc(lambda: self.imp_service.query(query,))
beeswax/impala_beeswax.py:460: in __do_rpc
raise ImpalaBeeswaxException(self.__build_error_message(b), b)
E ImpalaBeeswaxException: ImpalaBeeswaxException:
E INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
E MESSAGE: AnalysisException: Syntax error in line 1:
E grant role grant_revoke_test_admin to group quanlong.huang
E ^
E Encountered: .
E Expected
E
E CAUSED BY: Exception: Syntax error
……
======================================= FAILURES ==============================
_________________ TestAdmissionController.test_set_request_pool __________________________
hs2/hs2_test_suite.py:48: in add_session
fn(self)
custom_cluster/test_admission_controller.py:212: in test_set_request_pool
self.__check_pool_rejected(client, pool, expected_error)
custom_cluster/test_admission_controller.py:144: in __check_pool_rejected
assert re.search(expected_error_re, str(e))
E assert None
E + where None = <function search at 0x7ff6115ddaa0>("No mapping found for request from user '\\w+' with requested pool ''", "ImpalaBeeswaxException:\n INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>\n MESSAGE: No mapping found for request from user 'quanlong.huang' with requested pool ''\n")
E + where <function search at 0x7ff6115ddaa0> = re.search
E + and "ImpalaBeeswaxException:\n INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>\n MESSAGE: No mapping found for request from user 'quanlong.huang' with requested pool ''\n" = str(ImpalaBeeswaxException())
What can I do to fix this?
Thanks,
Quanlong
Re: Re:Re: Build failure in TestAdmissionController
Posted by Thomas Tauber-Marshall <tm...@cloudera.com>.
On Sun, Dec 10, 2017 at 2:38 PM Quanlong Huang <hu...@126.com>
wrote:
> Hi all,
>
>
> I've fixed all the test failures in my dev environment and here is the
> patch: https://gerrit.cloudera.org/#/c/8807/
> It has passed the gerrit-verify-dryrun-external test and here is the link:
> https://jenkins.impala.io/job/gerrit-verify-dryrun/1604/ (Don't know how
> to let Jenkins comment in gerrit after build succeed like you do ...)
>
Once you've gotten a +2, you'll have to ask a committer to run
gerrit-verify-dryrun, which is what talks to gerrit.
>
>
> Would you please have a look at it?
>
>
> Thanks,
> Quanlong
>
> At 2017-12-09 21:49:23, "Quanlong Huang" <hu...@126.com> wrote:
> >Thanks, Dimitris!
> >
> >
> >The cause is my problematic username and group name. There is a dot in
> them, which causes many tests to fail.
> >
> >
> >I think we should make less assumption about the username and group
> names. I create a JIRA (https://issues.apache.org/jira/browse/IMPALA-6301)
> for this and will submit a code review later.
> >
> >
> >Quanlong
> >
> >At 2017-12-09 08:11:36, "Dimitris Tsirogiannis" <
> dtsirogiannis@cloudera.com> wrote:
> >>I think the problem is the '.' in what the test infrastructure uses as a
> >>group to assign roles which is your linux group 'quanlong.huang'. You can
> >>try to quote the group (not sure if that will work) or change your group.
> >>
> >>Dimitris
> >>
> >>On Fri, Dec 8, 2017 at 4:00 PM, Quanlong Huang <hu...@126.com>
> >>wrote:
> >>
> >>> Hi all,
> >>>
> >>>
> >>> I'm working on the ORC support feature (IMPALA-5717). However, I
> encounter
> >>> the following test errors not related to my patch:
> >>>
> >>>
> >>> ERROR at setup of TestGrantRevoke.test_role_update[exec_option:
> >>> {'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 0,
> >>> 'disable_codegen': False, 'abort_on_error': 1,
> 'exec_single_node_rows_th
> >>> reshold': 0} | table_format: text/none]
> >>> authorization/test_grant_revoke.py:47: in setup_method
> >>> self.__test_cleanup()
> >>> authorization/test_grant_revoke.py:72: in __test_cleanup
> >>> self.client.execute("grant role grant_revoke_test_admin to group
> %s" %
> >>> group_name)
> >>> common/impala_connection.py:160: in execute
> >>> return self.__beeswax_client.execute(sql_stmt, user=user)
> >>> beeswax/impala_beeswax.py:173: in execute
> >>> handle = self.__execute_query(query_string.strip(), user=user)
> >>> beeswax/impala_beeswax.py:339: in __execute_query
> >>> handle = self.execute_query_async(query_string, user=user)
> >>> beeswax/impala_beeswax.py:335: in execute_query_async
> >>> return self.__do_rpc(lambda: self.imp_service.query(query,))
> >>> beeswax/impala_beeswax.py:460: in __do_rpc
> >>> raise ImpalaBeeswaxException(self.__build_error_message(b), b)
> >>> E ImpalaBeeswaxException: ImpalaBeeswaxException:
> >>> E INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
> >>> E MESSAGE: AnalysisException: Syntax error in line 1:
> >>> E grant role grant_revoke_test_admin to group quanlong.huang
> >>> E ^
> >>> E Encountered: .
> >>> E Expected
> >>> E
> >>> E CAUSED BY: Exception: Syntax error
> >>> ……
> >>> ======================================= FAILURES
> >>> ==============================
> >>> _________________ TestAdmissionController.test_set_request_pool
> >>> __________________________
> >>> hs2/hs2_test_suite.py:48: in add_session
> >>> fn(self)
> >>> custom_cluster/test_admission_controller.py:212: in
> test_set_request_pool
> >>> self.__check_pool_rejected(client, pool, expected_error)
> >>> custom_cluster/test_admission_controller.py:144: in
> __check_pool_rejected
> >>> assert re.search(expected_error_re, str(e))
> >>> E assert None
> >>> E + where None = <function search at 0x7ff6115ddaa0>("No mapping
> found
> >>> for request from user '\\w+' with requested pool ''",
> >>> "ImpalaBeeswaxException:\n INNER EXCEPTION: <class
> 'beeswaxd.ttypes.BeeswaxException'>\n
> >>> MESSAGE: No mapping found for request from user 'quanlong.huang' with
> >>> requested pool ''\n")
> >>> E + where <function search at 0x7ff6115ddaa0> = re.search
> >>> E + and "ImpalaBeeswaxException:\n INNER EXCEPTION: <class
> >>> 'beeswaxd.ttypes.BeeswaxException'>\n MESSAGE: No mapping found for
> >>> request from user 'quanlong.huang' with requested pool ''\n" =
> >>> str(ImpalaBeeswaxException())
> >>>
> >>>
> >>> What can I do to fix this?
> >>>
> >>>
> >>> Thanks,
> >>> Quanlong
>
Re:Re:Re: Build failure in TestAdmissionController
Posted by Quanlong Huang <hu...@126.com>.
Hi all,
I've fixed all the test failures in my dev environment and here is the patch: https://gerrit.cloudera.org/#/c/8807/
It has passed the gerrit-verify-dryrun-external test and here is the link: https://jenkins.impala.io/job/gerrit-verify-dryrun/1604/ (Don't know how to let Jenkins comment in gerrit after build succeed like you do ...)
Would you please have a look at it?
Thanks,
Quanlong
At 2017-12-09 21:49:23, "Quanlong Huang" <hu...@126.com> wrote:
>Thanks, Dimitris!
>
>
>The cause is my problematic username and group name. There is a dot in them, which causes many tests to fail.
>
>
>I think we should make less assumption about the username and group names. I create a JIRA (https://issues.apache.org/jira/browse/IMPALA-6301) for this and will submit a code review later.
>
>
>Quanlong
>
>At 2017-12-09 08:11:36, "Dimitris Tsirogiannis" <dt...@cloudera.com> wrote:
>>I think the problem is the '.' in what the test infrastructure uses as a
>>group to assign roles which is your linux group 'quanlong.huang'. You can
>>try to quote the group (not sure if that will work) or change your group.
>>
>>Dimitris
>>
>>On Fri, Dec 8, 2017 at 4:00 PM, Quanlong Huang <hu...@126.com>
>>wrote:
>>
>>> Hi all,
>>>
>>>
>>> I'm working on the ORC support feature (IMPALA-5717). However, I encounter
>>> the following test errors not related to my patch:
>>>
>>>
>>> ERROR at setup of TestGrantRevoke.test_role_update[exec_option:
>>> {'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 0,
>>> 'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_th
>>> reshold': 0} | table_format: text/none]
>>> authorization/test_grant_revoke.py:47: in setup_method
>>> self.__test_cleanup()
>>> authorization/test_grant_revoke.py:72: in __test_cleanup
>>> self.client.execute("grant role grant_revoke_test_admin to group %s" %
>>> group_name)
>>> common/impala_connection.py:160: in execute
>>> return self.__beeswax_client.execute(sql_stmt, user=user)
>>> beeswax/impala_beeswax.py:173: in execute
>>> handle = self.__execute_query(query_string.strip(), user=user)
>>> beeswax/impala_beeswax.py:339: in __execute_query
>>> handle = self.execute_query_async(query_string, user=user)
>>> beeswax/impala_beeswax.py:335: in execute_query_async
>>> return self.__do_rpc(lambda: self.imp_service.query(query,))
>>> beeswax/impala_beeswax.py:460: in __do_rpc
>>> raise ImpalaBeeswaxException(self.__build_error_message(b), b)
>>> E ImpalaBeeswaxException: ImpalaBeeswaxException:
>>> E INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
>>> E MESSAGE: AnalysisException: Syntax error in line 1:
>>> E grant role grant_revoke_test_admin to group quanlong.huang
>>> E ^
>>> E Encountered: .
>>> E Expected
>>> E
>>> E CAUSED BY: Exception: Syntax error
>>> ……
>>> ======================================= FAILURES
>>> ==============================
>>> _________________ TestAdmissionController.test_set_request_pool
>>> __________________________
>>> hs2/hs2_test_suite.py:48: in add_session
>>> fn(self)
>>> custom_cluster/test_admission_controller.py:212: in test_set_request_pool
>>> self.__check_pool_rejected(client, pool, expected_error)
>>> custom_cluster/test_admission_controller.py:144: in __check_pool_rejected
>>> assert re.search(expected_error_re, str(e))
>>> E assert None
>>> E + where None = <function search at 0x7ff6115ddaa0>("No mapping found
>>> for request from user '\\w+' with requested pool ''",
>>> "ImpalaBeeswaxException:\n INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>\n
>>> MESSAGE: No mapping found for request from user 'quanlong.huang' with
>>> requested pool ''\n")
>>> E + where <function search at 0x7ff6115ddaa0> = re.search
>>> E + and "ImpalaBeeswaxException:\n INNER EXCEPTION: <class
>>> 'beeswaxd.ttypes.BeeswaxException'>\n MESSAGE: No mapping found for
>>> request from user 'quanlong.huang' with requested pool ''\n" =
>>> str(ImpalaBeeswaxException())
>>>
>>>
>>> What can I do to fix this?
>>>
>>>
>>> Thanks,
>>> Quanlong
Re:Re: Build failure in TestAdmissionController
Posted by Quanlong Huang <hu...@126.com>.
Thanks, Dimitris!
The cause is my problematic username and group name. There is a dot in them, which causes many tests to fail.
I think we should make less assumption about the username and group names. I create a JIRA (https://issues.apache.org/jira/browse/IMPALA-6301) for this and will submit a code review later.
Quanlong
At 2017-12-09 08:11:36, "Dimitris Tsirogiannis" <dt...@cloudera.com> wrote:
>I think the problem is the '.' in what the test infrastructure uses as a
>group to assign roles which is your linux group 'quanlong.huang'. You can
>try to quote the group (not sure if that will work) or change your group.
>
>Dimitris
>
>On Fri, Dec 8, 2017 at 4:00 PM, Quanlong Huang <hu...@126.com>
>wrote:
>
>> Hi all,
>>
>>
>> I'm working on the ORC support feature (IMPALA-5717). However, I encounter
>> the following test errors not related to my patch:
>>
>>
>> ERROR at setup of TestGrantRevoke.test_role_update[exec_option:
>> {'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 0,
>> 'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_th
>> reshold': 0} | table_format: text/none]
>> authorization/test_grant_revoke.py:47: in setup_method
>> self.__test_cleanup()
>> authorization/test_grant_revoke.py:72: in __test_cleanup
>> self.client.execute("grant role grant_revoke_test_admin to group %s" %
>> group_name)
>> common/impala_connection.py:160: in execute
>> return self.__beeswax_client.execute(sql_stmt, user=user)
>> beeswax/impala_beeswax.py:173: in execute
>> handle = self.__execute_query(query_string.strip(), user=user)
>> beeswax/impala_beeswax.py:339: in __execute_query
>> handle = self.execute_query_async(query_string, user=user)
>> beeswax/impala_beeswax.py:335: in execute_query_async
>> return self.__do_rpc(lambda: self.imp_service.query(query,))
>> beeswax/impala_beeswax.py:460: in __do_rpc
>> raise ImpalaBeeswaxException(self.__build_error_message(b), b)
>> E ImpalaBeeswaxException: ImpalaBeeswaxException:
>> E INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
>> E MESSAGE: AnalysisException: Syntax error in line 1:
>> E grant role grant_revoke_test_admin to group quanlong.huang
>> E ^
>> E Encountered: .
>> E Expected
>> E
>> E CAUSED BY: Exception: Syntax error
>> ……
>> ======================================= FAILURES
>> ==============================
>> _________________ TestAdmissionController.test_set_request_pool
>> __________________________
>> hs2/hs2_test_suite.py:48: in add_session
>> fn(self)
>> custom_cluster/test_admission_controller.py:212: in test_set_request_pool
>> self.__check_pool_rejected(client, pool, expected_error)
>> custom_cluster/test_admission_controller.py:144: in __check_pool_rejected
>> assert re.search(expected_error_re, str(e))
>> E assert None
>> E + where None = <function search at 0x7ff6115ddaa0>("No mapping found
>> for request from user '\\w+' with requested pool ''",
>> "ImpalaBeeswaxException:\n INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>\n
>> MESSAGE: No mapping found for request from user 'quanlong.huang' with
>> requested pool ''\n")
>> E + where <function search at 0x7ff6115ddaa0> = re.search
>> E + and "ImpalaBeeswaxException:\n INNER EXCEPTION: <class
>> 'beeswaxd.ttypes.BeeswaxException'>\n MESSAGE: No mapping found for
>> request from user 'quanlong.huang' with requested pool ''\n" =
>> str(ImpalaBeeswaxException())
>>
>>
>> What can I do to fix this?
>>
>>
>> Thanks,
>> Quanlong
Re: Build failure in TestAdmissionController
Posted by Dimitris Tsirogiannis <dt...@cloudera.com>.
I think the problem is the '.' in what the test infrastructure uses as a
group to assign roles which is your linux group 'quanlong.huang'. You can
try to quote the group (not sure if that will work) or change your group.
Dimitris
On Fri, Dec 8, 2017 at 4:00 PM, Quanlong Huang <hu...@126.com>
wrote:
> Hi all,
>
>
> I'm working on the ORC support feature (IMPALA-5717). However, I encounter
> the following test errors not related to my patch:
>
>
> ERROR at setup of TestGrantRevoke.test_role_update[exec_option:
> {'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 0,
> 'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_th
> reshold': 0} | table_format: text/none]
> authorization/test_grant_revoke.py:47: in setup_method
> self.__test_cleanup()
> authorization/test_grant_revoke.py:72: in __test_cleanup
> self.client.execute("grant role grant_revoke_test_admin to group %s" %
> group_name)
> common/impala_connection.py:160: in execute
> return self.__beeswax_client.execute(sql_stmt, user=user)
> beeswax/impala_beeswax.py:173: in execute
> handle = self.__execute_query(query_string.strip(), user=user)
> beeswax/impala_beeswax.py:339: in __execute_query
> handle = self.execute_query_async(query_string, user=user)
> beeswax/impala_beeswax.py:335: in execute_query_async
> return self.__do_rpc(lambda: self.imp_service.query(query,))
> beeswax/impala_beeswax.py:460: in __do_rpc
> raise ImpalaBeeswaxException(self.__build_error_message(b), b)
> E ImpalaBeeswaxException: ImpalaBeeswaxException:
> E INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
> E MESSAGE: AnalysisException: Syntax error in line 1:
> E grant role grant_revoke_test_admin to group quanlong.huang
> E ^
> E Encountered: .
> E Expected
> E
> E CAUSED BY: Exception: Syntax error
> ……
> ======================================= FAILURES
> ==============================
> _________________ TestAdmissionController.test_set_request_pool
> __________________________
> hs2/hs2_test_suite.py:48: in add_session
> fn(self)
> custom_cluster/test_admission_controller.py:212: in test_set_request_pool
> self.__check_pool_rejected(client, pool, expected_error)
> custom_cluster/test_admission_controller.py:144: in __check_pool_rejected
> assert re.search(expected_error_re, str(e))
> E assert None
> E + where None = <function search at 0x7ff6115ddaa0>("No mapping found
> for request from user '\\w+' with requested pool ''",
> "ImpalaBeeswaxException:\n INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>\n
> MESSAGE: No mapping found for request from user 'quanlong.huang' with
> requested pool ''\n")
> E + where <function search at 0x7ff6115ddaa0> = re.search
> E + and "ImpalaBeeswaxException:\n INNER EXCEPTION: <class
> 'beeswaxd.ttypes.BeeswaxException'>\n MESSAGE: No mapping found for
> request from user 'quanlong.huang' with requested pool ''\n" =
> str(ImpalaBeeswaxException())
>
>
> What can I do to fix this?
>
>
> Thanks,
> Quanlong