You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Joe McDonnell (JIRA)" <ji...@apache.org> on 2018/10/02 16:53:00 UTC
[jira] [Commented] (IMPALA-7639) impala-shell stuck at "Starting
Impala Shell without Kerberos authentication" in
test_multiline_queries_in_history
[ https://issues.apache.org/jira/browse/IMPALA-7639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16635807#comment-16635807 ]
Joe McDonnell commented on IMPALA-7639:
---------------------------------------
I added some code to track the number of beeswax and HS2 connections and output them every 10 seconds. The number of beeswax connections is hitting 64, the default value of fe_service_threads, during our tests. I tracked it down to query_test/test_udfs.py::TestUdfExecution::test_native_functions_race(). This test spawns multiple threads to test concurrency for add/drop of functions. Running this test alone maxes out the number of beeswax connections and our tests can run multiple variants of this test simultaneously. On my machine, running with fe_service_threads=5000, the number of beeswax connections goes into the hundreds during these tests, peaking at 462. TestUdfTargeted::test_concurrent_jar_drop_use() also maxes out the beeswax connections.
Switching the shell tests to run in parallel means they can now overlap with these tests when they couldn't before.
Code locations:
* [https://github.com/apache/impala/blob/master/tests/query_test/test_udfs.py#L301]
* [https://github.com/apache/impala/blob/master/tests/query_test/test_udfs.py#L364]
* [https://github.com/apache/impala/blob/master/tests/query_test/test_udfs.py#L519]
> impala-shell stuck at "Starting Impala Shell without Kerberos authentication" in test_multiline_queries_in_history
> ------------------------------------------------------------------------------------------------------------------
>
> Key: IMPALA-7639
> URL: https://issues.apache.org/jira/browse/IMPALA-7639
> Project: IMPALA
> Issue Type: Improvement
> Components: Infrastructure
> Affects Versions: Impala 3.1.0
> Reporter: Tianyi Wang
> Assignee: Joe McDonnell
> Priority: Critical
> Labels: broken-build, flaky
>
> Impala-shell wrote nothing other than "Starting Impala Shell without Kerberos authentication" to stdout until timeout.
> {noformat}
> 03:11:31 [gw3] linux2 -- Python 2.7.12 /home/ubuntu/Impala/bin/../infra/python/env/bin/python
> 03:11:31 shell/test_shell_interactive.py:303: in test_multiline_queries_in_history
> 03:11:31 child_proc.expect(PROMPT_REGEX)
> 03:11:31 ../infra/python/env/local/lib/python2.7/site-packages/pexpect/__init__.py:1451: in expect
> 03:11:31 timeout, searchwindowsize)
> 03:11:31 ../infra/python/env/local/lib/python2.7/site-packages/pexpect/__init__.py:1466: in expect_list
> 03:11:31 timeout, searchwindowsize)
> 03:11:31 ../infra/python/env/local/lib/python2.7/site-packages/pexpect/__init__.py:1568: in expect_loop
> 03:11:31 raise TIMEOUT(str(err) + '\n' + str(self))
> 03:11:31 E TIMEOUT: Timeout exceeded.
> 03:11:31 E <pexpect.spawn object at 0x7f53cc155390>
> 03:11:31 E version: 3.3
> 03:11:31 E command: /home/ubuntu/Impala/bin/impala-shell.sh
> 03:11:31 E args: ['/home/ubuntu/Impala/bin/impala-shell.sh']
> 03:11:31 E searcher: <pexpect.searcher_re object at 0x7f53cc155c10>
> 03:11:31 E buffer (last 100 chars): 'Starting Impala Shell without Kerberos authentication\r\n'
> 03:11:31 E before (last 100 chars): 'Starting Impala Shell without Kerberos authentication\r\n'
> 03:11:31 E after: <class 'pexpect.TIMEOUT'>
> 03:11:31 E match: None
> 03:11:31 E match_index: None
> 03:11:31 E exitstatus: None
> 03:11:31 E flag_eof: False
> 03:11:31 E pid: 118020
> 03:11:31 E child_fd: 18
> 03:11:31 E closed: False
> 03:11:31 E timeout: 30
> 03:11:31 E delimiter: <class 'pexpect.EOF'>
> 03:11:31 E logfile: None
> 03:11:31 E logfile_read: None
> 03:11:31 E logfile_send: None
> 03:11:31 E maxread: 2000
> 03:11:31 E ignorecase: False
> 03:11:31 E searchwindowsize: None
> 03:11:31 E delaybeforesend: 0.05
> 03:11:31 E delayafterclose: 0.1
> 03:11:31 E delayafterterminate: 0.1
> {noformat}
> https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/3258/console
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org