[jira] [Resolved] (IMPALA-7151) session-expiry-test failed - unable to open ThriftServer port

["Tim Armstrong (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/IMPALA-7151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tim Armstrong resolved IMPALA-7151.
-----------------------------------
       Resolution: Fixed
    Fix Version/s: Impala 3.1.0

IMPALA-7151: Rework ephemeral port assignment for be tests

Instead of using FindUnusedEphemeralPort() to choose
many ephemeral ports for in-process servers, we use
Thrift's builtin wildcard ports, where it picks an
ephemeral port when the configured port is 0. This
should be more robust because there's no window where
something else can steal our port. Only Thrift 0.9.2+
support the getPort() method required for this.

This does not necessarily make all ImpalaServer
functionality work with ports configured to 0,
just enough to get expr-test and session-expiry-test
to work. E.g. various strings and names get port 0 in
them and query execution may not work end-to-end.

Some tests still use FindUnusedEphemeralPort() to
pick a single port at a time. We haven't seen that usage pattern
to be flaky with any frequency and it appears to be more work
to fix those, so I left them for now.

Testing:
Ran core tests.

Cherry-picks: not for 2.x

Change-Id: I2fcc9243099f8249380ac5f01ac5eb67cba24cf5
Reviewed-on: http://gerrit.cloudera.org:8080/10740
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>


> session-expiry-test failed - unable to open ThriftServer port
> -------------------------------------------------------------
>
>                 Key: IMPALA-7151
>                 URL: https://issues.apache.org/jira/browse/IMPALA-7151
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Infrastructure
>    Affects Versions: Impala 2.13.0
>            Reporter: Tim Armstrong
>            Assignee: Tim Armstrong
>            Priority: Critical
>              Labels: flaky
>             Fix For: Impala 3.1.0
>
>         Attachments: session-expiry-test.ERROR, session-expiry-test.FATAL, session-expiry-test.INFO, session-expiry-test.WARNING
>
>
> {noformat}
> ThriftServer 'backend' (on port: 52436) exited due to TException: Could not bind: Transport endpoint is not connected
> {noformat}
> This is similar to IMPALA-5499 but is on CentOS 7:
> {noformat}
> # lsb_release -a
> LSB Version:	:core-4.1-amd64:core-4.1-noarch:cxx-4.1-amd64:cxx-4.1-noarch:desktop-4.1-amd64:desktop-4.1-noarch:languages-4.1-amd64:languages-4.1-noarch:printing-4.1-amd64:printing-4.1-noarch
> Distributor ID:	CentOS
> Description:	CentOS Linux release 7.4.1708 (Core) 
> Release:	7.4.1708
> Codename:	Core
> {noformat}
> It's in the ephemeral port range:
> {noformat}
> # cat /proc/sys/net/ipv4/ip_local_port_range
> 32768	60999
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org