You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2022/08/18 01:53:00 UTC
[jira] [Commented] (IMPALA-11498) Change port range of TEZ's web UI server after TEZ-4347
[ https://issues.apache.org/jira/browse/IMPALA-11498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17581102#comment-17581102 ]
ASF subversion and git services commented on IMPALA-11498:
----------------------------------------------------------
Commit 46169e4ad29b5e5b4e50f88801f6a45da9764808 in impala's branch refs/heads/master from Fang-Yu Rao
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=46169e4ad ]
IMPALA-11498: Change port range of TEZ's web UI server
After TEZ-4347, by default TEZ would attempt to start a web UI server
before opening a session. The default port range for the server
specified in TezConfiguration.java (in the TEZ repository) is
"50000-50050", which does not seem to be a good choice in Impala's
testing environment in that there are always some other client programs
holding those ports when TEZ attempts to start its web UI server. As a
result, TEZ could not bind a port in the port range to start its web UI
server, resulting in TEZ session not being created, which in turn failed
some end-to-end test relying on TEZ, e.g., test_json_file_unsupported.
This patch explicitly sets the port range to "32000-32100" to avoid port
collision based on the parameter of 'ip_local_port_range', which is
"32768-60999" on the machine where Impala's tests are run.
Testing:
- Verified in 2 Jenkins runs of exhaustive RELEASE build that we do not
see test_json_file_unsupported fail again after this patch.
Change-Id: I3d067953f943a762ad50b0561570e96f0dc39791
Reviewed-on: http://gerrit.cloudera.org:8080/18851
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
> Change port range of TEZ's web UI server after TEZ-4347
> -------------------------------------------------------
>
> Key: IMPALA-11498
> URL: https://issues.apache.org/jira/browse/IMPALA-11498
> Project: IMPALA
> Issue Type: Task
> Components: Frontend
> Reporter: Fang-Yu Rao
> Assignee: Fang-Yu Rao
> Priority: Major
>
> After TEZ-4347, by default TEZ would attempt to start a web UI server before opening a session. The default port range for the server specified in [TezConfiguration.java|https://github.infra.cloudera.com/CDH/tez/blob/cdw-master/tez-api/src/main/java/org/apache/tez/dag/api/TezConfiguration.java#L1823] (in the TEZ repository) is "50000-50050", which does not seem to be a good choice in Impala's testing environment in that there are always some other client programs holding those ports when TEZ attempts to start its web UI server. As a result, TEZ could not bind a port in the port range to start its web UI
> server, resulting in TEZ session not being created.
> We should specify a better port ranger for TEZ once we start using a TEZ dependency with TEZ-4347.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org