You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@impala.apache.org by "Qifan Chen (Code Review)" <ge...@cloudera.org> on 2021/09/27 20:39:57 UTC

[Impala-ASF-CR] [WIP] IMPALA-10811 RPC to submit query getting stuck for AWS NLB forever

Qifan Chen has uploaded a new patch set (#2). ( http://gerrit.cloudera.org:8080/17872 )

Change subject: [WIP] IMPALA-10811 RPC to submit query getting stuck for AWS NLB forever
......................................................................

[WIP] IMPALA-10811 RPC to submit query getting stuck for AWS NLB forever

This patch addresses Impala client hang due to AWS network load balancer
timeout. The scope of the fix applies to the following Impala clients.

  1. HS2
  2. Beeswax
  3. Impyla
  4. HUE

These clients issue thrift RPC ExecuteStatement() followed by repeated
call to GetOperationStatus() (HS2, Impyla and HUE) or a variant of it
(Beeswax) to Impala backend.

In the fix, the backend operation for ExecuteStatement() runs
asynchronously in a new thread and its completion status is checked
periodically via the equivalent of the GetOperationStatus() from the
client. A new execution state CATALOG_OP_RUNNING is added to represent
the new execution state.

Change-Id: Ib57e86926a233ef13d27a9ec8d9c36d33a88a44e
---
M be/src/exec/catalog-op-executor.cc
M be/src/exec/catalog-op-executor.h
M be/src/service/client-request-state.cc
M be/src/service/client-request-state.h
M be/src/service/impala-beeswax-server.cc
M be/src/service/impala-hs2-server.cc
6 files changed, 157 insertions(+), 6 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/72/17872/2
-- 
To view, visit http://gerrit.cloudera.org:8080/17872
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Ib57e86926a233ef13d27a9ec8d9c36d33a88a44e
Gerrit-Change-Number: 17872
Gerrit-PatchSet: 2
Gerrit-Owner: Qifan Chen <qc...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <im...@cloudera.com>