[Impala-ASF-CR] IMPALA-10811 RPC to submit query getting stuck for AWS NLB forever

["Qifan Chen (Code Review)" <ge...@cloudera.org>]

Qifan Chen has uploaded a new patch set (#7). ( http://gerrit.cloudera.org:8080/17872 )

Change subject: IMPALA-10811 RPC to submit query getting stuck for AWS NLB forever
......................................................................

IMPALA-10811 RPC to submit query getting stuck for AWS NLB forever

This patch addresses Impala client hang due to AWS network load balancer
timeout. The scope of the fix applies to the following Impala clients.

  1. HS2
  2. Beeswax
  3. Impyla
  4. HUE

These clients issue thrift RPC ExecuteStatement() followed by repeated
call to GetOperationStatus() (HS2, Impyla and HUE) or a variant of it
(Beeswax) to Impala backend.

In the fix, the backend method ImpalaServer::ExecuteStatement()
starts a new thread for ImpalaServer::ExecuteStatementCommon() which
can reach two stages: COMPILED and DONE. The COMPILED is when the
query has been successfully compiled and the DONE is for the execution
to reach the end successfully or to encounter any errors. The main
thread, which start the new thread, waits for the COMPILED state
before advancing to another short wait period for the DONE state. If
the DONE state is not reached, the control is returned back to the
client and the client will issue GetOperationStatus() repeatedly to
check if the execution has reached the DONE state.

The TCLIService protocol between the client and Impala server
is unchanged.

Testing: TBD

Change-Id: Ib57e86926a233ef13d27a9ec8d9c36d33a88a44e
---
M be/src/service/client-request-state.cc
M be/src/service/impala-beeswax-server.cc
M be/src/service/impala-hs2-server.cc
M be/src/service/impala-server.cc
M be/src/service/impala-server.h
5 files changed, 176 insertions(+), 21 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/72/17872/7
-- 
To view, visit http://gerrit.cloudera.org:8080/17872
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Ib57e86926a233ef13d27a9ec8d9c36d33a88a44e
Gerrit-Change-Number: 17872
Gerrit-PatchSet: 7
Gerrit-Owner: Qifan Chen <qc...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <im...@cloudera.com>
Gerrit-Reviewer: Qifan Chen <qc...@cloudera.com>