You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@impala.apache.org by jo...@apache.org on 2020/08/06 15:10:30 UTC

[impala] branch master updated: IMPALA-10047: Revert core piece of IMPALA-6984

This is an automated email from the ASF dual-hosted git repository.

joemcdonnell pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/impala.git


The following commit(s) were added to refs/heads/master by this push:
     new c413f9b  IMPALA-10047: Revert core piece of IMPALA-6984
c413f9b is described below

commit c413f9b558d51de877f497590baf14139ad5cf99
Author: Joe McDonnell <jo...@cloudera.com>
AuthorDate: Tue Aug 4 17:29:19 2020 -0700

    IMPALA-10047: Revert core piece of IMPALA-6984
    
    Performance testing on TPC-DS found a peformance regression
    on short queries due to delayed exec status reports. Further
    testing traced this back to IMPALA-6984's behavior of
    cancelling backends on EOS. The coordinator log show that
    CancelBackends() call intermittently taking 10 seconds due
    to timing out in the RPC layer.
    
    As a temporary workaround, this reverts the core part of
    IMPALA-6984 that added that CancelBackends() call for EOS.
    It leaves the rest of IMPALA-6984 intact, as other code has built
    on top of it.
    
    Testing:
     - Core job
     - Performance tests
    
    Change-Id: Ibf00a56e91f0376eaaa552e3bb4763501bfb49e8
    (cherry picked from commit b91f3c0e064d592f3cdf2a2e089ca6546133ba55)
    Reviewed-on: http://gerrit.cloudera.org:8080/16288
    Reviewed-by: Joe McDonnell <jo...@cloudera.com>
    Tested-by: Impala Public Jenkins <im...@cloudera.com>
---
 be/src/runtime/coordinator.cc | 4 +---
 1 file changed, 1 insertion(+), 3 deletions(-)

diff --git a/be/src/runtime/coordinator.cc b/be/src/runtime/coordinator.cc
index b57d66f..0ceae83 100644
--- a/be/src/runtime/coordinator.cc
+++ b/be/src/runtime/coordinator.cc
@@ -714,9 +714,7 @@ void Coordinator::HandleExecStateTransition(
   // execution and release resources.
   ReleaseExecResources();
   if (new_state == ExecState::RETURNED_RESULTS) {
-    // Cancel all backends, but wait for the final status reports to be received so that
-    // we have a complete profile for this successful query.
-    CancelBackends(/*fire_and_forget=*/ false);
+    // TODO: IMPALA-6984: cancel all backends in this case too.
     WaitForBackends();
   } else {
     CancelBackends(/*fire_and_forget=*/ true);