You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@impala.apache.org by "Riza Suminto (Code Review)" <ge...@cloudera.org> on 2021/02/22 01:37:06 UTC

[Impala-ASF-CR] IMPALA-9767: Do not clean up filter while PublishFilter is ongoing

Hello Fang-Yu Rao, Joe McDonnell, Impala Public Jenkins, 

I'd like you to reexamine a change. Please visit

    http://gerrit.cloudera.org:8080/17095

to look at the new patch set (#2).

Change subject: IMPALA-9767: Do not clean up filter while PublishFilter is ongoing
......................................................................

IMPALA-9767: Do not clean up filter while PublishFilter is ongoing

There have been occurrences of heap-use-after-free in ASAN build during
runtime filter publishing. This issue happens because a Bloom filter is
cleaning up while the coordinator is still sending the aggregated filter
via KRPC to workers. This patch removes the offending cleanup routine.
This patch also decouples the cleanup routine from
FilterState::DisableAndRelease() into a separate method
FilterState::Release() and asserts that no RPC is inflight while
cleaning up the filter.

Testing:
- Reproduce the bug by instrumenting Coordinator::UpdateFilter().
- Manually verify that the bug does not happen anymore after the patch.
- Pass core tests in ASAN build.

Change-Id: I1c408bdedab83c4b9249e2c0c493cb0f894a3d08
---
M be/src/runtime/coordinator-backend-state.cc
M be/src/runtime/coordinator-filter-state.h
M be/src/runtime/coordinator.cc
3 files changed, 18 insertions(+), 20 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/95/17095/2
-- 
To view, visit http://gerrit.cloudera.org:8080/17095
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I1c408bdedab83c4b9249e2c0c493cb0f894a3d08
Gerrit-Change-Number: 17095
Gerrit-PatchSet: 2
Gerrit-Owner: Riza Suminto <ri...@cloudera.com>
Gerrit-Reviewer: Fang-Yu Rao <fa...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <im...@cloudera.com>
Gerrit-Reviewer: Joe McDonnell <jo...@cloudera.com>
Gerrit-Reviewer: Riza Suminto <ri...@cloudera.com>