You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by "Nirdosh Kumar Yadav (Jira)" <ji...@apache.org> on 2024/12/24 08:07:00 UTC
[jira] [Created] (HBASE-29041) Set UncaughtException Handler for RegionServer ExecutorService
Nirdosh Kumar Yadav created HBASE-29041:
-------------------------------------------
Summary: Set UncaughtException Handler for RegionServer ExecutorService
Key: HBASE-29041
URL: https://issues.apache.org/jira/browse/HBASE-29041
Project: HBase
Issue Type: Bug
Components: regionserver
Affects Versions: 2.5.10, 2.6.1, 3.0.0
Reporter: Nirdosh Kumar Yadav
In HBase cluster we have encountered a scenario where regionserver server crash procedure(SCP) waited for more than 3 Hours. Incident was triggered due to temporary network unavailability in hbase cluster. On Debugging found out SCP was stuck due to child {{SplitWALProcedure}} which was waiting for completion of SpliWalRemote procedure by regionserver worker. SplitWALRemote procedure while running encountered{{{} an unknown exception. In logs we can see "hdfs{}}}{{{}.{}}}{{{}DataStreamer{}}}{{ }}{{-}}{{ }}{{No}}{{ }}{{ack}}{{ }}{{{}receive{}}}{{{}d{}}}" error while regionserver connecting to Data Node. After this error thread was stuck or died as there was no related logs exists{{{}. There were inconsistent regions reported during this period. All procedure were restarted and completed after Active HMaster service was bounced. {}}}
Related logs:
--
This message was sent by Atlassian Jira
(v8.20.10#820010)