You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@impala.apache.org by "Wenzhe Zhou (Jira)" <ji...@apache.org> on 2021/02/05 06:00:17 UTC

[jira] [Created] (IMPALA-10476) Remove executor node with faulty disks from executor group

Wenzhe Zhou created IMPALA-10476:
------------------------------------

             Summary: Remove executor node with faulty disks from executor group
                 Key: IMPALA-10476
                 URL: https://issues.apache.org/jira/browse/IMPALA-10476
             Project: IMPALA
          Issue Type: Sub-task
          Components: Distributed Exec
            Reporter: Wenzhe Zhou


If an executor repeatedly get disk IO failures when read/write local disk, we should mark the node as down and remove it from executor group to avoid repeated query failures in the cluster.

The two main components of Impala that read / write from local disk are the spill-to-disk and data caching features. We need to to add stats to count local disk failures.

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)