You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@impala.apache.org by "Joe McDonnell (JIRA)" <ji...@apache.org> on 2018/02/28 16:20:00 UTC

[jira] [Resolved] (IMPALA-6530) Track time spent opening HDFS file handles

     [ https://issues.apache.org/jira/browse/IMPALA-6530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Joe McDonnell resolved IMPALA-6530.
-----------------------------------
       Resolution: Fixed
    Fix Version/s: Impala 2.12.0

> Track time spent opening HDFS file handles
> ------------------------------------------
>
>                 Key: IMPALA-6530
>                 URL: https://issues.apache.org/jira/browse/IMPALA-6530
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Backend
>    Affects Versions: Impala 2.10.0, Impala 2.11.0
>            Reporter: Joe McDonnell
>            Assignee: Joe McDonnell
>            Priority: Major
>             Fix For: Impala 2.12.0
>
>
> When the HDFS NameNode is overloaded, opening an HDFS file handle can become a time consuming operation and can become the bottleneck for the system. Currently, there is no statistic tracking time spent opening file handles. This limits the ability to determine the extent of the HDFS NameNode problem, especially when given only a single query profile.
> Impala should have a statistic at the HDFS scan node level tracking time spent opening file handles.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)