You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@impala.apache.org by "Tim Armstrong (JIRA)" <ji...@apache.org> on 2018/02/23 21:29:00 UTC

[jira] [Resolved] (IMPALA-4835) HDFS scans should operate with a constrained number of I/O buffers

     [ https://issues.apache.org/jira/browse/IMPALA-4835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tim Armstrong resolved IMPALA-4835.
-----------------------------------
       Resolution: Fixed
    Fix Version/s: Impala 3.0

> HDFS scans should operate with a constrained number of I/O buffers
> ------------------------------------------------------------------
>
>                 Key: IMPALA-4835
>                 URL: https://issues.apache.org/jira/browse/IMPALA-4835
>             Project: IMPALA
>          Issue Type: Improvement
>          Components: Backend
>    Affects Versions: Impala 2.9.0
>            Reporter: Tim Armstrong
>            Assignee: Tim Armstrong
>            Priority: Major
>              Labels: resource-management
>             Fix For: Impala 3.0
>
>
> The HDFS scan nodes should be able to operate with a fixed number of I/O buffers in most cases (excluding very large rows). We should modify them to claim a reservation upfront and use this for all disk I/O.
> This probably also requires switching DiskIoMgr to allocate memory from BufferPool.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)