You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@impala.apache.org by "Abhishek Rawat (Jira)" <ji...@apache.org> on 2022/12/16 15:58:00 UTC

[jira] [Created] (IMPALA-11804) Use proper capacity storage units such as KB, GB, TB

Abhishek Rawat created IMPALA-11804:
---------------------------------------

             Summary: Use proper capacity storage units such as KB, GB, TB
                 Key: IMPALA-11804
                 URL: https://issues.apache.org/jira/browse/IMPALA-11804
             Project: IMPALA
          Issue Type: Task
          Components: Backend
            Reporter: Abhishek Rawat


Most cloud vendors advertise storage in base 10 units such as GB, TB. Impala considers these storage units to be base 2. This could cause issue because when configuring data_cache or scratch_space Impala could try to use more capacity than what the underlying storage provides.

It's okay for Impala to use base 2 units, but it should support configs using base 10 units and also use proper units (KiB, GiB, TiB) internally and everywhere else such as web UI, query profile, etc.

The logic for parsing memory configs is here: https://github.com/apache/impala/blob/master/be/src/util/parse-util.cc#L39



--
This message was sent by Atlassian Jira
(v8.20.10#820010)