You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Christos Bisias (Jira)" <ji...@apache.org> on 2023/12/20 10:56:00 UTC

[jira] [Created] (HDDS-9972) Don't allow the user to set bucket quota close to the block size

Christos Bisias created HDDS-9972:
-------------------------------------

             Summary: Don't allow the user to set bucket quota close to the block size
                 Key: HDDS-9972
                 URL: https://issues.apache.org/jira/browse/HDDS-9972
             Project: Apache Ozone
          Issue Type: Bug
            Reporter: Christos Bisias


The default block size is 256MB. When storing a key, we are reserving and preallocating the space based on the block size, multiplied by the replication factor.

For example,
 * we want to write a 300MB key
 * 1 block = 256MB
 * 2 blocks = 512MB
 * the 300MB key will require 2 blocks
 * If Replication factor is Ratis THREE

We will need to preallocate *2blocks * 256MB * 3replfactor = 1536MB.*

Setting the bucket quota to anything lower than that, will result in allowing the user to write only 1 key in the bucket and that key's size should be less than 256MB. Any other write will be blocked due to disk space requirements.

We should set a limit to how low the bucket quota can be. This is a blur idea but it could be something likeĀ 

*default block size (get from config) * default replication factor (get from config) * X*

and upon failure there could be an error message like

*Default replication type is {}, replication factor is {} and block size is {}. Bucket quota can't be less than {}*



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org