[jira] [Updated] (HDDS-8417) Cap on queue of commands at DN

["Sumit Agrawal (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HDDS-8417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sumit Agrawal updated HDDS-8417:
--------------------------------
    Labels: proton  (was: )

> Cap on queue of commands at DN
> ------------------------------
>
>                 Key: HDDS-8417
>                 URL: https://issues.apache.org/jira/browse/HDDS-8417
>             Project: Apache Ozone
>          Issue Type: Improvement
>            Reporter: Sumit Agrawal
>            Assignee: Sumit Agrawal
>            Priority: Minor
>              Labels: proton
>             Fix For: 1.4.0
>
>
> When command is operating very slowly, its observed that queue is getting pilled up. In one of environment, below are queued up causing usages of approx 5GB memory,
>  * Block delete command: 2.8k
>  * Close Container command: 13k
>  * Close pipeline command: 2390k
>  * replicate container command: 57k
> This is happening when disk is almost full and command is running very slow.
> SCM keeps sending same command every heartbeat.
> So a cap on queue is required and need reject further command accumulation. This needs to be done for each command type queue based on memory occupancy and repeating of command from SCM.
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org