You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Sammi Chen (Jira)" <ji...@apache.org> on 2025/02/26 09:39:00 UTC

[jira] [Commented] (HDDS-12391) Speed up container set loading during Datanode Startup

    [ https://issues.apache.org/jira/browse/HDDS-12391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17930616#comment-17930616 ] 

Sammi Chen commented on HDDS-12391:
-----------------------------------

[~ivanandika], datanode will start a thread for each volume. How many containers on one volume in this case?  Because the container yaml file reading slowness? 

> Speed up container set loading during Datanode Startup
> ------------------------------------------------------
>
>                 Key: HDDS-12391
>                 URL: https://issues.apache.org/jira/browse/HDDS-12391
>             Project: Apache Ozone
>          Issue Type: Improvement
>          Components: Ozone Datanode
>            Reporter: Ivan Andika
>            Priority: Major
>
> We found that DN startup took very long to send the first heartbeat to the SCM, causing SCM to think the DN is STALE and DEAD.
> Seems DN takes very long to read all the container files in ContainerReader, it takes approximately 30 minutes. We should try to optimize this (maybe need to support merging containers).
> {code:java}
> 2024-12-10 10:46:51,000 [main] INFO org.apache.hadoop.ozone.container.ozoneimpl.OzoneContainer: Build ContainerSet costs 1939s {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org