You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Sammi Chen (Jira)" <ji...@apache.org> on 2025/02/26 09:39:00 UTC
[jira] [Commented] (HDDS-12391) Speed up container set loading during Datanode Startup
[ https://issues.apache.org/jira/browse/HDDS-12391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17930616#comment-17930616 ]
Sammi Chen commented on HDDS-12391:
-----------------------------------
[~ivanandika], datanode will start a thread for each volume. How many containers on one volume in this case? Because the container yaml file reading slowness?
> Speed up container set loading during Datanode Startup
> ------------------------------------------------------
>
> Key: HDDS-12391
> URL: https://issues.apache.org/jira/browse/HDDS-12391
> Project: Apache Ozone
> Issue Type: Improvement
> Components: Ozone Datanode
> Reporter: Ivan Andika
> Priority: Major
>
> We found that DN startup took very long to send the first heartbeat to the SCM, causing SCM to think the DN is STALE and DEAD.
> Seems DN takes very long to read all the container files in ContainerReader, it takes approximately 30 minutes. We should try to optimize this (maybe need to support merging containers).
> {code:java}
> 2024-12-10 10:46:51,000 [main] INFO org.apache.hadoop.ozone.container.ozoneimpl.OzoneContainer: Build ContainerSet costs 1939s {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org