You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Konstantin Shvachko (Jira)" <ji...@apache.org> on 2020/02/20 01:56:00 UTC
[jira] [Commented] (HDFS-15185) StartupProgress reports edits
segments until the entire startup completes
[ https://issues.apache.org/jira/browse/HDFS-15185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040562#comment-17040562 ]
Konstantin Shvachko commented on HDFS-15185:
--------------------------------------------
HDFS-14500 tried to fix it, but it is still happening. Most of the excessive segments look like this:
{code}
ByteStringEditLog[406685107236, 406685108346] 203.99 KB (0/1111) 100%
ByteStringEditLog[406685108347, 406685110031] 348.07 KB (0/1685) 100%
ByteStringEditLog[406685110032, 406685111308] 277.39 KB (0/1277) 100%
ByteStringEditLog[406685111309, 406685112369] 239.67 KB (0/1061) 100%
ByteStringEditLog[406685112370, 406685113032] 129.18 KB (0/663) 100%
{code}
> StartupProgress reports edits segments until the entire startup completes
> -------------------------------------------------------------------------
>
> Key: HDFS-15185
> URL: https://issues.apache.org/jira/browse/HDFS-15185
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: namenode
> Affects Versions: 2.10.0
> Reporter: Konstantin Shvachko
> Assignee: Konstantin Shvachko
> Priority: Major
>
> Startup Progress page keeps reporting edits segments after the {{LOAD_EDITS}} stage is complete. New steps are added to StartupProgress while journal tailing until all startup phases are completed. This adds a lot of edits steps, since {{SAFEMODE}} phase can take a long time on a large cluster.
> With fast tailing the segments are small, but the number of them is large - 160K. This makes the page load forever.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org