You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "zy.jordan (JIRA)" <ji...@apache.org> on 2019/07/18 03:49:00 UTC
[jira] [Commented] (HDFS-12978) Fine-grained locking while
consuming journal stream.
[ https://issues.apache.org/jira/browse/HDFS-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16887584#comment-16887584 ]
zy.jordan commented on HDFS-12978:
----------------------------------
Hi, [~shv], Could you let me know which issue is involved in the above mentioned problem of calling FSEditLog.selectInputStreams() multiple times?
> Fine-grained locking while consuming journal stream.
> ----------------------------------------------------
>
> Key: HDFS-12978
> URL: https://issues.apache.org/jira/browse/HDFS-12978
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: namenode
> Reporter: Konstantin Shvachko
> Assignee: Konstantin Shvachko
> Priority: Major
> Fix For: 3.2.0, 3.1.1, 3.0.4
>
> Attachments: HDFS-12978.001.patch, HDFS-12978.002.patch, HDFS-12978.003.patch
>
>
> In current implementation SBN consumes the entire segment of transactions under a single namesystem lock, which does not allow reads over a long period of time until the segment is processed. We should break the lock into fine grained chunks. In extreme case each transaction should release the lock once it is applied.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org