You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Erik Krogen (JIRA)" <ji...@apache.org> on 2018/05/23 16:44:00 UTC
[jira] [Comment Edited] (HDFS-13150) [Edit Tail Fast Path] Allow
SbNN to tail in-progress edits from JN via RPC
[ https://issues.apache.org/jira/browse/HDFS-13150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16487611#comment-16487611 ]
Erik Krogen edited comment on HDFS-13150 at 5/23/18 4:43 PM:
-------------------------------------------------------------
Attaching v2 document with some changes to reflect decisions made during implementation. The only larger change is to the way the in-memory cache of edits is set up (see section _JournalNode Edit Cache_).
I have created four parts to the JIRA to split it into smaller, easier to review sections: HDFS-13607, HDFS-13608, HDFS-13609, HDFS-13610. Uploading patches there now.
was (Author: xkrogen):
Attaching v2 document with some changes to reflect decisions made during implementation. The only larger change is to the way the in-memory cache of edits is set up (see section _JournalNode Edit Cache_).
I have created four parts to the JIRA to split it into smaller, easier to review sections: HDFS-13607, HDFS-13608, HDFS-13609, HDFS-13610
> [Edit Tail Fast Path] Allow SbNN to tail in-progress edits from JN via RPC
> --------------------------------------------------------------------------
>
> Key: HDFS-13150
> URL: https://issues.apache.org/jira/browse/HDFS-13150
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: ha, hdfs, journal-node, namenode
> Reporter: Erik Krogen
> Assignee: Erik Krogen
> Priority: Major
> Attachments: edit-tailing-fast-path-design-v0.pdf, edit-tailing-fast-path-design-v1.pdf, edit-tailing-fast-path-design-v2.pdf
>
>
> In the interest of making coordinated/consistent reads easier to complete with low latency, it is advantageous to reduce the time between when a transaction is applied on the ANN and when it is applied on the SbNN. We propose adding a new "fast path" which can be used to tail edits when low latency is desired. We leave the existing tailing logic in place, and fall back to this path on startup, recovery, and when the fast path encounters unrecoverable errors.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org