You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Ewan Higgs (JIRA)" <ji...@apache.org> on 2018/08/06 12:48:00 UTC
[jira] [Comment Edited] (HDFS-13777) [PROVIDED Phase 2] Scheduler
in the NN for distributing DNA_BACKUP work.
[ https://issues.apache.org/jira/browse/HDFS-13777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570167#comment-16570167 ]
Ewan Higgs edited comment on HDFS-13777 at 8/6/18 12:47 PM:
------------------------------------------------------------
001
- Add Remove method to AliasMap
- Add Scheduler to NN that will periodically snapshot the mount point, diff it with the previous snapshot, and create work.
- Add tracker for work in progress.
- End-to-end test(s) "TestGrandSyncTask" as described in HDFS-13421
This is a rather large patch so I am looking to break it up. For example, I can pull out the AliasMap changes into a separate ticket.
[~virajith], please let me know if you have questions or thoughts on how to better break this up.
was (Author: ehiggs):
001
- Add Remove method to AliasMap
- Add Scheduler to NN that will periodically snapshot the mount point, diff it with the previous snapshot, and create work.
- Add tracker for work in progress.
- End-to-end test(s) "TestGrandSyncTask" as described in HDFS-13421
This is a rather large patch so I am looking to break it up. For example, I can pull out the AliasMap changes into a separate ticket.
> [PROVIDED Phase 2] Scheduler in the NN for distributing DNA_BACKUP work.
> ------------------------------------------------------------------------
>
> Key: HDFS-13777
> URL: https://issues.apache.org/jira/browse/HDFS-13777
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Reporter: Ewan Higgs
> Assignee: Ewan Higgs
> Priority: Major
> Attachments: HDFS-13777-HDFS-12090.001.patch
>
>
> When the SyncService is running, it should periodically take snapshots, make a snapshotdiff, and then distribute DNA_BACKUP work to the Datanodes (See HDFS-13421). Upon completion of the work, the NN should update the AliasMap.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org