[jira] [Commented] (HDDS-6818) Multi DC feature for Ozone

["Janus Chow (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HDDS-6818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17544783#comment-17544783 ] 

Janus Chow commented on HDDS-6818:
----------------------------------

[~umamaheswararao] Thank you for the advice.

I think it's of two different scenarios.
 * For NFly, it should be one client connecting to multi-dedicated clusters via viewFs, and every file is written to each cluster. (Correct me if I'm wrong.)
 * For the proposal in the design doc, it's one cluster with datanodes distributed in multi datacenters.

For NFly, since it's built on viewFs, which is very configuration cumbersome, and the article is quite old, I'm not sure if they have changed to RBF since it's much more succinct. Maybe in the future Ozone also can have Routers to manage different clusters.

Another thing is the writing mechanism of NFly might not be cost-efficient, from the article, it's reusing the Hadoop outputStream to write the data, so the replica should be 3 * N, which could be quite a waste of resources for many users.

 

Understand that the Multi-DC may have different priorities for different users, some care disaster recovery, some care latency, or locality. But I think this proposal is much more a basic prototype than a final result, it will only provide a default algorithm for the pipeline and container policy, and it can always be extended by each user.

 

> Multi DC feature for Ozone
> --------------------------
>
>                 Key: HDDS-6818
>                 URL: https://issues.apache.org/jira/browse/HDDS-6818
>             Project: Apache Ozone
>          Issue Type: New Feature
>            Reporter: Janus Chow
>            Assignee: Janus Chow
>            Priority: Major
>
> The aim of this Jira is to add the multi DC feature for Ozone. This feature will try to solve the latency and bandwidth issues of multi DC in two phases.
> Attached the design doc for reviewing: https://docs.google.com/document/d/1J_HTIQJ7x8BIMIaSuJPDhaJBLc4WdOqFJUCvCbD3MLE/edit?usp=sharing



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org