You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-dev@hadoop.apache.org by "Simbarashe Dzinamarira (Jira)" <ji...@apache.org> on 2023/04/06 02:43:00 UTC

[jira] [Resolved] (HDFS-16943) RBF: Implement MySQL based StateStoreDriver

     [ https://issues.apache.org/jira/browse/HDFS-16943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Simbarashe Dzinamarira resolved HDFS-16943.
-------------------------------------------
    Hadoop Flags: Reviewed
      Resolution: Fixed

> RBF: Implement MySQL based StateStoreDriver
> -------------------------------------------
>
>                 Key: HDFS-16943
>                 URL: https://issues.apache.org/jira/browse/HDFS-16943
>             Project: Hadoop HDFS
>          Issue Type: Task
>          Components: hdfs, rbf
>            Reporter: Simbarashe Dzinamarira
>            Assignee: Simbarashe Dzinamarira
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 3.4.0
>
>
> RBF supports two types of StateStoreDrivers
>  # StateStoreFileImpl
>  # StateStoreZooKeeperImpl
> I propose implementing a third driver that is backed by MySQL.
>  * StateStoreZooKeeperImpl requires an additional Zookeeper cluster.
>  * StateStoreFileImpl can use one of the namenodes in the HDFS cluster, but that namenode becomes a single point of failure, introducing coupling between the federated clusters.
>  HADOOP-18535 implemented a MySQL token store. When tokens are stored in MySQL, using MySQL for the StateStore as well reduces the number of external dependencies for routers.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org