You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Palakur Eshwitha Sai (Jira)" <ji...@apache.org> on 2024/07/16 09:56:00 UTC

[jira] [Updated] (HDFS-17583) Support auto-refresh of latest viewDFS mount configuration

     [ https://issues.apache.org/jira/browse/HDFS-17583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Palakur Eshwitha Sai updated HDFS-17583:
----------------------------------------
    Component/s: ViewHDFS

> Support auto-refresh of latest viewDFS mount configuration
> ----------------------------------------------------------
>
>                 Key: HDFS-17583
>                 URL: https://issues.apache.org/jira/browse/HDFS-17583
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: ViewHDFS
>            Reporter: Palakur Eshwitha Sai
>            Assignee: Palakur Eshwitha Sai
>            Priority: Major
>
> Currently, the central mount table configuration feature for viewDFS loads the latest mounts each time the viewDFS initialize function is called. But in the case of use cases with hive, hive does the call to initialize the fs only for the first time after HS2 restart. From then on, it fetches the filesystem/ resolved mount points from the cache.
> This requires HS2 restart each time some data is moved to S3 or other hadoop compatible file systems and a new mount-table.xml file is added to the viewDFS central mount config directory, which is not ideal.
> Should implement a way in which the mount table is auto loaded at specific intervals/ each time the central mount-table directory is updated with a new mount-table.xml file. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org