You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Virajith Jalaparti (Jira)" <ji...@apache.org> on 2019/08/30 22:05:00 UTC
[jira] [Created] (HDFS-14805) Mounting external stores in HDFS
on-the-fly
Virajith Jalaparti created HDFS-14805:
-----------------------------------------
Summary: Mounting external stores in HDFS on-the-fly
Key: HDFS-14805
URL: https://issues.apache.org/jira/browse/HDFS-14805
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Virajith Jalaparti
Attachments: dynamic-mounts-in-hdfs.pdf
Provided storage (HDFS-9806) allows HDFS to address data in external storage systems, including cloud stores. Data mounted in this manner, seamlessly, appears to be part of HDFS for applications/clients. The external data can also be cached by HDFS on local disks and SSDs, accelerating remote data reads (HDFS-13069).
However, Provided storage was originally targeted at ephemeral HDFS deployments in the cloud (e.g., Azure HDInsight). Long running HDFS clusters are common in many other scenarios which can benefit from accessing data in remote stores. This JIRA targets such scenarios and aims to provide the ability to:
(a) Dynamically mount external stores in a HDFS cluster while supporting high availability.
(b) Mount multiple remote stores simultaneously.
(c) Reduce deployment overheads and simplify usability of Provided storage.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org