[jira] [Created] (HDFS-9806) Allow HDFS block replicas to be provided by an external storage system

["Chris Douglas (JIRA)" <ji...@apache.org>]

Chris Douglas created HDFS-9806:
-----------------------------------

             Summary: Allow HDFS block replicas to be provided by an external storage system
                 Key: HDFS-9806
                 URL: https://issues.apache.org/jira/browse/HDFS-9806
             Project: Hadoop HDFS
          Issue Type: New Feature
            Reporter: Chris Douglas


In addition to heterogeneous media, many applications work with heterogeneous storage systems. The guarantees and semantics provided by these systems are often similar, but not identical to those of [HDFS|https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/filesystem/index.html]. Any client accessing multiple storage systems is responsible for reasoning about each system independently, and must propagate/and renew credentials for each store.

Remote stores could be mounted under HDFS. Block locations could be mapped to immutable file regions, opaque IDs, or other tokens that represent a consistent view of the data. While correctness for arbitrary operations requires careful coordination between stores, in practice we can provide workable semantics with weaker guarantees.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)