You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-issues@hadoop.apache.org by "Steve Loughran (Jira)" <ji...@apache.org> on 2020/02/09 15:39:00 UTC

[jira] [Created] (HADOOP-16848) add initial S3A layering + async init

Steve Loughran created HADOOP-16848:
---------------------------------------

             Summary: add initial S3A layering + async init
                 Key: HADOOP-16848
                 URL: https://issues.apache.org/jira/browse/HADOOP-16848
             Project: Hadoop Common
          Issue Type: Sub-task
          Components: fs/s3
    Affects Versions: 3.3.0
            Reporter: Steve Loughran
            Assignee: Steve Loughran


Split the S3A code into layers

* S3AFileSystem
* S3AStore + Impl
* RawS3A + Impl

S3AFS will create the others and start in order: DelegationTokens, RawS3A, S3AStore, Metastore

this will involve wrapping all access of DTs, s3client, Metastore to block until that layer is complete, or raise an exception if instantiation of it/predecessor failed.

New layers will all be subclasses of Service, split into Interface and Impl, so we can manage the init/start/stop lifecycle with existing code



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org