You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Steve Loughran (Jira)" <ji...@apache.org> on 2022/10/07 11:33:00 UTC

[jira] [Resolved] (HADOOP-18442) Remove the hadoop-openstack module

     [ https://issues.apache.org/jira/browse/HADOOP-18442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Steve Loughran resolved HADOOP-18442.
-------------------------------------
    Fix Version/s: 3.3.5
     Release Note: The swift:// connector for openstack support has been removed. It had fundamental problems (swift's handling of files > 4GB). A subset of the S3 protocol is now exported by almost all object store services -please use that through the s3a connector instead. The hadoop-openstack jar remains, only now it is empty of code. This is to ensure that projects which declare the JAR a dependency will still have successful builds.  (was: The swift:// connector for openstack support has been removed. It had fundamental problems (swifts handling of files > 4GB). A subset of the S3 protocol is now exported by almost all object store services -please use that through the s3a connector instead. The hadoop-openstack jar remains, only now it is empty of code. This is to ensure that projects which declare the JAR a dependency will still have successful builds.)
       Resolution: Fixed

> Remove the hadoop-openstack module
> ----------------------------------
>
>                 Key: HADOOP-18442
>                 URL: https://issues.apache.org/jira/browse/HADOOP-18442
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: build, fs
>    Affects Versions: 3.3.5
>            Reporter: Steve Loughran
>            Assignee: Steve Loughran
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 3.4.0, 3.3.5
>
>
>  the openstack module doesn't get tested or maintained; it's just something else to keep up to date security wise. As nobody ever files bugs on it it is clearly not being used either.
>  
>  On-prem object stores support the S3 APIs and/or provide their own hadoop connectors (ozone, IBM).
>  
>  Let's just cut it completely. As someone who co-authored a lot of it I am happy to do the duty. I will do a quick review of all test to see if there are any left which we could pull into hadoop common...the FS contract tests were initially derived from the ones I did here.
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org