[jira] [Commented] (HDDS-5447) HttpFS support in Ozone

["István Fajth (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HDDS-5447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17391726#comment-17391726 ] 

István Fajth commented on HDDS-5447:
------------------------------------

We already created a branch in the Ozone project to do some proof of concept work with [~zitadombi], and a design doc is also in the making, we have a few things to polish mainly around uploading files to an Ozone cluster via the REST endpoint, and enumeration of the features, and how we want to support them in Ozone, or what dependencies we have that still to be developed.

[~weichiu], I am doing my best to upload the design doc in the coming days, aiming for today or tomorrow. The aim is to provide the same API, but there are lot's of API endpoints that have no counterpart in Ozone so far, where we plan to genuinely provide an error code back, while there is a question still to be discussed about whether we should provide a separate api to create volumes and buckets, and to manage volume and bucket things, but this we think to be answered after the basics are working. Until that we will provide functionality around volumes and buckets similarly to the ofs scheme.

The sub-tasks that are already created for the JIRA are finished in Zita's fork, we will work to finalize those early next week when she will be available to work on this further.

> HttpFS support in Ozone
> -----------------------
>
>                 Key: HDDS-5447
>                 URL: https://issues.apache.org/jira/browse/HDDS-5447
>             Project: Apache Ozone
>          Issue Type: New Feature
>          Components: Ozone Client, Ozone Manager
>            Reporter: Aravindan Vijayan
>            Assignee: István Fajth
>            Priority: Major
>
> There are several tools out there mainly written in Python, that uses the webhdfs interface to connect to HDFS. Even there are quite a few other filesystem implementations that provide access via the same rest interface that HDFS provides.
> HUE also implements the HDFS file browser by accessing HDFS via the REST API either on the NameNodes or on HTTPFS Server instances added to the HDFS service.
> This gave the inspiration to check and experiment what is required to support a similar REST endpoint over Ozone.
> The advantage is that we can ease the migration of tools developed in-house that are using this interface of HDFS, while we can add the possibility to browse Ozone from HUE.
> There is literally no disadvantage of having such an interface, as we can implement it as a separate module which does not have any interference with the rest of the code, as the REST endpoint as with HTTPFS will use a regular Java based Ozone client to serve any requests.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org