You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ranger.apache.org by "Madhan Neethiraj (JIRA)" <ji...@apache.org> on 2018/06/22 16:46:00 UTC

[jira] [Comment Edited] (RANGER-1300) S3 support

    [ https://issues.apache.org/jira/browse/RANGER-1300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16520572#comment-16520572 ] 

Madhan Neethiraj edited comment on RANGER-1300 at 6/22/18 4:45 PM:
-------------------------------------------------------------------

[~bolke] - great start! Recently Atlas community has added types for S3 - which include aws_s3_bucket, aws_s3_pseudo_dir and aws_s3_object (ATLAS-2708); also updated Atlas hook for Hive to recognize S3 path references in DDL/DML and populate Atlas with appropriate S3 entities (ATLAS-2760). It might be useful to model Ranger resources to be in sync with Atlas entity-types. Please review resource-definitions in the attached  [^ranger-servicedef-aws-s3.json] . Access-types in this service-def only have get/put/delete of objects. Your service-def cover bucket level as well - which is better. Let's continue to take this further. Thanks!


was (Author: madhan.neethiraj):
[~bolke] - great start! Recently Atlas community has added types for S3 - which include aws_s3_bucket, aws_s3_pseudo_dir and aws_s3_object (ATLAS-2708); also updated Atlas hook for Hive to recognize S3 path references in DDL/DML and populate Atlas with appropriate S3 entities (ATLAS-2760). It might be useful to model Ranger resources to be in sync with Atlas entity-types. Please review resource-definitions in the attached ranger-servicedef-aws-s3.json. Access-types in this service-def only have get/put/delete of objects. Your service-def cover bucket level as well - which is better. Let's continue to take this further. Thanks!

> S3 support
> ----------
>
>                 Key: RANGER-1300
>                 URL: https://issues.apache.org/jira/browse/RANGER-1300
>             Project: Ranger
>          Issue Type: New Feature
>          Components: plugins
>            Reporter: Jose
>            Priority: Major
>         Attachments: ranger-servicedef-aws-s3.json
>
>
> As more and more people are deploying hadoop into AWS and as S3 is used in lots of application. It'd be nice to have S3 support built into Ranger.
> It's not a trivial task. Right now Ranger Storage support (only hdfs) runs directly in the Namenode



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)