You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@atlas.apache.org by "Nikhil Bonte (Jira)" <ji...@apache.org> on 2020/07/07 12:28:00 UTC
[jira] [Updated] (ATLAS-3879) Ozone: ozone_key entity is directly
created under ozone_bucket
[ https://issues.apache.org/jira/browse/ATLAS-3879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nikhil Bonte updated ATLAS-3879:
--------------------------------
Description:
Apache ozone support addded in ATLAS-3836
Currently ozone_key entity is getting created under ozone_bucket.
e.g.
{code:java}
-> CREATE EXTERNAL TABLE sales (id int) row format delimited fields terminated by ' ' stored as textfile location 'o3fs://bucket1.volume1.ozone1/sale1/q1/sales';{code}
This query will create only 1 ozone_key directly under bucket "bucket1".
Created entities :
* o3fs://volume1@cm (ozone_key)
* o3fs://volume1.bucket1@cm (ozone_bucket)
* o3fs://bucket1.volume1.ozone1/sale1/q1/sales@cm (ozone_key)
This Jira will improve implementation to support add ozone_key under ozone_key.
With this, above query will result into following entites
* o3fs://volume1@cm (ozone_key)
* o3fs://volume1.bucket1@cm (ozone_bucket)
* o3fs://bucket1.volume1.ozone1/sale1/@cm (ozone_key) *child of ozone_bucket*
* o3fs://bucket1.volume1.ozone1/sale1/q1/@cm (ozone_key) *child of ozone_key*
* o3fs://bucket1.volume1.ozone1/sale1/q1/sales/@cm (ozone_key) *child of ozone_key*
This will bring Ozone model to be consistent with AWS S3 v2 and ADLS-Gen2 models.
was:
Apache ozone support addded in ATLAS-3836
Currently ozone_key entity is getting created under ozone_bucket.
e.g.
{code:java}
-> CREATE EXTERNAL TABLE sales (id int) row format delimited fields terminated by ' ' stored as textfile location 'o3fs://bucket1.volume1.ozone1/sale1/q1/sales';{code}
This query will create only 1 ozone_key directly under bucket "bucket1".
Entities will be
* o3fs://volume1@cm (ozone_key)
* o3fs://volume1.bucket1@cm (ozone_bucket)
* o3fs://bucket1.volume1.ozone1/sale1/q1/sales@cm (ozone_key)
This Jira will improve implementation to support add ozone_key under ozone_key.
With this above query will create following entites
* o3fs://volume1@cm (ozone_key)
* o3fs://volume1.bucket1@cm (ozone_bucket)
* o3fs://bucket1.volume1.ozone1/sale1/@cm (ozone_key) *child of ozone_bucket*
* o3fs://bucket1.volume1.ozone1/sale1/q1/@cm (ozone_key) *child of ozone_key*
* o3fs://bucket1.volume1.ozone1/sale1/q1/sales/@cm (ozone_key) *child of ozone_key*
This will bring Ozone model to be consistent with AWS S3 v2 and ADLS-Gen2 models.
> Ozone: ozone_key entity is directly created under ozone_bucket
> --------------------------------------------------------------
>
> Key: ATLAS-3879
> URL: https://issues.apache.org/jira/browse/ATLAS-3879
> Project: Atlas
> Issue Type: Bug
> Components: atlas-core
> Affects Versions: 2.0.0
> Reporter: Nikhil Bonte
> Assignee: Nikhil Bonte
> Priority: Major
>
> Apache ozone support addded in ATLAS-3836
> Currently ozone_key entity is getting created under ozone_bucket.
> e.g.
> {code:java}
> -> CREATE EXTERNAL TABLE sales (id int) row format delimited fields terminated by ' ' stored as textfile location 'o3fs://bucket1.volume1.ozone1/sale1/q1/sales';{code}
> This query will create only 1 ozone_key directly under bucket "bucket1".
> Created entities :
> * o3fs://volume1@cm (ozone_key)
> * o3fs://volume1.bucket1@cm (ozone_bucket)
> * o3fs://bucket1.volume1.ozone1/sale1/q1/sales@cm (ozone_key)
>
> This Jira will improve implementation to support add ozone_key under ozone_key.
> With this, above query will result into following entites
> * o3fs://volume1@cm (ozone_key)
> * o3fs://volume1.bucket1@cm (ozone_bucket)
> * o3fs://bucket1.volume1.ozone1/sale1/@cm (ozone_key) *child of ozone_bucket*
> * o3fs://bucket1.volume1.ozone1/sale1/q1/@cm (ozone_key) *child of ozone_key*
> * o3fs://bucket1.volume1.ozone1/sale1/q1/sales/@cm (ozone_key) *child of ozone_key*
>
> This will bring Ozone model to be consistent with AWS S3 v2 and ADLS-Gen2 models.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)