Can be tags inherited?

[Peter Gergo Barna <pb...@hortonworks.com>]

Hi All,
I have a question about the possibility of Atlas automatically apply tags based on lineage relations.

Let's suppose we have a hive table tagged as 'secret'.
Can we have Atlas automatically apply this tag on all entities derived form this table, e.g. all views selecting from this table?
Kind Regards
Gergo Barna

Re: Can be tags inherited?

[Nigel Jones <jo...@uk.ibm.com>]

On 12/07/2017 13:17, David Radley wrote:

 > will derive the tags associated with an entity. We have not designed yet
 > how to override this behaviour, when the propagation behaviour in the Def
 > is not appropriate. I have not got the Jira number for this  : by copy
 > Madhan - do you have this for Peter.
Additionally there will be changes in how tags are propogated to ranger 
in that whilst today you just associate a tag (classification) with an 
entity, it's more useful often to associate the classification with a 
business term, and then associate that with the entity.

The changes up from the core atlas, will go through a new API 
(ATLAS-1696) and changes in ranger  (RANGER-1454) - if approved (this is 
still work in progress/unreviewed thus far), so feel free to engage in 
the discussions there too.

In terms of in general inheriting the classification ... overrides will 
IMO be needed (as David mentions) since sometimes a derived table will 
require the same classification, for example around confidentiality, 
whilst other times data could be combined and need a HIGHER 
classification whilst in other cases data may be redacted, requiring a 
LOWER classification ;-)

Regards
Nigel.

Re: Can be tags inherited?

[David Radley <da...@uk.ibm.com>]

Hi Peter,
We have recently added RelationshipDefs, as the way to inject new 
relationship attributes into  entities. The relationship def can specify 
whether tags propagate across the relationship and in which direction. The 
actual tag propagation is not in the code base yet, but is being worked 
on. Tag propagation  will not result in copies of tags - that could be 
become difficult to manage - instead as you query entities, the Atlas code 
will derive the tags associated with an entity. We have not designed yet 
how to override this behaviour, when the propagation behaviour in the Def 
is not appropriate. I have not got the Jira number for this  : by copy 
Madhan - do you have this for Peter. 

We feel this feature will allow more consistent control on how tags are 
applied to entities and in what circumstances; it therefore simplifies tag 
authoring. 
 
 all the best, David.



From:   Peter Gergo Barna <pb...@hortonworks.com>
To:     "dev@atlas.apache.org" <de...@atlas.apache.org>
Date:   12/07/2017 04:32
Subject:        Can be tags inherited?



Hi All,
I have a question about the possibility of Atlas automatically apply tags 
based on lineage relations.

Let's suppose we have a hive table tagged as 'secret'.
Can we have Atlas automatically apply this tag on all entities derived 
form this table, e.g. all views selecting from this table?
Kind Regards
Gergo Barna




Unless stated otherwise above:
IBM United Kingdom Limited - Registered in England and Wales with number 
741598. 
Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU