Hard deleting entities and updating lineage

[Marc Doan <md...@stripe.com>]

Hi,

My team is currently using version 0.8.1-rc1 and can't seem to hard delete
entities or update lineage.

1. Hard deleting entities
Based on this ticket: https://issues.apache.org/jira/browse/ATLAS-541, it
seems like hard deletes should be possible. We uncommented and set
`atlas.DeleteHandler.impl` to
`org.apache.atlas.repository.graph.HardDeleteHandler`
in `atlas-application.properties`, but after making a DELETE request on an
entity, we can still see it in the UI (marked as deleted). What is the
correct way to hard delete entities in Altas?

2. Updating lineage
Based on this thread: https://community.hortonworks.com/questions/
53470/how-to-delete-lineage-metadata-in-apache-atlas.html, it looks like
the way to update lineage is to re-POST a Process entity with the `inputs`
and `outputs` attributes updated to reflect the new lineage. However, it
looks like updates to these attributes can only be _additive_. POST'ing
empty `inputs` and `outputs` arrays have no effect. What's the correct way
to delete edges in a lineage graph?

Great work on the tool so far!

-marc

Re: Hard deleting entities and updating lineage

[Madhan Neethiraj <ma...@apache.org>]

Marc,

 

>> 1. Hard deleting entities

Starting with Apache Atlas 0.8 release, please set the following property to enable hard-delete:

  atlas.DeleteHandlerV1.impl=org.apache.atlas.repository.store.graph.v1.HardDeleteHandlerV1

 

However, deleting an entity with above configuration hits the issue detailed in ATLAS-2169. Fix to address this issue is under review and should be committed shortly in branch-0.8. Next release from this branch (Apache Atlas 0.8.2) will include this fix.

 

>> 2. Updating lineage

I was able to update the lineage (i.e. remove entries from inputs/outputs of a process), with hard-delete enabled. Can you please try with above fix on top of Apache Atlas from branch-0.8?

 

Thanks,

Madhan

 

 

From: Marc Doan <md...@stripe.com>
Reply-To: "user@atlas.apache.org" <us...@atlas.apache.org>
Date: Friday, December 15, 2017 at 11:30 AM
To: "user@atlas.apache.org" <us...@atlas.apache.org>
Subject: Hard deleting entities and updating lineage

 

Hi,

 

My team is currently using version 0.8.1-rc1 and can't seem to hard delete entities or update lineage.

 

1. Hard deleting entities

Based on this ticket: https://issues.apache.org/jira/browse/ATLAS-541, it seems like hard deletes should be possible. We uncommented and set `atlas.DeleteHandler.impl` to `org.apache.atlas.repository.graph.HardDeleteHandler` in `atlas-application.properties`, but after making a DELETE request on an entity, we can still see it in the UI (marked as deleted). What is the correct way to hard delete entities in Altas?

 

2. Updating lineage

Based on this thread: https://community.hortonworks.com/questions/53470/how-to-delete-lineage-metadata-in-apache-atlas.html, it looks like the way to update lineage is to re-POST a Process entity with the `inputs` and `outputs` attributes updated to reflect the new lineage. However, it looks like updates to these attributes can only be _additive_. POST'ing empty `inputs` and `outputs` arrays have no effect. What's the correct way to delete edges in a lineage graph?

 

Great work on the tool so far!

 

-marc