You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@atlas.apache.org by Herman Yu <he...@teeupdata.com> on 2016/02/24 15:40:58 UTC

Filter lineages being displayed

Is there a way to filter the lineages being displayed? for example, for a given hive_table entity, there are two inputs and two outputs, is there a way only display one input and one output in the data lineage diagram?

Thanks
Herman.

Re: Filter lineages being displayed

Posted by Erik Bergenholtz <eb...@hortonworks.com>.

There is no current way of doing this in the lineage graph through the UI. We had looked allowing you to expand/contract each part of the tree in the lineage for larger graphs but have not yet implemented this. 

Erik

> On Feb 24, 2016, at 9:40 AM, Herman Yu <he...@teeupdata.com> wrote:
> 
> Is there a way to filter the lineages being displayed? for example, for a given hive_table entity, there are two inputs and two outputs, is there a way only display one input and one output in the data lineage diagram?
> 
> Thanks
> Herman.
> 
>

Re: Filter lineages being displayed

Posted by Herman Yu <he...@teeupdata.com>.

Thanks Shwetha, ATLAS-552 created to track this.     Thanks. Herman.

> On Mar 3, 2016, at 12:58 AM, Shwetha Shivalingamurthy <ss...@hortonworks.com> wrote:
> 
> Currently, atlas maintains just the latest lineage. Point in time lineage
> requires graph versioning.
> 
> We can probably add filter for lineage. Can you file a jira for that?
> 
> Regards,
> Shwetha
> 
> 
> 
> 
> 
> 
> On 26/02/16, 8:19 PM, "Herman Yu" <he...@teeupdata.com> wrote:
> 
>> Hi Shwetha,
>> 
>> Use case 1: display point-in-time lineage information only
>> Use case 2: display certain types of lineage only. e.g. only technical
>> lineage, or only business semantic lineage, or only lineage at
>> table/column level...
>> Use case 3: with built-in hive model, filter out those ³temporary² hive
>> tables and lineages associated with themŠ
>> 
>> Thanks
>> Herman.
>> 
>> 
>>> On Feb 25, 2016, at 3:10 AM, Shwetha Shivalingamurthy
>>> <ss...@hortonworks.com> wrote:
>>> 
>>> Herman,
>>> 
>>> Whats your use case for this filtering?
>>> 
>>> Regards,
>>> Shwetha
>>> 
>>> 
>>> 
>>> 
>>> 
>>> 
>>> On 24/02/16, 8:10 PM, "Herman Yu" <he...@teeupdata.com> wrote:
>>> 
>>>> Is there a way to filter the lineages being displayed? for example,
>>>> for a
>>>> given hive_table entity, there are two inputs and two outputs, is
>>>> there a
>>>> way only display one input and one output in the data lineage diagram?
>>>> 
>>>> Thanks
>>>> Herman.
>>>> 
>>>> 
>>> 
>> 
>> 
>

Re: Filter lineages being displayed

Posted by Shwetha Shivalingamurthy <ss...@hortonworks.com>.

Currently, atlas maintains just the latest lineage. Point in time lineage
requires graph versioning.

We can probably add filter for lineage. Can you file a jira for that?

Regards,
Shwetha






On 26/02/16, 8:19 PM, "Herman Yu" <he...@teeupdata.com> wrote:

>Hi Shwetha,
>
>Use case 1: display point-in-time lineage information only
>Use case 2: display certain types of lineage only. e.g. only technical
>lineage, or only business semantic lineage, or only lineage at
>table/column level...
>Use case 3: with built-in hive model, filter out those ³temporary² hive
>tables and lineages associated with themŠ
>
>Thanks
>Herman.
>
>
>> On Feb 25, 2016, at 3:10 AM, Shwetha Shivalingamurthy
>><ss...@hortonworks.com> wrote:
>> 
>> Herman,
>> 
>> Whats your use case for this filtering?
>> 
>> Regards,
>> Shwetha
>> 
>> 
>> 
>> 
>> 
>> 
>> On 24/02/16, 8:10 PM, "Herman Yu" <he...@teeupdata.com> wrote:
>> 
>>> Is there a way to filter the lineages being displayed? for example,
>>>for a
>>> given hive_table entity, there are two inputs and two outputs, is
>>>there a
>>> way only display one input and one output in the data lineage diagram?
>>> 
>>> Thanks
>>> Herman.
>>> 
>>> 
>> 
>
>

Re: Filter lineages being displayed

Posted by Herman Yu <he...@teeupdata.com>.

Hi Shwetha,

Use case 1: display point-in-time lineage information only
Use case 2: display certain types of lineage only. e.g. only technical lineage, or only business semantic lineage, or only lineage at table/column level...
Use case 3: with built-in hive model, filter out those “temporary” hive tables and lineages associated with them…

Thanks
Herman.

> On Feb 25, 2016, at 3:10 AM, Shwetha Shivalingamurthy <ss...@hortonworks.com> wrote:
> 
> Herman,
> 
> Whats your use case for this filtering?
> 
> Regards,
> Shwetha
> 
> 
> 
> 
> 
> 
> On 24/02/16, 8:10 PM, "Herman Yu" <he...@teeupdata.com> wrote:
> 
>> Is there a way to filter the lineages being displayed? for example, for a
>> given hive_table entity, there are two inputs and two outputs, is there a
>> way only display one input and one output in the data lineage diagram?
>> 
>> Thanks
>> Herman.
>> 
>> 
>

Re: Filter lineages being displayed

Posted by Shwetha Shivalingamurthy <ss...@hortonworks.com>.

Herman,

Whats your use case for this filtering?

Regards,
Shwetha






On 24/02/16, 8:10 PM, "Herman Yu" <he...@teeupdata.com> wrote:

>Is there a way to filter the lineages being displayed? for example, for a
>given hive_table entity, there are two inputs and two outputs, is there a
>way only display one input and one output in the data lineage diagram?
>
>Thanks
>Herman.
>
>