You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@atlas.apache.org by "Nixon Rodrigues (Jira)" <ji...@apache.org> on 2020/03/16 10:05:00 UTC

[jira] [Resolved] (ATLAS-3661) Create 'spark_column_lineage' type and relationship definition to add support of column level lineage

     [ https://issues.apache.org/jira/browse/ATLAS-3661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Nixon Rodrigues resolved ATLAS-3661.
------------------------------------
    Resolution: Fixed

PR merged on master & branch-2.0, thanks [~vladglinskiy] for PR

> Create 'spark_column_lineage' type and relationship definition to add support of column level lineage
> -----------------------------------------------------------------------------------------------------
>
>                 Key: ATLAS-3661
>                 URL: https://issues.apache.org/jira/browse/ATLAS-3661
>             Project: Atlas
>          Issue Type: Task
>            Reporter: Vladislav Glinskiy
>            Priority: Major
>             Fix For: 2.1.0, 3.0.0
>
>          Time Spent: 50m
>  Remaining Estimate: 0h
>
> Create 'spark_column_lineage' type and corresponding 'spark_process_column_lineage' relationship definition to add support of column-level lineage.
> Column level lineage refers to lineage created between the input and output columns.
>  For example:
> {code:java}
> hive > create table employee_ctas as select id from employee;{code}
>  For the above query, lineage is created from 'employee' to 'employee_ctas',
>  and also from 'employee.id' to 'employee_ctas.id'.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)