You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@atlas.apache.org by "Nixon Rodrigues (Jira)" <ji...@apache.org> on 2020/03/16 10:05:00 UTC
[jira] [Resolved] (ATLAS-3661) Create 'spark_column_lineage' type
and relationship definition to add support of column level lineage
[ https://issues.apache.org/jira/browse/ATLAS-3661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nixon Rodrigues resolved ATLAS-3661.
------------------------------------
Resolution: Fixed
PR merged on master & branch-2.0, thanks [~vladglinskiy] for PR
> Create 'spark_column_lineage' type and relationship definition to add support of column level lineage
> -----------------------------------------------------------------------------------------------------
>
> Key: ATLAS-3661
> URL: https://issues.apache.org/jira/browse/ATLAS-3661
> Project: Atlas
> Issue Type: Task
> Reporter: Vladislav Glinskiy
> Priority: Major
> Fix For: 2.1.0, 3.0.0
>
> Time Spent: 50m
> Remaining Estimate: 0h
>
> Create 'spark_column_lineage' type and corresponding 'spark_process_column_lineage' relationship definition to add support of column-level lineage.
> Column level lineage refers to lineage created between the input and output columns.
> For example:
> {code:java}
> hive > create table employee_ctas as select id from employee;{code}
> For the above query, lineage is created from 'employee' to 'employee_ctas',
> and also from 'employee.id' to 'employee_ctas.id'.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)