[jira] [Created] (ATLAS-3661) Create 'spark_column_lineage' type and relationship definition to add support of column level lineage

["Vladislav Glinskiy (Jira)" <ji...@apache.org>]

Vladislav Glinskiy created ATLAS-3661:
-----------------------------------------

             Summary: Create 'spark_column_lineage' type and relationship definition to add support of column level lineage
                 Key: ATLAS-3661
                 URL: https://issues.apache.org/jira/browse/ATLAS-3661
             Project: Atlas
          Issue Type: Task
            Reporter: Vladislav Glinskiy
             Fix For: 2.1.0, 3.0.0


Create 'spark_column_lineage' type and corresponding 'spark_process_column_lineage' relationship definition to add support of column-level lineage.

Column level lineage refers to lineage created between the input and output columns.
 For example:
{code:java}
hive > create table employee_ctas as select id from employee;{code}

 For the above query, lineage is created from 'employee' to 'employee_ctas',
 and also from 'employee.id' to 'employee_ctas.id'.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)