[jira] [Commented] (HIVE-13112) Expose Lineage information in case of CTAS

["Vimal Sharma (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-13112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15458509#comment-15458509 ] 

Vimal Sharma commented on HIVE-13112:
-------------------------------------

I am using Hive version 2.1.0 and trying to get Column level lineage. However, when I try to access the Dependency value in LineageInfo, it is coming as null. Sample Code:
{code}
   public static Map<ColumnName, List<HiveColumnLineageInfo>> buildLineageMap(LineageInfo lInfo) {
        for(Map.Entry<LineageInfo.DependencyKey, LineageInfo.Dependency> e : lInfo.entrySet()) {
            System.out.println("Col Lineage Key : " + e.getKey());
            System.out.println("Col Lineage Value: " + e.getValue());
{code}

In the output, Key is set to destination column in a lineage but the Value which should contain origin column information is null. How can I verify whether the lineage information being set correctly in Hive Sessionstate.

> Expose Lineage information in case of CTAS
> ------------------------------------------
>
>                 Key: HIVE-13112
>                 URL: https://issues.apache.org/jira/browse/HIVE-13112
>             Project: Hive
>          Issue Type: Bug
>          Components: lineage
>            Reporter: Harish Butani
>            Assignee: Harish Butani
>             Fix For: 2.1.0
>
>         Attachments: HIVE-13112.01.patch
>
>
> This is not happening because Lineage is being exposed by MoveTask which checks for a LoadTableDesc. In case of CTAS the table is created after the MoveTask.
> Proposed solution is to add a flag to CreateTableDesc to track a CTAS operation, and have the DDLTask expose the lineage if this flag is set.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)