You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@atlas.apache.org by "Suma Shivaprasad (JIRA)" <ji...@apache.org> on 2016/06/08 17:19:21 UTC

[jira] [Comment Edited] (ATLAS-642) import-hive should create the lineage for external tables

    [ https://issues.apache.org/jira/browse/ATLAS-642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15320969#comment-15320969 ] 

Suma Shivaprasad edited comment on ATLAS-642 at 6/8/16 5:18 PM:
----------------------------------------------------------------

 lineageProcess.set(AtlasClient.REFERENCEABLE_ATTRIBUTE_NAME, tableQualifiedName); - this should be set of processQualifiedName - pls refer HiveHook where theres a function for getting the qualifiedName for a process - getProcessQualifiedName. The same for getProcessReference(tableQualifiedName);


was (Author: suma.shivaprasad):
 lineageProcess.set(AtlasClient.REFERENCEABLE_ATTRIBUTE_NAME, tableQualifiedName); - this should be set of processQualifiedName - pls refer HiveHook where theres a function for getting the qualifiedName for a process - getProcessQualifiedName

> import-hive should create the lineage for external tables
> ---------------------------------------------------------
>
>                 Key: ATLAS-642
>                 URL: https://issues.apache.org/jira/browse/ATLAS-642
>             Project: Atlas
>          Issue Type: Sub-task
>            Reporter: Suma Shivaprasad
>            Assignee: Vimal Sharma
>             Fix For: 0.7-incubating
>
>         Attachments: ATLAS-642.patch
>
>
> import-hive can also start showing lineage between HDFS paths and tables. 
> However the create table process should also register the exact query that was  used to create the table. Show create table does that by reconstructing the query. Need to figure out if we can potentially use that to create the query



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)