You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@atlas.apache.org by "Madhan Neethiraj (JIRA)" <ji...@apache.org> on 2016/05/24 12:25:12 UTC

[jira] [Commented] (ATLAS-642) import-hive should create the lineage for external tables

    [ https://issues.apache.org/jira/browse/ATLAS-642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15298088#comment-15298088 ] 

Madhan Neethiraj commented on ATLAS-642:
----------------------------------------

[~suma.shivaprasad] since most details needed for lineage (HDFS paths, Hive table info) are available from Hive metadata, I think it is valuable to get the available info into Atlas - even if SQL query used to create the table is not available.

> import-hive should create the lineage for external tables
> ---------------------------------------------------------
>
>                 Key: ATLAS-642
>                 URL: https://issues.apache.org/jira/browse/ATLAS-642
>             Project: Atlas
>          Issue Type: Sub-task
>            Reporter: Suma Shivaprasad
>             Fix For: 0.7-incubating
>
>
> import-hive can also start showing lineage between HDFS paths and tables. 
> However the create table process should also register the exact query that was  used to create the table. Show create table does that by reconstructing the query. Need to figure out if we can potentially use that to create the query



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)