You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@atlas.apache.org by Artur Mrozowski <ar...@gmail.com> on 2017/08/23 11:13:15 UTC

Data lineage missing when using import-hive.sh

Hello,
I am running Atlast 0.8rc1 on HDInsight 3.5 equivalent of HDP 2.5. I run
into troubles when executing import-hive.sh. The tables are imported but
there is no data lineage.The SQL I execute comes from this simple example
https://community.hortonworks.com/articles/36121/using-apache-atlas-to-view-data-lineage.html

Basically two tables and third CTAS as result of a join between these two.

Here is the error I spot in the application.log. Please advise


2017-08-23 08:47:19,811 INFO  - [pool-1-thread-7 -
ead205f6-8229-4266-b804-04a7c011f1db:] ~ Converted query string with 1
replacements: [v."entityText":(branch_intersect3)] =>
[sg5_t:(branch_intersect3)] (IndexSerializer:648)
2017-08-23 08:47:19,821 INFO  - [pool-1-thread-6 -
40dad2df-de5b-4693-b40a-5ff64d56c9cb:] ~ LuceneQuery: name:_=1503478035866
(QueryFactory:98)
2017-08-23 08:47:20,117 INFO  - [pool-1-thread-8 -
7d9a21c5-b789-43e8-a3d4-f195cd09ef3e:] ~ LuceneQuery: name:_=1503478035867
(QueryFactory:98)
2017-08-23 08:47:20,142 INFO  - [pool-1-thread-5 -
2cb948c3-3eef-4290-a1cd-829048d8a851:] ~ LuceneQuery:
hierarchy__slash__path:__slash__ (QueryFactory:98)
2017-08-23 08:47:27,109 INFO  - [pool-1-thread-10 -
f85823d7-6515-4f75-b6b0-b6fd50ae9510:] ~ Converted query string with 1
replacements: [v."entityText":(branch_intersect4)] =>
[sg5_t:(branch_intersect4)] (IndexSerializer:648)
2017-08-23 08:50:44,090 ERROR - [pool-1-thread-10 -
50b86be9-2d57-4325-89fe-8b733fe84019:] ~ graph rollback due to exception
AtlasBaseException:Instance hive_table with unique attribute
{qualifiedName=default.branch_intersect4@primary} does not exist
(GraphTransactionInterceptor:64)
2017-08-23 08:50:44,090 ERROR - [pool-1-thread-10 -
50b86be9-2d57-4325-89fe-8b733fe84019:] ~ Cannot find entity with type:
hive_table, attribute: qualifiedName and value:
default.branch_intersect4@primary (EntityResource:798)
2017-08-23 08:50:44,091 ERROR - [pool-1-thread-10 -
50b86be9-2d57-4325-89fe-8b733fe84019:] ~ Unable to get instance definition
for type=hive_table, qualifiedName=default.branch_intersect4@primary
(EntityResource:832)
javax.ws.rs.WebApplicationException
    at
org.apache.atlas.web.resources.EntityResource.toWebApplicationException(EntityResource.java:1201)
    at
org.apache.atlas.web.resources.EntityResource.getEntityDefinitionByAttribute(EntityResource.java:799)
    at
org.apache.atlas.web.resources.EntityResource.getEntity(EntityResource.java:762)
    at sun.reflect.GeneratedMethodAccessor84.invoke(Unknown Source)
    at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at
com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
    at
com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:205)


Best Regards
Artur