You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@atlas.apache.org by Viking K <cy...@hotmail.com> on 2019/01/04 07:20:32 UTC

Atlas disable Linage

Hi

Is there anyway to turn of the Atlas linage, so that it skips the linage graphing part?
I currently have an issue with Atlas that it stops consuming messages from the ATLAS_HOOK topic and I believe its related to the linage part.

Best regards
Viking

Re: Atlas disable Linage

Posted by Viking K <cy...@hotmail.com>.
Hi

Our issues presents itself like this:

Thu Dec 27 14:38:44 CET 2018
TOPIC PARTITION CURRENT-OFFSET LOG-END-OFFSET LAG CONSUMER-ID HOST CLIENT-ID
ATLAS_HOOK 0 2393 16927 14534 consumer-1-a23c26d6-e285-4a24-882a-6640b9d7be12 /x.x.x.x consumer-1

Thu Dec 27 14:42:04 CET 2018
Consumer group 'atlas' has no active members.
TOPIC PARTITION CURRENT-OFFSET LOG-END-OFFSET LAG CONSUMER-ID HOST CLIENT-ID
ATLAS_HOOK 0 2393 16927 14534 - - -


The Atlas hook consumer stops consuming from the topic and disconnects.
There are no errors or warnings in the logfiles that have so far given any clue, my provider is also looking into the issue but have not been able to find anything either.

The message length from the hook are sometimes up to 180k characters.
Received Message topic =ATLAS_HOOK, partition =0, offset = 2398, key = null, value = ......

It seems to be some edge cases, most of the messages process ok (takes about 10 sec each or so)
I had one message take 12 hour to complete in atlas once.

We are running:
project.name: apache-atlas
project.description: Metadata Management and Data Governance Platform over Hadoop
build.user: jenkins
build.epoch: 1544041773072
project.version: 0.8.0.2.6.5.92-1
build.version: 0.8.0.2.6.5.92-1-r9049f50388aa59f765a39e23e766ba5d7466f006
vc.revision: 9049f50388aa59f765a39e23e766ba5d7466f006
vc.source.url: scm:git:git://git.apache.org/atlas.git/atlas-webapp

________________________________
From: Sarath Subramanian <sa...@apache.org>
Sent: Friday, January 4, 2019 10:23 PM
To: user@atlas.apache.org
Subject: Re: Atlas disable Linage

Viking,

Currently there is no way to disable lineage rendering.

Can you share more about the issue you are facing?


Thanks,
Sarath

On Thu, Jan 3, 2019 at 11:20 PM Viking K <cy...@hotmail.com>> wrote:
Hi

Is there anyway to turn of the Atlas linage, so that it skips the linage graphing part?
I currently have an issue with Atlas that it stops consuming messages from the ATLAS_HOOK topic and I believe its related to the linage part.

Best regards
Viking

Re: Atlas disable Linage

Posted by Sarath Subramanian <sa...@apache.org>.
Viking,

Currently there is no way to disable lineage rendering.

Can you share more about the issue you are facing?


Thanks,
Sarath

On Thu, Jan 3, 2019 at 11:20 PM Viking K <cy...@hotmail.com> wrote:

> Hi
>
> Is there anyway to turn of the Atlas linage, so that it skips the linage
> graphing part?
> I currently have an issue with Atlas that it stops consuming messages from
> the ATLAS_HOOK topic and I believe its related to the linage part.
>
> Best regards
> Viking
>