You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@atlas.apache.org by "Madhan Neethiraj (JIRA)" <ji...@apache.org> on 2018/05/17 05:08:00 UTC
[jira] [Reopened] (ATLAS-2064) Compress Hook Messages Posted to
Kafka Atlas Topic
[ https://issues.apache.org/jira/browse/ATLAS-2064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Madhan Neethiraj reopened ATLAS-2064:
-------------------------------------
> Compress Hook Messages Posted to Kafka Atlas Topic
> --------------------------------------------------
>
> Key: ATLAS-2064
> URL: https://issues.apache.org/jira/browse/ATLAS-2064
> Project: Atlas
> Issue Type: Improvement
> Components: atlas-intg
> Affects Versions: 0.8-incubating
> Reporter: Ashutosh Mestry
> Assignee: Ashutosh Mestry
> Priority: Major
> Fix For: trunk
>
> Attachments: ATLAS-2064-compressed-hook-message-envelope.patch
>
>
> *Background*
> Messages posted by hooks to Atlas Kafka topics are JSON format.
> Kafka imposes a 1MB limit on the message size.
> Occasionally, depending on operations performed, this threshold is reached. This results in messages being dropped.
> The entities are thus not reflected in Atlas.
> *Solution*
> Applying compression to these message will alleviate the problem.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)