You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@atlas.apache.org by arvind garg <er...@gmail.com> on 2020/09/25 11:35:09 UTC

Apache Atlas CPU is too high

Hi All,

In my Hadoop server,  I found that the Atlas server is consuming too much
CPU and even going above 200%. Also, I have found that when I try to
create more than 5000 file entities in the Atlas server (in a bunch of 50
files), the server becomes too slow.  Any idea how to solve this problem?

[image: image.png]

Thanks
Arvind Garg

Re: Apache Atlas CPU is too high

Posted by arvind garg <er...@gmail.com>.

Hi Sarath,

This is a single node setup with 32 GB RAM. CPU information and Atlas
configuration file also have been attached to the mail.
There are 10 clients connected with this machine and each is trying to
create a file entity on the Atlas server for 1000 files(total: 10 * 1000).

P.S. This is a non-SSL setup.

Please let me know if you have any questions.

On Mon, Sep 28, 2020 at 10:32 AM Sarath Subramanian <sa...@apache.org>
wrote:

> Arvind,
>
> Can you share the memory and deployment configuration for Atlas?
>
> Are you running parallel requests to create entities in batches?
>
>
> Thanks.
> Sarath
>
> On Fri, Sep 25, 2020 at 4:35 AM arvind garg <er...@gmail.com>
> wrote:
>
>> Hi All,
>>
>> In my Hadoop server,  I found that the Atlas server is consuming too much
>> CPU and even going above 200%. Also, I have found that when I try to
>> create more than 5000 file entities in the Atlas server (in a bunch of 50
>> files), the server becomes too slow.  Any idea how to solve this problem?
>>
>> [image: image.png]
>>
>> Thanks
>> Arvind Garg
>>
>

Re: Apache Atlas CPU is too high

Posted by Sarath Subramanian <sa...@apache.org>.

Arvind,

Can you share the memory and deployment configuration for Atlas?

Are you running parallel requests to create entities in batches?

Thanks.
Sarath

On Fri, Sep 25, 2020 at 4:35 AM arvind garg <er...@gmail.com> wrote:

> Hi All,
>
> In my Hadoop server,  I found that the Atlas server is consuming too much
> CPU and even going above 200%. Also, I have found that when I try to
> create more than 5000 file entities in the Atlas server (in a bunch of 50
> files), the server becomes too slow.  Any idea how to solve this problem?
>
> [image: image.png]
>
> Thanks
> Arvind Garg
>