You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Mala Chikka Kempanna (JIRA)" <ji...@apache.org> on 2018/06/04 21:02:00 UTC

[jira] [Created] (IMPALA-7118) Add mem_limit metric listing for all hosts in the profile

Mala Chikka Kempanna created IMPALA-7118:
--------------------------------------------

             Summary: Add mem_limit metric listing for all hosts in the profile
                 Key: IMPALA-7118
                 URL: https://issues.apache.org/jira/browse/IMPALA-7118
             Project: IMPALA
          Issue Type: Improvement
            Reporter: Mala Chikka Kempanna


Similar to peak node memeory metric in profile below, we need a metric listing mem_limit set on each node.

{code}

Per Node Peak Memory Usage: p1ehowchp2d04.prudential.com:22000(36.14 GB) p1ehowchp2d07.prudential.com:22000(48.50 GB) p1ehowchp2d06.prudential.com:22000(44.67 GB) p1ehowchp2d02.prudential.com:22000(38.42 GB) p1ehowchp2d01.prudential.com:22000(43.19 GB) p1ehowchp2d08.prudential.com:22000(41.60 GB) p1ehowchp2d03.prudential.com:22000(49.72 GB) p1ehowchp2d05.prudential.com:22000(45.89 GB)

{code}

 

Background for this ask is:

We have seen performance issues reported across releases of impala, where cluster admin would have lowered memory limits on all or subset of impala daemons while also upgrading the version.

And query performance suffers if the queries that were running in-memory before start spilling now due to lower memory limit.

And end-users/application-users blame the upgraded version for slowness when they share profiles for analysis not knowing the lowering of memory by cluster-admins was the reason.

Having this mem limit metric in profile will help easily spot this issue.

 

 

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org