You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@trafodion.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/04/07 19:03:41 UTC
[jira] [Commented] (TRAFODION-2420) RMS enhancements
[ https://issues.apache.org/jira/browse/TRAFODION-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15961294#comment-15961294 ]
ASF GitHub Bot commented on TRAFODION-2420:
-------------------------------------------
GitHub user selvaganesang opened a pull request:
https://github.com/apache/incubator-trafodion/pull/1052
[TRAFODION-2420] RMS enhancements
Improved BMO operation accounting. Two new counters are added
a) scratchIOSize - Size in KB of the scratch IO
b) scratchIOMaxTime - Time in microseconds taken by any long pole
ESP instance to do scratch IO operations
The ScrBufSize, ScrBufRead and ScrBufWritten are no longer displayed
in the formatted get statistics command outputs.
Reduced the default value of CQD HBASE_NUM_CACHE_ROWS_MAX to 1024 from
10000 to reduce stress on the client JVM memory.
Disabled the memory pressure triggering in the BMO operators by increasing
the threshold GEN_MEM_PRESSURE_THRESHOLD to 10000 from 100. The memory
pressure detection code was inadvertently enabled when the cap to limit
memory pressure constant to 100 was removed.
Memory pressure triggers in BMO operators will be enabled later when
we understand the memory pressure detection better.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/selvaganesang/incubator-trafodion trafodion-2420_1
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-trafodion/pull/1052.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1052
----
commit 0c10290402c121eec54541d3720c3f407155722a
Author: selvaganesang <se...@esgyn.com>
Date: 2017-04-07T00:03:58Z
[TRAFODION-2420] RMS enhancements
Improved BMO operation accounting. Two new counters are added
a) scratchIOSize - Size in KB of the scratch IO
b) scratchIOMaxTime - Time in microseconds taken by any long pole
ESP instance to do scratch IO operations
The ScrBufSize, ScrBufRead and ScrBufWritten are no longer displayed
in the formatted get statistics command outputs.
Reduced the default value of CQD HBASE_NUM_CACHE_ROWS_MAX to 1024 from
10000 to reduce stress on the client JVM memory.
Disabled the memory pressure triggering in the BMO operators by increasing
the threshold GEN_MEM_PRESSURE_THRESHOLD to 10000 from 100. The memory
pressure detection code was inadvertently enabled when the cap to limit
memory pressure constant to 100 was removed.
Memory pressure triggers in BMO operators will be enabled later when
we understand the memory pressure detection better.
----
> RMS enhancements
> ----------------
>
> Key: TRAFODION-2420
> URL: https://issues.apache.org/jira/browse/TRAFODION-2420
> Project: Apache Trafodion
> Issue Type: Improvement
> Components: sql-general
> Affects Versions: 2.1-incubating
> Reporter: Selvaganesan Govindarajan
> Assignee: Selvaganesan Govindarajan
>
> Improve RMS to provide the following features/capabilities:
> 1. Currently RMS can list queries that consumed cpu time between two time points. However, the calls to storage engine like hbase, hdfs etc are blocking and these blocked APIs will not allow the Trafodion SQL engine scheduler to detect the cpu time spent during the time the call was blocked. Introduce a feature called SE offender (storage engine offender) to list the queries that are blocked in storage engine more than a certain duration.
> 2. Remove counters that are no longer updated or needed
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)