You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@trafodion.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/05/09 04:12:04 UTC

[jira] [Commented] (TRAFODION-2420) RMS enhancements

    [ https://issues.apache.org/jira/browse/TRAFODION-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16001996#comment-16001996 ] 

ASF GitHub Bot commented on TRAFODION-2420:
-------------------------------------------

GitHub user selvaganesang opened a pull request:

    https://github.com/apache/incubator-trafodion/pull/1087

    [TRAFODION-2420] RMS enhancements

    New counters introduced as part of BMO
    
    InterimRowCount - Counter to keep track intermediate rows
                      produced by hash join and for intermediate
                      runs in sort
    phase           - BMO Phase for hash-join and sort
    
    get statistics for statement s1, options 'cs' now works.
    
    Removed attaching BMO stats to Non-root Paritial and leaf partition hash group by operators.
    These operators are non-blocking BMOs.
    
    Introduced 3 phases for hash grby operator to be visible in RMS Stats
    
    options 'sl' now works with get statistics for qid.
    
    The relevant new counters are now part of accumulated statistics type.
    
    Extended the support upto 512 opeartors from 256 operators in RMS
    
    Fixed both Type 2 and mxosrvr code to obtain all the externalized counters in accumualted stats correctly.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/selvaganesang/incubator-trafodion trafodion-2420_4

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-trafodion/pull/1087.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #1087
    
----
commit e7719015286a0217fa5ec81551a783f8bc18fc3b
Author: selvaganesang <se...@esgyn.com>
Date:   2017-05-01T23:11:47Z

    [TRAFODION-2420] RMS enhancements
    
    New counters introduced as part of BMO
    
    InterimRowCount - Counter to keep track intermediate rows
                      produced by hash join and for intermediate
                      runs in sort
    phase           - BMO Phase for hash-join and sort
    
    get statistics for statement s1, options 'cs' now works.
    
    Removed attaching BMO stats to Non-root Paritial and leaf partition hash group by operators.
    These operators are non-blocking BMOs.
    
    Introduced 3 phases for hash grby operator to be visible in RMS Stats
    
    options 'sl' now works with get statistics for qid.
    
    The relevant new counters are now part of accumulated statistics type.
    
    Extended the support upto 512 opeartors from 256 operators in RMS
    
    Fixed both Type 2 and mxosrvr code to obtain all the externalized counters in accumualted stats correctly.

----


> RMS enhancements
> ----------------
>
>                 Key: TRAFODION-2420
>                 URL: https://issues.apache.org/jira/browse/TRAFODION-2420
>             Project: Apache Trafodion
>          Issue Type: Improvement
>          Components: sql-general
>    Affects Versions: 2.1-incubating
>            Reporter: Selvaganesan Govindarajan
>            Assignee: Selvaganesan Govindarajan
>
> Improve RMS to provide the following features/capabilities:
> 1. Currently RMS can list queries that consumed cpu time between two time points. However, the calls to storage engine like hbase, hdfs etc are blocking and these blocked APIs will not allow the Trafodion SQL engine scheduler to detect the cpu time spent during the time the call was blocked. Introduce a feature called SE offender (storage engine offender) to list the queries that are blocked in storage engine more than a certain duration.
> 2. Remove counters that are no longer updated or needed



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)