You are viewing a plain text version of this content. The canonical link for it is here.
Posted to olio-dev@incubator.apache.org by "Shanti Subramanyam (JIRA)" <ji...@apache.org> on 2009/01/02 17:59:44 UTC

[jira] Created: (OLIO-20) Driver does not check for accuracy in throughput to determine pass/fail

Driver does not check for accuracy in throughput to determine pass/fail
-----------------------------------------------------------------------

                 Key: OLIO-20
                 URL: https://issues.apache.org/jira/browse/OLIO-20
             Project: Olio
          Issue Type: Bug
          Components: generic
         Environment: generic
            Reporter: Shanti Subramanyam
            Assignee: Akara Sucharitakul
            Priority: Minor


The driver only checks whether the various metrics reported in the summary report have passed the necessary criteria but does not check whether the resulting throughput (ops/sec) is correct for the scale of the run (number of concurrent users). Thus for example, it is possible to get 800 ops/sec for a run done with 200 users and be reported as PASSED.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Closed: (OLIO-20) Driver does not check for accuracy in throughput to determine pass/fail

Posted by "Shanti Subramanyam (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/OLIO-20?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Shanti Subramanyam closed OLIO-20.
----------------------------------


> Driver does not check for accuracy in throughput to determine pass/fail
> -----------------------------------------------------------------------
>
>                 Key: OLIO-20
>                 URL: https://issues.apache.org/jira/browse/OLIO-20
>             Project: Olio
>          Issue Type: Bug
>          Components: php-driver
>         Environment: generic
>            Reporter: Shanti Subramanyam
>            Assignee: Akara Sucharitakul
>            Priority: Minor
>          Time Spent: 1h
>  Remaining Estimate: 0h
>
> The driver only checks whether the various metrics reported in the summary report have passed the necessary criteria but does not check whether the resulting throughput (ops/sec) is correct for the scale of the run (number of concurrent users). Thus for example, it is possible to get 150 ops/sec for a run done with 1000 users and be reported as PASSED.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (OLIO-20) Driver does not check for accuracy in throughput to determine pass/fail

Posted by "Akara Sucharitakul (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/OLIO-20?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Akara Sucharitakul updated OLIO-20:
-----------------------------------

    Component/s:     (was: generic)
                 php-driver

> Driver does not check for accuracy in throughput to determine pass/fail
> -----------------------------------------------------------------------
>
>                 Key: OLIO-20
>                 URL: https://issues.apache.org/jira/browse/OLIO-20
>             Project: Olio
>          Issue Type: Bug
>          Components: php-driver
>         Environment: generic
>            Reporter: Shanti Subramanyam
>            Assignee: Akara Sucharitakul
>            Priority: Minor
>          Time Spent: 1h
>  Remaining Estimate: 0h
>
> The driver only checks whether the various metrics reported in the summary report have passed the necessary criteria but does not check whether the resulting throughput (ops/sec) is correct for the scale of the run (number of concurrent users). Thus for example, it is possible to get 150 ops/sec for a run done with 1000 users and be reported as PASSED.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (OLIO-20) Driver does not check for accuracy in throughput to determine pass/fail

Posted by "Shanti Subramanyam (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/OLIO-20?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Shanti Subramanyam updated OLIO-20:
-----------------------------------

    Description: The driver only checks whether the various metrics reported in the summary report have passed the necessary criteria but does not check whether the resulting throughput (ops/sec) is correct for the scale of the run (number of concurrent users). Thus for example, it is possible to get 150 ops/sec for a run done with 1000 users and be reported as PASSED.  (was: The driver only checks whether the various metrics reported in the summary report have passed the necessary criteria but does not check whether the resulting throughput (ops/sec) is correct for the scale of the run (number of concurrent users). Thus for example, it is possible to get 800 ops/sec for a run done with 200 users and be reported as PASSED.)

> Driver does not check for accuracy in throughput to determine pass/fail
> -----------------------------------------------------------------------
>
>                 Key: OLIO-20
>                 URL: https://issues.apache.org/jira/browse/OLIO-20
>             Project: Olio
>          Issue Type: Bug
>          Components: generic
>         Environment: generic
>            Reporter: Shanti Subramanyam
>            Assignee: Akara Sucharitakul
>            Priority: Minor
>
> The driver only checks whether the various metrics reported in the summary report have passed the necessary criteria but does not check whether the resulting throughput (ops/sec) is correct for the scale of the run (number of concurrent users). Thus for example, it is possible to get 150 ops/sec for a run done with 1000 users and be reported as PASSED.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (OLIO-20) Driver does not check for accuracy in throughput to determine pass/fail

Posted by "Akara Sucharitakul (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/OLIO-20?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Akara Sucharitakul resolved OLIO-20.
------------------------------------

    Resolution: Fixed

> Driver does not check for accuracy in throughput to determine pass/fail
> -----------------------------------------------------------------------
>
>                 Key: OLIO-20
>                 URL: https://issues.apache.org/jira/browse/OLIO-20
>             Project: Olio
>          Issue Type: Bug
>          Components: php-driver
>         Environment: generic
>            Reporter: Shanti Subramanyam
>            Assignee: Akara Sucharitakul
>            Priority: Minor
>          Time Spent: 1h
>  Remaining Estimate: 0h
>
> The driver only checks whether the various metrics reported in the summary report have passed the necessary criteria but does not check whether the resulting throughput (ops/sec) is correct for the scale of the run (number of concurrent users). Thus for example, it is possible to get 150 ops/sec for a run done with 1000 users and be reported as PASSED.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.