You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@harmony.apache.org by "Eugene S. Ostrovsky (JIRA)" <ji...@apache.org> on 2007/09/27 11:07:50 UTC

[jira] Created: (HARMONY-4865) [buildtest][tptp] Some of TPTP tests intermittently fail because of the TPTP Agent bugs.

[buildtest][tptp] Some of TPTP tests intermittently fail because of the TPTP Agent bugs.
----------------------------------------------------------------------------------------

                 Key: HARMONY-4865
                 URL: https://issues.apache.org/jira/browse/HARMONY-4865
             Project: Harmony
          Issue Type: Bug
          Components: build - test - ci
            Reporter: Eugene S. Ostrovsky


There are bugs in TPTP agent which lead to intermittent failures of TPTP tests.
See https://bugs.eclipse.org/bugs/show_bug.cgi?id=180454 and related bugs.
16 tests are already excluded but some other fail sometimes.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HARMONY-4865) [buildtest][tptp] Some of TPTP tests intermittently fail because of the TPTP Agent bugs.

Posted by "Eugene S. Ostrovsky (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HARMONY-4865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Eugene S. Ostrovsky updated HARMONY-4865:
-----------------------------------------

    Attachment: tptp_excludes_update.patch

Added patch:
  tptp_excludes_update.patch

Excludes the following test that intermittently fail:
  agg_threadPlainWorkload_100
  agg_threadPlainWorkload_100_F

The patch should be applied to tests/tptp/exclude.list file.

> [buildtest][tptp] Some of TPTP tests intermittently fail because of the TPTP Agent bugs.
> ----------------------------------------------------------------------------------------
>
>                 Key: HARMONY-4865
>                 URL: https://issues.apache.org/jira/browse/HARMONY-4865
>             Project: Harmony
>          Issue Type: Bug
>          Components: build - test - ci
>            Reporter: Eugene S. Ostrovsky
>         Attachments: tptp_excludes_update.patch
>
>
> There are bugs in TPTP agent which lead to intermittent failures of TPTP tests.
> See https://bugs.eclipse.org/bugs/show_bug.cgi?id=180454 and related bugs.
> 16 tests are already excluded but some other fail sometimes.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HARMONY-4865) [buildtest][tptp] Some of TPTP tests intermittently fail because of the TPTP Agent bugs.

Posted by "Eugene S. Ostrovsky (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HARMONY-4865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12538870 ] 

Eugene S. Ostrovsky commented on HARMONY-4865:
----------------------------------------------

Tim,

Actually most of TPTP tests can fail intermittently both on Sun and on Harmony 

The usual results of TPTP tests run are:
 failed 0 - 2 tests from thread package (28 tests)
 failed 0 or 1 test from heap package (18 tests)

Such results are expected and considered as passed.

I think we should keep the situation as it is and not exclude unstable tests (~ 46). This let us to determine regressions more carefully. E.g. if too many tests fail than additional evaluation should be performed.

The issue should be resolved as "Won't Fix".

Thanks.

> [buildtest][tptp] Some of TPTP tests intermittently fail because of the TPTP Agent bugs.
> ----------------------------------------------------------------------------------------
>
>                 Key: HARMONY-4865
>                 URL: https://issues.apache.org/jira/browse/HARMONY-4865
>             Project: Harmony
>          Issue Type: Bug
>          Components: build - test - ci
>            Reporter: Eugene S. Ostrovsky
>         Attachments: tptp_excludes_update.patch
>
>
> There are bugs in TPTP agent which lead to intermittent failures of TPTP tests.
> See https://bugs.eclipse.org/bugs/show_bug.cgi?id=180454 and related bugs.
> 16 tests are already excluded but some other fail sometimes.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Closed: (HARMONY-4865) [buildtest][tptp] Some of TPTP tests intermittently fail because of the TPTP Agent bugs.

Posted by "Tim Ellison (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HARMONY-4865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tim Ellison closed HARMONY-4865.
--------------------------------


> [buildtest][tptp] Some of TPTP tests intermittently fail because of the TPTP Agent bugs.
> ----------------------------------------------------------------------------------------
>
>                 Key: HARMONY-4865
>                 URL: https://issues.apache.org/jira/browse/HARMONY-4865
>             Project: Harmony
>          Issue Type: Bug
>          Components: build - test - ci
>            Reporter: Eugene S. Ostrovsky
>         Attachments: tptp_excludes_update.patch
>
>
> There are bugs in TPTP agent which lead to intermittent failures of TPTP tests.
> See https://bugs.eclipse.org/bugs/show_bug.cgi?id=180454 and related bugs.
> 16 tests are already excluded but some other fail sometimes.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HARMONY-4865) [buildtest][tptp] Some of TPTP tests intermittently fail because of the TPTP Agent bugs.

Posted by "Tim Ellison (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HARMONY-4865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12538802 ] 

Tim Ellison commented on HARMONY-4865:
--------------------------------------

Eugene,

Apologies that this patch has been around for a month.  Please confirm that these TPTP tests are still failing intermittently, and that they should be excluded (as poor tests)?


> [buildtest][tptp] Some of TPTP tests intermittently fail because of the TPTP Agent bugs.
> ----------------------------------------------------------------------------------------
>
>                 Key: HARMONY-4865
>                 URL: https://issues.apache.org/jira/browse/HARMONY-4865
>             Project: Harmony
>          Issue Type: Bug
>          Components: build - test - ci
>            Reporter: Eugene S. Ostrovsky
>         Attachments: tptp_excludes_update.patch
>
>
> There are bugs in TPTP agent which lead to intermittent failures of TPTP tests.
> See https://bugs.eclipse.org/bugs/show_bug.cgi?id=180454 and related bugs.
> 16 tests are already excluded but some other fail sometimes.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (HARMONY-4865) [buildtest][tptp] Some of TPTP tests intermittently fail because of the TPTP Agent bugs.

Posted by "Eugene S. Ostrovsky (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HARMONY-4865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Eugene S. Ostrovsky resolved HARMONY-4865.
------------------------------------------

    Resolution: Won't Fix

> [buildtest][tptp] Some of TPTP tests intermittently fail because of the TPTP Agent bugs.
> ----------------------------------------------------------------------------------------
>
>                 Key: HARMONY-4865
>                 URL: https://issues.apache.org/jira/browse/HARMONY-4865
>             Project: Harmony
>          Issue Type: Bug
>          Components: build - test - ci
>            Reporter: Eugene S. Ostrovsky
>         Attachments: tptp_excludes_update.patch
>
>
> There are bugs in TPTP agent which lead to intermittent failures of TPTP tests.
> See https://bugs.eclipse.org/bugs/show_bug.cgi?id=180454 and related bugs.
> 16 tests are already excluded but some other fail sometimes.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.