You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by "Jake Mannix (JIRA)" <ji...@apache.org> on 2011/05/06 21:02:03 UTC

[jira] [Created] (MAHOUT-690) LanczosSolver tests take forever. No fun.

LanczosSolver tests take forever.  No fun.
------------------------------------------

                 Key: MAHOUT-690
                 URL: https://issues.apache.org/jira/browse/MAHOUT-690
             Project: Mahout
          Issue Type: Improvement
            Reporter: Jake Mannix
            Assignee: Jake Mannix
             Fix For: 0.6


Long test runs long.

Sample output:
...
Running org.apache.mahout.math.hadoop.decomposer.TestDistributedLanczosSolver
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 282.859 sec
...

This is very long, and should be improved, if possible.


--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAHOUT-690) LanczosSolver tests take forever. No fun.

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAHOUT-690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13045349#comment-13045349 ] 

Hudson commented on MAHOUT-690:
-------------------------------

Integrated in Mahout-Quality #872 (See [https://builds.apache.org/job/Mahout-Quality/872/])
    MAHOUT-690 reduce test input size to speed up test

srowen : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1132893
Files : 
* /mahout/trunk/core/src/test/java/org/apache/mahout/math/hadoop/decomposer/TestDistributedLanczosSolverCLI.java
* /mahout/trunk/core/src/test/java/org/apache/mahout/math/hadoop/decomposer/TestDistributedLanczosSolver.java


> LanczosSolver tests take forever.  No fun.
> ------------------------------------------
>
>                 Key: MAHOUT-690
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-690
>             Project: Mahout
>          Issue Type: Improvement
>    Affects Versions: 0.5
>            Reporter: Jake Mannix
>            Assignee: Jake Mannix
>             Fix For: 0.6
>
>         Attachments: MAHOUT-690.patch
>
>
> Long test runs long.
> Sample output:
> ...
> Running org.apache.mahout.math.hadoop.decomposer.TestDistributedLanczosSolver
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 282.859 sec
> ...
> This is very long, and should be improved, if possible.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (MAHOUT-690) LanczosSolver tests take forever. No fun.

Posted by "Sean Owen (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAHOUT-690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sean Owen updated MAHOUT-690:
-----------------------------

    Attachment: MAHOUT-690.patch

Agree, this is over half the test time and does burn a fair bit of time as I run tests frequently.

One way to speed it up is to shrink the test data size, no? I did so and made it run about 3x faster without causing it to fail, but does this look like it remains a valid test?

The non-CLI test can be shrunk further but then an assertion about the size of error fails.

> LanczosSolver tests take forever.  No fun.
> ------------------------------------------
>
>                 Key: MAHOUT-690
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-690
>             Project: Mahout
>          Issue Type: Improvement
>    Affects Versions: 0.5
>            Reporter: Jake Mannix
>            Assignee: Jake Mannix
>             Fix For: 0.6
>
>         Attachments: MAHOUT-690.patch
>
>
> Long test runs long.
> Sample output:
> ...
> Running org.apache.mahout.math.hadoop.decomposer.TestDistributedLanczosSolver
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 282.859 sec
> ...
> This is very long, and should be improved, if possible.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (MAHOUT-690) LanczosSolver tests take forever. No fun.

Posted by "Sean Owen (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAHOUT-690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sean Owen updated MAHOUT-690:
-----------------------------

    Resolution: Fixed
        Status: Resolved  (was: Patch Available)

These two together take 46 sec on my laptop after my change -- 80% faster. So I think we can call it fixed enough?

> LanczosSolver tests take forever.  No fun.
> ------------------------------------------
>
>                 Key: MAHOUT-690
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-690
>             Project: Mahout
>          Issue Type: Improvement
>    Affects Versions: 0.5
>            Reporter: Jake Mannix
>            Assignee: Jake Mannix
>             Fix For: 0.6
>
>         Attachments: MAHOUT-690.patch
>
>
> Long test runs long.
> Sample output:
> ...
> Running org.apache.mahout.math.hadoop.decomposer.TestDistributedLanczosSolver
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 282.859 sec
> ...
> This is very long, and should be improved, if possible.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAHOUT-690) LanczosSolver tests take forever. No fun.

Posted by "Sean Owen (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAHOUT-690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sean Owen updated MAHOUT-690:
-----------------------------

    Affects Version/s: 0.5
               Status: Patch Available  (was: Open)

> LanczosSolver tests take forever.  No fun.
> ------------------------------------------
>
>                 Key: MAHOUT-690
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-690
>             Project: Mahout
>          Issue Type: Improvement
>    Affects Versions: 0.5
>            Reporter: Jake Mannix
>            Assignee: Jake Mannix
>             Fix For: 0.6
>
>         Attachments: MAHOUT-690.patch
>
>
> Long test runs long.
> Sample output:
> ...
> Running org.apache.mahout.math.hadoop.decomposer.TestDistributedLanczosSolver
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 282.859 sec
> ...
> This is very long, and should be improved, if possible.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira