You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by Andrew Musselman <an...@gmail.com> on 2014/01/28 09:00:54 UTC

Test failure in TDigestTest

Got this error running tests; anyone know what causes this?

Tests run: 9, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 40.063 sec
<<< FAILURE! - in org.apache.mahout.math.stats.TDigestTest
testSequentialPoints(org.apache.mahout.math.stats.TDigestTest)  Time
elapsed: 4.674 sec  <<< FAILURE!
java.lang.AssertionError: expected:<0.5> but was:<0.49489>

Re: Test failure in TDigestTest

Posted by Ted Dunning <te...@gmail.com>.
yes.  Increasing the threshold is a good idea.


On Tue, Jan 28, 2014 at 7:08 AM, Suneel Marthi <su...@yahoo.com>wrote:

> These failures are not repeatable, and had seen this happen a few times.
> The tolerance margin for this statistical test is presently set at 0.005.
>
> I once had a test failure that read:
>
>  java.lang.AssertionError: expected:<0.5> but was:<0.50578>
>
> Maybe change the fuzzfactor for this test from present 0.005 to 0.006?
>
>
>
> On Tuesday, January 28, 2014 7:00 AM, Ted Dunning <te...@gmail.com>
> wrote:
>
> Was this repeatable ?
>
> If transient then the test likely has a variable seed.  This test is
> statistical and may have too tight a tolerance.
>
> Sent from my iPhone
>
>
> > On Jan 28, 2014, at 0:00, Andrew Musselman <an...@gmail.com>
> wrote:
> >
> > Got this error running tests; anyone know what causes this?
> >
> > Tests run: 9, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 40.063
> sec
> > <<< FAILURE! - in org.apache.mahout.math.stats.TDigestTest
> > testSequentialPoints(org.apache.mahout.math.stats.TDigestTest)  Time
> > elapsed: 4.674 sec  <<< FAILURE!
> > java.lang.AssertionError: expected:<0.5> but was:<0.49489>
>

Re: Test failure in TDigestTest

Posted by Suneel Marthi <su...@yahoo.com>.
These failures are not repeatable, and had seen this happen a few times. 
The tolerance margin for this statistical test is presently set at 0.005.

I once had a test failure that read:

 java.lang.AssertionError: expected:<0.5> but was:<0.50578>

Maybe change the fuzzfactor for this test from present 0.005 to 0.006?



On Tuesday, January 28, 2014 7:00 AM, Ted Dunning <te...@gmail.com> wrote:
 
Was this repeatable ?  

If transient then the test likely has a variable seed.  This test is statistical and may have too tight a tolerance. 

Sent from my iPhone


> On Jan 28, 2014, at 0:00, Andrew Musselman <an...@gmail.com> wrote:
> 
> Got this error running tests; anyone know what causes this?
> 
> Tests run: 9, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 40.063 sec
> <<< FAILURE! - in org.apache.mahout.math.stats.TDigestTest
> testSequentialPoints(org.apache.mahout.math.stats.TDigestTest)  Time
> elapsed: 4.674 sec  <<< FAILURE!
> java.lang.AssertionError: expected:<0.5> but was:<0.49489>

Re: Test failure in TDigestTest

Posted by Ted Dunning <te...@gmail.com>.
Was this repeatable ?  

If transient then the test likely has a variable seed.  This test is statistical and may have too tight a tolerance. 

Sent from my iPhone

> On Jan 28, 2014, at 0:00, Andrew Musselman <an...@gmail.com> wrote:
> 
> Got this error running tests; anyone know what causes this?
> 
> Tests run: 9, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 40.063 sec
> <<< FAILURE! - in org.apache.mahout.math.stats.TDigestTest
> testSequentialPoints(org.apache.mahout.math.stats.TDigestTest)  Time
> elapsed: 4.674 sec  <<< FAILURE!
> java.lang.AssertionError: expected:<0.5> but was:<0.49489>