You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by Pat Ferrel <pa...@gmail.com> on 2014/06/06 22:57:22 UTC
Build
the build seems to be broken on my machine.
testTranspose(org.apache.mahout.math.hadoop.TestDistributedRowMatrix) Time elapsed: 1.103 sec <<< ERROR!
java.lang.IllegalStateException: transposition failed
at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:137)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:973)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:936)
at java.security.AccessController.doPrivileged(Native Method)
etc
anyone else see this? It’s in the mr legacy tests.
BTW how often does a build breakage notice go out?
Re: Build
Posted by Dmitriy Lyubimov <dl...@gmail.com>.
i don't know though anything about this mrlegacy test. never saw that
happening recently.
On Fri, Jun 6, 2014 at 1:57 PM, Pat Ferrel <pa...@gmail.com> wrote:
> the build seems to be broken on my machine.
>
> testTranspose(org.apache.mahout.math.hadoop.TestDistributedRowMatrix)
> Time elapsed: 1.103 sec <<< ERROR!
> java.lang.IllegalStateException: transposition failed
> at
> org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:137)
> at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:973)
> at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:936)
> at java.security.AccessController.doPrivileged(Native Method)
> etc
>
> anyone else see this? It’s in the mr legacy tests.
>
> BTW how often does a build breakage notice go out?
Re: Build
Posted by Pat Ferrel <pa...@gmail.com>.
OK, Thanks. I’ll look a little deeper to see what’s happening.
On Jun 6, 2014, at 2:40 PM, Dmitriy Lyubimov <dl...@gmail.com> wrote:
I am patching non-deterministic test behavior in these methods (als, at
least) as part of M-1365. the scala side haven't been using RandomUtil
sweepingly but probably should.
On Fri, Jun 6, 2014 at 2:35 PM, Andrew Palumbo <ap...@outlook.com> wrote:
> looks like it was a random/threshold issue- ran it again and passed
>
> From: ap.dev@outlook.com
> To: dev@mahout.apache.org
> Subject: RE: Build
> Date: Fri, 6 Jun 2014 17:33:09 -0400
>
>
>
>
> I didn't get any failures in mrlegacy but did get one in spark-shell:
>
> *** 1 TEST FAILED ***
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Mahout Build Tools ................................ SUCCESS [4.056s]
> [INFO] Apache Mahout ..................................... SUCCESS [0.787s]
> [INFO] Mahout Math ....................................... SUCCESS
> [2:36.258s]
> [INFO] Mahout MapReduce Legacy ........................... SUCCESS
> [17:52.964s]
> [INFO] Mahout Integration ................................ SUCCESS
> [1:36.630s]
> [INFO] Mahout Examples ................................... SUCCESS
> [21.628s]
> [INFO] Mahout Release Package ............................ SUCCESS [0.153s]
> [INFO] Mahout Math/Scala wrappers ........................ SUCCESS
> [1:15.464s]
> [INFO] Mahout Spark bindings ............................. FAILURE
> [3:15.106s]
> [INFO] Mahout Spark bindings shell ....................... SKIPPED
>
>
> ALS factorized approximation block:
> {
> 0 =>
> {0:0.39474878632299804,1:-0.0869672266359451,2:-1.0574506867969315}
> 1 =>
> {0:0.4076223671588186,1:0.013588403631779156,2:-0.6050329555295999}
> 2 =>
> {0:0.15932451623364444,1:0.07468331598847106,2:-0.3796237843015263}
> }
> norm of residuals 0.012073
> train iteration rmses: List(2.0234162711717642E-7, 2.9153664240021547E-7)
> - als *** FAILED ***
> 0.012073455230384868 was not less than 0.01 (MathSuite.scala:208)
>
>
>
>
>
>
>
Re: Build
Posted by Dmitriy Lyubimov <dl...@gmail.com>.
I am patching non-deterministic test behavior in these methods (als, at
least) as part of M-1365. the scala side haven't been using RandomUtil
sweepingly but probably should.
On Fri, Jun 6, 2014 at 2:35 PM, Andrew Palumbo <ap...@outlook.com> wrote:
> looks like it was a random/threshold issue- ran it again and passed
>
> From: ap.dev@outlook.com
> To: dev@mahout.apache.org
> Subject: RE: Build
> Date: Fri, 6 Jun 2014 17:33:09 -0400
>
>
>
>
> I didn't get any failures in mrlegacy but did get one in spark-shell:
>
> *** 1 TEST FAILED ***
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Mahout Build Tools ................................ SUCCESS [4.056s]
> [INFO] Apache Mahout ..................................... SUCCESS [0.787s]
> [INFO] Mahout Math ....................................... SUCCESS
> [2:36.258s]
> [INFO] Mahout MapReduce Legacy ........................... SUCCESS
> [17:52.964s]
> [INFO] Mahout Integration ................................ SUCCESS
> [1:36.630s]
> [INFO] Mahout Examples ................................... SUCCESS
> [21.628s]
> [INFO] Mahout Release Package ............................ SUCCESS [0.153s]
> [INFO] Mahout Math/Scala wrappers ........................ SUCCESS
> [1:15.464s]
> [INFO] Mahout Spark bindings ............................. FAILURE
> [3:15.106s]
> [INFO] Mahout Spark bindings shell ....................... SKIPPED
>
>
> ALS factorized approximation block:
> {
> 0 =>
> {0:0.39474878632299804,1:-0.0869672266359451,2:-1.0574506867969315}
> 1 =>
> {0:0.4076223671588186,1:0.013588403631779156,2:-0.6050329555295999}
> 2 =>
> {0:0.15932451623364444,1:0.07468331598847106,2:-0.3796237843015263}
> }
> norm of residuals 0.012073
> train iteration rmses: List(2.0234162711717642E-7, 2.9153664240021547E-7)
> - als *** FAILED ***
> 0.012073455230384868 was not less than 0.01 (MathSuite.scala:208)
>
>
>
>
>
>
>
RE: Build
Posted by Andrew Palumbo <ap...@outlook.com>.
looks like it was a random/threshold issue- ran it again and passed
From: ap.dev@outlook.com
To: dev@mahout.apache.org
Subject: RE: Build
Date: Fri, 6 Jun 2014 17:33:09 -0400
I didn't get any failures in mrlegacy but did get one in spark-shell:
*** 1 TEST FAILED ***
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Mahout Build Tools ................................ SUCCESS [4.056s]
[INFO] Apache Mahout ..................................... SUCCESS [0.787s]
[INFO] Mahout Math ....................................... SUCCESS [2:36.258s]
[INFO] Mahout MapReduce Legacy ........................... SUCCESS [17:52.964s]
[INFO] Mahout Integration ................................ SUCCESS [1:36.630s]
[INFO] Mahout Examples ................................... SUCCESS [21.628s]
[INFO] Mahout Release Package ............................ SUCCESS [0.153s]
[INFO] Mahout Math/Scala wrappers ........................ SUCCESS [1:15.464s]
[INFO] Mahout Spark bindings ............................. FAILURE [3:15.106s]
[INFO] Mahout Spark bindings shell ....................... SKIPPED
ALS factorized approximation block:
{
0 => {0:0.39474878632299804,1:-0.0869672266359451,2:-1.0574506867969315}
1 => {0:0.4076223671588186,1:0.013588403631779156,2:-0.6050329555295999}
2 => {0:0.15932451623364444,1:0.07468331598847106,2:-0.3796237843015263}
}
norm of residuals 0.012073
train iteration rmses: List(2.0234162711717642E-7, 2.9153664240021547E-7)
- als *** FAILED ***
0.012073455230384868 was not less than 0.01 (MathSuite.scala:208)
RE: Build
Posted by Andrew Palumbo <ap...@outlook.com>.
I didn't get any failures in mrlegacy but did get one in spark-shell:
*** 1 TEST FAILED ***
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Mahout Build Tools ................................ SUCCESS [4.056s]
[INFO] Apache Mahout ..................................... SUCCESS [0.787s]
[INFO] Mahout Math ....................................... SUCCESS [2:36.258s]
[INFO] Mahout MapReduce Legacy ........................... SUCCESS [17:52.964s]
[INFO] Mahout Integration ................................ SUCCESS [1:36.630s]
[INFO] Mahout Examples ................................... SUCCESS [21.628s]
[INFO] Mahout Release Package ............................ SUCCESS [0.153s]
[INFO] Mahout Math/Scala wrappers ........................ SUCCESS [1:15.464s]
[INFO] Mahout Spark bindings ............................. FAILURE [3:15.106s]
[INFO] Mahout Spark bindings shell ....................... SKIPPED
ALS factorized approximation block:
{
0 => {0:0.39474878632299804,1:-0.0869672266359451,2:-1.0574506867969315}
1 => {0:0.4076223671588186,1:0.013588403631779156,2:-0.6050329555295999}
2 => {0:0.15932451623364444,1:0.07468331598847106,2:-0.3796237843015263}
}
norm of residuals 0.012073
train iteration rmses: List(2.0234162711717642E-7, 2.9153664240021547E-7)
- als *** FAILED ***
0.012073455230384868 was not less than 0.01 (MathSuite.scala:208)
RE: Build
Posted by Andrew Palumbo <ap...@outlook.com>.
I just checked out a fresh copy. I haven't built with tests in a while. I'm running them now- will let you know what i see.
> From: pat.ferrel@gmail.com
> Subject: Build
> Date: Fri, 6 Jun 2014 13:57:22 -0700
> To: dev@mahout.apache.org
>
> the build seems to be broken on my machine.
>
> testTranspose(org.apache.mahout.math.hadoop.TestDistributedRowMatrix) Time elapsed: 1.103 sec <<< ERROR!
> java.lang.IllegalStateException: transposition failed
> at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:137)
> at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:973)
> at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:936)
> at java.security.AccessController.doPrivileged(Native Method)
> etc
>
> anyone else see this? It’s in the mr legacy tests.
>
> BTW how often does a build breakage notice go out?