You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by Andrew Musselman <ak...@apache.org> on 2020/06/30 05:10:52 UTC
RC1 for 14.1
Thanks to some great work by Chris Dutz, RC1 for 14.1 release is out!
Please go try it out, check signatures and checksums, etc.
Binaries:
https://repository.apache.org/content/repositories/orgapachemahout-1062/org/apache/mahout/apache-mahout-distribution/14.1/
Source:
https://repository.apache.org/content/repositories/orgapachemahout-1062/org/apache/mahout/mahout/14.1/
Best
Andrew
Re: RC1 for 14.1
Posted by Andrew Musselman <an...@gmail.com>.
Yeah, I think after voting we add the artifacts to SVN by hand. Happy to
discuss, what are the advantages of the way you're doing it in PLC4X?
On Tue, Jun 30, 2020 at 8:08 AM Christofer Dutz <ch...@c-ware.de>
wrote:
> Hi all,
>
>
>
> well we setup things in PLC4X the same way most projects have them … so
> for PLC4X we stage releases here:
>
> https://dist.apache.org/repos/dist/dev/plc4x/
>
>
>
> and as soon as they are released, they are SVN-Moved here:
>
> https://dist.apache.org/repos/dist/release/plc4x
>
>
>
> This then automatically makes all the mirror syncing of Apache make the
> artifacts available here:
>
> https://downloads.apache.org/plc4x/
>
> All this SVN staging stuff is manual stuff … for PLC4X too, the
> release:perform uploads the source bundles to Nexus, but we don’t vote on
> that.
>
> We vote on the stuff that’s in SVN.
>
>
>
> Chris
>
>
>
>
>
> *Von: *Andrew Musselman <an...@gmail.com>
> *Datum: *Dienstag, 30. Juni 2020 um 16:57
> *An: *Mahout Dev List <de...@mahout.apache.org>, Christofer Dutz <
> christofer.dutz@c-ware.de>
> *Betreff: *Re: RC1 for 14.1
>
>
>
> (1) We've always done it through Nexus, not married to the approach
>
> (2) Agreed, https://issues.apache.org/jira/browse/MAHOUT-2109
>
> (3) Agreed, https://issues.apache.org/jira/browse/MAHOUT-2110
>
> (4) Also https://issues.apache.org/jira/browse/MAHOUT-2110
>
> (5) @Christofer Dutz <ch...@c-ware.de> where are KEYS normally
> kept?
>
>
>
> On Tue, Jun 30, 2020 at 5:47 AM Trevor Grant <tr...@gmail.com>
> wrote:
>
> 1. Interesting on the Nexux- who knows who set that up- what are the
> pro/cons of nexus v SVN?
> 2. make sure this gets added to docs
> 3. let's make a jira for this.
> 4. just drop them then.
> 5. https://github.com/apache/mahout/blob/trunk/distribution/KEYS
>
>
>
> On Tue, Jun 30, 2020 at 2:42 AM Christofer Dutz <christofer.dutz@c-ware.de
> >
> wrote:
>
> > Hi folks,
> >
> > some things I noticed:
> >
> > 1) You're using the Nexus Staging Repo ... I know most Apache projects
> use
> > the apache SVN for officially staging the release
> > 2) The source-repo is missing the RELEASE_NOTES which usually goes
> > alongside the source bundle.
> > 3) (this might be the most serious issue) you are using SHA1 hashes and
> > Apache wants us to use SHA512 hashes (The build does provide these, but
> > doesn't automatically deploy them) (
> > https://infra.apache.org/release-distribution.html)
> > 4) MD5 are also considered deprecated
> > 5) Where's your KEYS file? I need that to validate the signatures.
> >
> > Chris
> >
> >
> >
> > Am 30.06.20, 07:11 schrieb "Andrew Musselman" <ak...@apache.org>:
> >
> > Thanks to some great work by Chris Dutz, RC1 for 14.1 release is out!
> > Please go try it out, check signatures and checksums, etc.
> >
> > Binaries:
> >
> >
> https://repository.apache.org/content/repositories/orgapachemahout-1062/org/apache/mahout/apache-mahout-distribution/14.1/
> >
> > Source:
> >
> >
> https://repository.apache.org/content/repositories/orgapachemahout-1062/org/apache/mahout/mahout/14.1/
> >
> > Best
> > Andrew
> >
> >
>
>
Re: RC1 for 14.1
Posted by Christofer Dutz <ch...@c-ware.de>.
Hi all,
well we setup things in PLC4X the same way most projects have them … so for PLC4X we stage releases here:
https://dist.apache.org/repos/dist/dev/plc4x/
and as soon as they are released, they are SVN-Moved here:
https://dist.apache.org/repos/dist/release/plc4x
This then automatically makes all the mirror syncing of Apache make the artifacts available here:
https://downloads.apache.org/plc4x/
All this SVN staging stuff is manual stuff … for PLC4X too, the release:perform uploads the source bundles to Nexus, but we don’t vote on that.
We vote on the stuff that’s in SVN.
Chris
Von: Andrew Musselman <an...@gmail.com>
Datum: Dienstag, 30. Juni 2020 um 16:57
An: Mahout Dev List <de...@mahout.apache.org>, Christofer Dutz <ch...@c-ware.de>
Betreff: Re: RC1 for 14.1
(1) We've always done it through Nexus, not married to the approach
(2) Agreed, https://issues.apache.org/jira/browse/MAHOUT-2109
(3) Agreed, https://issues.apache.org/jira/browse/MAHOUT-2110
(4) Also https://issues.apache.org/jira/browse/MAHOUT-2110
(5) @Christofer Dutz<ma...@c-ware.de> where are KEYS normally kept?
On Tue, Jun 30, 2020 at 5:47 AM Trevor Grant <tr...@gmail.com>> wrote:
1. Interesting on the Nexux- who knows who set that up- what are the
pro/cons of nexus v SVN?
2. make sure this gets added to docs
3. let's make a jira for this.
4. just drop them then.
5. https://github.com/apache/mahout/blob/trunk/distribution/KEYS
On Tue, Jun 30, 2020 at 2:42 AM Christofer Dutz <ch...@c-ware.de>>
wrote:
> Hi folks,
>
> some things I noticed:
>
> 1) You're using the Nexus Staging Repo ... I know most Apache projects use
> the apache SVN for officially staging the release
> 2) The source-repo is missing the RELEASE_NOTES which usually goes
> alongside the source bundle.
> 3) (this might be the most serious issue) you are using SHA1 hashes and
> Apache wants us to use SHA512 hashes (The build does provide these, but
> doesn't automatically deploy them) (
> https://infra.apache.org/release-distribution.html)
> 4) MD5 are also considered deprecated
> 5) Where's your KEYS file? I need that to validate the signatures.
>
> Chris
>
>
>
> Am 30.06.20, 07:11 schrieb "Andrew Musselman" <ak...@apache.org>>:
>
> Thanks to some great work by Chris Dutz, RC1 for 14.1 release is out!
> Please go try it out, check signatures and checksums, etc.
>
> Binaries:
>
> https://repository.apache.org/content/repositories/orgapachemahout-1062/org/apache/mahout/apache-mahout-distribution/14.1/
>
> Source:
>
> https://repository.apache.org/content/repositories/orgapachemahout-1062/org/apache/mahout/mahout/14.1/
>
> Best
> Andrew
>
>
Re: RC1 for 14.1
Posted by Andrew Musselman <an...@gmail.com>.
(1) We've always done it through Nexus, not married to the approach
(2) Agreed, https://issues.apache.org/jira/browse/MAHOUT-2109
(3) Agreed, https://issues.apache.org/jira/browse/MAHOUT-2110
(4) Also https://issues.apache.org/jira/browse/MAHOUT-2110
(5) @Christofer Dutz <ch...@c-ware.de> where are KEYS normally
kept?
On Tue, Jun 30, 2020 at 5:47 AM Trevor Grant <tr...@gmail.com>
wrote:
> 1. Interesting on the Nexux- who knows who set that up- what are the
> pro/cons of nexus v SVN?
> 2. make sure this gets added to docs
> 3. let's make a jira for this.
> 4. just drop them then.
> 5. https://github.com/apache/mahout/blob/trunk/distribution/KEYS
>
>
>
> On Tue, Jun 30, 2020 at 2:42 AM Christofer Dutz <christofer.dutz@c-ware.de
> >
> wrote:
>
> > Hi folks,
> >
> > some things I noticed:
> >
> > 1) You're using the Nexus Staging Repo ... I know most Apache projects
> use
> > the apache SVN for officially staging the release
> > 2) The source-repo is missing the RELEASE_NOTES which usually goes
> > alongside the source bundle.
> > 3) (this might be the most serious issue) you are using SHA1 hashes and
> > Apache wants us to use SHA512 hashes (The build does provide these, but
> > doesn't automatically deploy them) (
> > https://infra.apache.org/release-distribution.html)
> > 4) MD5 are also considered deprecated
> > 5) Where's your KEYS file? I need that to validate the signatures.
> >
> > Chris
> >
> >
> >
> > Am 30.06.20, 07:11 schrieb "Andrew Musselman" <ak...@apache.org>:
> >
> > Thanks to some great work by Chris Dutz, RC1 for 14.1 release is out!
> > Please go try it out, check signatures and checksums, etc.
> >
> > Binaries:
> >
> >
> https://repository.apache.org/content/repositories/orgapachemahout-1062/org/apache/mahout/apache-mahout-distribution/14.1/
> >
> > Source:
> >
> >
> https://repository.apache.org/content/repositories/orgapachemahout-1062/org/apache/mahout/mahout/14.1/
> >
> > Best
> > Andrew
> >
> >
>
Re: RC1 for 14.1
Posted by Trevor Grant <tr...@gmail.com>.
1. Interesting on the Nexux- who knows who set that up- what are the
pro/cons of nexus v SVN?
2. make sure this gets added to docs
3. let's make a jira for this.
4. just drop them then.
5. https://github.com/apache/mahout/blob/trunk/distribution/KEYS
On Tue, Jun 30, 2020 at 2:42 AM Christofer Dutz <ch...@c-ware.de>
wrote:
> Hi folks,
>
> some things I noticed:
>
> 1) You're using the Nexus Staging Repo ... I know most Apache projects use
> the apache SVN for officially staging the release
> 2) The source-repo is missing the RELEASE_NOTES which usually goes
> alongside the source bundle.
> 3) (this might be the most serious issue) you are using SHA1 hashes and
> Apache wants us to use SHA512 hashes (The build does provide these, but
> doesn't automatically deploy them) (
> https://infra.apache.org/release-distribution.html)
> 4) MD5 are also considered deprecated
> 5) Where's your KEYS file? I need that to validate the signatures.
>
> Chris
>
>
>
> Am 30.06.20, 07:11 schrieb "Andrew Musselman" <ak...@apache.org>:
>
> Thanks to some great work by Chris Dutz, RC1 for 14.1 release is out!
> Please go try it out, check signatures and checksums, etc.
>
> Binaries:
>
> https://repository.apache.org/content/repositories/orgapachemahout-1062/org/apache/mahout/apache-mahout-distribution/14.1/
>
> Source:
>
> https://repository.apache.org/content/repositories/orgapachemahout-1062/org/apache/mahout/mahout/14.1/
>
> Best
> Andrew
>
>
Re: RC1 for 14.1
Posted by Christofer Dutz <ch...@c-ware.de>.
Hi folks,
some things I noticed:
1) You're using the Nexus Staging Repo ... I know most Apache projects use the apache SVN for officially staging the release
2) The source-repo is missing the RELEASE_NOTES which usually goes alongside the source bundle.
3) (this might be the most serious issue) you are using SHA1 hashes and Apache wants us to use SHA512 hashes (The build does provide these, but doesn't automatically deploy them) (https://infra.apache.org/release-distribution.html)
4) MD5 are also considered deprecated
5) Where's your KEYS file? I need that to validate the signatures.
Chris
Am 30.06.20, 07:11 schrieb "Andrew Musselman" <ak...@apache.org>:
Thanks to some great work by Chris Dutz, RC1 for 14.1 release is out!
Please go try it out, check signatures and checksums, etc.
Binaries:
https://repository.apache.org/content/repositories/orgapachemahout-1062/org/apache/mahout/apache-mahout-distribution/14.1/
Source:
https://repository.apache.org/content/repositories/orgapachemahout-1062/org/apache/mahout/mahout/14.1/
Best
Andrew
Re: RC1 for 14.1
Posted by Andrew Musselman <ak...@apache.org>.
I'm seeing a couple potential bugs, definitely at least a typo in
`bin/mahout` where there was some commented out nested ifs; when I comment
out the dangling fi on line 257 I still see some problems. Am I missing a
step?
$ ./bin/mahout spark-shell
Adding lib/ to CLASSPATH
./bin/mahout: line 257: syntax error near unexpected token `fi'
./bin/mahout: line 257: ` fi'
$ vi bin/mahout
$ ./bin/mahout spark-shell
Adding lib/ to CLASSPATH
2020-06-30 15:27:39 WARN Utils:66 - Your hostname, rob resolves to a
loopback address: 127.0.1.1; using 10.0.1.40 instead (on interface wlp60s0)
2020-06-30 15:27:39 WARN Utils:66 - Set SPARK_LOCAL_IP if you need to bind
to another address
2020-06-30 15:27:40 WARN NativeCodeLoader:62 - Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use
setLogLevel(newLevel).
Spark context Web UI available at http://10.0.1.40:4040
Spark context available as 'sc' (master = local[*], app id =
local-1593556068798).
Spark session available as 'spark'.
Loading /home/akm/unpack/
repository.apache.org/content/repositories/orgapachemahout-1062/org/apache/mahout/apache-mahout-distribution/14.1/bin/load-shell.scala.
..
<console>:40: error: object mahout is not a member of package org.apache
import org.apache.mahout.math._
^
<console>:23: error: object mahout is not a member of package org.apache
import org.apache.mahout.math.scalabindings._
^
<console>:23: error: object mahout is not a member of package org.apache
import org.apache.mahout.math.drm._
^
<console>:23: error: object mahout is not a member of package org.apache
import org.apache.mahout.math.scalabindings.RLikeOps._
^
<console>:23: error: object mahout is not a member of package org.apache
import org.apache.mahout.math.drm.RLikeDrmOps._
^
<console>:23: error: object mahout is not a member of package org.apache
import org.apache.mahout.sparkbindings._
^
<console>:24: error: object mahout is not a member of package org.apache
implicit val sdc:
org.apache.mahout.sparkbindings.SparkDistributedContext = sc2sdc(sc)
^
<console>:24: error: not found: value sc2sdc
implicit val sdc:
org.apache.mahout.sparkbindings.SparkDistributedContext = sc2sdc(sc)
^
_ _
_ __ ___ __ _| |__ ___ _ _| |_
'_ ` _ \ / _` | '_ \ / _ \| | | | __|
| | | | (_| | | | | (_) | |_| | |_
_| |_| |_|\__,_|_| |_|\___/ \__,_|\__| version 0.14
That file does not exist
Welcome to
____ __
/ __/__ ___ _____/ /__
_\ \/ _ \/ _ `/ __/ '_/
/___/ .__/\_,_/_/ /_/\_\ version 2.3.0
/_/
Using Scala version 2.11.8 (OpenJDK 64-Bit Server VM, Java 1.8.0_252)
Type in expressions to have them evaluated.
Type :help for more information.
scala>
scala> import org.apache.mahout.math._
<console>:23: error: object mahout is not a member of package org.apache
import org.apache.mahout.math._
^
scala> import scalabindings._
<console>:23: error: not found: value scalabindings
import scalabindings._
^
scala> import RLikeOps._
<console>:23: error: not found: value RLikeOps
import RLikeOps._
^
scala>
On Mon, Jun 29, 2020 at 10:10 PM Andrew Musselman <ak...@apache.org> wrote:
> Thanks to some great work by Chris Dutz, RC1 for 14.1 release is out!
> Please go try it out, check signatures and checksums, etc.
>
> Binaries:
> https://repository.apache.org/content/repositories/orgapachemahout-1062/org/apache/mahout/apache-mahout-distribution/14.1/
>
> Source:
> https://repository.apache.org/content/repositories/orgapachemahout-1062/org/apache/mahout/mahout/14.1/
>
> Best
> Andrew
>
Re: RC1 for 14.1
Posted by Andrew Musselman <ak...@apache.org>.
I'm seeing a couple potential bugs, definitely at least a typo in
`bin/mahout` where there was some commented out nested ifs; when I comment
out the dangling fi on line 257 I still see some problems. Am I missing a
step?
$ ./bin/mahout spark-shell
Adding lib/ to CLASSPATH
./bin/mahout: line 257: syntax error near unexpected token `fi'
./bin/mahout: line 257: ` fi'
$ vi bin/mahout
$ ./bin/mahout spark-shell
Adding lib/ to CLASSPATH
2020-06-30 15:27:39 WARN Utils:66 - Your hostname, rob resolves to a
loopback address: 127.0.1.1; using 10.0.1.40 instead (on interface wlp60s0)
2020-06-30 15:27:39 WARN Utils:66 - Set SPARK_LOCAL_IP if you need to bind
to another address
2020-06-30 15:27:40 WARN NativeCodeLoader:62 - Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use
setLogLevel(newLevel).
Spark context Web UI available at http://10.0.1.40:4040
Spark context available as 'sc' (master = local[*], app id =
local-1593556068798).
Spark session available as 'spark'.
Loading /home/akm/unpack/
repository.apache.org/content/repositories/orgapachemahout-1062/org/apache/mahout/apache-mahout-distribution/14.1/bin/load-shell.scala.
..
<console>:40: error: object mahout is not a member of package org.apache
import org.apache.mahout.math._
^
<console>:23: error: object mahout is not a member of package org.apache
import org.apache.mahout.math.scalabindings._
^
<console>:23: error: object mahout is not a member of package org.apache
import org.apache.mahout.math.drm._
^
<console>:23: error: object mahout is not a member of package org.apache
import org.apache.mahout.math.scalabindings.RLikeOps._
^
<console>:23: error: object mahout is not a member of package org.apache
import org.apache.mahout.math.drm.RLikeDrmOps._
^
<console>:23: error: object mahout is not a member of package org.apache
import org.apache.mahout.sparkbindings._
^
<console>:24: error: object mahout is not a member of package org.apache
implicit val sdc:
org.apache.mahout.sparkbindings.SparkDistributedContext = sc2sdc(sc)
^
<console>:24: error: not found: value sc2sdc
implicit val sdc:
org.apache.mahout.sparkbindings.SparkDistributedContext = sc2sdc(sc)
^
_ _
_ __ ___ __ _| |__ ___ _ _| |_
'_ ` _ \ / _` | '_ \ / _ \| | | | __|
| | | | (_| | | | | (_) | |_| | |_
_| |_| |_|\__,_|_| |_|\___/ \__,_|\__| version 0.14
That file does not exist
Welcome to
____ __
/ __/__ ___ _____/ /__
_\ \/ _ \/ _ `/ __/ '_/
/___/ .__/\_,_/_/ /_/\_\ version 2.3.0
/_/
Using Scala version 2.11.8 (OpenJDK 64-Bit Server VM, Java 1.8.0_252)
Type in expressions to have them evaluated.
Type :help for more information.
scala>
scala> import org.apache.mahout.math._
<console>:23: error: object mahout is not a member of package org.apache
import org.apache.mahout.math._
^
scala> import scalabindings._
<console>:23: error: not found: value scalabindings
import scalabindings._
^
scala> import RLikeOps._
<console>:23: error: not found: value RLikeOps
import RLikeOps._
^
scala>
On Mon, Jun 29, 2020 at 10:10 PM Andrew Musselman <ak...@apache.org> wrote:
> Thanks to some great work by Chris Dutz, RC1 for 14.1 release is out!
> Please go try it out, check signatures and checksums, etc.
>
> Binaries:
> https://repository.apache.org/content/repositories/orgapachemahout-1062/org/apache/mahout/apache-mahout-distribution/14.1/
>
> Source:
> https://repository.apache.org/content/repositories/orgapachemahout-1062/org/apache/mahout/mahout/14.1/
>
> Best
> Andrew
>