You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@subversion.apache.org by "Hyrum K. Wright" <hy...@mail.utexas.edu> on 2010/04/16 17:02:24 UTC

Hosting tarballs on ASF infrastructure

This is another one of those 'migrating to the ASF' emails.  If you don't
care about such things, you may stop reading.

This latest release has given me a chance to think about the post-ASF future
of the release process.  Currently, we are still hosting our tarballs on
s.t.o, with the expectation that we'll start distributing stuff via
apache.org infrastructure once we are cutting 1.7 prereleases.  In
preparation for that time, I'd like to know a couple of things:
1) Is there a guide somewhere about how to use the ASF mirrors and release
infrastructure?
2) Is it possible for us to move the existing tarballs to somewhere on ASF
infrastructure, so that we can maintain a complete archive of all past
releases (without having to split up said archive)?

If any of the ASF folks in the know about either of the above could let me
know about them, I'd appreciate it.

Thanks,
-Hyrum

Re: Hosting tarballs on ASF infrastructure

Posted by Greg Stein <gs...@gmail.com>.
I'm at Yogi Bear's Jellystone Park right now. Needless to say, it will be a
bit before I respond properly. :-P

On Apr 17, 2010 9:25 AM, "Justin Erenkrantz" <ju...@erenkrantz.com> wrote:

On Fri, Apr 16, 2010 at 10:02 AM, Hyrum K. Wright
<hy...@mail.utexas.edu> wrote:
> 1) Is ther...
http://www.apache.org/dev/mirrors.html


> 2) Is it possible for us to move the existing tarballs to somewhere on ASF
> infrastructure, so t...
Possible, yes, as there is no legal obstruction in doing so - however,
I'll leave it to Greg to provide a recommendation here.  My suggestion
would be to import the old releases into archive.apache.org - but this
is a bit of uncharted territory for the ASF, so there may be some
policy wrangling that is best left to Greg.  -- justin

Re: Hosting tarballs on ASF infrastructure

Posted by Manuel Vacelet <ma...@gmail.com>.
On Mon, Apr 26, 2010 at 8:31 PM, Daniel Shahaf <d....@daniel.shahaf.name> wrote:
> Manuel Vacelet wrote on Mon, 26 Apr 2010 at 20:03 +0200:
>> My 2 cts as time-to-time compiler (user in your list): -deps are one
>> of things I just find perfect when I have to build subversion: no need
>> to worry and to spend time to find all the dependencies: juste
>> download 2 tarballs, unpack & go.
>
> Instead of posting deps tarballs, we could just post the URLs of the
> dependencies.  (That also means you don't have to spend time finding
> them.)

It's not as "plug'n play" but it's a good trade off IMHO.

Manuel

Re: Hosting tarballs on ASF infrastructure

Posted by Daniel Shahaf <d....@daniel.shahaf.name>.
Manuel Vacelet wrote on Mon, 26 Apr 2010 at 20:03 +0200:
> My 2 cts as time-to-time compiler (user in your list): -deps are one
> of things I just find perfect when I have to build subversion: no need
> to worry and to spend time to find all the dependencies: juste
> download 2 tarballs, unpack & go.

Instead of posting deps tarballs, we could just post the URLs of the
dependencies.  (That also means you don't have to spend time finding 
them.)

Re: Hosting tarballs on ASF infrastructure

Posted by Manuel Vacelet <ma...@gmail.com>.
On Mon, Apr 26, 2010 at 6:20 PM, Hyrum K. Wright
<hy...@mail.utexas.edu> wrote:
> I would *love* to stop shipping the deps, and would be happy to make this
> happen as part of the 1.7 release cycle.  It would be nice to hear from our
> users / packages / 3rd-party-clients to find out if they actually use or
> care about the deps tarballs before we banish them, however.

My 2 cts as time-to-time compiler (user in your list): -deps are one
of things I just find perfect when I have to build subversion: no need
to worry and to spend time to find all the dependencies: juste
download 2 tarballs, unpack & go.
But I might not be representative because I'm stuck on rather old
system and I rely on linux distribution packages for build
dependencies.

Manuel

Re: Hosting tarballs on ASF infrastructure

Posted by Stefan Sperling <st...@elego.de>.
On Mon, Apr 26, 2010 at 11:20:52AM -0500, Hyrum K. Wright wrote:
> On Mon, Apr 26, 2010 at 11:06 AM, Mark Phippard <ma...@gmail.com> wrote:
> 
> > On Mon, Apr 26, 2010 at 11:44 AM, Hyrum K. Wright
> > <hy...@mail.utexas.edu> wrote:
> > I was under the impression we couldn't post it unless we remove Neon
> > and maybe other parts.
> >
> > Personally, I think this is a good opportunity to stop making it.
> >
> 
> I would *love* to stop shipping the deps, and would be happy to make this
> happen as part of the 1.7 release cycle.  It would be nice to hear from our
> users / packages / 3rd-party-clients to find out if they actually use or
> care about the deps tarballs before we banish them, however.

I have not seen a single packager in Linux/UNIX land that uses
the deps tarball. It does not make sense to use it when you have
a package manager anyway.

Not sure about Windows.

Stefan

Re: Hosting tarballs on ASF infrastructure

Posted by "Hyrum K. Wright" <hy...@mail.utexas.edu>.
On Mon, Apr 26, 2010 at 11:06 AM, Mark Phippard <ma...@gmail.com> wrote:

> On Mon, Apr 26, 2010 at 11:44 AM, Hyrum K. Wright
> <hy...@mail.utexas.edu> wrote:
> > This looks like a good location, do you know what needs to happen so I
> can
> > get the appropriate privs to upload to the subversion/ directory there?
> >
> > Also, I'm planning on just putting the release tarballs, not the deps
> > tarballs.  Any reason why we should include the deps tarballs?
>
> I was under the impression we couldn't post it unless we remove Neon
> and maybe other parts.
>
> Personally, I think this is a good opportunity to stop making it.
>

I would *love* to stop shipping the deps, and would be happy to make this
happen as part of the 1.7 release cycle.  It would be nice to hear from our
users / packages / 3rd-party-clients to find out if they actually use or
care about the deps tarballs before we banish them, however.

-Hyrum

Re: Hosting tarballs on ASF infrastructure

Posted by Mark Phippard <ma...@gmail.com>.
On Mon, Apr 26, 2010 at 11:44 AM, Hyrum K. Wright
<hy...@mail.utexas.edu> wrote:
> This looks like a good location, do you know what needs to happen so I can
> get the appropriate privs to upload to the subversion/ directory there?
>
> Also, I'm planning on just putting the release tarballs, not the deps
> tarballs.  Any reason why we should include the deps tarballs?

I was under the impression we couldn't post it unless we remove Neon
and maybe other parts.

Personally, I think this is a good opportunity to stop making it.

-- 
Thanks

Mark Phippard
http://markphip.blogspot.com/

Re: Hosting tarballs on ASF infrastructure

Posted by "C. Michael Pilato" <cm...@collab.net>.
Hyrum K. Wright wrote:
> Just a bit of followup on this.  I've moved over all the
> subversion-*.{zip,tar.gz,tar.bz2} artifacts to archive.apache.org.  I
> verified all the signatures, and also created sha1 checksum files for each
> artifact.  You should shortly be able to find them here:
> http://archive.apache.org/dist/subversion/

Awesome -- thanks!  Do we have pointers on our website to the new location yet?

> Aside from the deps tarballs, there are a few random items that I'm not sure
> what to do with.  In s.t.o/downloads/ we have a series of files similar in
> name to svn-python-1.4.2.win32-py2.3.exe.  I think they are the python
> bindings, but I'm not sure.  There are also files named
> svn-win32-1.4.2_{pdb,javahl,pl,py23,py24,dev}.zip.  In both cases, I'm
> inclined to just let 'em be, and not move them to archive.apache.org.
> Thoughts?

Yup, just let 'em be.

-- 
C. Michael Pilato <cm...@collab.net>
CollabNet   <>   www.collab.net   <>   Distributed Development On Demand

Re: Hosting tarballs on ASF infrastructure

Posted by "Hyrum K. Wright" <hy...@mail.utexas.edu>.
On Mon, Apr 26, 2010 at 11:19 AM, Hyrum K. Wright <
hyrum_wright@mail.utexas.edu> wrote:

>
>
> On Mon, Apr 26, 2010 at 11:05 AM, Greg Stein <gs...@gmail.com> wrote:
>
>> I believe we should have no problem with the svn tarballs themselves,
>> and will follow up on legal-discuss with that.
>>
>> Note that archive.apache.org is not mirrored. The mirroring system
>> applies just to current releases.
>>
>
> That's fine.  I'm just looking to consolidate our artifacts in one location
> as part of the asymptotic move away from tigris.
>

Just a bit of followup on this.  I've moved over all the
subversion-*.{zip,tar.gz,tar.bz2} artifacts to archive.apache.org.  I
verified all the signatures, and also created sha1 checksum files for each
artifact.  You should shortly be able to find them here:
http://archive.apache.org/dist/subversion/

Aside from the deps tarballs, there are a few random items that I'm not sure
what to do with.  In s.t.o/downloads/ we have a series of files similar in
name to svn-python-1.4.2.win32-py2.3.exe.  I think they are the python
bindings, but I'm not sure.  There are also files named
svn-win32-1.4.2_{pdb,javahl,pl,py23,py24,dev}.zip.  In both cases, I'm
inclined to just let 'em be, and not move them to archive.apache.org.
Thoughts?

-Hyrum

Re: Hosting tarballs on ASF infrastructure

Posted by "Hyrum K. Wright" <hy...@mail.utexas.edu>.
Ping.

Greg, any additional steps we need to take before uploading the archival
tarballs to archive.apache.org ?

-Hyrum

On Mon, Apr 26, 2010 at 11:19 AM, Hyrum K. Wright <
hyrum_wright@mail.utexas.edu> wrote:

>
>
>   On Mon, Apr 26, 2010 at 11:05 AM, Greg Stein <gs...@gmail.com> wrote:
>
>> On Mon, Apr 26, 2010 at 11:44, Hyrum K. Wright
>> <hy...@mail.utexas.edu> wrote:
>> >
>> >
>> > On Sat, Apr 17, 2010 at 8:24 AM, Justin Erenkrantz <
>> justin@erenkrantz.com>
>> > wrote:
>> >>
>> >> On Fri, Apr 16, 2010 at 10:02 AM, Hyrum K. Wright
>> >> <hy...@mail.utexas.edu> wrote:
>> >> > 1) Is there a guide somewhere about how to use the ASF mirrors and
>> >> > release
>> >> > infrastructure?
>> >>
>> >> http://www.apache.org/dev/mirrors.html
>> >>
>> >> > 2) Is it possible for us to move the existing tarballs to somewhere
>> on
>> >> > ASF
>> >> > infrastructure, so that we can maintain a complete archive of all
>> past
>> >> > releases (without having to split up said archive)?
>> >>
>> >> Possible, yes, as there is no legal obstruction in doing so - however,
>> >> I'll leave it to Greg to provide a recommendation here.  My suggestion
>> >> would be to import the old releases into archive.apache.org - but this
>> >> is a bit of uncharted territory for the ASF, so there may be some
>> >> policy wrangling that is best left to Greg.  -- justin
>> >
>> > Greg,
>> > This looks like a good location, do you know what needs to happen so I
>> can
>> > get the appropriate privs to upload to the subversion/ directory there?
>> >
>> > Also, I'm planning on just putting the release tarballs, not the deps
>> > tarballs.  Any reason why we should include the deps tarballs?
>>
>> Ah. Thanks for the reminder.
>>
>> Do the deps have code that is less permissive than the Apache license?
>> e.g MPL or LGPL (or GPL!) ?
>>
>
> Not sure.  In the current set of tarballs, we've got sqlite, serf, apr,
> apr-util, neon, zlib, and possibly apr-iconv (in the zips).  In the pre-1.4
> days, we actually included the current deps in the shipping Subversion
> tarballs, but it might have been just apr, apr-util and neon at that point.
>
>
>> I believe we should have no problem with the svn tarballs themselves,
>> and will follow up on legal-discuss with that.
>>
>> Note that archive.apache.org is not mirrored. The mirroring system
>> applies just to current releases.
>>
>
> That's fine.  I'm just looking to consolidate our artifacts in one location
> as part of the asymptotic move away from tigris.
>
> -Hyrum
>

Re: Hosting tarballs on ASF infrastructure

Posted by "Hyrum K. Wright" <hy...@mail.utexas.edu>.
On Mon, Apr 26, 2010 at 11:05 AM, Greg Stein <gs...@gmail.com> wrote:

> On Mon, Apr 26, 2010 at 11:44, Hyrum K. Wright
> <hy...@mail.utexas.edu> wrote:
> >
> >
> > On Sat, Apr 17, 2010 at 8:24 AM, Justin Erenkrantz <
> justin@erenkrantz.com>
> > wrote:
> >>
> >> On Fri, Apr 16, 2010 at 10:02 AM, Hyrum K. Wright
> >> <hy...@mail.utexas.edu> wrote:
> >> > 1) Is there a guide somewhere about how to use the ASF mirrors and
> >> > release
> >> > infrastructure?
> >>
> >> http://www.apache.org/dev/mirrors.html
> >>
> >> > 2) Is it possible for us to move the existing tarballs to somewhere on
> >> > ASF
> >> > infrastructure, so that we can maintain a complete archive of all past
> >> > releases (without having to split up said archive)?
> >>
> >> Possible, yes, as there is no legal obstruction in doing so - however,
> >> I'll leave it to Greg to provide a recommendation here.  My suggestion
> >> would be to import the old releases into archive.apache.org - but this
> >> is a bit of uncharted territory for the ASF, so there may be some
> >> policy wrangling that is best left to Greg.  -- justin
> >
> > Greg,
> > This looks like a good location, do you know what needs to happen so I
> can
> > get the appropriate privs to upload to the subversion/ directory there?
> >
> > Also, I'm planning on just putting the release tarballs, not the deps
> > tarballs.  Any reason why we should include the deps tarballs?
>
> Ah. Thanks for the reminder.
>
> Do the deps have code that is less permissive than the Apache license?
> e.g MPL or LGPL (or GPL!) ?
>

Not sure.  In the current set of tarballs, we've got sqlite, serf, apr,
apr-util, neon, zlib, and possibly apr-iconv (in the zips).  In the pre-1.4
days, we actually included the current deps in the shipping Subversion
tarballs, but it might have been just apr, apr-util and neon at that point.


> I believe we should have no problem with the svn tarballs themselves,
> and will follow up on legal-discuss with that.
>
> Note that archive.apache.org is not mirrored. The mirroring system
> applies just to current releases.
>

That's fine.  I'm just looking to consolidate our artifacts in one location
as part of the asymptotic move away from tigris.

-Hyrum

Re: Hosting tarballs on ASF infrastructure

Posted by Greg Stein <gs...@gmail.com>.
On Mon, Apr 26, 2010 at 11:44, Hyrum K. Wright
<hy...@mail.utexas.edu> wrote:
>
>
> On Sat, Apr 17, 2010 at 8:24 AM, Justin Erenkrantz <ju...@erenkrantz.com>
> wrote:
>>
>> On Fri, Apr 16, 2010 at 10:02 AM, Hyrum K. Wright
>> <hy...@mail.utexas.edu> wrote:
>> > 1) Is there a guide somewhere about how to use the ASF mirrors and
>> > release
>> > infrastructure?
>>
>> http://www.apache.org/dev/mirrors.html
>>
>> > 2) Is it possible for us to move the existing tarballs to somewhere on
>> > ASF
>> > infrastructure, so that we can maintain a complete archive of all past
>> > releases (without having to split up said archive)?
>>
>> Possible, yes, as there is no legal obstruction in doing so - however,
>> I'll leave it to Greg to provide a recommendation here.  My suggestion
>> would be to import the old releases into archive.apache.org - but this
>> is a bit of uncharted territory for the ASF, so there may be some
>> policy wrangling that is best left to Greg.  -- justin
>
> Greg,
> This looks like a good location, do you know what needs to happen so I can
> get the appropriate privs to upload to the subversion/ directory there?
>
> Also, I'm planning on just putting the release tarballs, not the deps
> tarballs.  Any reason why we should include the deps tarballs?

Ah. Thanks for the reminder.

Do the deps have code that is less permissive than the Apache license?
e.g MPL or LGPL (or GPL!) ?

I believe we should have no problem with the svn tarballs themselves,
and will follow up on legal-discuss with that.

Note that archive.apache.org is not mirrored. The mirroring system
applies just to current releases.

Cheers,
-g

Re: Hosting tarballs on ASF infrastructure

Posted by "Hyrum K. Wright" <hy...@mail.utexas.edu>.
On Sat, Apr 17, 2010 at 8:24 AM, Justin Erenkrantz <ju...@erenkrantz.com>wrote:

> On Fri, Apr 16, 2010 at 10:02 AM, Hyrum K. Wright
> <hy...@mail.utexas.edu> wrote:
> > 1) Is there a guide somewhere about how to use the ASF mirrors and
> release
> > infrastructure?
>
> http://www.apache.org/dev/mirrors.html
>
> > 2) Is it possible for us to move the existing tarballs to somewhere on
> ASF
> > infrastructure, so that we can maintain a complete archive of all past
> > releases (without having to split up said archive)?
>
> Possible, yes, as there is no legal obstruction in doing so - however,
> I'll leave it to Greg to provide a recommendation here.  My suggestion
> would be to import the old releases into archive.apache.org - but this
> is a bit of uncharted territory for the ASF, so there may be some
> policy wrangling that is best left to Greg.  -- justin
>

Greg,
This looks like a good location, do you know what needs to happen so I can
get the appropriate privs to upload to the subversion/ directory there?

Also, I'm planning on just putting the release tarballs, not the deps
tarballs.  Any reason why we should include the deps tarballs?

-Hyrum

Re: Hosting tarballs on ASF infrastructure

Posted by Justin Erenkrantz <ju...@erenkrantz.com>.
On Fri, Apr 16, 2010 at 10:02 AM, Hyrum K. Wright
<hy...@mail.utexas.edu> wrote:
> 1) Is there a guide somewhere about how to use the ASF mirrors and release
> infrastructure?

http://www.apache.org/dev/mirrors.html

> 2) Is it possible for us to move the existing tarballs to somewhere on ASF
> infrastructure, so that we can maintain a complete archive of all past
> releases (without having to split up said archive)?

Possible, yes, as there is no legal obstruction in doing so - however,
I'll leave it to Greg to provide a recommendation here.  My suggestion
would be to import the old releases into archive.apache.org - but this
is a bit of uncharted territory for the ASF, so there may be some
policy wrangling that is best left to Greg.  -- justin