You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ant.apache.org by Antoine Levy Lambert <an...@gmx.de> on 2014/04/29 05:00:16 UTC

migration to git and web site publication

Hello Jan,

On Apr 28, 2014, at 1:29 AM, Jan Matèrne (jhm) <ap...@materne.de> wrote:

> 
> 
> 
>> The web sites will remain in svn in any event because svnpubsub is the
>> only supported mechanism to maintain web sites AFAIK.
> 
> I havent looked at the current svnpubsub, but there is also one with that
> name for git
> https://www.apache.org/dev/gitpubsub.html
> 
> I would appreciate to have the same scm. 
> Could we start a new git repo for tests and vote later after the
> git/gitpubsub is working?

 Apache Infra does not support gitpubsub for the purpose of maintaining an Apache web site.
I asked confirmation of that on the #asfinfra 
All Apache web sites are in svn and use svnpubsub.
git is not the tool of choice to deal with large files such as the ones on dist.apache.org.
That might be part of the reason why infra supports only svn for the web site.

> 
> 
> Jan
> 
> 
Antoine


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@ant.apache.org
For additional commands, e-mail: dev-help@ant.apache.org


Re: migration to git and web site publication

Posted by Matt Sicker <bo...@gmail.com>.
You can use git submodules similarly. I just don't think it stays
automatically up to date with the HEAD of a branch. If you want that, I
believe you need to use a 3rd party plugin.


On 29 April 2014 10:10, Jean-Louis Boudart <je...@gmail.com>wrote:

> Then this could be an issue with while migrating to git for Ivy / EasyAnt
> as they both use xooki to create website and project documentation (website
> contains version of each releassed documentation through svn:external).
>
> I thought gitpubsub could be used for website.
>
>
> 2014-04-29 5:00 GMT+02:00 Antoine Levy Lambert <an...@gmx.de>:
>
> > Hello Jan,
> >
> > On Apr 28, 2014, at 1:29 AM, Jan Matèrne (jhm) <ap...@materne.de>
> wrote:
> >
> > >
> > >
> > >
> > >> The web sites will remain in svn in any event because svnpubsub is the
> > >> only supported mechanism to maintain web sites AFAIK.
> > >
> > > I havent looked at the current svnpubsub, but there is also one with
> that
> > > name for git
> > > https://www.apache.org/dev/gitpubsub.html
> > >
> > > I would appreciate to have the same scm.
> > > Could we start a new git repo for tests and vote later after the
> > > git/gitpubsub is working?
> >
> >  Apache Infra does not support gitpubsub for the purpose of maintaining
> an
> > Apache web site.
> > I asked confirmation of that on the #asfinfra
> > All Apache web sites are in svn and use svnpubsub.
> > git is not the tool of choice to deal with large files such as the ones
> on
> > dist.apache.org.
> > That might be part of the reason why infra supports only svn for the web
> > site.
> >
> > >
> > >
> > > Jan
> > >
> > >
> > Antoine
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: dev-unsubscribe@ant.apache.org
> > For additional commands, e-mail: dev-help@ant.apache.org
> >
> >
>
>
> --
> Jean Louis Boudart
> Independent consultant
> Apache EasyAnt commiter http://ant.apache.org/easyant/
>



-- 
Matt Sicker <bo...@gmail.com>

Re: migration to git and web site publication

Posted by Jean-Louis Boudart <je...@gmail.com>.
Then this could be an issue with while migrating to git for Ivy / EasyAnt
as they both use xooki to create website and project documentation (website
contains version of each releassed documentation through svn:external).

I thought gitpubsub could be used for website.


2014-04-29 5:00 GMT+02:00 Antoine Levy Lambert <an...@gmx.de>:

> Hello Jan,
>
> On Apr 28, 2014, at 1:29 AM, Jan Matèrne (jhm) <ap...@materne.de> wrote:
>
> >
> >
> >
> >> The web sites will remain in svn in any event because svnpubsub is the
> >> only supported mechanism to maintain web sites AFAIK.
> >
> > I havent looked at the current svnpubsub, but there is also one with that
> > name for git
> > https://www.apache.org/dev/gitpubsub.html
> >
> > I would appreciate to have the same scm.
> > Could we start a new git repo for tests and vote later after the
> > git/gitpubsub is working?
>
>  Apache Infra does not support gitpubsub for the purpose of maintaining an
> Apache web site.
> I asked confirmation of that on the #asfinfra
> All Apache web sites are in svn and use svnpubsub.
> git is not the tool of choice to deal with large files such as the ones on
> dist.apache.org.
> That might be part of the reason why infra supports only svn for the web
> site.
>
> >
> >
> > Jan
> >
> >
> Antoine
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@ant.apache.org
> For additional commands, e-mail: dev-help@ant.apache.org
>
>


-- 
Jean Louis Boudart
Independent consultant
Apache EasyAnt commiter http://ant.apache.org/easyant/

Re: migration to git and web site publication

Posted by Johan Corveleyn <jc...@gmail.com>.
On Tue, Apr 29, 2014 at 9:32 AM, Dominique Devienne <dd...@gmail.com>
wrote:
> On Tue, Apr 29, 2014 at 5:00 AM, Antoine Levy Lambert <an...@gmx.de>
wrote:
>> On Apr 28, 2014, at 1:29 AM, Jan Matèrne (jhm) <ap...@materne.de> wrote:
>>>> The web sites will remain in svn in any event because svnpubsub is the
>>>> only supported mechanism to maintain web sites AFAIK.
>>> [...] git/gitpubsub is working?
>>
>>  Apache Infra does not support gitpubsub for [...] web site.
>
>> git is not the tool of choice to deal with large files such as the ones
on dist.apache.org.
>> That might be part of the reason why infra supports only svn for the web
site.
>
> Just for info, what makes you say that? Why would git be worse than
> SVN for large files?
>
> Is that because all clones must "copy" all versions (compressed deltas
> I guess) of those large files? --DD

Various people indicate that git doesn't work well with large binary files:
https://www.google.com/#q=git+large+binary+files

-- 
Johan

Re: migration to git and web site publication

Posted by Matt Sicker <bo...@gmail.com>.
It's good to use a separate git repository (or svn repository or whatever
works best for you) for storing large assets. You can use it as a git
submodule to pull in a specific revision ID (so it's somewhat similar to
svn:external, except you have to update it yourself and commit changes to
the pointer in the parent repository). That way it only takes up a tiny
text file in the main git repo.


On 29 April 2014 07:50, Dominique Devienne <dd...@gmail.com> wrote:

> On Tue, Apr 29, 2014 at 12:15 PM, Antoine Levy Lambert <an...@gmx.de>
> wrote:
> > On Apr 29, 2014, at 3:32 AM, Dominique Devienne <dd...@gmail.com>
> wrote:
> >> Just for info, what makes you say that? Why would git be worse than
> >> SVN for large files?
> >
> > Below see some references found in google, the first one says that each
> version of a large file is stored
> > (or maybe each version with a different md5).
>
> [DD] Read this old thread [1], I get the impression that git supports
> deltas both during network transfers, and in the remote repo, but
> chooses performance by default over disk-space, by keeping full copies
> of files. But git does support delta-compression, even across "files"
> apparently. So I guess it's more the matter of DCVS' in general
> forcing you to get the whole repos, that is the main drawback of
> storing large files in them. But I'm definitely out of my depth here,
> so I'll stop here :). --DD
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@ant.apache.org
> For additional commands, e-mail: dev-help@ant.apache.org
>
>


-- 
Matt Sicker <bo...@gmail.com>

Re: migration to git and web site publication

Posted by Dominique Devienne <dd...@gmail.com>.
On Tue, Apr 29, 2014 at 12:15 PM, Antoine Levy Lambert <an...@gmx.de> wrote:
> On Apr 29, 2014, at 3:32 AM, Dominique Devienne <dd...@gmail.com> wrote:
>> Just for info, what makes you say that? Why would git be worse than
>> SVN for large files?
>
> Below see some references found in google, the first one says that each version of a large file is stored
> (or maybe each version with a different md5).

[DD] Read this old thread [1], I get the impression that git supports
deltas both during network transfers, and in the remote repo, but
chooses performance by default over disk-space, by keeping full copies
of files. But git does support delta-compression, even across "files"
apparently. So I guess it's more the matter of DCVS' in general
forcing you to get the whole repos, that is the main drawback of
storing large files in them. But I'm definitely out of my depth here,
so I'll stop here :). --DD

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@ant.apache.org
For additional commands, e-mail: dev-help@ant.apache.org


Re: migration to git and web site publication

Posted by Antoine Levy Lambert <an...@gmx.de>.
Hello Dominique,

On Apr 29, 2014, at 3:32 AM, Dominique Devienne <dd...@gmail.com> wrote:

> On Tue, Apr 29, 2014 at 5:00 AM, Antoine Levy Lambert <an...@gmx.de> wrote:
>> git is not the tool of choice to deal with large files such as the ones on dist.apache.org.
>> That might be part of the reason why infra supports only svn for the web site.
> 
> Just for info, what makes you say that? Why would git be worse than
> SVN for large files?
> 
> Is that because all clones must "copy" all versions (compressed deltas
> I guess) of those large files? —D

> D
> 

Below see some references found in google, the first one says that each version of a large file is stored
(or maybe each version with a different md5).

So cloning a plain vanilla git repository containing several versions of a large file would fill up one’s disk.

That makes me think that the Ant git module will be a bit fat already from all the versions of xercesImpl and of jUnit that we have checked in over the years.

The stack overflow article mentions add-ons to git to manage large files.

Antoine

http://www.altdevblogaday.com/2013/09/05/git-off-my-lawn-large-and-unmergable-assets/
http://stackoverflow.com/questions/540535/managing-large-binary-files-with-git
https://help.github.com/articles/working-with-large-files


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@ant.apache.org
For additional commands, e-mail: dev-help@ant.apache.org


Re: migration to git and web site publication

Posted by Dominique Devienne <dd...@gmail.com>.
On Tue, Apr 29, 2014 at 5:00 AM, Antoine Levy Lambert <an...@gmx.de> wrote:
> On Apr 28, 2014, at 1:29 AM, Jan Matèrne (jhm) <ap...@materne.de> wrote:
>>> The web sites will remain in svn in any event because svnpubsub is the
>>> only supported mechanism to maintain web sites AFAIK.
>> [...] git/gitpubsub is working?
>
>  Apache Infra does not support gitpubsub for [...] web site.

> git is not the tool of choice to deal with large files such as the ones on dist.apache.org.
> That might be part of the reason why infra supports only svn for the web site.

Just for info, what makes you say that? Why would git be worse than
SVN for large files?

Is that because all clones must "copy" all versions (compressed deltas
I guess) of those large files? --DD

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@ant.apache.org
For additional commands, e-mail: dev-help@ant.apache.org