You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ant.apache.org by "Alexey N. Solofnenko" <A....@mdl.com> on 2005/10/28 19:59:22 UTC
latest is very slow.
It takes about 2 and a half minutes to delete 20K files with last winter
build, but with the latest ANT build takes about 6 minutes. I do not
know when it started to happen.
- Alexey.
--
------------------------------------------------------------------------
/ Alexey N. Solofnenko
home: http://trelony.cjb.net/
/
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@ant.apache.org
For additional commands, e-mail: dev-help@ant.apache.org
Re: latest is very slow.
Posted by Alexey Solofnenko <tr...@gmail.com>.
More news - there are still 25K files - fileset creation is still running.
- Alexey.
On 10/28/05, Alexey Solofnenko <tr...@gmail.com> wrote:
>
> This is a Jython script generates about 25K files in 4 level directory
> hierarchy. Simple <delete><fileset dir="build/test"/></delete> has been
> running for 7 minutes and did not yet complete.
>
> =========================================
> # generate
> import fileutils
> import os
>
> text="some boring text\n"*100
>
> def generate(level, path):
> for i in range(1, 20):
> fileutils.writeFile (path+'/'+str(i)+'.txt', text)
>
> if level>0:
> for i in range(1, 5):
> newpath=path+'/'+str(i)
> os.mkdir(newpath)
> generate(level-1, newpath)
>
> test_dir='build/test'
> os.mkdir(test_dir)
> generate(5, test_dir)
> =================================
>
> I can send you TGZ - it is about 570K.
>
> - Alexey.
>
> On 10/28/05, Alexey Solofnenko <tr...@gmail.com> wrote:
> >
> > Good idea, I will have one generated. In the real build, there is
> > nothing special - I just remove one directory that is about 1GB size and
> > with about 21K files. There are 2x2 (hyper threading) processors and during
> > file deletion one CPU is at 100%.
> >
> > - Alexey.
> >
> > On 10/28/05, Matt Benson < gudnabrsam@yahoo.com> wrote:
> > >
> > > Alexey, can you send a buildfile to the list (or enter
> > > in bugzilla) that will create a file structure that
> > > will exhibit the problem?
> > >
> > > -Matt
> > >
> > > --- "Alexey N. Solofnenko" < A.Solofnenko@mdl.com>
> > > wrote:
> > >
> > > > It takes about 2 and a half minutes to delete 20K
> > > > files with last winter
> > > > build, but with the latest ANT build takes about 6
> > > > minutes. I do not
> > > > know when it started to happen.
> > > >
> > > > - Alexey.
> > > >
> > > > --
> > > >
> > >
> > > ------------------------------------------------------------------------
> > > > / Alexey N. Solofnenko
> > > > home: http://trelony.cjb.net/
> > > > /
> > > >
> > > >
> > > ---------------------------------------------------------------------
> > > > To unsubscribe, e-mail:
> > > > dev-unsubscribe@ant.apache.org
> > > > For additional commands, e-mail:
> > > > dev-help@ant.apache.org
> > > >
> > > >
> > >
> > >
> > >
> > >
> > > __________________________________
> > > Start your day with Yahoo! - Make it your home page!
> > > http://www.yahoo.com/r/hs
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: dev-unsubscribe@ant.apache.org
> > > For additional commands, e-mail: dev-help@ant.apache.org
> > >
> > >
> >
> >
> > --
> > Alexey N. Solofnenko trelony at gmail.com <http://gmail.com>
> > home: http://trelony.cjb.net/
> > Pleasant Hill, CA (GMT-8 hours usually)
> >
>
>
>
> --
> Alexey N. Solofnenko trelony at gmail.com <http://gmail.com>
> home: http://trelony.cjb.net/
> Pleasant Hill, CA (GMT-8 hours usually)
>
--
Alexey N. Solofnenko trelony at gmail.com <http://gmail.com>
home: http://trelony.cjb.net/
Pleasant Hill, CA (GMT-8 hours usually)
Re: latest is very slow.
Posted by Alexey Solofnenko <tr...@gmail.com>.
This is a Jython script generates about 25K files in 4 level directory
hierarchy. Simple <delete><fileset dir="build/test"/></delete> has been
running for 7 minutes and did not yet complete.
=========================================
# generate
import fileutils
import os
text="some boring text\n"*100
def generate(level, path):
for i in range(1, 20):
fileutils.writeFile(path+'/'+str(i)+'.txt', text)
if level>0:
for i in range(1, 5):
newpath=path+'/'+str(i)
os.mkdir(newpath)
generate(level-1, newpath)
test_dir='build/test'
os.mkdir(test_dir)
generate(5, test_dir)
=================================
I can send you TGZ - it is about 570K.
- Alexey.
On 10/28/05, Alexey Solofnenko <tr...@gmail.com> wrote:
>
> Good idea, I will have one generated. In the real build, there is nothing
> special - I just remove one directory that is about 1GB size and with about
> 21K files. There are 2x2 (hyper threading) processors and during file
> deletion one CPU is at 100%.
>
> - Alexey.
>
> On 10/28/05, Matt Benson <gu...@yahoo.com> wrote:
> >
> > Alexey, can you send a buildfile to the list (or enter
> > in bugzilla) that will create a file structure that
> > will exhibit the problem?
> >
> > -Matt
> >
> > --- "Alexey N. Solofnenko" < A.Solofnenko@mdl.com>
> > wrote:
> >
> > > It takes about 2 and a half minutes to delete 20K
> > > files with last winter
> > > build, but with the latest ANT build takes about 6
> > > minutes. I do not
> > > know when it started to happen.
> > >
> > > - Alexey.
> > >
> > > --
> > >
> > ------------------------------------------------------------------------
> > > / Alexey N. Solofnenko
> > > home: http://trelony.cjb.net/
> > > /
> > >
> > >
> > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail:
> > > dev-unsubscribe@ant.apache.org
> > > For additional commands, e-mail:
> > > dev-help@ant.apache.org
> > >
> > >
> >
> >
> >
> >
> > __________________________________
> > Start your day with Yahoo! - Make it your home page!
> > http://www.yahoo.com/r/hs
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: dev-unsubscribe@ant.apache.org
> > For additional commands, e-mail: dev-help@ant.apache.org
> >
> >
>
>
> --
> Alexey N. Solofnenko trelony at gmail.com <http://gmail.com>
> home: http://trelony.cjb.net/
> Pleasant Hill, CA (GMT-8 hours usually)
>
--
Alexey N. Solofnenko trelony at gmail.com <http://gmail.com>
home: http://trelony.cjb.net/
Pleasant Hill, CA (GMT-8 hours usually)
Re: latest is very slow.
Posted by Alexey Solofnenko <tr...@gmail.com>.
Good idea, I will have one generated. In the real build, there is nothing
special - I just remove one directory that is about 1GB size and with about
21K files. There are 2x2 (hyper threading) processors and during file
deletion one CPU is at 100%.
- Alexey.
On 10/28/05, Matt Benson <gu...@yahoo.com> wrote:
>
> Alexey, can you send a buildfile to the list (or enter
> in bugzilla) that will create a file structure that
> will exhibit the problem?
>
> -Matt
>
> --- "Alexey N. Solofnenko" <A....@mdl.com>
> wrote:
>
> > It takes about 2 and a half minutes to delete 20K
> > files with last winter
> > build, but with the latest ANT build takes about 6
> > minutes. I do not
> > know when it started to happen.
> >
> > - Alexey.
> >
> > --
> >
> ------------------------------------------------------------------------
> > / Alexey N. Solofnenko
> > home: http://trelony.cjb.net/
> > /
> >
> >
> ---------------------------------------------------------------------
> > To unsubscribe, e-mail:
> > dev-unsubscribe@ant.apache.org
> > For additional commands, e-mail:
> > dev-help@ant.apache.org
> >
> >
>
>
>
>
> __________________________________
> Start your day with Yahoo! - Make it your home page!
> http://www.yahoo.com/r/hs
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@ant.apache.org
> For additional commands, e-mail: dev-help@ant.apache.org
>
>
--
Alexey N. Solofnenko trelony at gmail.com <http://gmail.com>
home: http://trelony.cjb.net/
Pleasant Hill, CA (GMT-8 hours usually)
Re: latest is very slow.
Posted by Matt Benson <gu...@yahoo.com>.
Alexey, can you send a buildfile to the list (or enter
in bugzilla) that will create a file structure that
will exhibit the problem?
-Matt
--- "Alexey N. Solofnenko" <A....@mdl.com>
wrote:
> It takes about 2 and a half minutes to delete 20K
> files with last winter
> build, but with the latest ANT build takes about 6
> minutes. I do not
> know when it started to happen.
>
> - Alexey.
>
> --
>
------------------------------------------------------------------------
> / Alexey N. Solofnenko
> home: http://trelony.cjb.net/
> /
>
>
---------------------------------------------------------------------
> To unsubscribe, e-mail:
> dev-unsubscribe@ant.apache.org
> For additional commands, e-mail:
> dev-help@ant.apache.org
>
>
__________________________________
Start your day with Yahoo! - Make it your home page!
http://www.yahoo.com/r/hs
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@ant.apache.org
For additional commands, e-mail: dev-help@ant.apache.org