You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@poi.apache.org by "Adam R. B. Jack" <aj...@trysybase.com> on 2004/07/08 20:23:50 UTC

Getting lots of /tmp/*.xls on Brutus

My local (work) Gump that builds a really small subset of the Gump stack
(and then my code) started dying w/ lack of disk space. We found that we
were getting a full /tmp, and then I saw that Brutus has a similar issue.

gump@brutus:~$ wc /tmp/*.xls
-bash: /usr/bin/wc: Argument list too long
gump@brutus:~$ cat /tmp/*.xls | wc
-bash: /bin/cat: Argument list too long
      0       0       0

i.e. lots of files!

Basically, I have to assume that these are from POI (please correct me if I
am wrong) and one (or both) of the two POI runs.

    http://brutus.apache.org:8080/gump/jakarta-poi/index.html
    http://brutus.apache.org:8080/gump/jakarta-poi-3/index.html

Could you look at this problem, and help us out? Could you see if the POI
test runs could use a ./tmp (or similar) directory, 'cos Gump cleans that
out each run. [I don't know if this uses some Java function that you have
limited control over, but I thought I'd ask.]

Also, would it be possible to separate the POI tests from the POI compile? I
use POI at work (love it, thanks!) and we try to compile our stack of code
regularly. Anything that creates this much data must be resource intensive
:) -- so if we could have separate poi and poi-test, we'd be able to save
local resources. No biggee though.

Thanks in advance.

regards,

Adam
--
Experience the Unwired Enterprise:
http://www.sybase.com/unwiredenterprise
Try Sybase: http://www.try.sybase.com


---------------------------------------------------------------------
To unsubscribe, e-mail: poi-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: poi-dev-help@jakarta.apache.org


Re: Getting lots of /tmp/*.xls on Brutus

Posted by "Adam R. B. Jack" <aj...@trysybase.com>.
> In any case, the files
> are created in the system temp directory, using the java
> File.createTempFile method call. I dont know if that is something that
> can be controlled by setting environment variables.

Does JDK 1.3+ cover POI users?

http://java.sun.com/j2se/1.3/docs/api/java/io/File.html#createTempFile(java.lang.String,%20java.lang.String,%20java.io.File)

Seems you could pass ./tmp, which would make Gump happy.

regards

Adam


---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@gump.apache.org
For additional commands, e-mail: general-help@gump.apache.org


Re: Getting lots of /tmp/*.xls on Brutus

Posted by "Adam R. B. Jack" <aj...@trysybase.com>.
> In any case, the files
> are created in the system temp directory, using the java
> File.createTempFile method call. I dont know if that is something that
> can be controlled by setting environment variables.

Does JDK 1.3+ cover POI users?

http://java.sun.com/j2se/1.3/docs/api/java/io/File.html#createTempFile(java.lang.String,%20java.lang.String,%20java.io.File)

Seems you could pass ./tmp, which would make Gump happy.

regards

Adam


---------------------------------------------------------------------
To unsubscribe, e-mail: poi-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: poi-dev-help@jakarta.apache.org


Re: Getting lots of /tmp/*.xls on Brutus

Posted by Avik Sengupta <av...@itellix.com>.
As Rainer confirmed, these are indeed POI tests. 

tests are indeed a separate target from compile in the build scripts, so
even if you compile regularly, you should be fine. (Also I must say that
all tests on  my 1.8GHz pentium4 take about 1min 10sec to run .. POI is
quite fast :). Its just that our gump descriptor specifies the "test"
target to be run.  

We don't, in general, delete the files created, because  some tests
require opening up the file in excel to see if it displays correctly. 

So usually this is not a problem for interactive use, but I can see why
gump would have a problem. One solution is to specify a separate ant
target for gump that deletes all files created. In any case, the files
are created in the system temp directory, using the java
File.createTempFile method call. I dont know if that is something that
can be controlled by setting environment variables. 

I'll see what I can do. 

Regards
-
Avik


On Thu, 2004-07-08 at 23:53, Adam R. B. Jack wrote:
> My local (work) Gump that builds a really small subset of the Gump stack
> (and then my code) started dying w/ lack of disk space. We found that we
> were getting a full /tmp, and then I saw that Brutus has a similar issue.
> 
> gump@brutus:~$ wc /tmp/*.xls
> -bash: /usr/bin/wc: Argument list too long
> gump@brutus:~$ cat /tmp/*.xls | wc
> -bash: /bin/cat: Argument list too long
>       0       0       0
> 
> i.e. lots of files!
> 
> Basically, I have to assume that these are from POI (please correct me if I
> am wrong) and one (or both) of the two POI runs.
> 
>     http://brutus.apache.org:8080/gump/jakarta-poi/index.html
>     http://brutus.apache.org:8080/gump/jakarta-poi-3/index.html
> 
> Could you look at this problem, and help us out? Could you see if the POI
> test runs could use a ./tmp (or similar) directory, 'cos Gump cleans that
> out each run. [I don't know if this uses some Java function that you have
> limited control over, but I thought I'd ask.]
> 
> Also, would it be possible to separate the POI tests from the POI compile? I
> use POI at work (love it, thanks!) and we try to compile our stack of code
> regularly. Anything that creates this much data must be resource intensive
> :) -- so if we could have separate poi and poi-test, we'd be able to save
> local resources. No biggee though.
> 
> Thanks in advance.
> 
> regards,
> 
> Adam
> --
> Experience the Unwired Enterprise:
> http://www.sybase.com/unwiredenterprise
> Try Sybase: http://www.try.sybase.com
> 
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: general-unsubscribe@gump.apache.org
> For additional commands, e-mail: general-help@gump.apache.org
> 


---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@gump.apache.org
For additional commands, e-mail: general-help@gump.apache.org


Re: Getting lots of /tmp/*.xls on Brutus

Posted by Rainer Klute <kl...@rainer-klute.de>.
Am Do, 2004-07-08 um 20.50 schrieb Rainer Klute:
> You are write, ...

You are right, it is too late, at least for me. :-(

Best regards
Rainer Klute

                           Rainer Klute IT-Consulting GmbH
  Dipl.-Inform.
  Rainer Klute             E-Mail:  klute@rainer-klute.de
  Körner Grund 24          Telefon: +49 172 2324824
D-44143 Dortmund           Telefax: +49 231 5349423


---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@gump.apache.org
For additional commands, e-mail: general-help@gump.apache.org


Re: Getting lots of /tmp/*.xls on Brutus

Posted by Rainer Klute <kl...@rainer-klute.de>.
Am Do, 2004-07-08 um 20.50 schrieb Rainer Klute:
> You are write, ...

You are right, it is too late, at least for me. :-(

Best regards
Rainer Klute

                           Rainer Klute IT-Consulting GmbH
  Dipl.-Inform.
  Rainer Klute             E-Mail:  klute@rainer-klute.de
  Körner Grund 24          Telefon: +49 172 2324824
D-44143 Dortmund           Telefax: +49 231 5349423


---------------------------------------------------------------------
To unsubscribe, e-mail: poi-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: poi-dev-help@jakarta.apache.org


Re: Getting lots of /tmp/*.xls on Brutus

Posted by Avik Sengupta <av...@itellix.com>.
Yeah it did. We usually try to keep 1.2 compatibility .. but I dont know
how important it is any more.. needs discussion on the dev list, I
suppose. 

Regards
-
Avik


On Mon, 2004-07-12 at 21:01, Adam R. B. Jack wrote:
> Did my suggestion of :
> 
> http://java.sun.com/j2se/1.3/docs/api/java/io/File.html#createTempFile(java.lang.String,%20java.lang.String,%20java.io.File)
> 
> Make it to this list? If you could pass a third parameter of './tmp' or
> './test/tmp' or something, then Gump would automatically clean up. Also,
> wouldn't this be a nicer place for human users to look?
> 
> regards,
> 
> Adam
> ----- Original Message ----- 
> From: "Rainer Klute" <kl...@rainer-klute.de>
> To: "POI Developers List" <po...@jakarta.apache.org>
> Sent: Sunday, July 11, 2004 10:22 PM
> Subject: Re: Getting lots of /tmp/*.xls on Brutus
> 
> 
> > Am So, den 11.07.2004 schrieb acoliver@apache.org um 8:23:
> > > It is deliberately this way.  You need to delete the unit tests after
> > > running the test target.  They are left there because how the heck could
> yo=
> > > u
> > > test if the files where valid otherwise?
> >
> > You could compare the generated files with files that are known to be
> > correct and contain the expected result. Such a scenario could be set up
> > as follows:
> >
> > 1. Run the test with a switch "do not compare".
> > 2. Manually load the generated file into the target application (Word,
> > Excel etc.) and ensure that it is correct.
> > 3. Move the generated file to a directory with "should be" files.
> > 4. Future test runs use the file to compare with the files they generate
> > themselves and remove the latter if the comparison yielded equality.
> >
> > (HPSF does it similarly.)
> >
> >
> > > Maybe we should add a delete /tmp/*.xls to the gump target?  I doubt
> that
> > > any gump instances have other uses for xls files in the temp directory
> >
> > This could be done, too.
> >
> >
> > Best regards
> > Rainer Klute
> >
> >                            Rainer Klute IT-Consulting GmbH
> >   Dipl.-Inform.
> >   Rainer Klute             E-Mail:  klute@rainer-klute.de
> >   Körner Grund 24          Telefon: +49 172 2324824
> > D-44143 Dortmund           Telefax: +49 231 5349423
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: poi-dev-unsubscribe@jakarta.apache.org
> > For additional commands, e-mail: poi-dev-help@jakarta.apache.org
> >
> 
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: poi-dev-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: poi-dev-help@jakarta.apache.org
> 


---------------------------------------------------------------------
To unsubscribe, e-mail: poi-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: poi-dev-help@jakarta.apache.org


Re: Getting lots of /tmp/*.xls on Brutus

Posted by "Adam R. B. Jack" <aj...@trysybase.com>.
Did my suggestion of :

http://java.sun.com/j2se/1.3/docs/api/java/io/File.html#createTempFile(java.lang.String,%20java.lang.String,%20java.io.File)

Make it to this list? If you could pass a third parameter of './tmp' or
'./test/tmp' or something, then Gump would automatically clean up. Also,
wouldn't this be a nicer place for human users to look?

regards,

Adam
----- Original Message ----- 
From: "Rainer Klute" <kl...@rainer-klute.de>
To: "POI Developers List" <po...@jakarta.apache.org>
Sent: Sunday, July 11, 2004 10:22 PM
Subject: Re: Getting lots of /tmp/*.xls on Brutus


> Am So, den 11.07.2004 schrieb acoliver@apache.org um 8:23:
> > It is deliberately this way.  You need to delete the unit tests after
> > running the test target.  They are left there because how the heck could
yo=
> > u
> > test if the files where valid otherwise?
>
> You could compare the generated files with files that are known to be
> correct and contain the expected result. Such a scenario could be set up
> as follows:
>
> 1. Run the test with a switch "do not compare".
> 2. Manually load the generated file into the target application (Word,
> Excel etc.) and ensure that it is correct.
> 3. Move the generated file to a directory with "should be" files.
> 4. Future test runs use the file to compare with the files they generate
> themselves and remove the latter if the comparison yielded equality.
>
> (HPSF does it similarly.)
>
>
> > Maybe we should add a delete /tmp/*.xls to the gump target?  I doubt
that
> > any gump instances have other uses for xls files in the temp directory
>
> This could be done, too.
>
>
> Best regards
> Rainer Klute
>
>                            Rainer Klute IT-Consulting GmbH
>   Dipl.-Inform.
>   Rainer Klute             E-Mail:  klute@rainer-klute.de
>   Körner Grund 24          Telefon: +49 172 2324824
> D-44143 Dortmund           Telefax: +49 231 5349423
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: poi-dev-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: poi-dev-help@jakarta.apache.org
>


---------------------------------------------------------------------
To unsubscribe, e-mail: poi-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: poi-dev-help@jakarta.apache.org


Re: Getting lots of /tmp/*.xls on Brutus

Posted by Rainer Klute <kl...@rainer-klute.de>.
Am So, den 11.07.2004 schrieb acoliver@apache.org um 8:23:
> It is deliberately this way.  You need to delete the unit tests after
> running the test target.  They are left there because how the heck could yo=
> u
> test if the files where valid otherwise?

You could compare the generated files with files that are known to be
correct and contain the expected result. Such a scenario could be set up
as follows:

1. Run the test with a switch "do not compare".
2. Manually load the generated file into the target application (Word,
Excel etc.) and ensure that it is correct.
3. Move the generated file to a directory with "should be" files.
4. Future test runs use the file to compare with the files they generate
themselves and remove the latter if the comparison yielded equality.

(HPSF does it similarly.)


> Maybe we should add a delete /tmp/*.xls to the gump target?  I doubt that
> any gump instances have other uses for xls files in the temp directory

This could be done, too.


Best regards
Rainer Klute

                           Rainer Klute IT-Consulting GmbH
  Dipl.-Inform.
  Rainer Klute             E-Mail:  klute@rainer-klute.de
  Körner Grund 24          Telefon: +49 172 2324824
D-44143 Dortmund           Telefax: +49 231 5349423


---------------------------------------------------------------------
To unsubscribe, e-mail: poi-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: poi-dev-help@jakarta.apache.org


Re: Getting lots of /tmp/*.xls on Brutus

Posted by ac...@apache.org.
It is deliberately this way.  You need to delete the unit tests after
running the test target.  They are left there because how the heck could yo=
u
test if the files where valid otherwise?

Maybe we should add a delete /tmp/*.xls to the gump target?  I doubt that
any gump instances have other uses for xls files in the temp directory
--=20
Andrew C. Oliver
http://www.superlinksoftware.com/poi.jsp
Custom enhancements and Commercial Implementation for Jakarta POI

http://jakarta.apache.org/poi
For Java and Excel, Got POI?

The views expressed in this email are those of the author and are almost
definitely not shared by the Apache Software Foundation, its board or its
general membership.  In fact they probably most definitively disagree with
everything espoused in the above email.

> From: Rainer Klute <kl...@rainer-klute.de>
> Organization: Rainer Klute IT-Consulting GmbH
> Reply-To: "POI Developers List" <po...@jakarta.apache.org>
> Date: Thu, 08 Jul 2004 20:50:15 +0200
> To: POI Developers List <po...@jakarta.apache.org>
> Cc: general@gump.apache.org
> Subject: Re: Getting lots of /tmp/*.xls on Brutus
>=20
> Am Do, 2004-07-08 um 20.23 schrieb Adam R. B. Jack:
>> i.e. lots of files!
>>=20
>> Basically, I have to assume that these are from POI (please correct me i=
f I
>> am wrong) and one (or both) of the two POI runs.
>=20
> You are write, the POI test cases do create temporary files without
> deleting them. I think you can remove them without any harm.
>=20
> Fellow POI committers, could you please delve into your test cases and
> resolve that issue? BTW, the HPSF test cases tidy the disk when they are
> finished (tap on my shoulder).
>=20
> Best regards
> Rainer Klute
>=20
>                          Rainer Klute IT-Consulting GmbH
> Dipl.-Inform.
> Rainer Klute             E-Mail:  klute@rainer-klute.de
> K=F6rner Grund 24          Telefon: +49 172 2324824
> D-44143 Dortmund           Telefax: +49 231 5349423
>=20
>=20
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: poi-dev-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: poi-dev-help@jakarta.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: poi-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: poi-dev-help@jakarta.apache.org


Re: Getting lots of /tmp/*.xls on Brutus

Posted by ac...@apache.org.
It is deliberately this way.  You need to delete the unit tests after
running the test target.  They are left there because how the heck could yo=
u
test if the files where valid otherwise?

Maybe we should add a delete /tmp/*.xls to the gump target?  I doubt that
any gump instances have other uses for xls files in the temp directory
--=20
Andrew C. Oliver
http://www.superlinksoftware.com/poi.jsp
Custom enhancements and Commercial Implementation for Jakarta POI

http://jakarta.apache.org/poi
For Java and Excel, Got POI?

The views expressed in this email are those of the author and are almost
definitely not shared by the Apache Software Foundation, its board or its
general membership.  In fact they probably most definitively disagree with
everything espoused in the above email.

> From: Rainer Klute <kl...@rainer-klute.de>
> Organization: Rainer Klute IT-Consulting GmbH
> Reply-To: "POI Developers List" <po...@jakarta.apache.org>
> Date: Thu, 08 Jul 2004 20:50:15 +0200
> To: POI Developers List <po...@jakarta.apache.org>
> Cc: general@gump.apache.org
> Subject: Re: Getting lots of /tmp/*.xls on Brutus
>=20
> Am Do, 2004-07-08 um 20.23 schrieb Adam R. B. Jack:
>> i.e. lots of files!
>>=20
>> Basically, I have to assume that these are from POI (please correct me i=
f I
>> am wrong) and one (or both) of the two POI runs.
>=20
> You are write, the POI test cases do create temporary files without
> deleting them. I think you can remove them without any harm.
>=20
> Fellow POI committers, could you please delve into your test cases and
> resolve that issue? BTW, the HPSF test cases tidy the disk when they are
> finished (tap on my shoulder).
>=20
> Best regards
> Rainer Klute
>=20
>                          Rainer Klute IT-Consulting GmbH
> Dipl.-Inform.
> Rainer Klute             E-Mail:  klute@rainer-klute.de
> K=F6rner Grund 24          Telefon: +49 172 2324824
> D-44143 Dortmund           Telefax: +49 231 5349423
>=20
>=20
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: poi-dev-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: poi-dev-help@jakarta.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@gump.apache.org
For additional commands, e-mail: general-help@gump.apache.org


Re: Getting lots of /tmp/*.xls on Brutus

Posted by Rainer Klute <kl...@rainer-klute.de>.
Am Do, 2004-07-08 um 20.23 schrieb Adam R. B. Jack:
> i.e. lots of files!
> 
> Basically, I have to assume that these are from POI (please correct me if I
> am wrong) and one (or both) of the two POI runs.

You are write, the POI test cases do create temporary files without
deleting them. I think you can remove them without any harm.

Fellow POI committers, could you please delve into your test cases and
resolve that issue? BTW, the HPSF test cases tidy the disk when they are
finished (tap on my shoulder).

Best regards
Rainer Klute

                           Rainer Klute IT-Consulting GmbH
  Dipl.-Inform.
  Rainer Klute             E-Mail:  klute@rainer-klute.de
  Körner Grund 24          Telefon: +49 172 2324824
D-44143 Dortmund           Telefax: +49 231 5349423


---------------------------------------------------------------------
To unsubscribe, e-mail: poi-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: poi-dev-help@jakarta.apache.org


Re: Getting lots of /tmp/*.xls on Brutus

Posted by Rainer Klute <kl...@rainer-klute.de>.
Am Do, 2004-07-08 um 20.23 schrieb Adam R. B. Jack:
> i.e. lots of files!
> 
> Basically, I have to assume that these are from POI (please correct me if I
> am wrong) and one (or both) of the two POI runs.

You are write, the POI test cases do create temporary files without
deleting them. I think you can remove them without any harm.

Fellow POI committers, could you please delve into your test cases and
resolve that issue? BTW, the HPSF test cases tidy the disk when they are
finished (tap on my shoulder).

Best regards
Rainer Klute

                           Rainer Klute IT-Consulting GmbH
  Dipl.-Inform.
  Rainer Klute             E-Mail:  klute@rainer-klute.de
  Körner Grund 24          Telefon: +49 172 2324824
D-44143 Dortmund           Telefax: +49 231 5349423


---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@gump.apache.org
For additional commands, e-mail: general-help@gump.apache.org


Re: Getting lots of /tmp/*.xls on Brutus

Posted by Avik Sengupta <av...@itellix.com>.
As Rainer confirmed, these are indeed POI tests. 

tests are indeed a separate target from compile in the build scripts, so
even if you compile regularly, you should be fine. (Also I must say that
all tests on  my 1.8GHz pentium4 take about 1min 10sec to run .. POI is
quite fast :). Its just that our gump descriptor specifies the "test"
target to be run.  

We don't, in general, delete the files created, because  some tests
require opening up the file in excel to see if it displays correctly. 

So usually this is not a problem for interactive use, but I can see why
gump would have a problem. One solution is to specify a separate ant
target for gump that deletes all files created. In any case, the files
are created in the system temp directory, using the java
File.createTempFile method call. I dont know if that is something that
can be controlled by setting environment variables. 

I'll see what I can do. 

Regards
-
Avik


On Thu, 2004-07-08 at 23:53, Adam R. B. Jack wrote:
> My local (work) Gump that builds a really small subset of the Gump stack
> (and then my code) started dying w/ lack of disk space. We found that we
> were getting a full /tmp, and then I saw that Brutus has a similar issue.
> 
> gump@brutus:~$ wc /tmp/*.xls
> -bash: /usr/bin/wc: Argument list too long
> gump@brutus:~$ cat /tmp/*.xls | wc
> -bash: /bin/cat: Argument list too long
>       0       0       0
> 
> i.e. lots of files!
> 
> Basically, I have to assume that these are from POI (please correct me if I
> am wrong) and one (or both) of the two POI runs.
> 
>     http://brutus.apache.org:8080/gump/jakarta-poi/index.html
>     http://brutus.apache.org:8080/gump/jakarta-poi-3/index.html
> 
> Could you look at this problem, and help us out? Could you see if the POI
> test runs could use a ./tmp (or similar) directory, 'cos Gump cleans that
> out each run. [I don't know if this uses some Java function that you have
> limited control over, but I thought I'd ask.]
> 
> Also, would it be possible to separate the POI tests from the POI compile? I
> use POI at work (love it, thanks!) and we try to compile our stack of code
> regularly. Anything that creates this much data must be resource intensive
> :) -- so if we could have separate poi and poi-test, we'd be able to save
> local resources. No biggee though.
> 
> Thanks in advance.
> 
> regards,
> 
> Adam
> --
> Experience the Unwired Enterprise:
> http://www.sybase.com/unwiredenterprise
> Try Sybase: http://www.try.sybase.com
> 
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: general-unsubscribe@gump.apache.org
> For additional commands, e-mail: general-help@gump.apache.org
> 


---------------------------------------------------------------------
To unsubscribe, e-mail: poi-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: poi-dev-help@jakarta.apache.org