You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@jmeter.apache.org by Brad Seelinger <bs...@ipswitch.com> on 2014/06/03 21:22:52 UTC
Jmeter not loading the results file into sampler
Hello Community -
I'm fairly new to jmeter and having difficulty loading the results file and was hoping someone might be able to assist me.
I have a FTP test plan that I'm running headless and it created a 650MB results file. I then open my test plan using the GUI. I have two samplers: "Show Results in Table" & "Summary Report". The summary report takes about 1 minute for the data to load but works great. The "Show Results in Table" report however pegs the cpu to 100% for about 20 mins, then just freezes the GUI and renders it useless. I have to kill -9 the jmeter process.
Is there a size constraint on report files? Are there any settings I need to modify to allow for larger results files? Any help or suggestions would be appreciated!
Brad Seelinger
Software Quality Assurance Manager
Re: Jmeter not loading the results file into sampler
Posted by Deepak Shetty <sh...@gmail.com>.
The table listener has to show a row for every result row so I doubt 2GB
heap would be enough for a 650MB CSV file -
Im not sure what you want to do visually with such a big file either. Also
what data is being written to this file? possibly you are writing responses?
You could throw more memory in a 64bit JVM ...usually when we have this
level we have to load it into a DBMS type structure and then analyse
whatever we want to..
regards
deepak
On Wed, Jun 4, 2014 at 12:27 PM, Brad Seelinger <bs...@ipswitch.com>
wrote:
> Hi Louis,
>
> Thank you for your idea. Yes, I had already tried increasing HEAP to
> 2048M without any difference (see below screenshot). The results file
> is a standard CSV file that is 60MB. Jmeter simply won’t load that size of
> file into the “View Results in Table” sampler. I’ve reduced the length of
> the test to create a small results file (1MB) and it loads instantly
> without issue. So I know there is not an issue with the file or format of
> the file. I’m left to deduct there is some sort of sizing defect trying to
> load large files into the GUI sampler (the table sampler to be specific).
>
>
>
> Any other thoughts or suggestions?
>
>
>
> Regards,
>
> Brad
>
>
>
>
>
>
>
>
>
>
>
> -----Original Message-----
> From: Masters,Louis [mailto:Louis.Masters@fhlbny.com]
> Sent: Wednesday, June 04, 2014 7:33 AM
> To: user@jmeter.apache.org
> Subject: RE: Jmeter not loading the results file into sampler
>
>
>
> Did you try increasing memory allocated to JMeter? I think it defaults
> to 512M.
>
>
>
> > -----Original Message-----
>
> > From: Brad Seelinger [mailto:bseelinger@ipswitch.com
> <bs...@ipswitch.com>]
>
> > Sent: Tuesday, June 03, 2014 3:23 PM
>
> > To: user@jmeter.apache.org
>
> > Subject: Jmeter not loading the results file into sampler
>
> >
>
> > Hello Community -
>
> >
>
> > I'm fairly new to jmeter and having difficulty loading the results
>
> > file and was hoping someone might be able to assist me.
>
> >
>
> > I have a FTP test plan that I'm running headless and it created a
>
> > 650MB results file. I then open my test plan using the GUI. I have
>
> > two
>
> > samplers: "Show Results in Table" & "Summary Report". The summary
>
> > report takes about 1 minute for the data to load but works great. The
>
> > "Show Results in Table" report however pegs the cpu to 100% for about
>
> > 20 mins, then just freezes the GUI and renders it useless. I have to
>
> > kill -9 the jmeter process.
>
> >
>
> > Is there a size constraint on report files? Are there any settings I
>
> > need to modify to allow for larger results files? Any help or
>
> > suggestions would be appreciated!
>
> >
>
> > Brad Seelinger
>
> > Software Quality Assurance Manager
>
>
>
>
>
> Confidentiality Notice: The information contained in this e-mail and any
> attachments (including, but not limited to, any attached e-mails) may be
> legally privileged and confidential. If you are not an intended recipient,
> you are hereby notified that any dissemination, distribution or copying of
> this e-mail is strictly prohibited. If you have received this e-mail in
> error, please notify the sender and permanently delete the e-mail and any
> attachments immediately. You should not retain, copy or use this e-mail or
> any attachment for any purpose, nor disclose all or any part of the
> contents to any other person. Thank you.
>
>
>
> ---------------------------------------------------------------------
>
> To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
>
> For additional commands, e-mail: user-help@jmeter.apache.org
>
>
>
Re: Jmeter not loading the results file into sampler
Posted by Jeff Ohrstrom <jo...@hotmail.com>.
Brad,
I am wondering about your motivation for loading all this data into the
GUI. There are perhaps tens of thousands of samples, if not more,
during a load test and surely you're not going to pour over all of them
and view the response?
I assume you may be in 1 of 2 situations. One is that you simply want
to view a few of the samples during runtime, both request and response
in full (some small % of samples, not all). In this case, you could
write 2 files, one that is minimalistic and to be loaded into the
summary report or listener that generates a graph for that matter. The
other file you write maybe every 1000th sample so that it does not too
large to view. The other situation you may be in is that the response
has some important information in it that you need to track over the
duration of the test. In this case you can use an extractor post
processor and simply extract the field. Then write it to a file using
the sample_variables property. That way you're saving some small % of
the response while still being able to view what occurred during runtime
(albeit you'll have to view it through excel or some text editor).
In sum, I would question why you need such a large file, why you need to
view the response in full, and whether you need to view every single
response and 100% of the response.
I hope this helps.
On Wed, 2014-06-04 at 15:35 -0400, Masters,Louis wrote:
> Brad,
>
> I've never loaded files that large back into JM. I usually use Excel on my larger datasets (although I still don't think I ever went above 100M or so).
>
> Did you try enabling debugging (in Help) and the log (in Options) to see if anything is being spit out? Maybe a nasty error?
>
> Did you try to split it into smaller pieces? Doesn't help with your large file, but you may be able to load portions of it.
>
> -Lou
>
>
> From: Brad Seelinger [mailto:bseelinger@ipswitch.com]
> Sent: Wednesday, June 04, 2014 3:27 PM
> To: JMeter Users List
> Subject: RE: Jmeter not loading the results file into sampler
>
> Hi Louis,
> Thank you for your idea. Yes, I had already tried increasing HEAP to 2048M without any difference (see below screenshot). The results file is a standard CSV file that is 60MB. Jmeter simply won't load that size of file into the "View Results in Table" sampler. I've reduced the length of the test to create a small results file (1MB) and it loads instantly without issue. So I know there is not an issue with the file or format of the file. I'm left to deduct there is some sort of sizing defect trying to load large files into the GUI sampler (the table sampler to be specific).
>
> Any other thoughts or suggestions?
>
> Regards,
> Brad
>
>
>
>
>
>
> -----Original Message-----
> From: Masters,Louis [mailto:Louis.Masters@fhlbny.com]
> Sent: Wednesday, June 04, 2014 7:33 AM
> To: user@jmeter.apache.org
> Subject: RE: Jmeter not loading the results file into sampler
>
> Did you try increasing memory allocated to JMeter? I think it defaults to 512M.
>
> > -----Original Message-----
> > From: Brad Seelinger [mailto:bseelinger@ipswitch.com]
> > Sent: Tuesday, June 03, 2014 3:23 PM
> > To: user@jmeter.apache.org
> > Subject: Jmeter not loading the results file into sampler
> >
> > Hello Community -
> >
> > I'm fairly new to jmeter and having difficulty loading the results
> > file and was hoping someone might be able to assist me.
> >
> > I have a FTP test plan that I'm running headless and it created a
> > 650MB results file. I then open my test plan using the GUI. I have
> > two
> > samplers: "Show Results in Table" & "Summary Report". The summary
> > report takes about 1 minute for the data to load but works great. The
> > "Show Results in Table" report however pegs the cpu to 100% for about
> > 20 mins, then just freezes the GUI and renders it useless. I have to
> > kill -9 the jmeter process.
> >
> > Is there a size constraint on report files? Are there any settings I
> > need to modify to allow for larger results files? Any help or
> > suggestions would be appreciated!
> >
> > Brad Seelinger
> > Software Quality Assurance Manager
>
>
> Confidentiality Notice: The information contained in this e-mail and any attachments (including, but not limited to, any attached e-mails) may be legally privileged and confidential. If you are not an intended recipient, you are hereby notified that any dissemination, distribution or copying of this e-mail is strictly prohibited. If you have received this e-mail in error, please notify the sender and permanently delete the e-mail and any attachments immediately. You should not retain, copy or use this e-mail or any attachment for any purpose, nor disclose all or any part of the contents to any other person. Thank you.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> For additional commands, e-mail: user-help@jmeter.apache.org
>
>
>
> Confidentiality Notice: The information contained in this e-mail and any attachments (including, but not limited to, any attached e-mails) may be legally privileged and confidential. If you are not an intended recipient, you are hereby notified that any dissemination, distribution or copying of this e-mail is strictly prohibited. If you have received this e-mail in error, please notify the sender and permanently delete the e-mail and any attachments immediately. You should not retain, copy or use this e-mail or any attachment for any purpose, nor disclose all or any part of the contents to any other person. Thank you.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> For additional commands, e-mail: user-help@jmeter.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
For additional commands, e-mail: user-help@jmeter.apache.org
RE: Jmeter not loading the results file into sampler
Posted by "Masters,Louis" <Lo...@fhlbny.com>.
Brad,
I've never loaded files that large back into JM. I usually use Excel on my larger datasets (although I still don't think I ever went above 100M or so).
Did you try enabling debugging (in Help) and the log (in Options) to see if anything is being spit out? Maybe a nasty error?
Did you try to split it into smaller pieces? Doesn't help with your large file, but you may be able to load portions of it.
-Lou
From: Brad Seelinger [mailto:bseelinger@ipswitch.com]
Sent: Wednesday, June 04, 2014 3:27 PM
To: JMeter Users List
Subject: RE: Jmeter not loading the results file into sampler
Hi Louis,
Thank you for your idea. Yes, I had already tried increasing HEAP to 2048M without any difference (see below screenshot). The results file is a standard CSV file that is 60MB. Jmeter simply won't load that size of file into the "View Results in Table" sampler. I've reduced the length of the test to create a small results file (1MB) and it loads instantly without issue. So I know there is not an issue with the file or format of the file. I'm left to deduct there is some sort of sizing defect trying to load large files into the GUI sampler (the table sampler to be specific).
Any other thoughts or suggestions?
Regards,
Brad
-----Original Message-----
From: Masters,Louis [mailto:Louis.Masters@fhlbny.com]
Sent: Wednesday, June 04, 2014 7:33 AM
To: user@jmeter.apache.org
Subject: RE: Jmeter not loading the results file into sampler
Did you try increasing memory allocated to JMeter? I think it defaults to 512M.
> -----Original Message-----
> From: Brad Seelinger [mailto:bseelinger@ipswitch.com]
> Sent: Tuesday, June 03, 2014 3:23 PM
> To: user@jmeter.apache.org
> Subject: Jmeter not loading the results file into sampler
>
> Hello Community -
>
> I'm fairly new to jmeter and having difficulty loading the results
> file and was hoping someone might be able to assist me.
>
> I have a FTP test plan that I'm running headless and it created a
> 650MB results file. I then open my test plan using the GUI. I have
> two
> samplers: "Show Results in Table" & "Summary Report". The summary
> report takes about 1 minute for the data to load but works great. The
> "Show Results in Table" report however pegs the cpu to 100% for about
> 20 mins, then just freezes the GUI and renders it useless. I have to
> kill -9 the jmeter process.
>
> Is there a size constraint on report files? Are there any settings I
> need to modify to allow for larger results files? Any help or
> suggestions would be appreciated!
>
> Brad Seelinger
> Software Quality Assurance Manager
Confidentiality Notice: The information contained in this e-mail and any attachments (including, but not limited to, any attached e-mails) may be legally privileged and confidential. If you are not an intended recipient, you are hereby notified that any dissemination, distribution or copying of this e-mail is strictly prohibited. If you have received this e-mail in error, please notify the sender and permanently delete the e-mail and any attachments immediately. You should not retain, copy or use this e-mail or any attachment for any purpose, nor disclose all or any part of the contents to any other person. Thank you.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
For additional commands, e-mail: user-help@jmeter.apache.org
Confidentiality Notice: The information contained in this e-mail and any attachments (including, but not limited to, any attached e-mails) may be legally privileged and confidential. If you are not an intended recipient, you are hereby notified that any dissemination, distribution or copying of this e-mail is strictly prohibited. If you have received this e-mail in error, please notify the sender and permanently delete the e-mail and any attachments immediately. You should not retain, copy or use this e-mail or any attachment for any purpose, nor disclose all or any part of the contents to any other person. Thank you.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
For additional commands, e-mail: user-help@jmeter.apache.org
RE: Jmeter not loading the results file into sampler
Posted by Brad Seelinger <bs...@ipswitch.com>.
Hi Louis,
Thank you for your idea. Yes, I had already tried increasing HEAP to 2048M without any difference (see below screenshot). The results file is a standard CSV file that is 60MB. Jmeter simply won't load that size of file into the "View Results in Table" sampler. I've reduced the length of the test to create a small results file (1MB) and it loads instantly without issue. So I know there is not an issue with the file or format of the file. I'm left to deduct there is some sort of sizing defect trying to load large files into the GUI sampler (the table sampler to be specific).
Any other thoughts or suggestions?
Regards,
Brad
[cid:image002.png@01CF8005.B5C28650]
-----Original Message-----
From: Masters,Louis [mailto:Louis.Masters@fhlbny.com]
Sent: Wednesday, June 04, 2014 7:33 AM
To: user@jmeter.apache.org
Subject: RE: Jmeter not loading the results file into sampler
Did you try increasing memory allocated to JMeter? I think it defaults to 512M.
> -----Original Message-----
> From: Brad Seelinger [mailto:bseelinger@ipswitch.com]
> Sent: Tuesday, June 03, 2014 3:23 PM
> To: user@jmeter.apache.org<ma...@jmeter.apache.org>
> Subject: Jmeter not loading the results file into sampler
>
> Hello Community -
>
> I'm fairly new to jmeter and having difficulty loading the results
> file and was hoping someone might be able to assist me.
>
> I have a FTP test plan that I'm running headless and it created a
> 650MB results file. I then open my test plan using the GUI. I have
> two
> samplers: "Show Results in Table" & "Summary Report". The summary
> report takes about 1 minute for the data to load but works great. The
> "Show Results in Table" report however pegs the cpu to 100% for about
> 20 mins, then just freezes the GUI and renders it useless. I have to
> kill -9 the jmeter process.
>
> Is there a size constraint on report files? Are there any settings I
> need to modify to allow for larger results files? Any help or
> suggestions would be appreciated!
>
> Brad Seelinger
> Software Quality Assurance Manager
Confidentiality Notice: The information contained in this e-mail and any attachments (including, but not limited to, any attached e-mails) may be legally privileged and confidential. If you are not an intended recipient, you are hereby notified that any dissemination, distribution or copying of this e-mail is strictly prohibited. If you have received this e-mail in error, please notify the sender and permanently delete the e-mail and any attachments immediately. You should not retain, copy or use this e-mail or any attachment for any purpose, nor disclose all or any part of the contents to any other person. Thank you.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org<ma...@jmeter.apache.org>
For additional commands, e-mail: user-help@jmeter.apache.org<ma...@jmeter.apache.org>
RE: Jmeter not loading the results file into sampler
Posted by "Masters,Louis" <Lo...@fhlbny.com>.
Did you try increasing memory allocated to JMeter? I think it defaults to 512M.
> -----Original Message-----
> From: Brad Seelinger [mailto:bseelinger@ipswitch.com]
> Sent: Tuesday, June 03, 2014 3:23 PM
> To: user@jmeter.apache.org
> Subject: Jmeter not loading the results file into sampler
>
> Hello Community -
>
> I'm fairly new to jmeter and having difficulty loading the results file
> and was hoping someone might be able to assist me.
>
> I have a FTP test plan that I'm running headless and it created a 650MB
> results file. I then open my test plan using the GUI. I have two
> samplers: "Show Results in Table" & "Summary Report". The summary
> report takes about 1 minute for the data to load but works great. The
> "Show Results in Table" report however pegs the cpu to 100% for about
> 20 mins, then just freezes the GUI and renders it useless. I have to
> kill -9 the jmeter process.
>
> Is there a size constraint on report files? Are there any settings I
> need to modify to allow for larger results files? Any help or
> suggestions would be appreciated!
>
> Brad Seelinger
> Software Quality Assurance Manager
Confidentiality Notice: The information contained in this e-mail and any attachments (including, but not limited to, any attached e-mails) may be legally privileged and confidential. If you are not an intended recipient, you are hereby notified that any dissemination, distribution or copying of this e-mail is strictly prohibited. If you have received this e-mail in error, please notify the sender and permanently delete the e-mail and any attachments immediately. You should not retain, copy or use this e-mail or any attachment for any purpose, nor disclose all or any part of the contents to any other person. Thank you.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
For additional commands, e-mail: user-help@jmeter.apache.org