You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@jmeter.apache.org by "Adamo, Vince" <Vi...@vignette.com> on 2007/05/14 21:21:42 UTC
Merging result files from remote servers
The JMeter FAQ includes the following in the response to the question
"How to do remote testing the 'proper way'":
"Running JMeter in non-GUI (batch) mode is preferable, as this uses far
fewer resources. The output log files can be merged after the test run
and used to create overall test statistics. (CVS files can just be
appended to each other; XML output files need a bit of editting to
maintain well-formedness.)"
This implies that there is a way to configure the JMeter servers to
write result data to local files and then these files can be copied and
merged after the test run completes. Is this a correct interpretation?
If so, what is unclear in any documentation I've read so far, is how I
would configure the remote servers to accomplish this.
I am running version 2.2 in non-GUI mode (using the JMeter ant task)
with two remote servers and have been unable to determine how to develop
a test script or modify the jmeter.properties file to make this happen.
In all cases it appears results are being returned to the client, where
data is then written to a result file.
Thanks,
Vince
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
Re: Merging result files from remote servers - AGAIN
Posted by sebb <se...@gmail.com>.
On 21/05/07, Adamo, Vince <Vi...@vignette.com> wrote:
> Okay, thanks...I now understand my problem. I was trying to accomplish
> this using a central jmeter instance running in non-gui mode starting up
> with distributed nodes running jmeter-server.bat.
>
> Running independent instances of jmeter, though, does not appear to be a
> desirable configuration. I want to coordinate the start of each remote
> server (and corresponding thread groups) so load is applied consistently
> across the remote servers.
You could use the Synchronize option for the test plan - unfortunately
at present the start time cannot be a variable, so you would need to
edit the files.
Or maybe the OS provides suitable timers?
Or you could perhaps use a script on one server and use SSH or RSH etc
to start the jobs in quick succession.
> I suspect I need to look at the various remote batching modes. Can
> someone point to any documentation on these modes (other than what is in
> the properties file)?
>
There is none, apart from the source ...
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
RE: Merging result files from remote servers - AGAIN
Posted by "Adamo, Vince" <Vi...@vignette.com>.
Okay, thanks...I now understand my problem. I was trying to accomplish
this using a central jmeter instance running in non-gui mode starting up
with distributed nodes running jmeter-server.bat.
Running independent instances of jmeter, though, does not appear to be a
desirable configuration. I want to coordinate the start of each remote
server (and corresponding thread groups) so load is applied consistently
across the remote servers.
I suspect I need to look at the various remote batching modes. Can
someone point to any documentation on these modes (other than what is in
the properties file)?
Thanks again,
Vince
-----Original Message-----
From: sebb [mailto:sebbaz@gmail.com]
Sent: Monday, May 21, 2007 10:30 AM
To: JMeter Users List
Subject: Re: Merging result files from remote servers - AGAIN
If you run in non-GUI mode then files will be written locally.
e.g. create the test plan with NO listeners (or disable existing ones).
Copy to all remote nodes.
Edit jmeter.properties (or create user.properties) to define the
appropriate saveservice settings.
On each node, run the following:
jmeter -n -t testplan.jmx -l testplan.jtl
Then combine the testplan.jtl files.
S.
On 21/05/07, Adamo, Vince <Vi...@vignette.com> wrote:
> My problem is actually getting jmeter configured properly so it
actually
> writes the data files locally to each remote server.
>
> -----Original Message-----
> From: sebb [mailto:sebbaz@gmail.com]
> Sent: Monday, May 21, 2007 10:22 AM
> To: JMeter Users List
> Subject: Re: Merging result files from remote servers - AGAIN
>
> Just append the files together and then sort them by date/time.
>
> This assumes that all the test plans write the same columns into the
CSV
> files.
>
> This is probably easiest if the timestamps are written in the default
> "ms" format; if not, use a format that sorts properly (e.g. yyyy-MM-dd
> hh:mm:ss)
>
> S.
> On 21/05/07, Adamo, Vince <Vi...@vignette.com> wrote:
> > Let me try this again....
> >
> > In a recent reply to the message "Re: STOP SENDING HTTP REQUEST" the
> > comment was made:
> >
> > "If that does not help, then run the test on each node in non-GUI
> mode,
> > using CSV output, and then combine the results for further analysis
if
> > required."
> >
> > Can someone provide an explanation on how to accomplish this? I
have
> > been unsuccessful in configuring the distributed nodes to write
local
> > data files (using non-GUI mode and the Simple Data Writer) that can
be
> > merged.
> >
> > Thanks,
> > Vince
> >
> > -----Original Message-----
> > From: Adamo, Vince [mailto:Vince.Adamo@vignette.com]
> > Sent: Monday, May 14, 2007 2:22 PM
> > To: jmeter-user@jakarta.apache.org
> > Subject: Merging result files from remote servers
> >
> >
> > The JMeter FAQ includes the following in the response to the
question
> > "How to do remote testing the 'proper way'":
> >
> > "Running JMeter in non-GUI (batch) mode is preferable, as this uses
> far
> > fewer resources. The output log files can be merged after the test
run
> > and used to create overall test statistics. (CVS files can just be
> > appended to each other; XML output files need a bit of editting to
> > maintain well-formedness.)"
> >
> > This implies that there is a way to configure the JMeter servers to
> > write result data to local files and then these files can be copied
> and
> > merged after the test run completes. Is this a correct
> interpretation?
> > If so, what is unclear in any documentation I've read so far, is how
I
> > would configure the remote servers to accomplish this.
> >
> > I am running version 2.2 in non-GUI mode (using the JMeter ant task)
> > with two remote servers and have been unable to determine how to
> develop
> > a test script or modify the jmeter.properties file to make this
> happen.
> > In all cases it appears results are being returned to the client,
> where
> > data is then written to a result file.
> >
> > Thanks,
> > Vince
> >
> >
---------------------------------------------------------------------
> > To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
> > For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
> >
> >
> >
> >
---------------------------------------------------------------------
> > To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
> > For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
> >
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
Re: Merging result files from remote servers - AGAIN
Posted by sebb <se...@gmail.com>.
If you run in non-GUI mode then files will be written locally.
e.g. create the test plan with NO listeners (or disable existing ones).
Copy to all remote nodes.
Edit jmeter.properties (or create user.properties) to define the
appropriate saveservice settings.
On each node, run the following:
jmeter -n -t testplan.jmx -l testplan.jtl
Then combine the testplan.jtl files.
S.
On 21/05/07, Adamo, Vince <Vi...@vignette.com> wrote:
> My problem is actually getting jmeter configured properly so it actually
> writes the data files locally to each remote server.
>
> -----Original Message-----
> From: sebb [mailto:sebbaz@gmail.com]
> Sent: Monday, May 21, 2007 10:22 AM
> To: JMeter Users List
> Subject: Re: Merging result files from remote servers - AGAIN
>
> Just append the files together and then sort them by date/time.
>
> This assumes that all the test plans write the same columns into the CSV
> files.
>
> This is probably easiest if the timestamps are written in the default
> "ms" format; if not, use a format that sorts properly (e.g. yyyy-MM-dd
> hh:mm:ss)
>
> S.
> On 21/05/07, Adamo, Vince <Vi...@vignette.com> wrote:
> > Let me try this again....
> >
> > In a recent reply to the message "Re: STOP SENDING HTTP REQUEST" the
> > comment was made:
> >
> > "If that does not help, then run the test on each node in non-GUI
> mode,
> > using CSV output, and then combine the results for further analysis if
> > required."
> >
> > Can someone provide an explanation on how to accomplish this? I have
> > been unsuccessful in configuring the distributed nodes to write local
> > data files (using non-GUI mode and the Simple Data Writer) that can be
> > merged.
> >
> > Thanks,
> > Vince
> >
> > -----Original Message-----
> > From: Adamo, Vince [mailto:Vince.Adamo@vignette.com]
> > Sent: Monday, May 14, 2007 2:22 PM
> > To: jmeter-user@jakarta.apache.org
> > Subject: Merging result files from remote servers
> >
> >
> > The JMeter FAQ includes the following in the response to the question
> > "How to do remote testing the 'proper way'":
> >
> > "Running JMeter in non-GUI (batch) mode is preferable, as this uses
> far
> > fewer resources. The output log files can be merged after the test run
> > and used to create overall test statistics. (CVS files can just be
> > appended to each other; XML output files need a bit of editting to
> > maintain well-formedness.)"
> >
> > This implies that there is a way to configure the JMeter servers to
> > write result data to local files and then these files can be copied
> and
> > merged after the test run completes. Is this a correct
> interpretation?
> > If so, what is unclear in any documentation I've read so far, is how I
> > would configure the remote servers to accomplish this.
> >
> > I am running version 2.2 in non-GUI mode (using the JMeter ant task)
> > with two remote servers and have been unable to determine how to
> develop
> > a test script or modify the jmeter.properties file to make this
> happen.
> > In all cases it appears results are being returned to the client,
> where
> > data is then written to a result file.
> >
> > Thanks,
> > Vince
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
> > For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
> >
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
> > For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
> >
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
RE: Merging result files from remote servers - AGAIN
Posted by "Adamo, Vince" <Vi...@vignette.com>.
My problem is actually getting jmeter configured properly so it actually
writes the data files locally to each remote server.
-----Original Message-----
From: sebb [mailto:sebbaz@gmail.com]
Sent: Monday, May 21, 2007 10:22 AM
To: JMeter Users List
Subject: Re: Merging result files from remote servers - AGAIN
Just append the files together and then sort them by date/time.
This assumes that all the test plans write the same columns into the CSV
files.
This is probably easiest if the timestamps are written in the default
"ms" format; if not, use a format that sorts properly (e.g. yyyy-MM-dd
hh:mm:ss)
S.
On 21/05/07, Adamo, Vince <Vi...@vignette.com> wrote:
> Let me try this again....
>
> In a recent reply to the message "Re: STOP SENDING HTTP REQUEST" the
> comment was made:
>
> "If that does not help, then run the test on each node in non-GUI
mode,
> using CSV output, and then combine the results for further analysis if
> required."
>
> Can someone provide an explanation on how to accomplish this? I have
> been unsuccessful in configuring the distributed nodes to write local
> data files (using non-GUI mode and the Simple Data Writer) that can be
> merged.
>
> Thanks,
> Vince
>
> -----Original Message-----
> From: Adamo, Vince [mailto:Vince.Adamo@vignette.com]
> Sent: Monday, May 14, 2007 2:22 PM
> To: jmeter-user@jakarta.apache.org
> Subject: Merging result files from remote servers
>
>
> The JMeter FAQ includes the following in the response to the question
> "How to do remote testing the 'proper way'":
>
> "Running JMeter in non-GUI (batch) mode is preferable, as this uses
far
> fewer resources. The output log files can be merged after the test run
> and used to create overall test statistics. (CVS files can just be
> appended to each other; XML output files need a bit of editting to
> maintain well-formedness.)"
>
> This implies that there is a way to configure the JMeter servers to
> write result data to local files and then these files can be copied
and
> merged after the test run completes. Is this a correct
interpretation?
> If so, what is unclear in any documentation I've read so far, is how I
> would configure the remote servers to accomplish this.
>
> I am running version 2.2 in non-GUI mode (using the JMeter ant task)
> with two remote servers and have been unable to determine how to
develop
> a test script or modify the jmeter.properties file to make this
happen.
> In all cases it appears results are being returned to the client,
where
> data is then written to a result file.
>
> Thanks,
> Vince
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
Re: Merging result files from remote servers - AGAIN
Posted by sebb <se...@gmail.com>.
Just append the files together and then sort them by date/time.
This assumes that all the test plans write the same columns into the CSV files.
This is probably easiest if the timestamps are written in the default
"ms" format; if not, use a format that sorts properly (e.g. yyyy-MM-dd
hh:mm:ss)
S.
On 21/05/07, Adamo, Vince <Vi...@vignette.com> wrote:
> Let me try this again....
>
> In a recent reply to the message "Re: STOP SENDING HTTP REQUEST" the
> comment was made:
>
> "If that does not help, then run the test on each node in non-GUI mode,
> using CSV output, and then combine the results for further analysis if
> required."
>
> Can someone provide an explanation on how to accomplish this? I have
> been unsuccessful in configuring the distributed nodes to write local
> data files (using non-GUI mode and the Simple Data Writer) that can be
> merged.
>
> Thanks,
> Vince
>
> -----Original Message-----
> From: Adamo, Vince [mailto:Vince.Adamo@vignette.com]
> Sent: Monday, May 14, 2007 2:22 PM
> To: jmeter-user@jakarta.apache.org
> Subject: Merging result files from remote servers
>
>
> The JMeter FAQ includes the following in the response to the question
> "How to do remote testing the 'proper way'":
>
> "Running JMeter in non-GUI (batch) mode is preferable, as this uses far
> fewer resources. The output log files can be merged after the test run
> and used to create overall test statistics. (CVS files can just be
> appended to each other; XML output files need a bit of editting to
> maintain well-formedness.)"
>
> This implies that there is a way to configure the JMeter servers to
> write result data to local files and then these files can be copied and
> merged after the test run completes. Is this a correct interpretation?
> If so, what is unclear in any documentation I've read so far, is how I
> would configure the remote servers to accomplish this.
>
> I am running version 2.2 in non-GUI mode (using the JMeter ant task)
> with two remote servers and have been unable to determine how to develop
> a test script or modify the jmeter.properties file to make this happen.
> In all cases it appears results are being returned to the client, where
> data is then written to a result file.
>
> Thanks,
> Vince
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
Merging result files from remote servers - AGAIN
Posted by "Adamo, Vince" <Vi...@vignette.com>.
Let me try this again....
In a recent reply to the message "Re: STOP SENDING HTTP REQUEST" the
comment was made:
"If that does not help, then run the test on each node in non-GUI mode,
using CSV output, and then combine the results for further analysis if
required."
Can someone provide an explanation on how to accomplish this? I have
been unsuccessful in configuring the distributed nodes to write local
data files (using non-GUI mode and the Simple Data Writer) that can be
merged.
Thanks,
Vince
-----Original Message-----
From: Adamo, Vince [mailto:Vince.Adamo@vignette.com]
Sent: Monday, May 14, 2007 2:22 PM
To: jmeter-user@jakarta.apache.org
Subject: Merging result files from remote servers
The JMeter FAQ includes the following in the response to the question
"How to do remote testing the 'proper way'":
"Running JMeter in non-GUI (batch) mode is preferable, as this uses far
fewer resources. The output log files can be merged after the test run
and used to create overall test statistics. (CVS files can just be
appended to each other; XML output files need a bit of editting to
maintain well-formedness.)"
This implies that there is a way to configure the JMeter servers to
write result data to local files and then these files can be copied and
merged after the test run completes. Is this a correct interpretation?
If so, what is unclear in any documentation I've read so far, is how I
would configure the remote servers to accomplish this.
I am running version 2.2 in non-GUI mode (using the JMeter ant task)
with two remote servers and have been unable to determine how to develop
a test script or modify the jmeter.properties file to make this happen.
In all cases it appears results are being returned to the client, where
data is then written to a result file.
Thanks,
Vince
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
Re: Merging result files from remote servers
Posted by grasper9 <gr...@gmail.com>.
Please assist with the script or code to merge jtl files retrived from jmeter
from remote systems using STAF.
Thanks.
--
View this message in context: http://www.nabble.com/Merging-result-files-from-remote-servers-tf3754415.html#a12268993
Sent from the JMeter - User mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
Re: Merging result files from remote servers
Posted by grasper9 <gr...@gmail.com>.
Adamo, Vince wrote:
>
>
> The JMeter FAQ includes the following in the response to the question
> "How to do remote testing the 'proper way'":
>
> "Running JMeter in non-GUI (batch) mode is preferable, as this uses far
> fewer resources. The output log files can be merged after the test run
> and used to create overall test statistics. (CVS files can just be
> appended to each other; XML output files need a bit of editting to
> maintain well-formedness.)"
>
> This implies that there is a way to configure the JMeter servers to
> write result data to local files and then these files can be copied and
> merged after the test run completes. Is this a correct interpretation?
> If so, what is unclear in any documentation I've read so far, is how I
> would configure the remote servers to accomplish this.
>
> I am running version 2.2 in non-GUI mode (using the JMeter ant task)
> with two remote servers and have been unable to determine how to develop
> a test script or modify the jmeter.properties file to make this happen.
> In all cases it appears results are being returned to the client, where
> data is then written to a result file.
>
> Thanks,
> Vince
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
>
>
>
--
View this message in context: http://www.nabble.com/Merging-result-files-from-remote-servers-tf3754415.html#a12268852
Sent from the JMeter - User mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
Re: Merging result files from remote servers
Posted by sebb <se...@gmail.com>.
On 14/05/07, Adamo, Vince <Vi...@vignette.com> wrote:
>
> The JMeter FAQ includes the following in the response to the question
> "How to do remote testing the 'proper way'":
>
> "Running JMeter in non-GUI (batch) mode is preferable, as this uses far
> fewer resources. The output log files can be merged after the test run
> and used to create overall test statistics. (CVS files can just be
> appended to each other; XML output files need a bit of editting to
> maintain well-formedness.)"
>
> This implies that there is a way to configure the JMeter servers to
> write result data to local files and then these files can be copied and
> merged after the test run completes. Is this a correct interpretation?
Not exactly.
You can use non-GUI test runs to write to local files.
For example:
host1: jmeter -n -t test.jmx -l host1.jtl
host2: jmeter -n -t test.jmx -l host2.jtl
host3: jmeter -n -t test.jmx -l host3.jtl
Copy host*.jtl to a single machine and then do the merge.
A JMeter server is different. JMeter server refers to the remote
JMeter instance that is controlled by a GUI (or non_GUI) client to
which the results are returned. There's no need to merge the results
as this happens in the client.
But this method uses more resources as the client has to handle all
the response traffic, and the server has the additional load of
sending the data remotely.
> If so, what is unclear in any documentation I've read so far, is how I
> would configure the remote servers to accomplish this.
See above - servers are not used in this situation.
> I am running version 2.2 in non-GUI mode (using the JMeter ant task)
> with two remote servers and have been unable to determine how to develop
> a test script or modify the jmeter.properties file to make this happen.
> In all cases it appears results are being returned to the client, where
> data is then written to a result file.
See above.
> Thanks,
> Vince
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org