You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@jmeter.apache.org by rkedari <rk...@msas.in> on 2011/02/12 16:55:29 UTC
Quick and easy performance reports using Jmeter
Hi All,
I would like to share some information on the tool which we are developing
for generation of performance reports which are easy to understand and
analyze.
The main purpose is a quick and easy way to execute the test plans and
generate reports without the hassle of using the native JMeter GUI.
The tools works on the principle of accepting JMX file as inputs and allows
users to perform operation like configure test plan inputs, execute test
plans and analyze results along with generation of reports using wizard like
approach.
The analysis report are linked between summary and detail sections for easy
of navigation. The report is exported using style sheet templates for custom
look and feel. It also has features to configure on demand graphs too.
What are your initial thoughts, views about the tool?
regards,
rkedari.
--
View this message in context: http://jmeter.512774.n5.nabble.com/Quick-and-easy-performance-reports-using-Jmeter-tp3382843p3382843.html
Sent from the JMeter - User mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
Re: Data Driven Testing
Posted by Sonam Chauhan <so...@gmail.com>.
Each time you run your test with changed data, it is really a different test
If you are proposing to vary input data by driving it from a spreadsheet ,
you probably need a way to vary your assertions too so the test can check
whether your code transformed the input data properly or not.
Regards
Sonam
On Wed, Mar 2, 2011 at 2:22 AM, Jain, Kapil <ka...@logica.com> wrote:
> I'm involved on a project where we're replacing the integrations between a
> number of apps (each with their own DB). When testing this our focus is on
> testing the integrations, including data transformation (XSL) to ensure the
> data that comes from one app/db goes into the correct fields with the
> correct format into the destination app/db. To do this we're taking a data
> driven approach as we need to pass as many combinations of types, lengths,
> etc of data. This won't be automated but will be run from 'template' test
> scripts, e.g. testscript1 will test the integration between app/db1 and
> app/db2 but will be run many times with different data. The data will be
> picked up from a spreadsheet. The query I have is how to track this. We
> haven't got a test management tool in place so generally track test script
> progress (pass/fail etc) in a spreadsheet. Usually we would have a bunch of
> test scripts, e.g. testscript1, testscript2, testscript3 etc which is easy
> to track as we can have a row for each script and track which cycle it was
> run in and pass/fail etc. If we take a data driven approach each test script
> could be run 100 times, we wouldn't want to fail the whole script if just 1
> combination of data failed, so we need to track each run separately. My view
> is that we would track it as testscript1_1, testscript1_2, testscript1_3
> where the _1, _2 _3 etc would be a reference to the data row that was run
> through the script. Any views?
>
Data Driven Testing
Posted by "Jain, Kapil" <ka...@logica.com>.
I'm involved on a project where we're replacing the integrations between a number of apps (each with their own DB). When testing this our focus is on testing the integrations, including data transformation (XSL) to ensure the data that comes from one app/db goes into the correct fields with the correct format into the destination app/db. To do this we're taking a data driven approach as we need to pass as many combinations of types, lengths, etc of data. This won't be automated but will be run from 'template' test scripts, e.g. testscript1 will test the integration between app/db1 and app/db2 but will be run many times with different data. The data will be picked up from a spreadsheet. The query I have is how to track this. We haven't got a test management tool in place so generally track test script progress (pass/fail etc) in a spreadsheet. Usually we would have a bunch of test scripts, e.g. testscript1, testscript2, testscript3 etc which is easy to track as we can have a row for each script and track which cycle it was run in and pass/fail etc. If we take a data driven approach each test script could be run 100 times, we wouldn't want to fail the whole script if just 1 combination of data failed, so we need to track each run separately. My view is that we would track it as testscript1_1, testscript1_2, testscript1_3 where the _1, _2 _3 etc would be a reference to the data row that was run through the script. Any views?
Think green - keep it on the screen.
This e-mail and any attachment is for authorised use by the intended recipient(s) only. It may contain proprietary material, confidential information and/or be subject to legal privilege. It should not be copied, disclosed to, retained or used by, any other party. If you are not an intended recipient then please promptly delete this e-mail and any attachment and all copies and inform the sender. Thank you.
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
Re: Quick and easy performance reports using Jmeter
Posted by rkedari <rk...@msas.in>.
Hi All,
Features of the tool are available at http://www.msas.in/meterplus.html
The tool is free and you can download your copy using the information
provided in above website. Please let us know your feedback's and
suggestions on the evaluation of this tool.
regards,
rkedari.
--
View this message in context: http://jmeter.512774.n5.nabble.com/Quick-and-easy-performance-reports-using-Jmeter-tp3382843p3404800.html
Sent from the JMeter - User mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
Re: Quick and easy performance reports using Jmeter
Posted by rkedari <rk...@msas.in>.
Hi sebb,
Thanks for the reply.
The JMX file has to be created with the JMeter GUI, surely?
>> any JMX format test plan can be executed, you just need to input .jmx
>> file to the tool.
Does the tool use pure Java?
Or does the tool require a specific OS?
JMeter itself will run on any platform that supports a conforming Java.
>> tool is devolved using java and swing, so no specific OS.
JMeter is a bit weak on reporting, so improvements here would be useful.
>> that is the concern for us also, so we are trying to improve it and would
>> like to add some more features
Do you plan to charge for the tool?
>> no, it will be free, but we haven't yet decided on submitting code.
regards,
rkedari
--
View this message in context: http://jmeter.512774.n5.nabble.com/Quick-and-easy-performance-reports-using-Jmeter-tp3382843p3383297.html
Sent from the JMeter - User mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
Re: Quick and easy performance reports using Jmeter
Posted by sebb <se...@gmail.com>.
On 12 February 2011 15:55, rkedari <rk...@msas.in> wrote:
>
> Hi All,
>
> I would like to share some information on the tool which we are developing
> for generation of performance reports which are easy to understand and
> analyze.
> The main purpose is a quick and easy way to execute the test plans and
> generate reports without the hassle of using the native JMeter GUI.
The JMX file has to be created with the JMeter GUI, surely?
> The tools works on the principle of accepting JMX file as inputs and allows
> users to perform operation like configure test plan inputs, execute test
> plans and analyze results along with generation of reports using wizard like
> approach.
Does the tool use pure Java?
Or does the tool require a specific OS?
JMeter itself will run on any platform that supports a conforming Java.
> The analysis report are linked between summary and detail sections for easy
> of navigation. The report is exported using style sheet templates for custom
> look and feel. It also has features to configure on demand graphs too.
JMeter is a bit weak on reporting, so improvements here would be useful.
> What are your initial thoughts, views about the tool?
Do you plan to charge for the tool?
Or do you plan to submit the code for potential inclusion in JMeter?
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
Re: Quick and easy performance reports using Jmeter
Posted by rkedari <rk...@msas.in>.
Hi geezenslaw,
Tool name
* underlying framework or language used to develop
>> java and swing is used for devolpment
* Any type of direct online info about the tool including URLs, doco,
reference links etc.
>> we will able share it soon.....
--
View this message in context: http://jmeter.512774.n5.nabble.com/Quick-and-easy-performance-reports-using-Jmeter-tp3382843p3383291.html
Sent from the JMeter - User mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
Re: Quick and easy performance reports using Jmeter
Posted by David Brown <da...@davidwbrown.name>.
Hi, it would help your cause if u were to supply:
* Tool name
* underlying framework or language used to develop
* Source code repo
* Any type of direct online info about the tool including URLs, doco,
reference links etc.
On Sat, 2011-02-12 at 07:55 -0800, rkedari wrote:
> Hi All,
>
> I would like to share some information on the tool which we are developing
> for generation of performance reports which are easy to understand and
> analyze.
> The main purpose is a quick and easy way to execute the test plans and
> generate reports without the hassle of using the native JMeter GUI.
> The tools works on the principle of accepting JMX file as inputs and allows
> users to perform operation like configure test plan inputs, execute test
> plans and analyze results along with generation of reports using wizard like
> approach.
> The analysis report are linked between summary and detail sections for easy
> of navigation. The report is exported using style sheet templates for custom
> look and feel. It also has features to configure on demand graphs too.
> What are your initial thoughts, views about the tool?
>
> regards,
> rkedari.
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
Re: Quick and easy performance reports using Jmeter
Posted by Felix Frank <ff...@mpexnet.de>.
> After I will get some free time and get the hang of this, I will update the
> jmeter wiki with what I have learned and some out of the box scripts ready
> to use (but it won't be too soon).
I look forward to that! Gnuplot is a tool of choice for me, as well.
Cheers,
Felix
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
Re: Quick and easy performance reports using Jmeter
Posted by Adrian Speteanu <as...@gmail.com>.
Hello,
I started learning this tool: http://www.gnuplot.info/
because I need to run tests on remote linux machines anyway and because it
has its own scripting support that can be executed at the end of test
automatically and in the morning you just get the test results and some .png
files with whatever you wanted to plot.
But it ain't easy or quick unless you know someone that has worked with this
toy before and can help you with some quick gnuplot scripts that you later
use. Simple scripts are easy after a few online examples and some reading in
their manual, but if you want to make cool graphs aggregating more and to
make it look "pretty" (as there will be a lot of data to plot and the graphs
tend to get very "crowded")...
Anyway, maybe it helps in the future.
After I will get some free time and get the hang of this, I will update the
jmeter wiki with what I have learned and some out of the box scripts ready
to use (but it won't be too soon).
Adrian S
On Mon, Feb 14, 2011 at 11:54 AM, rkedari <rk...@msas.in> wrote:
>
> Hey Felix,
>
> You are right. The tool allows users to load JMX file and runs it in
> background using JMeter. The result JTL data can be reviewed by user. If
> all
> data looks fine user can use the same to generate analysis/summary reports
> and graphs. The tool has following tabs for wizard like approach.
>
> 1] Configure 2] Execute 3] Analyze 4] Reports
>
> If the JTL has errors or failure then you can discard it and rerun the JMX
> again multiple times.
>
> JMX file also can be run multiple times with variable virtual user load
> (e.g. 20, 50, 100). After review, these JTL files would be used to create
> reports and graphs like Virtual User vs. avg. response time etc.
>
> We also have option to import multiple JTL's and create reports and graphs
> as stated by you as Offline mode. Infact we like your idea of calling it as
> offline mode. Appreciate your remarks on the same.
>
> regards,
> rkedari.
> --
> View this message in context:
> http://jmeter.512774.n5.nabble.com/Quick-and-easy-performance-reports-using-Jmeter-tp3382843p3384196.html
> Sent from the JMeter - User mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
>
>
Re: Quick and easy performance reports using Jmeter
Posted by rkedari <rk...@msas.in>.
Hey Felix,
You are right. The tool allows users to load JMX file and runs it in
background using JMeter. The result JTL data can be reviewed by user. If all
data looks fine user can use the same to generate analysis/summary reports
and graphs. The tool has following tabs for wizard like approach.
1] Configure 2] Execute 3] Analyze 4] Reports
If the JTL has errors or failure then you can discard it and rerun the JMX
again multiple times.
JMX file also can be run multiple times with variable virtual user load
(e.g. 20, 50, 100). After review, these JTL files would be used to create
reports and graphs like Virtual User vs. avg. response time etc.
We also have option to import multiple JTL's and create reports and graphs
as stated by you as Offline mode. Infact we like your idea of calling it as
offline mode. Appreciate your remarks on the same.
regards,
rkedari.
--
View this message in context: http://jmeter.512774.n5.nabble.com/Quick-and-easy-performance-reports-using-Jmeter-tp3382843p3384196.html
Sent from the JMeter - User mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
Re: Quick and easy performance reports using Jmeter
Posted by Felix Frank <ff...@mpexnet.de>.
Hi,
your previous post makes me think that your tool relies on Jmeter in
non-GUI mode to do the actual testing work?
Are you simply running Jmeter and some post-processing to make graphs
and reports from the resulting JTL-file?
This would be a rather sound approach I think. If you are in fact going
that route, I'd be pleased to see an "offline" alternative as well.
I.e., it would be interesting to some users (me) to be able to run the
Jmeter tests on my own, and merely feed JTL files to your scripts.
Will such an M.O. be possible?
Cheers,
Felix
On 02/12/2011 04:55 PM, rkedari wrote:
>
> Hi All,
>
> I would like to share some information on the tool which we are developing
> for generation of performance reports which are easy to understand and
> analyze.
> The main purpose is a quick and easy way to execute the test plans and
> generate reports without the hassle of using the native JMeter GUI.
> The tools works on the principle of accepting JMX file as inputs and allows
> users to perform operation like configure test plan inputs, execute test
> plans and analyze results along with generation of reports using wizard like
> approach.
> The analysis report are linked between summary and detail sections for easy
> of navigation. The report is exported using style sheet templates for custom
> look and feel. It also has features to configure on demand graphs too.
> What are your initial thoughts, views about the tool?
>
> regards,
> rkedari.
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org