You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@jmeter.apache.org by Mike Stover <ms...@apache.org> on 2001/06/09 12:45:37 UTC
Re: some questions
My answers are interspersed below:
On Friday 08 June 2001 17:56, you wrote:
> Hi,
> I am writing this email to you directly instead of sending it to the dev
> mailing list. Hope that is ok.
Sure, I hope you don't mind that I'm sending my answers to the list. There
may be others out there that are interested.
>
> First of all, thanks for working on an excellent product that is turning
> out to be extremely useful for a number of us out there. After working with
> a number of different commercially available products I feel that this
> initiative was necessary and would be glad to contribute in any way I can.
>
> I am using JMeter to load test a number of different web based apps that we
> are working on here. There are a few enhancements that I am working on and
> it would be good to know if these
> 1) have already been implemented (and somehow I could not get to them),
> 2) are being implemented by you/ other JMeter commiters,
> 3) or these would be found useful to be included in future releases and I
> can go ahead and post them (whenever ready) to the dev list.
>
> Here are the enhancements that I am working on.
> a) RequestDataExtractor :
> Description: This class sits inside the Servlet and instantiates itself on
> the basis of a property file or Servlet parameters. It captures the request
> data and stores it as URLConfig data. We can use all the data generated by
> this class to create Test Plans and then test the Servlet.
Something I've also been planning to write. It would probably be nice to
include some such tool with JMeter - a library class that took a
ServletRequest as a parameter which output XML for test samples.
Alternatively, it would be even better to write a small proxy server that
recorded the actions from the browser side. This has been talked about, but
I dont know if anyone is working on it. I also don't know how hard it would
be to write a proxy server (I'm betting there's several out there that just
need to be found). Anyone know more?
>
> b) Saving of Timers, Listeners etc.
> Although I found reference to a number of emails stating that this works, I
> have not found any code for this, nor could I make this work. Any ideas?
The XML saving framework is something I wrote, and I suspect it's a fairly
unusual design, so I'm not surprised you had some trouble. However, I can
get Timers and Listeners saved with less than an hour's work, so I will do
that and let you know.
>
> c) Adding Log4J statements for debugging.
> I am not sure whether JMeter would benefit from it in terms of performance
> but my personal opinion is that debugging primitives make products better
> both during development and while fixing bugs. This does add an additional
> dependency (of the Log4J jar files) on JMeter.
I could go along with that. I don't mind the extra dependency since it is
open-source, and it's a minimal amount of coding to get that working (and
actually, I already have such code from another project). So, give me about
a week on that one.
>
> d) Adding parameters to Sampler. Alternatively, I am also looking into
> creating a URLSampler and URLSampleResult. The Filer could handle the URL
> results to parse the parameters sent over to the Servlet.
>
> In my particular case, we have just one Servlet for one application(and I
> assume that this would be the case in most places). This Servlet redirects
> requests to appropriate classes based on keys stored in the request. We
> want to measure the performance against each key and hence want the
> parameters of the request stored in the Filer. Would you consider this a
> feature that more users of JMeter would like to use?
The whole area of sample result data and listeners is one where JMeter needs
a lot of expansion. Anyone out there who writes themselves a new listener -
we'd appreciate it if you donated it to the JMeter project. To help with
that, I would be willing to put as much information into the SampleResult
object as people wanted. Just send me specifics about the data you want in
there. Does that answer your question?
Personally, I have an eye on making listeners that perform assertions - to
check the correctness of the responses, rather than just recording timing
info. To help, I've added the ORO jar files to JMeter, as I imagine regular
expressions will be needed for that. I've also got another use in mind for
reg exp's - dynamic input parameters.
>
> e)Based on d) above, create Filers that can generate/populate data
> corresponding to Excel spreadsheets / Custom Listeners. I am still looking
> into this.
I would need more explanation about this. Are you talking about using a csv
type file format for test scripting?
>
> I would appreciate you comments.
>
> Thanks
> Tushar Bhatia
--
Mike Stover
mstover1@apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
Re: some questions
Posted by Mike Stover <ms...@apache.org>.
Hi Mark,
This is something I've been wanting too. The way I'm thinking about
it, it's like an Assertion - the user wants to be able to make assertions
about the results that are returned from the server.
You mention URLSample, which suggests you are using JMeter 1.5x or earlier?
If so, you should switch to 1.6 for the purposes of doing new development.
The design of the application is completely new in 1.6, and if you work on
1.5, it won't be useful in 1.6.
For 1.6, I think one could allow a user to add an Assert object to a
UrlConfig object in the test tree, and then, when the SampleEvent is
generated, the Assert object and the results are added to the SampleResults
object. Special listeners can be created to report the results of the
assertions (I'm not sure GraphListener is well suited for it).
I think Assertions are an important enough element that they'll require
adjustments to the various interfaces that currently exist (such as, to allow
Assert objects to be attached to ConfigElements and maybe Controllers).
Assertions are one of the Big 3 things I want JMeter ultimately to do:
1. Proxy server to record browser actions directly as JMeter XML test scripts
2. Dynamic request generation, reacting to results from previous requests (to
enable spidering, and useful testing of dynamic sites).
3. Assertions for user in functional testing
Currently, I have code that works at a very rough level for #1, and I have
written an HTML parser that can extract anchor tags and generate URL's from
them and find one that matches certain regular expression input. I've not
started working on Assertions yet.
I hope I haven't scared you off - I'd love help! But, I think the task will
require a good understanding of how JMeter 1.6 works, and some thought about
how best to modify it's current design to help the cause.
If you're still interested, I'd be glad to help point you in the right
directions. Just let me know.
-Mike
On Thursday 14 June 2001 20:07, Mark Church wrote:
> Mike,
>
> I've been thinking about possibly making modifications to JMeter to allow a
> URLSample to perform a series of tests on the response received. My idea
> would be to allow users to add a series of Tests to a URLSample. After
> recording the response time the URLSample would run through it's lists of
> tests. It would report the results of these tests to the Listener's via a
> boolean in the SampleResult class. The existing Listeners should continue
> to work but I would think we would also want to modify some of the existing
> Listners (Graph Results and File Reporter) to report this information.
>
> What do you think. Would this be enough?
>
> Mark Church
> Applications Developer
> accessIndiana
> http://www.state.in.us
>
> Mike Stover wrote:
> > My answers are interspersed below:
> >
> > On Friday 08 June 2001 17:56, you wrote:
> > > Hi,
> > > I am writing this email to you directly instead of sending it to the
> > > dev mailing list. Hope that is ok.
> >
> > Sure, I hope you don't mind that I'm sending my answers to the list.
> > There may be others out there that are interested.
> >
> > > First of all, thanks for working on an excellent product that is
> > > turning out to be extremely useful for a number of us out there. After
> > > working with a number of different commercially available products I
> > > feel that this initiative was necessary and would be glad to contribute
> > > in any way I can.
> > >
> > > I am using JMeter to load test a number of different web based apps
> > > that we are working on here. There are a few enhancements that I am
> > > working on and it would be good to know if these
> > > 1) have already been implemented (and somehow I could not get to them),
> > > 2) are being implemented by you/ other JMeter commiters,
> > > 3) or these would be found useful to be included in future releases and
> > > I can go ahead and post them (whenever ready) to the dev list.
> > >
> > > Here are the enhancements that I am working on.
> > > a) RequestDataExtractor :
> > > Description: This class sits inside the Servlet and instantiates itself
> > > on the basis of a property file or Servlet parameters. It captures the
> > > request data and stores it as URLConfig data. We can use all the data
> > > generated by this class to create Test Plans and then test the Servlet.
> >
> > Something I've also been planning to write. It would probably be nice to
> > include some such tool with JMeter - a library class that took a
> > ServletRequest as a parameter which output XML for test samples.
> >
> > Alternatively, it would be even better to write a small proxy server that
> > recorded the actions from the browser side. This has been talked about,
> > but I dont know if anyone is working on it. I also don't know how hard
> > it would be to write a proxy server (I'm betting there's several out
> > there that just need to be found). Anyone know more?
> >
> > > b) Saving of Timers, Listeners etc.
> > > Although I found reference to a number of emails stating that this
> > > works, I have not found any code for this, nor could I make this work.
> > > Any ideas?
> >
> > The XML saving framework is something I wrote, and I suspect it's a
> > fairly unusual design, so I'm not surprised you had some trouble.
> > However, I can get Timers and Listeners saved with less than an hour's
> > work, so I will do that and let you know.
> >
> > > c) Adding Log4J statements for debugging.
> > > I am not sure whether JMeter would benefit from it in terms of
> > > performance but my personal opinion is that debugging primitives make
> > > products better both during development and while fixing bugs. This
> > > does add an additional dependency (of the Log4J jar files) on JMeter.
> >
> > I could go along with that. I don't mind the extra dependency since it
> > is open-source, and it's a minimal amount of coding to get that working
> > (and actually, I already have such code from another project). So, give
> > me about a week on that one.
> >
> > > d) Adding parameters to Sampler. Alternatively, I am also looking into
> > > creating a URLSampler and URLSampleResult. The Filer could handle the
> > > URL results to parse the parameters sent over to the Servlet.
> > >
> > > In my particular case, we have just one Servlet for one application(and
> > > I assume that this would be the case in most places). This Servlet
> > > redirects requests to appropriate classes based on keys stored in the
> > > request. We want to measure the performance against each key and hence
> > > want the parameters of the request stored in the Filer. Would you
> > > consider this a feature that more users of JMeter would like to use?
> >
> > The whole area of sample result data and listeners is one where JMeter
> > needs a lot of expansion. Anyone out there who writes themselves a new
> > listener - we'd appreciate it if you donated it to the JMeter project.
> > To help with that, I would be willing to put as much information into the
> > SampleResult object as people wanted. Just send me specifics about the
> > data you want in there. Does that answer your question?
> >
> > Personally, I have an eye on making listeners that perform assertions -
> > to check the correctness of the responses, rather than just recording
> > timing info. To help, I've added the ORO jar files to JMeter, as I
> > imagine regular expressions will be needed for that. I've also got
> > another use in mind for reg exp's - dynamic input parameters.
> >
> > > e)Based on d) above, create Filers that can generate/populate data
> > > corresponding to Excel spreadsheets / Custom Listeners. I am still
> > > looking into this.
> >
> > I would need more explanation about this. Are you talking about using a
> > csv type file format for test scripting?
> >
> > > I would appreciate you comments.
> > >
> > > Thanks
> > > Tushar Bhatia
> >
> > --
> > Mike Stover
> > mstover1@apache.org
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
> > For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
--
Mike Stover
mstover1@apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
Re: some questions
Posted by Mark Church <mc...@www.IN.gov>.
Mike,
I've been thinking about possibly making modifications to JMeter to allow a
URLSample to perform a series of tests on the response received. My idea would
be to allow users to add a series of Tests to a URLSample. After recording the
response time the URLSample would run through it's lists of tests. It would
report the results of these tests to the Listener's via a boolean in the
SampleResult class. The existing Listeners should continue to work but I would
think we would also want to modify some of the existing Listners (Graph Results
and File Reporter) to report this information.
What do you think. Would this be enough?
Mark Church
Applications Developer
accessIndiana
http://www.state.in.us
Mike Stover wrote:
> My answers are interspersed below:
>
> On Friday 08 June 2001 17:56, you wrote:
> > Hi,
> > I am writing this email to you directly instead of sending it to the dev
> > mailing list. Hope that is ok.
>
> Sure, I hope you don't mind that I'm sending my answers to the list. There
> may be others out there that are interested.
>
> >
> > First of all, thanks for working on an excellent product that is turning
> > out to be extremely useful for a number of us out there. After working with
> > a number of different commercially available products I feel that this
> > initiative was necessary and would be glad to contribute in any way I can.
> >
> > I am using JMeter to load test a number of different web based apps that we
> > are working on here. There are a few enhancements that I am working on and
> > it would be good to know if these
> > 1) have already been implemented (and somehow I could not get to them),
> > 2) are being implemented by you/ other JMeter commiters,
> > 3) or these would be found useful to be included in future releases and I
> > can go ahead and post them (whenever ready) to the dev list.
> >
> > Here are the enhancements that I am working on.
> > a) RequestDataExtractor :
> > Description: This class sits inside the Servlet and instantiates itself on
> > the basis of a property file or Servlet parameters. It captures the request
> > data and stores it as URLConfig data. We can use all the data generated by
> > this class to create Test Plans and then test the Servlet.
>
> Something I've also been planning to write. It would probably be nice to
> include some such tool with JMeter - a library class that took a
> ServletRequest as a parameter which output XML for test samples.
>
> Alternatively, it would be even better to write a small proxy server that
> recorded the actions from the browser side. This has been talked about, but
> I dont know if anyone is working on it. I also don't know how hard it would
> be to write a proxy server (I'm betting there's several out there that just
> need to be found). Anyone know more?
>
> >
> > b) Saving of Timers, Listeners etc.
> > Although I found reference to a number of emails stating that this works, I
> > have not found any code for this, nor could I make this work. Any ideas?
>
> The XML saving framework is something I wrote, and I suspect it's a fairly
> unusual design, so I'm not surprised you had some trouble. However, I can
> get Timers and Listeners saved with less than an hour's work, so I will do
> that and let you know.
>
> >
> > c) Adding Log4J statements for debugging.
> > I am not sure whether JMeter would benefit from it in terms of performance
> > but my personal opinion is that debugging primitives make products better
> > both during development and while fixing bugs. This does add an additional
> > dependency (of the Log4J jar files) on JMeter.
>
> I could go along with that. I don't mind the extra dependency since it is
> open-source, and it's a minimal amount of coding to get that working (and
> actually, I already have such code from another project). So, give me about
> a week on that one.
>
> >
> > d) Adding parameters to Sampler. Alternatively, I am also looking into
> > creating a URLSampler and URLSampleResult. The Filer could handle the URL
> > results to parse the parameters sent over to the Servlet.
> >
> > In my particular case, we have just one Servlet for one application(and I
> > assume that this would be the case in most places). This Servlet redirects
> > requests to appropriate classes based on keys stored in the request. We
> > want to measure the performance against each key and hence want the
> > parameters of the request stored in the Filer. Would you consider this a
> > feature that more users of JMeter would like to use?
>
> The whole area of sample result data and listeners is one where JMeter needs
> a lot of expansion. Anyone out there who writes themselves a new listener -
> we'd appreciate it if you donated it to the JMeter project. To help with
> that, I would be willing to put as much information into the SampleResult
> object as people wanted. Just send me specifics about the data you want in
> there. Does that answer your question?
>
> Personally, I have an eye on making listeners that perform assertions - to
> check the correctness of the responses, rather than just recording timing
> info. To help, I've added the ORO jar files to JMeter, as I imagine regular
> expressions will be needed for that. I've also got another use in mind for
> reg exp's - dynamic input parameters.
>
> >
> > e)Based on d) above, create Filers that can generate/populate data
> > corresponding to Excel spreadsheets / Custom Listeners. I am still looking
> > into this.
>
> I would need more explanation about this. Are you talking about using a csv
> type file format for test scripting?
>
> >
> > I would appreciate you comments.
> >
> > Thanks
> > Tushar Bhatia
>
> --
> Mike Stover
> mstover1@apache.org
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
Re: Cookies under 1.6a
Posted by Mike Stover <ms...@apache.org>.
I'm not sure what's going wrong for you. If you could download the latest
version (1.6.1) and try again, I'd be glad to help you if you're still having
problems.
-Mike
On Sunday 10 June 2001 07:04, Graham Breeze wrote:
> Has anyone been able to get cookies working with the "Cookie Manager" under
> 1.6a? I am running into many problems trying to test some sites that are
> "cookie dependent" using 1.6a.
>
> Thinking this was something I was doing wrong, I wrote a simple set of
> servlets - one to set a client cookie and the other to read it back and
> confirm it's contents. When I try to run a test against these URLs (which
> work perfectly with a browser) with Jmeter, the cookie never appears to get
> set, in the "Cookie Manger", or elsewhere (as it can't be read back, nor
> does it appear to exist). To try and track this a bit further, I manually
> added serveral cookies to the "Cookie Manager" and even those can not be
> read by the servlet I wrote which attempts to fetch them (which is easily
> achieved in a browser).
>
> Am I missing something in my set-up of the Cookie Manager (it's directly
> under the "Thread" in my test tree, though I've tried it just about
> everywhere) in my test set-up, or is cookie support broken in 1.6a?
>
> Thanks,
> Graham
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
--
Mike Stover
mstover1@apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
Cookies under 1.6a
Posted by Graham Breeze <gb...@breezetech.com>.
Has anyone been able to get cookies working with the "Cookie Manager" under
1.6a? I am running into many problems trying to test some sites that are
"cookie dependent" using 1.6a.
Thinking this was something I was doing wrong, I wrote a simple set of
servlets - one to set a client cookie and the other to read it back and
confirm it's contents. When I try to run a test against these URLs (which
work perfectly with a browser) with Jmeter, the cookie never appears to get
set, in the "Cookie Manger", or elsewhere (as it can't be read back, nor
does it appear to exist). To try and track this a bit further, I manually
added serveral cookies to the "Cookie Manager" and even those can not be
read by the servlet I wrote which attempts to fetch them (which is easily
achieved in a browser).
Am I missing something in my set-up of the Cookie Manager (it's directly
under the "Thread" in my test tree, though I've tried it just about
everywhere) in my test set-up, or is cookie support broken in 1.6a?
Thanks,
Graham
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org