You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@jmeter.apache.org by Philippe Mouawad <p....@ubik-ingenierie.com> on 2018/07/15 12:55:40 UTC

Generating report by default in NON GUI mode

Hello,
Don't you think we should generate HTML report by default when running in
NON Gui mode ?

I see 3 reasons for that:

   - Why would somebody in 80% of cases do a load test without this report
   output ?
   - Still now, I continue to read "dishonnest" comparisons of JMeter with
   other tools (commercial or not) that say "JMeter has no reporting feature":
      - https://www.neotys.com/insights/how-neoload-is-different-from-jmeter
      - http://blog.loadimpact.com/how-to-do-10-things-in-jmeter-vs-k6
      - https://www.guru99.com/performance-testing-tools.html
      - https://www.loadtestingtool.com/wapt-vs-jmeter.shtml
      - When doing  trainings introducing JMeter, attendees are always
   surprised this report is not generated by default


Globally, JMeter offers a lot of features but many must be activated which
is a bit sad, activating some would reduce learning curve and make it more
user friendly

-- 
Regards.
Philippe

Re: Generating report by default in NON GUI mode

Posted by Felix Schumacher <fe...@internetallee.de>.

Am 18.07.2018 um 16:45 schrieb Philippe Mouawad:
> On Monday, July 16, 2018, Antonio Gomes Rodrigues <ra...@gmail.com> wrote:
>
>> Hi Philippe,
>>
>> It's a good idea but I think we need to:
>>
>> Optimize the performance
>
> Felix has been improving this
I just tested the improvements reported on bugzilla and added a few bugs :)

>
>> Improve the output during the generation to display something to the user
>
> a kind of windows progress bar :)
> as accurate ? :)
>
>> Because when I made a big load test (many days with a high traffic), the
>> generation of dashboard take a lot of time
>
> You would force a non generation in this case no?
After the user waited for minutes? We could look at the size of the 
results and decide on that measurement whether we would start a report 
or not, but ...

We would have to have the results on disk.
We would have to know where and if we are allowed to generate the report.
We would have to let the user know, that a report has been generated.

Maybe we could

ask the user, if a report should be generated?
point out the possibility to generate such a report.

Felix
>
>
>
>> Antonio
>>
>> Le dim. 15 juil. 2018 à 14:55, Philippe Mouawad <
>> p.mouawad@ubik-ingenierie.com> a écrit :
>>
>>> Hello,
>>> Don't you think we should generate HTML report by default when running in
>>> NON Gui mode ?
>>>
>>> I see 3 reasons for that:
>>>
>>>     - Why would somebody in 80% of cases do a load test without this
>> report
>>>     output ?
>>>     - Still now, I continue to read "dishonnest" comparisons of JMeter
>> with
>>>     other tools (commercial or not) that say "JMeter has no reporting
>>> feature":
>>>        -
>>> https://www.neotys.com/insights/how-neoload-is-different-from-jmeter
>>>        - http://blog.loadimpact.com/how-to-do-10-things-in-jmeter-vs-k6
>>>        - https://www.guru99.com/performance-testing-tools.html
>>>        - https://www.loadtestingtool.com/wapt-vs-jmeter.shtml
>>>        - When doing  trainings introducing JMeter, attendees are always
>>>     surprised this report is not generated by default
>>>
>>>
>>> Globally, JMeter offers a lot of features but many must be activated
>> which
>>> is a bit sad, activating some would reduce learning curve and make it
>> more
>>> user friendly
>>>
>>> --
>>> Regards.
>>> Philippe
>>>
>


Re: Generating report by default in NON GUI mode

Posted by Antonio Gomes Rodrigues <ra...@gmail.com>.
Hi Philippe

Le mer. 18 juil. 2018 à 16:45, Philippe Mouawad <ph...@gmail.com>
a écrit :

> On Monday, July 16, 2018, Antonio Gomes Rodrigues <ra...@gmail.com>
> wrote:
>
> > Hi Philippe,
> >
> > It's a good idea but I think we need to:
> >
> > Optimize the performance
>
>
> Felix has been improving this
>
> >
> > Improve the output during the generation to display something to the user
>
>
> a kind of windows progress bar :)
> as accurate ? :)
>

Not need a progress bar.

A message like Summariser is enough
I need to know that generating dashboard have started and in progress (a
line each XX second)


>
> >
> > Because when I made a big load test (many days with a high traffic), the
> > generation of dashboard take a lot of time
>
>
> You would force a non generation in this case no?
>
>
>
> >
> > Antonio
> >
> > Le dim. 15 juil. 2018 à 14:55, Philippe Mouawad <
> > p.mouawad@ubik-ingenierie.com> a écrit :
> >
> > > Hello,
> > > Don't you think we should generate HTML report by default when running
> in
> > > NON Gui mode ?
> > >
> > > I see 3 reasons for that:
> > >
> > >    - Why would somebody in 80% of cases do a load test without this
> > report
> > >    output ?
> > >    - Still now, I continue to read "dishonnest" comparisons of JMeter
> > with
> > >    other tools (commercial or not) that say "JMeter has no reporting
> > > feature":
> > >       -
> > > https://www.neotys.com/insights/how-neoload-is-different-from-jmeter
> > >       - http://blog.loadimpact.com/how-to-do-10-things-in-jmeter-vs-k6
> > >       - https://www.guru99.com/performance-testing-tools.html
> > >       - https://www.loadtestingtool.com/wapt-vs-jmeter.shtml
> > >       - When doing  trainings introducing JMeter, attendees are always
> > >    surprised this report is not generated by default
> > >
> > >
> > > Globally, JMeter offers a lot of features but many must be activated
> > which
> > > is a bit sad, activating some would reduce learning curve and make it
> > more
> > > user friendly
> > >
> > > --
> > > Regards.
> > > Philippe
> > >
> >
>
>
> --
> Cordialement.
> Philippe Mouawad.
>

Re: Generating report by default in NON GUI mode

Posted by Philippe Mouawad <ph...@gmail.com>.
On Monday, July 16, 2018, Antonio Gomes Rodrigues <ra...@gmail.com> wrote:

> Hi Philippe,
>
> It's a good idea but I think we need to:
>
> Optimize the performance


Felix has been improving this

>
> Improve the output during the generation to display something to the user


a kind of windows progress bar :)
as accurate ? :)

>
> Because when I made a big load test (many days with a high traffic), the
> generation of dashboard take a lot of time


You would force a non generation in this case no?



>
> Antonio
>
> Le dim. 15 juil. 2018 à 14:55, Philippe Mouawad <
> p.mouawad@ubik-ingenierie.com> a écrit :
>
> > Hello,
> > Don't you think we should generate HTML report by default when running in
> > NON Gui mode ?
> >
> > I see 3 reasons for that:
> >
> >    - Why would somebody in 80% of cases do a load test without this
> report
> >    output ?
> >    - Still now, I continue to read "dishonnest" comparisons of JMeter
> with
> >    other tools (commercial or not) that say "JMeter has no reporting
> > feature":
> >       -
> > https://www.neotys.com/insights/how-neoload-is-different-from-jmeter
> >       - http://blog.loadimpact.com/how-to-do-10-things-in-jmeter-vs-k6
> >       - https://www.guru99.com/performance-testing-tools.html
> >       - https://www.loadtestingtool.com/wapt-vs-jmeter.shtml
> >       - When doing  trainings introducing JMeter, attendees are always
> >    surprised this report is not generated by default
> >
> >
> > Globally, JMeter offers a lot of features but many must be activated
> which
> > is a bit sad, activating some would reduce learning curve and make it
> more
> > user friendly
> >
> > --
> > Regards.
> > Philippe
> >
>


-- 
Cordialement.
Philippe Mouawad.

Re: Generating report by default in NON GUI mode

Posted by Antonio Gomes Rodrigues <ra...@gmail.com>.
Hi Philippe,

It's a good idea but I think we need to:

Optimize the performance

Improve the output during the generation to display something to the user

Because when I made a big load test (many days with a high traffic), the
generation of dashboard take a lot of time

Antonio

Le dim. 15 juil. 2018 à 14:55, Philippe Mouawad <
p.mouawad@ubik-ingenierie.com> a écrit :

> Hello,
> Don't you think we should generate HTML report by default when running in
> NON Gui mode ?
>
> I see 3 reasons for that:
>
>    - Why would somebody in 80% of cases do a load test without this report
>    output ?
>    - Still now, I continue to read "dishonnest" comparisons of JMeter with
>    other tools (commercial or not) that say "JMeter has no reporting
> feature":
>       -
> https://www.neotys.com/insights/how-neoload-is-different-from-jmeter
>       - http://blog.loadimpact.com/how-to-do-10-things-in-jmeter-vs-k6
>       - https://www.guru99.com/performance-testing-tools.html
>       - https://www.loadtestingtool.com/wapt-vs-jmeter.shtml
>       - When doing  trainings introducing JMeter, attendees are always
>    surprised this report is not generated by default
>
>
> Globally, JMeter offers a lot of features but many must be activated which
> is a bit sad, activating some would reduce learning curve and make it more
> user friendly
>
> --
> Regards.
> Philippe
>