You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@groovy.apache.org by Daniel Sun <re...@hotmail.com> on 2017/01/29 17:12:40 UTC
答复: About the performance of the test builds
Hi Jochen,
> hardware is the same for all. afaik the parrot branch under the "JDK 7
> build" is tested with a JDK7 build bot. "Antlr4 grammar" is tested with
> a JDK8 bot. The same bot is used for "JDK 8 build".
If "Antlr4 grammar" is using the same bot with "JDK 8 build", the performance of Parrot is too good to believe ?? "Antlr4 grammar#180" ran 21591 tests and costed 23m:48s, and “JDK 8 Build#1801” ran 11155 tests and costed 22m:35s. As we can see, they costed almost same time, but "Antlr4 grammar#180" ran much more tests than “JDK 8 Build#1801”(10436 more tests)...
> BUILD TESTS COUNT COSTED TIME
> JDK 8 Build#1801 11155 22m:35s
> Antlr4 grammar#180 21591 23m:48s
Cheers,
Daniel.Sun
发件人: Jochen Theodorou [via Groovy]<ma...@n5.nabble.com>
发送时间: 2017年1月30日 0:58
收件人: Daniel Sun<ma...@hotmail.com>
主题: Re: About the performance of the test builds
On 29.01.2017 15:46, Daniel Sun wrote:
> Hi all,
>
> I noticed that test builds that use JDK 8 cost different time, they run
> tests from master and parrot branch(contains all commits from
> master)(http://ci.groovy-lang.org/project.html?projectId=Groovy), e.g.
>
> BUILD TESTS COUNT COSTED
> TIME
> JDK 8 Build#1801 11155 22m:35s
> JDK 8 snapshot build#995 11155 15m:32s
> Antlr4 grammar#180 21591 23m:48s
>
> Who can tell me what's different among the CI instances of "JDK 8
> Build", "JDK 8 snapshot" and "Antlr4 grammar"?
hardware is the same for all. afaik the parrot branch under the "JDK 7
build" is tested with a JDK7 build bot. "Antlr4 grammar" is tested with
a JDK8 bot. The same bot is used for "JDK 8 build". "JDK 8 snapshot
build" uses a checked out JDK8 to run. If "JDK 8 snapshot" is much
faster, then maybe because of changes the JDK people did for an upcoming
new JDK8 release
> PS:
> If "Antlr4 grammar" CI instance has same hardware resource with "JDK 8
> Build" CI instance, we can say the new parser Parrot has better performance
> than the old one;
> If "Antlr4 grammar" CI instance has same hardware resource with "JDK 8
> snapshot build" CI instance, we can say the new parser Parrot has almost
> same performance with the old one;
If you want to compare performance I suggest you run the build on your
computer with different JDKs. There you have much more control over things
bye Jochen
________________________________
If you reply to this email, your message will be added to the discussion below:
http://groovy.329449.n5.nabble.com/About-the-performance-of-the-test-builds-tp5738218p5738219.html
To unsubscribe from About the performance of the test builds, click here<http://groovy.329449.n5.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=5738218&code=cmVhbGJsdWVzdW5AaG90bWFpbC5jb218NTczODIxOHwxMTQ2MjE4MjI1>.
NAML<http://groovy.329449.n5.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
--
View this message in context: http://groovy.329449.n5.nabble.com/About-the-performance-of-the-test-builds-tp5738218p5738220.html
Sent from the Groovy Dev mailing list archive at Nabble.com.
Re: 答复: About the performance of the test builds
Posted by Daniel Sun <re...@hotmail.com>.
Hi Paul,
We can also run "clean" task for Antlr4 grammar build first as other builds do and compare these builds again.
Cheers,
Daniel.Sun
在 "paulk_asert [via Groovy]" <ml...@n5.nabble.com>，2017年1月30日 14:37写道：
I think it is a bit hard to compare those two numbers.
Antlr4 grammar build steps are:
gradlew test
JDK8 Build steps are:
gradlew clean test // with Indy
gradlew clean test // without Indy
And as a general comment, the CI server has numerous jobs that are kicked off from the main builds, so expect more work to be happening on the box after the main JDK7/8 builds - which will slow down whatever runs next.
Cheers, Paul.
On Mon, Jan 30, 2017 at 3:12 AM, Daniel Sun <[hidden email]> wrote:
Hi Jochen,
> hardware is the same for all. afaik the parrot branch under the "JDK 7
> build" is tested with a JDK7 build bot. "Antlr4 grammar" is tested with
> a JDK8 bot. The same bot is used for "JDK 8 build".
If "Antlr4 grammar" is using the same bot with "JDK 8 build", the performance of Parrot is too good to believe 😉 "Antlr4 grammar#180" ran 21591 tests and costed 23m:48s, and “JDK 8 Build#1801” ran 11155 tests and costed 22m:35s. As we can see, they costed almost same time, but "Antlr4 grammar#180" ran much more tests than “JDK 8 Build#1801”(10436 more tests)...
> BUILD TESTS COUNT COSTED TIME
> JDK 8 Build#1801 11155 22m:35s
> Antlr4 grammar#180 21591 23m:48s
Cheers,
Daniel.Sun
发件人: [hidden email]
发送时间: 2017年1月30日 0:58
收件人: [hidden email]
主题: Re: About the performance of the test builds
On 29.01.2017 15:46, Daniel Sun wrote:
> Hi all,
>
> I noticed that test builds that use JDK 8 cost different time, they run
> tests from master and parrot branch(contains all commits from
> master)(http://ci.groovy-lang.org/project.html?projectId=Groovy), e.g.
>
> BUILD TESTS COUNT COSTED
> TIME
> JDK 8 Build#1801 11155 22m:35s
> JDK 8 snapshot build#995 11155 15m:32s
> Antlr4 grammar#180 21591 23m:48s
>
> Who can tell me what's different among the CI instances of "JDK 8
> Build", "JDK 8 snapshot" and "Antlr4 grammar"?
hardware is the same for all. afaik the parrot branch under the "JDK 7
build" is tested with a JDK7 build bot. "Antlr4 grammar" is tested with
a JDK8 bot. The same bot is used for "JDK 8 build". "JDK 8 snapshot
build" uses a checked out JDK8 to run. If "JDK 8 snapshot" is much
faster, then maybe because of changes the JDK people did for an upcoming
new JDK8 release
> PS:
> If "Antlr4 grammar" CI instance has same hardware resource with "JDK 8
> Build" CI instance, we can say the new parser Parrot has better performance
> than the old one;
> If "Antlr4 grammar" CI instance has same hardware resource with "JDK 8
> snapshot build" CI instance, we can say the new parser Parrot has almost
> same performance with the old one;
If you want to compare performance I suggest you run the build on your
computer with different JDKs. There you have much more control over things
bye Jochen
________________________________
If you reply to this email, your message will be added to the discussion below:
http://groovy.329449.n5.nabble.com/About-the-performance-of-the-test-builds-tp5738218p5738219.html
To unsubscribe from About the performance of the test builds, click here.
NAML<http://groovy.329449.n5.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
________________________________
View this message in context: 答复: About the performance of the test builds<http://groovy.329449.n5.nabble.com/About-the-performance-of-the-test-builds-tp5738218p5738220.html>
Sent from the Groovy Dev mailing list archive<http://groovy.329449.n5.nabble.com/Groovy-Dev-f372993.html> at Nabble.com.
________________________________
If you reply to this email, your message will be added to the discussion below:
http://groovy.329449.n5.nabble.com/About-the-performance-of-the-test-builds-tp5738218p5738225.html
To unsubscribe from About the performance of the test builds, click here<http://groovy.329449.n5.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=5738218&code=cmVhbGJsdWVzdW5AaG90bWFpbC5jb218NTczODIxOHwxMTQ2MjE4MjI1>.
NAML<http://groovy.329449.n5.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
--
View this message in context: http://groovy.329449.n5.nabble.com/About-the-performance-of-the-test-builds-tp5738218p5738226.html
Sent from the Groovy Dev mailing list archive at Nabble.com.
Re: 答复: About the performance of the test builds
Posted by Paul King <pa...@asert.com.au>.
I think it is a bit hard to compare those two numbers.
Antlr4 grammar build steps are:
gradlew test
JDK8 Build steps are:
gradlew clean test // with Indy
gradlew clean test // without Indy
And as a general comment, the CI server has numerous jobs that are kicked
off from the main builds, so expect more work to be happening on the box
after the main JDK7/8 builds - which will slow down whatever runs next.
Cheers, Paul.
On Mon, Jan 30, 2017 at 3:12 AM, Daniel Sun <re...@hotmail.com> wrote:
> Hi Jochen,
>
>
>
> > hardware is the same for all. afaik the parrot branch under the "JDK 7
> > build" is tested with a JDK7 build bot. "Antlr4 grammar" is tested with
> > a JDK8 bot. The same bot is used for "JDK 8 build".
>
>
>
> If "Antlr4 grammar" is using the same bot with "JDK 8 build", the
> performance of Parrot is too good to believe 😉 "Antlr4 grammar#180" ran
> 21591 tests and costed 23m:48s, and “JDK 8 Build#1801” ran 11155 tests and
> costed 22m:35s. As we can see, they *costed almost same time*, but
> "Antlr4 grammar#180" *ran much more tests* than “JDK 8 Build#1801”(10436
> more tests)...
>
>
>
> > BUILD TESTS COUNT
> COSTED TIME
> > JDK 8 Build#1801 11155
> 22m:35s
> > Antlr4 grammar#180 21591 23m:48s
>
>
>
> Cheers,
>
> Daniel.Sun
>
>
>
> *发件人: *[hidden email]
> <http:///user/SendEmail.jtp?type=node&node=5738220&i=0>
> *发送时间: *2017年1月30日 0:58
> *收件人: *[hidden email]
> <http:///user/SendEmail.jtp?type=node&node=5738220&i=1>
> *主题: *Re: About the performance of the test builds
>
>
> On 29.01.2017 15:46, Daniel Sun wrote:
>
> > Hi all,
> >
> > I noticed that test builds that use JDK 8 cost different time,
> they run
> > tests from master and parrot branch(contains all commits from
> > master)(http://ci.groovy-lang.org/project.html?projectId=Groovy), e.g.
> >
> > BUILD TESTS COUNT
> COSTED
> > TIME
> > JDK 8 Build#1801 11155
> 22m:35s
> > JDK 8 snapshot build#995 11155 15m:32s
> > Antlr4 grammar#180 21591 23m:48s
> >
> > Who can tell me what's different among the CI instances of "JDK 8
> > Build", "JDK 8 snapshot" and "Antlr4 grammar"?
>
> hardware is the same for all. afaik the parrot branch under the "JDK 7
> build" is tested with a JDK7 build bot. "Antlr4 grammar" is tested with
> a JDK8 bot. The same bot is used for "JDK 8 build". "JDK 8 snapshot
> build" uses a checked out JDK8 to run. If "JDK 8 snapshot" is much
> faster, then maybe because of changes the JDK people did for an upcoming
> new JDK8 release
>
> > PS:
> > If "Antlr4 grammar" CI instance has same hardware resource with
> "JDK 8
> > Build" CI instance, we can say the new parser Parrot has better
> performance
> > than the old one;
> > If "Antlr4 grammar" CI instance has same hardware resource with
> "JDK 8
> > snapshot build" CI instance, we can say the new parser Parrot has almost
> > same performance with the old one;
>
> If you want to compare performance I suggest you run the build on your
> computer with different JDKs. There you have much more control over things
>
> bye Jochen
>
>
>
> ------------------------------
> If you reply to this email, your message will be added to the discussion
> below:
> http://groovy.329449.n5.nabble.com/About-the-performance-of-the-test-
> builds-tp5738218p5738219.html
> To unsubscribe from About the performance of the test builds, click here.
> NAML
> <http://groovy.329449.n5.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>
> ------------------------------
> View this message in context: 答复: About the performance of the test builds
> <http://groovy.329449.n5.nabble.com/About-the-performance-of-the-test-builds-tp5738218p5738220.html>
>
> Sent from the Groovy Dev mailing list archive
> <http://groovy.329449.n5.nabble.com/Groovy-Dev-f372993.html> at
> Nabble.com.
>