You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Dawid Weiss (JIRA)" <ji...@apache.org> on 2012/06/28 08:56:42 UTC
[jira] [Created] (LUCENE-4174) Some test statistics (mean, stddev).
Dawid Weiss created LUCENE-4174:
-----------------------------------
Summary: Some test statistics (mean, stddev).
Key: LUCENE-4174
URL: https://issues.apache.org/jira/browse/LUCENE-4174
Project: Lucene - Java
Issue Type: Bug
Components: general/test
Reporter: Dawid Weiss
Assignee: Dawid Weiss
Priority: Trivial
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-4174) Some test statistics (mean,
stddev).
Posted by "Dawid Weiss (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-4174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13402898#comment-13402898 ]
Dawid Weiss commented on LUCENE-4174:
-------------------------------------
I calculated simple stats from a dozen test runs on my build machine (trunk at Jun 28, 2012).
h3. The slowest tests (mean time, stddev)
{noformat}
name | mean | stddev | min | max
BasicDistributedZkTest | 168155 | 12697 | 136591 | 192507
FullSolrCloudTest | 95912 | 5867 | 76449 | 102628
OverseerTest | 95801 | 9025 | 82868 | 108840
RecoveryZkTest | 82924 | 13524 | 63800 | 115504
TestJoinUtil | 69328 | 74451 | 7358 | 268199
SpellCheckComponentTest | 65744 | 14222 | 38798 | 85575
FullSolrCloudDistribCmdsTest | 49543 | 2837 | 45376 | 53916
TestReplicationHandler | 45352 | 1863 | 41645 | 48253
LeaderElectionIntegrationTest | 42893 | 5400 | 33565 | 50718
TestLBHttpSolrServer | 35746 | 704 | 34841 | 37133
LeaderElectionTest | 33766 | 6039 | 23574 | 45419
DistributedSpellCheckComponentTest | 30688 | 3500 | 23605 | 36914
TestRealTimeGet | 30642 | 3960 | 24503 | 39594
TestJapaneseTokenizer | 27920 | 5575 | 22090 | 48021
TestDuelingAnalyzers | 26972 | 4330 | 18522 | 33446
ZkControllerTest | 26740 | 8703 | 16446 | 45590
TestSynonymMapFilter | 24929 | 3784 | 19259 | 31461
NGramTokenizerTest | 22886 | 8533 | 13972 | 49923
TestIndexWriterWithThreads | 22195 | 7698 | 14150 | 46912
TestExtendedMode | 19029 | 5525 | 12693 | 38139
TestDistributedGrouping | 18384 | 3128 | 12726 | 24952
TestRandomFaceting | 17223 | 5578 | 7514 | 27142
SamplingAccumulatorTest | 16966 | 7418 | 8858 | 30789
CloudStateUpdateTest | 16611 | 2728 | 10203 | 21394
TestDistributedSearch | 15850 | 2450 | 12915 | 22035
TestPackedInts | 15469 | 3433 | 11274 | 25217
SamplingWrapperTest | 14782 | 6307 | 7890 | 28589
AdaptiveAccumulatorTest | 14672 | 4603 | 8838 | 26736
SpellCheckCollatorTest | 13402 | 3775 | 5068 | 18996
SolrExampleStreamingBinaryTest | 12692 | 1110 | 11701 | 15060
TestJapaneseAnalyzer | 12538 | 3785 | 7372 | 24728
SolrExampleStreamingTest | 12441 | 882 | 11635 | 14698
UIMAUpdateRequestProcessorTest | 12053 | 346 | 11135 | 12807
TestNorms | 11652 | 8949 | 1861 | 35629
TestFSTs | 11421 | 3263 | 6679 | 16884
SoftAutoCommitTest | 11157 | 794 | 9906 | 12756
TestExtendedDismaxParser | 11149 | 1469 | 8410 | 13435
AutoCommitTest | 10827 | 752 | 9228 | 11822
TestPhoneticFilterFactory | 10273 | 2269 | 8453 | 17129
BasicZkTest | 10001 | 1108 | 7167 | 11637
TestFaceting | 9927 | 3660 | 6748 | 19713
TestPerfTasksLogic | 9842 | 768 | 8519 | 11465
TestGraphTokenizers | 9379 | 2526 | 5502 | 13915
TestAnalyzers | 9378 | 4605 | 5109 | 22722
TestHashPartitioner | 9351 | 3664 | 6645 | 22686
ZkSolrClientTest | 9290 | 824 | 7845 | 10847
UIMATypeAwareAnnotationsTokenizerFactoryTe | 8883 | 240 | 8540 | 9393
UIMAAnnotationsTokenizerFactoryTest | 8748 | 393 | 7883 | 9308
TestGrouping | 8656 | 1154 | 6909 | 11361
TestSmartChineseAnalyzer | 8594 | 2904 | 6694 | 18657
WordBreakSolrSpellCheckerTest | 8501 | 2056 | 4204 | 12071
TestIndexWriterReader | 8303 | 3168 | 4899 | 14695
TestRecovery | 8247 | 3132 | 5854 | 17090
DistributedTermsComponentTest | 8132 | 797 | 6736 | 9315
TestLookaheadTokenFilter | 7896 | 3085 | 3992 | 14377
StatsComponentTest | 7767 | 1015 | 6230 | 9364
TestJoin | 7764 | 2381 | 5615 | 14003
{noformat}
h3. Largest test execution variance
{noformat}
name | mean | stddev | min | max
TestJoinUtil | 69328 | 74451 | 7358 | 268199
SpellCheckComponentTest | 65744 | 14222 | 38798 | 85575
RecoveryZkTest | 82924 | 13524 | 63800 | 115504
BasicDistributedZkTest | 168155 | 12697 | 136591| 192507
OverseerTest | 95801 | 9025 | 82868 | 108840
TestNorms | 11652 | 8949 | 1861 | 35629
ZkControllerTest | 26740 | 8703 | 16446 | 45590
TestTypePromotion | 6467 | 8554 | 761 | 26213
NGramTokenizerTest | 22886 | 8533 | 13972 | 49923
{noformat}
> Some test statistics (mean, stddev).
> ------------------------------------
>
> Key: LUCENE-4174
> URL: https://issues.apache.org/jira/browse/LUCENE-4174
> Project: Lucene - Java
> Issue Type: Bug
> Components: general/test
> Reporter: Dawid Weiss
> Assignee: Dawid Weiss
> Priority: Trivial
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Resolved] (LUCENE-4174) Some test statistics (mean,
stddev).
Posted by "Dawid Weiss (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-4174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dawid Weiss resolved LUCENE-4174.
---------------------------------
Resolution: Not A Problem
This is just informational. It'd be nice to have those slowest tests run a bit faster though. Or maybe move them to @Nightly since they're so long to execute?
> Some test statistics (mean, stddev).
> ------------------------------------
>
> Key: LUCENE-4174
> URL: https://issues.apache.org/jira/browse/LUCENE-4174
> Project: Lucene - Java
> Issue Type: Bug
> Components: general/test
> Reporter: Dawid Weiss
> Assignee: Dawid Weiss
> Priority: Trivial
> Attachments: Selection_001.png
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (LUCENE-4174) Some test statistics (mean, stddev).
Posted by "Dawid Weiss (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-4174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dawid Weiss updated LUCENE-4174:
--------------------------------
Attachment: Selection_001.png
Logarithmic scale test time distribution (by mean, desc).
> Some test statistics (mean, stddev).
> ------------------------------------
>
> Key: LUCENE-4174
> URL: https://issues.apache.org/jira/browse/LUCENE-4174
> Project: Lucene - Java
> Issue Type: Bug
> Components: general/test
> Reporter: Dawid Weiss
> Assignee: Dawid Weiss
> Priority: Trivial
> Attachments: Selection_001.png
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org