You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@geode.apache.org by "John Hutchison (Jira)" <ji...@apache.org> on 2020/11/13 16:29:00 UTC
[jira] [Comment Edited] (GEODE-7616) ReplicatedPutAllBenchmark
average latency is 5% worse than baseline
[ https://issues.apache.org/jira/browse/GEODE-7616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17231608#comment-17231608 ]
John Hutchison edited comment on GEODE-7616 at 11/13/20, 4:28 PM:
------------------------------------------------------------------
11/3
org.apache.geode.benchmark.tests.ReplicatedPutAllLongBenchmark
average ops/second Baseline: 854.09 Test: 850.53 Difference: -0.4%
ops/second standard error Baseline: 2.82 Test: 2.52 Difference: -10.8%
ops/second standard deviation Baseline: 48.86 Test: 43.51 Difference: -10.9%
YS 99th percentile latency Baseline: 20099.00 Test: 20099.00 Difference: +0.0%
median latency Baseline: 164757503.00 Test: 165543935.00 Difference: +0.5%
90th percentile latency Baseline: 249036799.00 Test: 245366783.00 Difference: -1.5%
99th percentile latency Baseline: 328466431.00 Test: 319029247.00 Difference: -2.9%
99.9th percentile latency Baseline: 407896063.00 Test: 383778815.00 Difference: -5.9%
average latency Baseline: 168732913.71 Test: 169570366.99 Difference: +0.5%
latency standard deviation Baseline: 61216607.41 Test: 57135462.90 Difference: -6.7%
latency standard error Baseline: 121028.48 Test: 113222.36 Difference: -6.4%
average ops/second Baseline: 852.91 Test: 848.79 Difference: -0.5%
BENCHMARK FAILED: org.apache.geode.benchmark.tests.ReplicatedPutAllBenchmark average latency is 5% worse than baseline.
was (Author: john hutch):
11/3
org.apache.geode.benchmark.tests.ReplicatedPutAllLongBenchmark
average ops/second Baseline: 854.09 Test: 850.53 Difference: -0.4%
ops/second standard error Baseline: 2.82 Test: 2.52 Difference: -10.8%
ops/second standard deviation Baseline: 48.86 Test: 43.51 Difference: -10.9%
YS 99th percentile latency Baseline: 20099.00 Test: 20099.00 Difference: +0.0%
median latency Baseline: 164757503.00 Test: 165543935.00 Difference: +0.5%
90th percentile latency Baseline: 249036799.00 Test: 245366783.00 Difference: -1.5%
99th percentile latency Baseline: 328466431.00 Test: 319029247.00 Difference: -2.9%
99.9th percentile latency Baseline: 407896063.00 Test: 383778815.00 Difference: -5.9%
average latency Baseline: 168732913.71 Test: 169570366.99 Difference: +0.5%
latency standard deviation Baseline: 61216607.41 Test: 57135462.90 Difference: -6.7%
latency standard error Baseline: 121028.48 Test: 113222.36 Difference: -6.4%
average ops/second Baseline: 852.91 Test: 848.79 Difference: -0.5%
BENCHMARK FAILED: org.apache.geode.benchmark.tests.ReplicatedPutAllBenchmark average latency is 5% worse than baseline.
> ReplicatedPutAllBenchmark average latency is 5% worse than baseline
> -------------------------------------------------------------------
>
> Key: GEODE-7616
> URL: https://issues.apache.org/jira/browse/GEODE-7616
> Project: Geode
> Issue Type: Bug
> Components: benchmarks
> Reporter: Bill Burcham
> Assignee: Jacob Barrett
> Priority: Major
>
> Three runs in a row have failed with {{ReplicatedPutAllBenchmark average latency is 5% worse than baseline}} starting with:
> https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/Benchmark_base/builds/23
> e.g.
> {code}
> org.apache.geode.benchmark.tests.ReplicatedPutAllBenchmark
> average ops/second Baseline: 900.64 Test: 828.40 Difference: -8.0%
> ops/second standard error Baseline: 2.71 Test: 2.47 Difference: -8.9%
> ops/second standard deviation Baseline: 46.91 Test: 42.76 Difference: -8.9%
> YS 99th percentile latency Baseline: 20099.00 Test: 20099.00 Difference: +0.0%
> median latency Baseline: 158728191.00 Test: 172359679.00 Difference: +8.6%
> 90th percentile latency Baseline: 228458495.00 Test: 244449279.00 Difference: +7.0%
> 99th percentile latency Baseline: 299368447.00 Test: 319815679.00 Difference: +6.8%
> 99.9th percentile latency Baseline: 354156543.00 Test: 387710975.00 Difference: +9.5%
> average latency Baseline: 160197744.39 Test: 174083983.05 Difference: +8.7%
> latency standard deviation Baseline: 53484962.25 Test: 55775317.05 Difference: +4.3%
> latency standard error Baseline: 103053.88 Test: 111997.05 Difference: +8.7%
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)