You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@geode.apache.org by "John Hutchison (Jira)" <ji...@apache.org> on 2020/11/13 16:12:00 UTC
[jira] [Updated] (GEODE-8709) ReplicatedFunctionExecutionBenchmark
failing
[ https://issues.apache.org/jira/browse/GEODE-8709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
John Hutchison updated GEODE-8709:
----------------------------------
Description:
org.apache.geode.benchmark.tests.ReplicatedFunctionExecutionWithFiltersBenchmark
average ops/second Baseline: 546625.03 Test: 537316.10 Difference: -1.7%
ops/second standard error Baseline: 776.77 Test: 709.95 Difference: -8.6%
s/second standard deviation Baseline: 13431.54 Test: 12276.10 Difference: -8.6%
YS 99th percentile latency Baseline: 1700.00 Test: 1750.00 Difference: +2.9%
median latency Baseline: 1213439.00 Test: 1215487.00 Difference: +0.2%
90th percentile latency Baseline: 1465343.00 Test: 1518591.00 Difference: +3.6%
99th percentile latency Baseline: 4517887.00 Test: 4636671.00 Difference: +2.6%
99.9th percentile latency Baseline: 18202623.00 Test: 19234815.00 Difference: +5.7%
average latency Baseline: 1315053.32 Test: 1337898.07 Difference: +1.7%
latency standard deviation Baseline: 1303983.91 Test: 1335112.23 Difference: +2.4%
latency standard error Baseline: 101.85 Test: 105.17 Difference: +3.3%
average ops/second Baseline: 546531.56 Test: 537283.96 Difference: -1.7%
BENCHMARK FAILED: org.apache.geode.benchmark.tests.ReplicatedFunctionExecutionBenchmark average latency is 5% worse than baseline.
was:
org.apache.geode.benchmark.tests.ReplicatedFunctionExecutionWithFiltersBenchmark
[23:46:36|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/Benchmark_base/builds/455#L5f7d595d:6985]
average ops/second Baseline: 546625.03 Test: 537316.10 Difference: -1.7%
[23:46:36|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/Benchmark_base/builds/455#L5f7d595d:6986]
ops/second standard error Baseline: 776.77 Test: 709.95 Difference: -8.6%
[23:46:36|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/Benchmark_base/builds/455#L5f7d595d:6987]
ops/second standard deviation Baseline: 13431.54 Test: 12276.10 Difference: -8.6%
[23:46:36|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/Benchmark_base/builds/455#L5f7d595d:6988]
YS 99th percentile latency Baseline: 1700.00 Test: 1750.00 Difference: +2.9%
[23:46:36|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/Benchmark_base/builds/455#L5f7d595d:6989]
median latency Baseline: 1213439.00 Test: 1215487.00 Difference: +0.2%
[23:46:36|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/Benchmark_base/builds/455#L5f7d595d:6990]
90th percentile latency Baseline: 1465343.00 Test: 1518591.00 Difference: +3.6%
[23:46:36|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/Benchmark_base/builds/455#L5f7d595d:6991]
99th percentile latency Baseline: 4517887.00 Test: 4636671.00 Difference: +2.6%
[23:46:36|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/Benchmark_base/builds/455#L5f7d595d:6992]
99.9th percentile latency Baseline: 18202623.00 Test: 19234815.00 Difference: +5.7%
[23:46:36|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/Benchmark_base/builds/455#L5f7d595d:6993]
average latency Baseline: 1315053.32 Test: 1337898.07 Difference: +1.7%
[23:46:36|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/Benchmark_base/builds/455#L5f7d595d:6994]
latency standard deviation Baseline: 1303983.91 Test: 1335112.23 Difference: +2.4%
[23:46:36|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/Benchmark_base/builds/455#L5f7d595d:6995]
latency standard error Baseline: 101.85 Test: 105.17 Difference: +3.3%
[23:46:36|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/Benchmark_base/builds/455#L5f7d595d:6996]
average ops/second Baseline: 546531.56 Test: 537283.96 Difference: -1.7%
BENCHMARK FAILED: org.apache.geode.benchmark.tests.ReplicatedFunctionExecutionBenchmark average latency is 5% worse than baseline.
> ReplicatedFunctionExecutionBenchmark failing
> ---------------------------------------------
>
> Key: GEODE-8709
> URL: https://issues.apache.org/jira/browse/GEODE-8709
> Project: Geode
> Issue Type: Bug
> Reporter: John Hutchison
> Priority: Major
>
>
> org.apache.geode.benchmark.tests.ReplicatedFunctionExecutionWithFiltersBenchmark
> average ops/second Baseline: 546625.03 Test: 537316.10 Difference: -1.7%
> ops/second standard error Baseline: 776.77 Test: 709.95 Difference: -8.6%
> s/second standard deviation Baseline: 13431.54 Test: 12276.10 Difference: -8.6%
> YS 99th percentile latency Baseline: 1700.00 Test: 1750.00 Difference: +2.9%
> median latency Baseline: 1213439.00 Test: 1215487.00 Difference: +0.2%
> 90th percentile latency Baseline: 1465343.00 Test: 1518591.00 Difference: +3.6%
> 99th percentile latency Baseline: 4517887.00 Test: 4636671.00 Difference: +2.6%
> 99.9th percentile latency Baseline: 18202623.00 Test: 19234815.00 Difference: +5.7%
> average latency Baseline: 1315053.32 Test: 1337898.07 Difference: +1.7%
> latency standard deviation Baseline: 1303983.91 Test: 1335112.23 Difference: +2.4%
> latency standard error Baseline: 101.85 Test: 105.17 Difference: +3.3%
> average ops/second Baseline: 546531.56 Test: 537283.96 Difference: -1.7%
> BENCHMARK FAILED: org.apache.geode.benchmark.tests.ReplicatedFunctionExecutionBenchmark average latency is 5% worse than baseline.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)