You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@geode.apache.org by "Kamilla Aslami (Jira)" <ji...@apache.org> on 2021/11/23 17:44:00 UTC
[jira] [Resolved] (GEODE-9847) Benchmark instability in PartitionedPutLongBenchmark with security manager on support/1.14
[ https://issues.apache.org/jira/browse/GEODE-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kamilla Aslami resolved GEODE-9847.
-----------------------------------
Resolution: Duplicate
Closing this ticket as there’s not enough evidence to think that this issue is different from GEODE-9340. 1.14 and 1.15 haven’t diverged very far, so most likely this is the same issue popping up in a different place.
> Benchmark instability in PartitionedPutLongBenchmark with security manager on support/1.14
> ------------------------------------------------------------------------------------------
>
> Key: GEODE-9847
> URL: https://issues.apache.org/jira/browse/GEODE-9847
> Project: Geode
> Issue Type: Bug
> Components: benchmarks
> Affects Versions: 1.14.1
> Reporter: Kamilla Aslami
> Priority: Major
>
> PartitionedPutLongBenchmark failed in apache-support-1-14-main/benchmark-with-security-manager. This issue could have the same root cause as GEODE-9340, but GEODE-9340 fails on 1.15 and in another CI job (apache-develop-main/benchmark-base).
> {noformat}
> org.apache.geode.benchmark.tests.PartitionedPutLongBenchmark
> 05:20:08 average ops/second Baseline: 381785.31 Test: 351135.20 Difference: -8.0%
> 05:20:08 ops/second standard error Baseline: 2163.90 Test: 3115.81 Difference: +44.0%
> 05:20:08 ops/second standard deviation Baseline: 37417.40 Test: 53877.38 Difference: +44.0%
> 05:20:08 YS 99th percentile latency Baseline: 1606.00 Test: 1606.00 Difference: +0.0%
> 05:20:08 median latency Baseline: 1068031.00 Test: 1065983.00 Difference: -0.2%
> 05:20:08 90th percentile latency Baseline: 1364991.00 Test: 1356799.00 Difference: -0.6%
> 05:20:08 99th percentile latency Baseline: 7688191.00 Test: 8138751.00 Difference: +5.9%
> 05:20:08 99.9th percentile latency Baseline: 209584127.00 Test: 260964351.00 Difference: +24.5%
> 05:20:08 average latency Baseline: 1884576.09 Test: 2050262.70 Difference: +8.8%
> 05:20:08 latency standard deviation Baseline: 11587055.57 Test: 14728140.58 Difference: +27.1%
> 05:20:08 latency standard error Baseline: 1083.17 Test: 1435.92 Difference: +32.6%
> 05:20:08 average ops/second Baseline: 381621.08 Test: 350789.84 Difference: -8.1%
> 05:20:08BENCHMARK FAILED: org.apache.geode.benchmark.tests.PartitionedPutLongBenchmark average latency is 5% worse than baseline.
> 05:20:08{noformat}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)