You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Roman Khachatryan (Jira)" <ji...@apache.org> on 2020/08/28 15:56:00 UTC

[jira] [Comment Edited] (FLINK-19086) Performance regressin 2020-08-28 in globalWindow benchmark

    [ https://issues.apache.org/jira/browse/FLINK-19086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17186639#comment-17186639 ] 

Roman Khachatryan edited comment on FLINK-19086 at 8/28/20, 3:55 PM:
---------------------------------------------------------------------

Locally couldn't confirm:
{code:java}
642d4fe48c (Aug 26)
Benchmark                         Mode  Cnt     Score     Error   Units
WindowBenchmarks.globalWindow    thrpt   30  4580.346 ± 215.247  ops/ms
WindowBenchmarks.sessionWindow   thrpt   30   377.308 ±  40.897  ops/ms
WindowBenchmarks.slidingWindow   thrpt   30   448.708 ±  20.665  ops/ms
WindowBenchmarks.tumblingWindow  thrpt   30  3199.008 ±  43.838  ops/ms

e690793c6 (Aug 27)
Benchmark                         Mode  Cnt     Score     Error   Units
WindowBenchmarks.globalWindow    thrpt   30  4814.900 ± 100.372  ops/ms
WindowBenchmarks.sessionWindow   thrpt   30   590.319 ±   7.214  ops/ms
WindowBenchmarks.slidingWindow   thrpt   30   509.285 ±   4.370  ops/ms
WindowBenchmarks.tumblingWindow  thrpt   30  3014.359 ±  60.543  ops/ms
{code}
 


was (Author: roman_khachatryan):
Locally couldn't confirm:

 
{code:java}
642d4fe48c (Aug 26)
Benchmark                         Mode  Cnt     Score     Error   Units
WindowBenchmarks.globalWindow    thrpt   30  4580.346 ± 215.247  ops/ms
WindowBenchmarks.sessionWindow   thrpt   30   377.308 ±  40.897  ops/ms
WindowBenchmarks.slidingWindow   thrpt   30   448.708 ±  20.665  ops/ms
WindowBenchmarks.tumblingWindow  thrpt   30  3199.008 ±  43.838  ops/ms

e690793c6 (Aug 27)
Benchmark                         Mode  Cnt     Score     Error   Units
WindowBenchmarks.globalWindow    thrpt   30  4814.900 ± 100.372  ops/ms
WindowBenchmarks.sessionWindow   thrpt   30   590.319 ±   7.214  ops/ms
WindowBenchmarks.slidingWindow   thrpt   30   509.285 ±   4.370  ops/ms
WindowBenchmarks.tumblingWindow  thrpt   30  3014.359 ±  60.543  ops/ms
{code}
 

 

> Performance regressin 2020-08-28 in globalWindow benchmark
> ----------------------------------------------------------
>
>                 Key: FLINK-19086
>                 URL: https://issues.apache.org/jira/browse/FLINK-19086
>             Project: Flink
>          Issue Type: Bug
>          Components: Benchmarks, Runtime / Task
>    Affects Versions: 1.12.0
>            Reporter: Roman Khachatryan
>            Assignee: Roman Khachatryan
>            Priority: Major
>         Attachments: Screenshot_2020-08-28_09-58-31.png
>
>
> [http://codespeed.dak8s.net:8000/timeline/?ben=globalWindow&env=2]
> [http://codespeed.dak8s.net:8000/timeline/#/?exe=1,3&ben=tumblingWindow&env=2&revs=200&equid=off&quarts=on&extr=on] 
> The results started to decrease 2 days before decomissioning of an old jenkins node.
> The other tests, however, were stable.
>  
> cc: [~pnowojski]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)