You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by GitBox <gi...@apache.org> on 2021/10/11 07:23:53 UTC

[GitHub] [flink-benchmarks] dawidwys commented on pull request #34: [hotfix] Increase warmup iterations and iterations in CheckpointingTimeBenchmark

dawidwys commented on pull request #34:
URL: https://github.com/apache/flink-benchmarks/pull/34#issuecomment-939759529


   I don't know what could be a good measure of stability. The results from a couple of local runs of the `UNALIGNED` test:
   ```
   Benchmark                                              (mode)   Mode  Cnt    Score    Error  Units
   CheckpointingTimeBenchmark.checkpointSingleInput    UNALIGNED  thrpt   30  328.864 ± 20.784  ops/s
   
   Benchmark                                            (mode)   Mode  Cnt    Score    Error  Units
   CheckpointingTimeBenchmark.checkpointSingleInput  UNALIGNED  thrpt   30  336.844 ± 20.871  ops/s
   
   Benchmark                                            (mode)   Mode  Cnt    Score    Error  Units
   CheckpointingTimeBenchmark.checkpointSingleInput  UNALIGNED  thrpt   30  325.180 ± 17.333  ops/s
   
   Benchmark                                            (mode)   Mode  Cnt    Score    Error  Units
   CheckpointingTimeBenchmark.checkpointSingleInput  UNALIGNED  thrpt   30  341.993 ± 14.929  ops/s
   
   Benchmark                                            (mode)   Mode  Cnt    Score    Error  Units
   CheckpointingTimeBenchmark.checkpointSingleInput  UNALIGNED  thrpt   30  338.299 ± 17.544  ops/s
   ```
   
   The std dev decreased to ~5-6%


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org