You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@beam.apache.org by be...@gmail.com on 2024/07/23 11:03:50 UTC
Beam Metrics Report 2024-07-23
# Beam Metrics Report
Color legend: >= 20 | >= 10 | <= -10 | <= -20
---|---|---|---
## Possible regression
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
compressed_textioit_hdfs_results | read_time | - | 139.09 | 162.19 | 16.61 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_hdfs_results | write_time | - | 227.4 | 260.22 | 14.43 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
go_batch_combine_3 | dataflow_runtime | - | 65.42 | 74.97 | 14.58 |
go_batch_gbk_5 | dataflow_runtime | - | 39.87 | 44.44 | 11.48 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_pardo_1 | dataflow_runtime | - | 78.19 | 88.42 | 13.08 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_2 | flink_runtime | - | 3078.81 | 3408.24 | 10.7 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_3 | dataflow_runtime | - | 63.79 | 71.79 | 12.55 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_cogbk_1 | dataflow_runtime_sec | - | 44.49 | 50.34 | 13.17 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_combine_1 | sparkstructuredstreaming_runtime_sec | - | 206.06 |
237.98 | 15.49 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_gbk_1 | dataflow_v2_java11_runtime_sec | - | 75.34 | 85.82 | 13.92
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | dataflow_runtime_sec | - | 43.29 | 49.06 | 13.32 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_v2_java11_runtime_sec | - | 15.18 | 17.79 | 17.25
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | dataflow_v2_java11_runtime_sec | - | 24.35 | 28.66 | 17.71
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | dataflow_v2_java11_runtime_sec | - | 20.17 | 23.94 | 18.69
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | dataflow_v2_java17_runtime_sec | - | 18.63 | 24.36 | 30.75
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | dataflow_v2_java11_runtime_sec | - | 24.28 | 35.42 | 45.84
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_pardo_3 | dataflow_runtime_sec | - | 22.22 | 24.67 | 11.06 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | dataflow_v2_java11_runtime_sec | - | 14.42 | 18.55 |
28.69 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_4 | dataflow_v2_java11_runtime_sec | - | 25.68 | 39.32 | 53.1
| [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_gbk_6 | dataflow_v2_java17_runtime_sec | - | 152.19 | 170.08 |
11.75 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_pardo_1 | dataflow_runtime_sec | - | 29.45 | 32.49 | 10.3 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_1 | dataflow_v2_java17_runtime_sec | - | 24.3 | 29.81 |
22.7 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_2 | dataflow_v2_java17_runtime_sec | - | 108.42 | 120.49
| 11.13 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_3 | dataflow_v2_java17_runtime_sec | - | 23.97 | 33.84 |
41.18 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
kafkaioit_results | read_time | - | 318.5 | 458.34 | 43.9 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results | write_time | - | 167.05 | 188.39 | 12.78 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
mongodbioit_results | write_time | - | 66.18 | 73.68 | 11.34 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
python_batch_combine_2 | python_dataflow_batch_combine_2_runtime | - | 30.57 |
37.2 | 21.68 |
python_batch_combine_3 | python_dataflow_batch_combine_3_runtime | - | 23.71 |
35.2 | 48.43 |
python_batch_gbk_3 | python_dataflow_batch_gbk_3_runtime | - | 11.14 | 12.8 |
14.87 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_5 | python_dataflow_batch_gbk_5_runtime | - | 54.29 | 60.2 |
10.89 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_7 | python_dataflow_batch_gbk_7_runtime | - | 139.0 | 153.4 |
10.36 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_pardo_2 | python_dataflow_batch_pardo_2_runtime | - | 1281.71 |
1418.2 | 10.65 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_sideinput_2 | python_dataflow_batch_sideinput_2_runtime | - |
2.71 | 3.2 | 17.89 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_psio_2GB_results | pubsub_io_perf_read_runtime | - | 70.43 | 82.8 |
17.57 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_streaming_pardo_2 | python_dataflow_streaming_pardo_2_runtime | - |
2455.33 | 2757.0 | 12.29 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_textio_1GB_results | write_runtime | - | 208.86 | 232.8 | 11.46 |
[[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
singlestoreioit_results | read_time | - | 80.19 | 99.69 | 24.32 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_hdfs_results | read_time | - | 15.69 | 17.64 | 12.41 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
tfrecordioit_results | write_time | - | 22.9 | 25.63 | 11.9 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
nexmark_0_sql_streaming | RuntimeMs | FlinkRunner | 3777.39 | 4503.77 | 19.23
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_zetasql_batch | RuntimeMs | SparkRunner | 5536.75 | 6186.64 | 11.74
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_12_streaming | RuntimeMs | FlinkRunner | 994.71 | 1156.05 | 16.22 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_batch | RuntimeMs | DirectRunner | 9039.0 | 10404.32 | 15.1 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_batch | RuntimeMs | FlinkRunner | 592.0 | 663.77 | 12.12 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_streaming | RuntimeMs | FlinkRunner | 5132.18 | 5685.68 | 10.78
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_zetasql_streaming | RuntimeMs | DirectRunner | 70911.54 | 80233.27
| 13.15 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_14_batch | RuntimeMs | FlinkRunner | 857.04 | 974.41 | 13.7 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_16_batch | RuntimeMs | SparkRunner | 2065.75 | 2304.09 | 11.54 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_1_batch | RuntimeMs | FlinkRunner | 663.25 | 740.64 | 11.67 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_sql_streaming | RuntimeMs | FlinkRunner | 1918.46 | 2175.77 | 13.41
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_batch | RuntimeMs | FlinkRunner | 277.32 | 313.59 | 13.08 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_batch | RuntimeMs | SparkRunner | 887.96 | 994.05 | 11.95 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_sql_streaming | RuntimeMs | FlinkRunner | 1112.46 | 1248.59 | 12.24
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_streaming | RuntimeMs | DirectRunner | 25578.54 | 28500.91 |
11.43 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_sql_streaming | RuntimeMs | FlinkRunner | 1826.68 | 2147.45 | 17.56
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_zetasql_streaming | RuntimeMs | DirectRunner | 24421.93 | 29500.5 |
20.8 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_7_sql_batch | RuntimeMs | SparkRunner | 12640.54 | 14141.64 | 11.88 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_sql_streaming | RuntimeMs | DirectRunner | 4412831.5 | 6478084.57 |
46.8 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
## Possible improvement
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
java_batch_cogbk_3 | dataflow_v2_java11_runtime_sec | - | 23.67 | 21.2 |
-10.44 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | dataflow_runtime_sec | - | 23.04 | 19.75 | -14.3 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_combine_2 | dataflow_runtime_sec | - | 44.95 | 31.91 | -29.0 |
java_batch_combine_3 | dataflow_runtime_sec | - | 47.17 | 35.52 | -24.7 |
java_batch_gbk_1 | dataflow_runtime_sec | - | 165.93 | 139.92 | -15.67 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_1 | dataflow_v2_java17_runtime_sec | - | 93.19 | 81.35 | -12.7
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_runtime_sec | - | 21.55 | 15.32 | -28.94 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_v2_java17_runtime_sec | - | 13.63 | 12.03 | -11.74
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | sparkstructuredstreaming_runtime_sec | - | 16.24 | 13.59 |
-16.32 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | dataflow_runtime_sec | - | 31.25 | 26.15 | -16.3 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | sparkstructuredstreaming_runtime_sec | - | 61.03 | 52.85 |
-13.4 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | sparkstructuredstreaming_runtime_sec | - | 39.55 | 33.95 |
-14.16 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | dataflow_v2_java17_runtime_sec | - | 42.48 | 36.26 | -14.65
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_pardo_1 | dataflow_v2_java11_runtime_sec | - | 15.66 | 12.6 | -19.5
| [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_2 | dataflow_runtime_sec | - | 262.41 | 227.33 | -13.37 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_2 | sparkstructuredstreaming_runtime_sec | - | 54.68 | 44.53
| -18.55 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | dataflow_v2_java17_runtime_sec | - | 18.25 | 13.78 |
-24.49 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_4 | sparkstructuredstreaming_runtime_sec | - | 42.3 | 32.53 |
-23.1 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_gbk_3 | dataflow_v2_java11_runtime_sec | - | 51.08 | 39.34 |
-22.97 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_4 | dataflow_v2_java11_runtime_sec | - | 1114.35 | 603.66 |
-45.83 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_4 | dataflow_v2_java17_runtime_sec | - | 677.78 | 581.88 |
-14.15 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_5 | dataflow_v2_java11_runtime_sec | - | 598.84 | 531.02 |
-11.33 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_5 | dataflow_v2_java17_runtime_sec | - | 692.49 | 593.41 |
-14.31 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_7 | dataflow_v2_java17_runtime_sec | - | 261.14 | 219.11 |
-16.09 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_pardo_1 | dataflow_v2_java11_runtime_sec | - | 32.63 | 26.31 |
-19.38 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_3 | dataflow_v2_java11_runtime_sec | - | 32.95 | 27.11 |
-17.71 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_4 | dataflow_v2_java11_runtime_sec | - | 51.97 | 42.09 |
-19.0 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
jdbcioit_results | read_time | - | 29.5 | 25.56 | -13.34 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
python_batch_combine_1 | python_flink_batch_combine_1_runtime | - | 3170.5 |
2716.4 | -14.32 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_pardo_1 | python_flink_batch_pardo_1_runtime | - | 764.0 | 641.8
| -15.99 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_4 | python_flink_batch_pardo_4_runtime | - | 2416.33 |
2105.0 | -12.88 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_sideinput_4 | python_dataflow_batch_sideinput_4_runtime | - |
34.43 | 29.8 | -13.44 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_5 | python_dataflow_batch_sideinput_5_runtime | - |
3.14 | 2.8 | -10.91 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_6 | python_dataflow_batch_sideinput_6_runtime | - | 3.0
| 2.4 | -20.0 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_streaming_cogbk_3 | python_dataflow_streaming_cogbk_3_runtime | - |
252.29 | 214.4 | -15.02 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_gbk_3 | python_dataflow_streaming_gbk_3_runtime | - | 61.17 |
44.8 | -26.76 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_pardo_1 | python_dataflow_streaming_pardo_1_runtime | - |
198.33 | 164.4 | -17.11 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_3 | python_flink_streaming_pardo_3_runtime | - | 440.14
| 388.0 | -11.85 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_4 | python_flink_streaming_pardo_4_runtime | - |
1089.14 | 980.0 | -10.02 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_6 | python_flink_streaming_pardo_6_runtime | - | 562.57
| 492.0 | -12.54 |
tfrecordioit_results | read_time | - | 21.79 | 18.15 | -16.68 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_hdfs_results | write_time | - | 27.21 | 23.04 | -15.35 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
nexmark_0_batch | RuntimeMs | DirectRunner | 10996.39 | 9783.59 | -11.03 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_zetasql_batch | RuntimeMs | FlinkRunner | 3991.46 | 3561.05 | -10.78
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_batch | RuntimeMs | SparkStructuredStreamingRunner | 1277.57 |
1105.09 | -13.5 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_batch | RuntimeMs | SparkStructuredStreamingRunner | 2080.21 |
1404.77 | -32.47 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_streaming | RuntimeMs | DirectRunner | 29723.74 | 26078.95 | -12.26
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_zetasql_batch | RuntimeMs | DirectRunner | 23462.46 | 18589.05 |
-20.77 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_14_streaming | RuntimeMs | DirectRunner | 30068.93 | 26211.95 | -12.83
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_15_batch | RuntimeMs | SparkStructuredStreamingRunner | 1729.0 |
1526.05 | -11.74 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_16_batch | RuntimeMs | SparkStructuredStreamingRunner | 945.89 |
848.41 | -10.31 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_batch | RuntimeMs | DirectRunner | 9539.64 | 8270.55 | -13.3 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_batch | RuntimeMs | SparkStructuredStreamingRunner | 418.18 | 371.45
| -11.17 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_streaming | RuntimeMs | FlinkRunner | 716.25 | 630.09 | -12.03 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_zetasql_batch | RuntimeMs | DirectRunner | 7186.68 | 5974.59 |
-16.87 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_zetasql_batch | RuntimeMs | FlinkRunner | 1862.39 | 1604.32 | -13.86
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_zetasql_batch | RuntimeMs | DirectRunner | 9966.89 | 8187.45 |
-17.85 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_6_streaming | RuntimeMs | DataflowRunner | 40569.61 | 36128.0 | -10.95
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_6_streaming | RuntimeMs | FlinkRunner | 599.93 | 497.14 | -17.13 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_streaming | RuntimeMs | FlinkRunner | 1034.61 | 862.45 | -16.64 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_9_batch | RuntimeMs | SparkRunner | 950.14 | 809.41 | -14.81 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
tpcds_query52_Calcite_1GB | RuntimeMs | FlinkRunner | 18055.43 | 16009.86 |
-11.33 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
## All metrics
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
avroioit_hdfs_results | read_time | - | 98.1 | 94.12 | -4.06 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_hdfs_results | write_time | - | 136.46 | 134.38 | -1.53 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_results | read_time | - | 98.58 | 97.31 | -1.29 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_results | write_time | - | 134.51 | 136.16 | 1.23 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_avro | avro_write_time | - | 32.09 | 33.19 | 3.44
| [[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_avro | read_time | - | 42.12 | 41.71 | -0.97 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_json | read_time | - | 43.57 | 41.8 | -4.06 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_json | write_time | - | 57.65 | 56.32 | -2.32 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_stream | read_time | - | 42.56 | 40.72 | -4.32 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_stream | write_time | - | 217.62 | 206.58 | -5.07 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
cdapioit_results | read_time | - | 17.75 | 16.63 | -6.32 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
cdapioit_results | write_time | - | 27.1 | 25.61 | -5.53 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
cloudml_benchmark_cirteo_no_shuffle_10GB | runtime_sec | - | 2599.12 | 2668.56
| 2.67 | [[1]](http://metrics.beam.apache.org/d/C9nj1oxVk)
cloudml_benchmark_criteo_10GB | runtime_sec | - | 2459.7 | 2473.51 | 0.56 |
[[1]](http://metrics.beam.apache.org/d/C9nj1oxVk)
cloudml_benchmark_criteo_small | runtime_sec | - | 1009.64 | 981.99 | -2.74 |
compressed_textioit_hdfs_results | read_time | - | 139.09 | 162.19 | 16.61 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_hdfs_results | write_time | - | 227.4 | 260.22 | 14.43 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_results | read_time | - | 150.82 | 150.48 | -0.23 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_results | write_time | - | 234.83 | 241.37 | 2.79 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
go_batch_cogbk_1 | dataflow_runtime | - | 236.28 | 221.6 | -6.21 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_cogbk_2 | dataflow_runtime | - | 138.24 | 139.56 | 0.95 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_cogbk_3 | dataflow_runtime | - | 107.79 | 111.14 | 3.11 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_cogbk_4 | dataflow_runtime | - | 106.86 | 113.9 | 6.59 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_combine_1 | dataflow_runtime | - | 437.67 | 438.16 | 0.11 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
go_batch_combine_2 | dataflow_runtime | - | 77.49 | 71.87 | -7.25 |
go_batch_combine_3 | dataflow_runtime | - | 65.42 | 74.97 | 14.58 |
go_batch_gbk_1 | dataflow_runtime | - | 376.11 | 385.53 | 2.5 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_2 | dataflow_runtime | - | 93.07 | 96.81 | 4.01 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_3 | dataflow_runtime | - | 25.54 | 25.5 | -0.13 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_4 | dataflow_runtime | - | 52.11 | 50.77 | -2.58 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_5 | dataflow_runtime | - | 39.87 | 44.44 | 11.48 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_6 | dataflow_runtime | - | 97.47 | 102.63 | 5.29 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_7 | dataflow_runtime | - | 105.27 | 105.09 | -0.17 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_pardo_1 | dataflow_runtime | - | 78.19 | 88.42 | 13.08 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_1 | flink_runtime | - | 378.93 | 405.53 | 7.02 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_2 | dataflow_runtime | - | 668.61 | 691.73 | 3.46 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_2 | flink_runtime | - | 3078.81 | 3408.24 | 10.7 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_3 | dataflow_runtime | - | 63.79 | 71.79 | 12.55 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_3 | flink_runtime | - | 270.64 | 280.28 | 3.56 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_4 | dataflow_runtime | - | 70.48 | 67.03 | -4.9 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_4 | flink_runtime | - | 305.71 | 316.96 | 3.68 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_sideinput_1 | dataflow_runtime | - | 3.43 | 3.3 | -3.91 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
go_batch_sideinput_2 | dataflow_runtime | - | 284.84 | 263.46 | -7.5 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
hadoopformatioit_results | read_time | - | 15.11 | 15.92 | 5.34 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
hadoopformatioit_results | write_time | - | 24.62 | 25.6 | 3.97 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
java_batch_cogbk_1 | dataflow_runtime_sec | - | 44.49 | 50.34 | 13.17 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_1 | dataflow_v2_java11_runtime_sec | - | 49.55 | 45.47 |
-8.25 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_1 | dataflow_v2_java17_runtime_sec | - | 45.37 | 49.58 | 9.27
| [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_1 | sparkstructuredstreaming_runtime_sec | - | 64.82 | 63.2 |
-2.5 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | dataflow_runtime_sec | - | 46.73 | 45.66 | -2.28 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | dataflow_v2_java11_runtime_sec | - | 45.31 | 48.02 | 5.98
| [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | dataflow_v2_java17_runtime_sec | - | 47.13 | 49.42 | 4.85
| [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | sparkstructuredstreaming_runtime_sec | - | 65.41 | 62.91
| -3.83 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | dataflow_runtime_sec | - | 23.32 | 22.14 | -5.07 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | dataflow_v2_java11_runtime_sec | - | 23.67 | 21.2 |
-10.44 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | dataflow_v2_java17_runtime_sec | - | 23.73 | 21.62 |
-8.91 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | sparkstructuredstreaming_runtime_sec | - | 14.04 | 12.94
| -7.81 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | dataflow_runtime_sec | - | 23.04 | 19.75 | -14.3 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | dataflow_v2_java11_runtime_sec | - | 21.44 | 20.27 |
-5.47 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | dataflow_v2_java17_runtime_sec | - | 21.77 | 21.06 |
-3.25 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | sparkstructuredstreaming_runtime_sec | - | 14.58 | 13.99
| -4.04 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_combine_1 | dataflow_runtime_sec | - | 75.73 | 79.72 | 5.27 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_1 | sparkstructuredstreaming_runtime_sec | - | 206.06 |
237.98 | 15.49 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_2 | dataflow_runtime_sec | - | 44.95 | 31.91 | -29.0 |
java_batch_combine_2 | sparkstructuredstreaming_runtime_sec | - | 51.77 |
54.96 | 6.16 |
java_batch_combine_3 | dataflow_runtime_sec | - | 47.17 | 35.52 | -24.7 |
java_batch_combine_3 | sparkstructuredstreaming_runtime_sec | - | 47.97 |
52.22 | 8.85 |
java_batch_gbk_1 | dataflow_runtime_sec | - | 165.93 | 139.92 | -15.67 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_1 | dataflow_v2_java11_runtime_sec | - | 75.34 | 85.82 | 13.92
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_1 | dataflow_v2_java17_runtime_sec | - | 93.19 | 81.35 | -12.7
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_1 | sparkstructuredstreaming_runtime_sec | - | 291.39 | 264.05
| -9.38 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | dataflow_runtime_sec | - | 43.29 | 49.06 | 13.32 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | dataflow_v2_java11_runtime_sec | - | 38.04 | 38.2 | 0.43 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | dataflow_v2_java17_runtime_sec | - | 39.68 | 38.45 | -3.12
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | sparkstructuredstreaming_runtime_sec | - | 88.49 | 80.87 |
-8.61 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_runtime_sec | - | 21.55 | 15.32 | -28.94 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_v2_java11_runtime_sec | - | 15.18 | 17.79 | 17.25
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_v2_java17_runtime_sec | - | 13.63 | 12.03 | -11.74
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | sparkstructuredstreaming_runtime_sec | - | 16.24 | 13.59 |
-16.32 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | dataflow_runtime_sec | - | 31.25 | 26.15 | -16.3 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | dataflow_v2_java11_runtime_sec | - | 24.35 | 28.66 | 17.71
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | dataflow_v2_java17_runtime_sec | - | 24.39 | 21.99 | -9.86
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | sparkstructuredstreaming_runtime_sec | - | 61.03 | 52.85 |
-13.4 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | dataflow_runtime_sec | - | 27.0 | 24.86 | -7.9 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | dataflow_v2_java11_runtime_sec | - | 20.17 | 23.94 | 18.69
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | dataflow_v2_java17_runtime_sec | - | 18.63 | 24.36 | 30.75
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | sparkstructuredstreaming_runtime_sec | - | 49.7 | 51.67 |
3.96 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | dataflow_runtime_sec | - | 43.67 | 45.23 | 3.57 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | dataflow_v2_java11_runtime_sec | - | 24.28 | 35.42 | 45.84
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | dataflow_v2_java17_runtime_sec | - | 26.57 | 28.7 | 8.0 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | sparkstructuredstreaming_runtime_sec | - | 39.55 | 33.95 |
-14.16 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | dataflow_runtime_sec | - | 51.38 | 49.23 | -4.17 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | dataflow_v2_java11_runtime_sec | - | 35.21 | 33.16 | -5.83
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | dataflow_v2_java17_runtime_sec | - | 42.48 | 36.26 | -14.65
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | sparkstructuredstreaming_runtime_sec | - | 49.71 | 51.16 |
2.92 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_pardo_1 | dataflow_runtime_sec | - | 28.38 | 28.98 | 2.12 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_1 | dataflow_v2_java11_runtime_sec | - | 15.66 | 12.6 | -19.5
| [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_1 | dataflow_v2_java17_runtime_sec | - | 14.79 | 13.89 |
-6.04 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_1 | sparkstructuredstreaming_runtime_sec | - | 13.38 | 12.5 |
-6.58 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_2 | dataflow_runtime_sec | - | 262.41 | 227.33 | -13.37 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_2 | dataflow_v2_java11_runtime_sec | - | 65.6 | 63.17 | -3.7
| [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_2 | dataflow_v2_java17_runtime_sec | - | 71.49 | 67.33 |
-5.83 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_2 | sparkstructuredstreaming_runtime_sec | - | 54.68 | 44.53
| -18.55 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | dataflow_runtime_sec | - | 22.22 | 24.67 | 11.06 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | dataflow_v2_java11_runtime_sec | - | 14.42 | 18.55 |
28.69 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | dataflow_v2_java17_runtime_sec | - | 18.25 | 13.78 |
-24.49 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | sparkstructuredstreaming_runtime_sec | - | 12.76 | 12.57
| -1.53 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_4 | dataflow_runtime_sec | - | 34.52 | 35.64 | 3.24 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_4 | dataflow_v2_java11_runtime_sec | - | 25.68 | 39.32 | 53.1
| [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_4 | dataflow_v2_java17_runtime_sec | - | 31.46 | 30.14 |
-4.18 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_4 | sparkstructuredstreaming_runtime_sec | - | 42.3 | 32.53 |
-23.1 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_cogbk_1 | dataflow_runtime_sec | - | 821.33 | 851.65 | 3.69 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_1 | dataflow_v2_java11_runtime_sec | - | 859.73 | 844.44
| -1.78 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_1 | dataflow_v2_java17_runtime_sec | - | 845.98 | 839.82
| -0.73 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_2 | dataflow_runtime_sec | - | 865.7 | 852.76 | -1.49 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_2 | dataflow_v2_java11_runtime_sec | - | 828.8 | 874.11 |
5.47 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_2 | dataflow_v2_java17_runtime_sec | - | 829.15 | 872.31
| 5.21 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_3 | dataflow_runtime_sec | - | 131.36 | 128.02 | -2.54 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_3 | dataflow_v2_java11_runtime_sec | - | 123.43 | 128.79
| 4.34 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_3 | dataflow_v2_java17_runtime_sec | - | 124.45 | 123.7 |
-0.6 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_4 | dataflow_runtime_sec | - | 126.19 | 121.1 | -4.03 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_4 | dataflow_v2_java11_runtime_sec | - | 127.72 | 120.85
| -5.37 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_4 | dataflow_v2_java17_runtime_sec | - | 123.19 | 121.82
| -1.11 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_combine_1 | dataflow_runtime_sec | - | 523.03 | 523.95 | 0.18 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_combine_2 | dataflow_runtime_sec | - | 281.9 | 273.12 | -3.11 |
java_streaming_combine_3 | dataflow_runtime_sec | - | 287.26 | 268.71 | -6.46
|
java_streaming_gbk_1 | dataflow_runtime_sec | - | 746.71 | 705.26 | -5.55 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_1 | dataflow_v2_java11_runtime_sec | - | 945.11 | 895.57 |
-5.24 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_1 | dataflow_v2_java17_runtime_sec | - | 1025.06 | 968.49 |
-5.52 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_2 | dataflow_runtime_sec | - | 768.73 | 757.19 | -1.5 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_2 | dataflow_v2_java11_runtime_sec | - | 3007.09 | 2899.09
| -3.59 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_2 | dataflow_v2_java17_runtime_sec | - | 2873.68 | 2769.98
| -3.61 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_3 | dataflow_runtime_sec | - | 25.96 | 27.73 | 6.82 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_3 | dataflow_v2_java11_runtime_sec | - | 51.08 | 39.34 |
-22.97 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_3 | dataflow_v2_java17_runtime_sec | - | 47.28 | 45.13 |
-4.55 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_4 | dataflow_runtime_sec | - | 266.79 | 271.91 | 1.92 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_4 | dataflow_v2_java11_runtime_sec | - | 1114.35 | 603.66 |
-45.83 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_4 | dataflow_v2_java17_runtime_sec | - | 677.78 | 581.88 |
-14.15 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_5 | dataflow_runtime_sec | - | 273.4 | 266.84 | -2.4 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_5 | dataflow_v2_java11_runtime_sec | - | 598.84 | 531.02 |
-11.33 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_5 | dataflow_v2_java17_runtime_sec | - | 692.49 | 593.41 |
-14.31 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_6 | dataflow_runtime_sec | - | 80.15 | 82.78 | 3.28 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_6 | dataflow_v2_java11_runtime_sec | - | 174.98 | 168.81 |
-3.53 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_6 | dataflow_v2_java17_runtime_sec | - | 152.19 | 170.08 |
11.75 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_7 | dataflow_runtime_sec | - | 137.64 | 132.56 | -3.7 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_7 | dataflow_v2_java11_runtime_sec | - | 218.6 | 232.32 |
6.28 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_7 | dataflow_v2_java17_runtime_sec | - | 261.14 | 219.11 |
-16.09 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_pardo_1 | dataflow_runtime_sec | - | 29.45 | 32.49 | 10.3 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_1 | dataflow_v2_java11_runtime_sec | - | 32.63 | 26.31 |
-19.38 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_1 | dataflow_v2_java17_runtime_sec | - | 24.3 | 29.81 |
22.7 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_2 | dataflow_runtime_sec | - | 327.39 | 315.09 | -3.76 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_2 | dataflow_v2_java11_runtime_sec | - | 113.04 | 103.87
| -8.12 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_2 | dataflow_v2_java17_runtime_sec | - | 108.42 | 120.49
| 11.13 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_3 | dataflow_runtime_sec | - | 17.98 | 18.28 | 1.64 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_3 | dataflow_v2_java11_runtime_sec | - | 32.95 | 27.11 |
-17.71 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_3 | dataflow_v2_java17_runtime_sec | - | 23.97 | 33.84 |
41.18 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_4 | dataflow_runtime_sec | - | 33.01 | 34.49 | 4.49 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_4 | dataflow_v2_java11_runtime_sec | - | 51.97 | 42.09 |
-19.0 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_4 | dataflow_v2_java17_runtime_sec | - | 47.43 | 42.72 |
-9.94 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
jdbcioit_results | read_time | - | 29.5 | 25.56 | -13.34 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
jdbcioit_results | write_time | - | 43.01 | 43.01 | -0.02 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results | read_time | - | 318.5 | 458.34 | 43.9 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results | write_time | - | 167.05 | 188.39 | 12.78 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results_runner_v2 | read_time | - | 1324.84 | 1277.97 | -3.54 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results_runner_v2 | write_time | - | 204.13 | 197.91 | -3.05 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_hdfs_results | read_time | - | 14.03 | 15.36 | 9.54 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_hdfs_results | write_time | - | 67.37 | 69.39 | 2.99 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_results | read_time | - | 23.97 | 24.28 | 1.32 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_results | write_time | - | 60.11 | 60.18 | 0.12 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
ml_transform_large_movie_review_dataset_process_metrics | runtime_sec | - |
1385.3 | 1344.37 | -2.95 |
mongodbioit_results | read_time | - | 35.56 | 36.18 | 1.77 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
mongodbioit_results | write_time | - | 66.18 | 73.68 | 11.34 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
null_default | read_time | - | 60.19 | 61.88 | 2.8 |
null_directread | read_time | - | 50.31 | 51.7 | 2.78 |
null_directread_pushdown | read_time | - | 10.36 | 10.62 | 2.46 |
parquetioit_hdfs_results | read_time | - | 91.56 | 90.25 | -1.43 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_hdfs_results | write_time | - | 138.69 | 135.48 | -2.31 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_results | read_time | - | 96.97 | 96.02 | -0.98 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_results | write_time | - | 151.87 | 152.31 | 0.29 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
python_batch_cogbk_1 | python_dataflow_batch_cogbk_1_runtime | - | 292.14 |
285.2 | -2.38 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_1 | python_flink_batch_cogbk_1_runtime | - | 3846.33 |
3726.4 | -3.12 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_2 | python_dataflow_batch_cogbk_2_runtime | - | 143.14 |
142.8 | -0.24 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_2 | python_flink_batch_cogbk_2_runtime | - | 3760.08 |
3682.6 | -2.06 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_3 | python_dataflow_batch_cogbk_3_runtime | - | 116.43 |
120.0 | 3.07 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_4 | python_dataflow_batch_cogbk_4_runtime | - | 118.71 |
121.6 | 2.43 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_combine_1 | python_dataflow_batch_combine_1_runtime | - | 443.71
| 485.0 | 9.3 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_1 | python_flink_batch_combine_1_runtime | - | 3170.5 |
2716.4 | -14.32 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_2 | python_dataflow_batch_combine_2_runtime | - | 30.57 |
37.2 | 21.68 |
python_batch_combine_3 | python_dataflow_batch_combine_3_runtime | - | 23.71 |
35.2 | 48.43 |
python_batch_combine_4 | python_flink_batch_combine_4_runtime | - | 137.0 |
131.8 | -3.8 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_5 | python_flink_batch_combine_5_runtime | - | 140.0 |
146.2 | 4.43 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_gbk_1 | python_dataflow_batch_gbk_1_runtime | - | 1031.57 |
1081.6 | 4.85 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_2 | python_dataflow_batch_gbk_2_runtime | - | 205.29 | 211.8
| 3.17 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_3 | python_dataflow_batch_gbk_3_runtime | - | 11.14 | 12.8 |
14.87 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_4 | python_dataflow_batch_gbk_4_runtime | - | 70.29 | 73.2 |
4.15 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_5 | python_dataflow_batch_gbk_5_runtime | - | 54.29 | 60.2 |
10.89 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_6 | python_dataflow_batch_gbk_6_runtime | - | 137.86 | 141.4
| 2.57 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_7 | python_dataflow_batch_gbk_7_runtime | - | 139.0 | 153.4 |
10.36 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_pardo_1 | python_dataflow_batch_pardo_1_runtime | - | 113.43 |
108.8 | -4.08 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_1 | python_flink_batch_pardo_1_runtime | - | 764.0 | 641.8
| -15.99 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_2 | python_dataflow_batch_pardo_2_runtime | - | 1281.71 |
1418.2 | 10.65 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_3 | python_dataflow_batch_pardo_3_runtime | - | 92.14 |
89.8 | -2.54 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_4 | python_dataflow_batch_pardo_4_runtime | - | 286.86 |
287.2 | 0.12 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_4 | python_flink_batch_pardo_4_runtime | - | 2416.33 |
2105.0 | -12.88 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_sideinput_1 | python_dataflow_batch_sideinput_1_runtime | - | 3.0
| 3.0 | 0.0 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_10 | python_dataflow_batch_sideinput_10_runtime | - |
990.57 | 962.6 | -2.82 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_2 | python_dataflow_batch_sideinput_2_runtime | - |
2.71 | 3.2 | 17.89 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_3 | python_dataflow_batch_sideinput_3_runtime | - |
3.43 | 3.6 | 5.0 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_4 | python_dataflow_batch_sideinput_4_runtime | - |
34.43 | 29.8 | -13.44 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_5 | python_dataflow_batch_sideinput_5_runtime | - |
3.14 | 2.8 | -10.91 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_6 | python_dataflow_batch_sideinput_6_runtime | - | 3.0
| 2.4 | -20.0 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_7 | python_dataflow_batch_sideinput_7_runtime | - |
123.14 | 112.2 | -8.89 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_8 | python_dataflow_batch_sideinput_8_runtime | - |
114.43 | 108.2 | -5.44 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_9 | python_dataflow_batch_sideinput_9_runtime | - |
1082.0 | 1156.0 | 6.84 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_bqio_read_10GB_results | bqio_read_10GB_results_runtime | - | 106.43 |
111.17 | 4.45 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_bqio_write_10GB_results | bqio_write_10GB_results_runtime | - | 227.0 |
210.5 | -7.27 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_direct_microbenchmarks | fn_api_runner_microbenchmark_runtime_sec | - |
500.45 | 517.72 | 3.45 |
python_direct_microbenchmarks | teststream_microbenchmark_runtime_sec | - |
327.49 | 326.86 | -0.19 |
python_psio_2GB_results | pubsub_io_perf_read_runtime | - | 70.43 | 82.8 |
17.57 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_psio_2GB_results | pubsub_io_perf_write_runtime | - | 93.57 | 97.5 |
4.2 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_spanner_write_2GB_results | pyspanner_write_2GB_results_runtime | - |
1147.0 | 1161.6 | 1.27 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_spannerio_read_2GB_results | pyspanner_read_2GB_results_runtime | - |
27.86 | 27.33 | -1.88 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_streaming_cogbk_1 | python_dataflow_streaming_cogbk_1_runtime | - |
546.29 | 543.2 | -0.56 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_2 | python_dataflow_streaming_cogbk_2_runtime | - |
225.71 | 243.0 | 7.66 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_3 | python_dataflow_streaming_cogbk_3_runtime | - |
252.29 | 214.4 | -15.02 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_4 | python_dataflow_streaming_cogbk_4_runtime | - |
168.29 | 153.8 | -8.61 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_combine_1 | python_dataflow_streaming_combine_1_runtime | - |
7428.43 | 7203.0 | -3.03 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_streaming_combine_4 | python_dataflow_streaming_combine_4_runtime | - |
1594.29 | 1529.67 | -4.05 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_streaming_combine_5 | python_dataflow_streaming_combine_5_runtime | - |
997.86 | 920.5 | -7.75 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_streaming_gbk_3 | python_dataflow_streaming_gbk_3_runtime | - | 61.17 |
44.8 | -26.76 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_gbk_6 | python_dataflow_streaming_gbk_6_runtime | - | 320.14
| 327.4 | 2.27 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_gbk_7 | python_dataflow_streaming_gbk_7_runtime | - | 392.0 |
361.6 | -7.76 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_pardo_1 | python_dataflow_streaming_pardo_1_runtime | - |
198.33 | 164.4 | -17.11 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_1 | python_flink_streaming_pardo_5_runtime | - | 311.43
| 309.0 | -0.78 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_2 | python_dataflow_streaming_pardo_2_runtime | - |
2455.33 | 2757.0 | 12.29 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_2 | python_flink_streaming_pardo_2_runtime | - |
12072.57 | 11328.0 | -6.17 | [[1]](http://metrics.beam.apache.org/d/MOi-
kf3Zk)
python_streaming_pardo_3 | python_dataflow_streaming_pardo_3_runtime | - |
115.0 | 109.8 | -4.52 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_3 | python_flink_streaming_pardo_3_runtime | - | 440.14
| 388.0 | -11.85 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_4 | python_dataflow_streaming_pardo_4_runtime | - |
1536.33 | 1506.2 | -1.96 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_4 | python_flink_streaming_pardo_4_runtime | - |
1089.14 | 980.0 | -10.02 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_6 | python_flink_streaming_pardo_6_runtime | - | 562.57
| 492.0 | -12.54 |
python_textio_1GB_results | read_runtime | - | 106.0 | 95.8 | -9.62 |
[[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_textio_1GB_results | write_runtime | - | 208.86 | 232.8 | 11.46 |
[[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
singlestoreioit_results | read_time | - | 80.19 | 99.69 | 24.32 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
singlestoreioit_results | write_time | - | 29.09 | 29.38 | 0.97 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
sparkreceiverioit_results | read_time | - | 771.54 | 766.34 | -0.67 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_hdfs_results | read_time | - | 15.69 | 17.64 | 12.41 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_hdfs_results | write_time | - | 34.17 | 33.91 | -0.74 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_results | read_time | - | 17.98 | 16.85 | -6.29 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_results | write_time | - | 29.88 | 29.35 | -1.78 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
tfrecordioit_results | read_time | - | 21.79 | 18.15 | -16.68 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
tfrecordioit_results | write_time | - | 22.9 | 25.63 | 11.9 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
wordcount_py38_results | runtime | - | 1474.6 | 1483.27 | 0.59 |
xmlioit_hdfs_results | read_time | - | 22.27 | 21.2 | -4.8 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_hdfs_results | write_time | - | 27.21 | 23.04 | -15.35 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_results | read_time | - | 24.96 | 24.94 | -0.08 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_results | write_time | - | 23.2 | 24.8 | 6.86 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
nexmark_0_batch | RuntimeMs | DataflowRunner | 28412.27 | 29590.08 | 4.15 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_batch | RuntimeMs | DirectRunner | 10996.39 | 9783.59 | -11.03 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_batch | RuntimeMs | FlinkRunner | 2465.75 | 2380.36 | -3.46 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_batch | RuntimeMs | SparkRunner | 1999.64 | 1964.41 | -1.76 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_batch | RuntimeMs | SparkStructuredStreamingRunner | 2051.79 |
1848.14 | -9.93 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_sql_batch | RuntimeMs | DataflowRunner | 33771.0 | 34515.11 | 2.2 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_sql_batch | RuntimeMs | DirectRunner | 14446.07 | 13750.91 | -4.81 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_sql_batch | RuntimeMs | FlinkRunner | 2235.54 | 2018.05 | -9.73 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_sql_batch | RuntimeMs | SparkRunner | 4211.0 | 4009.0 | -4.8 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 2467.89 |
2456.36 | -0.47 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_sql_streaming | RuntimeMs | DataflowRunner | 29089.86 | 29208.82 |
0.41 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_sql_streaming | RuntimeMs | DirectRunner | 46535.73 | 44215.93 |
-4.98 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_sql_streaming | RuntimeMs | FlinkRunner | 3777.39 | 4503.77 | 19.23
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_streaming | RuntimeMs | DataflowRunner | 25905.11 | 26210.52 | 1.18
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_streaming | RuntimeMs | DirectRunner | 32410.07 | 32235.48 | -0.54 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_streaming | RuntimeMs | FlinkRunner | 3648.32 | 3396.95 | -6.89 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_zetasql_batch | RuntimeMs | DataflowRunner | 121980.54 | 121862.57 |
-0.1 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_zetasql_batch | RuntimeMs | DirectRunner | 15983.82 | 14440.91 |
-9.65 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_zetasql_batch | RuntimeMs | FlinkRunner | 3991.46 | 3561.05 | -10.78
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_batch | RuntimeMs | SparkRunner | 5536.75 | 6186.64 | 11.74
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_zetasql_batch | RuntimeMs | SparkStructuredStreamingRunner | 3696.64
| 3702.0 | 0.14 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_streaming | RuntimeMs | DataflowRunner | 74473.0 | 73360.25
| -1.49 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_zetasql_streaming | RuntimeMs | DirectRunner | 54342.18 | 57028.0 |
4.94 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_streaming | RuntimeMs | FlinkRunner | 6181.81 | 6274.14 |
1.49 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_batch | RuntimeMs | DataflowRunner | 45030.15 | 44747.92 | -0.63 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_10_batch | RuntimeMs | DirectRunner | 30848.75 | 32456.82 | 5.21 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_batch | RuntimeMs | FlinkRunner | 977.14 | 920.23 | -5.82 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_batch | RuntimeMs | SparkRunner | 1280.68 | 1189.59 | -7.11 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_10_batch | RuntimeMs | SparkStructuredStreamingRunner | 1336.54 |
1214.82 | -9.11 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_10_streaming | RuntimeMs | DataflowRunner | 93701.25 | 91981.45 |
-1.84 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_streaming | RuntimeMs | DirectRunner | 124706.56 | 115491.43 |
-7.39 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_streaming | RuntimeMs | FlinkRunner | 2883.21 | 3052.23 | 5.86 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_11_batch | RuntimeMs | DataflowRunner | 31714.94 | 31468.56 | -0.78 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_11_batch | RuntimeMs | DirectRunner | 6175.18 | 6211.05 | 0.58 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_11_batch | RuntimeMs | FlinkRunner | 510.68 | 498.05 | -2.47 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_11_batch | RuntimeMs | SparkRunner | 1771.61 | 1742.36 | -1.65 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_11_batch | RuntimeMs | SparkStructuredStreamingRunner | 1590.79 |
1566.5 | -1.53 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_streaming | RuntimeMs | DataflowRunner | 153856.82 | 153232.02 |
-0.41 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_11_streaming | RuntimeMs | DirectRunner | 19832.15 | 20587.62 | 3.81 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_streaming | RuntimeMs | FlinkRunner | 3341.43 | 3650.91 | 9.26 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_12_batch | RuntimeMs | DataflowRunner | 21169.5 | 20107.95 | -5.01 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_12_batch | RuntimeMs | DirectRunner | 5254.46 | 5358.09 | 1.97 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_12_batch | RuntimeMs | FlinkRunner | 438.32 | 465.45 | 6.19 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_12_batch | RuntimeMs | SparkRunner | 1187.07 | 1158.14 | -2.44 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_12_batch | RuntimeMs | SparkStructuredStreamingRunner | 1277.57 |
1105.09 | -13.5 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_streaming | RuntimeMs | DataflowRunner | 86980.05 | 88954.39 | 2.27
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_12_streaming | RuntimeMs | DirectRunner | 23552.56 | 22616.24 | -3.98
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_streaming | RuntimeMs | FlinkRunner | 994.71 | 1156.05 | 16.22 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_batch | RuntimeMs | DataflowRunner | 30593.36 | 31144.0 | 1.8 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_batch | RuntimeMs | DirectRunner | 9039.0 | 10404.32 | 15.1 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_batch | RuntimeMs | FlinkRunner | 592.0 | 663.77 | 12.12 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_batch | RuntimeMs | SparkRunner | 429.32 | 440.14 | 2.52 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_batch | RuntimeMs | SparkStructuredStreamingRunner | 2080.21 |
1404.77 | -32.47 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_sql_batch | RuntimeMs | DataflowRunner | 56424.36 | 57692.06 | 2.25
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_sql_batch | RuntimeMs | DirectRunner | 15985.96 | 15893.0 | -0.58 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_sql_batch | RuntimeMs | FlinkRunner | 1546.61 | 1457.64 | -5.75 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_batch | RuntimeMs | SparkRunner | 4220.14 | 4371.41 | 3.58 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 2169.36 |
2267.09 | 4.51 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_sql_streaming | RuntimeMs | DataflowRunner | 41282.05 | 40895.55 |
-0.94 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_streaming | RuntimeMs | DirectRunner | 61400.88 | 55869.5 |
-9.01 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_streaming | RuntimeMs | FlinkRunner | 5132.18 | 5685.68 | 10.78
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_streaming | RuntimeMs | DataflowRunner | 30424.38 | 29782.89 |
-2.11 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_streaming | RuntimeMs | DirectRunner | 29723.74 | 26078.95 | -12.26
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_streaming | RuntimeMs | FlinkRunner | 2960.18 | 2990.23 | 1.02 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_zetasql_batch | RuntimeMs | DataflowRunner | 277311.62 | 276018.62
| -0.47 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_zetasql_batch | RuntimeMs | DirectRunner | 23462.46 | 18589.05 |
-20.77 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_zetasql_batch | RuntimeMs | FlinkRunner | 4921.54 | 4880.41 | -0.84
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_batch | RuntimeMs | SparkRunner | 6584.32 | 6943.27 | 5.45
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_zetasql_batch | RuntimeMs | SparkStructuredStreamingRunner |
6162.07 | 6417.5 | 4.15 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_streaming | RuntimeMs | DataflowRunner | 130206.22 |
119122.4 | -8.51 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_streaming | RuntimeMs | DirectRunner | 70911.54 | 80233.27
| 13.15 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_zetasql_streaming | RuntimeMs | FlinkRunner | 6597.26 | 6390.23 |
-3.14 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_batch | RuntimeMs | DataflowRunner | 58183.66 | 59604.2 | 2.44 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_batch | RuntimeMs | DirectRunner | 8072.36 | 7530.05 | -6.72 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_14_batch | RuntimeMs | FlinkRunner | 857.04 | 974.41 | 13.7 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_batch | RuntimeMs | SparkRunner | 1204.86 | 1261.45 | 4.7 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_14_batch | RuntimeMs | SparkStructuredStreamingRunner | 1322.39 |
1324.32 | 0.15 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_streaming | RuntimeMs | DataflowRunner | 130286.18 | 129082.86 |
-0.92 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_14_streaming | RuntimeMs | DirectRunner | 30068.93 | 26211.95 | -12.83
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_14_streaming | RuntimeMs | FlinkRunner | 2575.11 | 2672.77 | 3.79 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_15_batch | RuntimeMs | DataflowRunner | 45331.03 | 45976.92 | 1.42 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_15_batch | RuntimeMs | DirectRunner | 35115.75 | 35895.36 | 2.22 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_15_batch | RuntimeMs | FlinkRunner | 1190.96 | 1090.18 | -8.46 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_15_batch | RuntimeMs | SparkRunner | 2630.75 | 2493.27 | -5.23 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_15_batch | RuntimeMs | SparkStructuredStreamingRunner | 1729.0 |
1526.05 | -11.74 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_16_batch | RuntimeMs | DataflowRunner | 48455.09 | 48837.47 | 0.79 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_16_batch | RuntimeMs | DirectRunner | 212709.64 | 208248.09 | -2.1 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_16_batch | RuntimeMs | FlinkRunner | 750.04 | 718.27 | -4.23 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_16_batch | RuntimeMs | SparkRunner | 2065.75 | 2304.09 | 11.54 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_16_batch | RuntimeMs | SparkStructuredStreamingRunner | 945.89 |
848.41 | -10.31 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_16_streaming | RuntimeMs | DataflowRunner | 69680.64 | 69212.05 |
-0.67 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_16_streaming | RuntimeMs | DirectRunner | 435897.44 | 451937.52 | 3.68
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_16_streaming | RuntimeMs | FlinkRunner | 803.46 | 873.27 | 8.69 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_batch | RuntimeMs | DataflowRunner | 22815.3 | 23023.77 | 0.91 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_batch | RuntimeMs | DirectRunner | 7857.18 | 7697.0 | -2.04 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_batch | RuntimeMs | FlinkRunner | 663.25 | 740.64 | 11.67 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_batch | RuntimeMs | SparkRunner | 727.43 | 671.0 | -7.76 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_batch | RuntimeMs | SparkStructuredStreamingRunner | 672.14 | 622.41
| -7.4 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_batch | RuntimeMs | DataflowRunner | 29440.0 | 30910.72 | 5.0 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_1_sql_batch | RuntimeMs | DirectRunner | 9539.64 | 8270.55 | -13.3 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_batch | RuntimeMs | FlinkRunner | 878.71 | 811.64 | -7.63 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_batch | RuntimeMs | SparkRunner | 2934.29 | 2820.14 | -3.89 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 994.04 |
967.64 | -2.66 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_streaming | RuntimeMs | DataflowRunner | 27376.91 | 26746.41 |
-2.3 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_streaming | RuntimeMs | DirectRunner | 37893.15 | 35154.86 |
-7.23 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_streaming | RuntimeMs | FlinkRunner | 1918.46 | 2175.77 | 13.41
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_streaming | RuntimeMs | DataflowRunner | 22470.59 | 22615.41 | 0.64
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_streaming | RuntimeMs | DirectRunner | 25552.74 | 24202.57 | -5.28 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_streaming | RuntimeMs | FlinkRunner | 1872.0 | 1687.82 | -9.84 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_batch | RuntimeMs | DataflowRunner | 16201.4 | 16300.11 | 0.61 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_batch | RuntimeMs | DirectRunner | 4323.18 | 4309.09 | -0.33 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_batch | RuntimeMs | FlinkRunner | 277.32 | 313.59 | 13.08 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_batch | RuntimeMs | SparkRunner | 428.0 | 426.73 | -0.3 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_batch | RuntimeMs | SparkStructuredStreamingRunner | 418.18 | 371.45
| -11.17 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_batch | RuntimeMs | DataflowRunner | 20847.91 | 22443.89 | 7.66
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_sql_batch | RuntimeMs | DirectRunner | 4561.64 | 4243.0 | -6.99 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_sql_batch | RuntimeMs | FlinkRunner | 411.86 | 395.68 | -3.93 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_sql_batch | RuntimeMs | SparkRunner | 887.96 | 994.05 | 11.95 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 848.96 |
826.14 | -2.69 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_sql_streaming | RuntimeMs | DataflowRunner | 19390.5 | 18753.45 |
-3.29 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_sql_streaming | RuntimeMs | DirectRunner | 21037.73 | 19255.93 |
-8.47 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_streaming | RuntimeMs | FlinkRunner | 1112.46 | 1248.59 | 12.24
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_streaming | RuntimeMs | DataflowRunner | 15990.0 | 16244.18 | 1.59 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_streaming | RuntimeMs | DirectRunner | 15327.67 | 13937.95 | -9.07 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_streaming | RuntimeMs | FlinkRunner | 716.25 | 630.09 | -12.03 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_zetasql_batch | RuntimeMs | DataflowRunner | 75164.23 | 72998.71 |
-2.88 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_batch | RuntimeMs | DirectRunner | 7186.68 | 5974.59 |
-16.87 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_zetasql_batch | RuntimeMs | FlinkRunner | 1862.39 | 1604.32 | -13.86
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_zetasql_batch | RuntimeMs | SparkRunner | 1494.57 | 1603.05 | 7.26 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_zetasql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1671.04
| 1769.82 | 5.91 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_zetasql_streaming | RuntimeMs | DataflowRunner | 43494.17 | 44302.85
| 1.86 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_zetasql_streaming | RuntimeMs | DirectRunner | 25578.54 | 28500.91 |
11.43 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_zetasql_streaming | RuntimeMs | FlinkRunner | 1860.0 | 1703.95 |
-8.39 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_batch | RuntimeMs | DataflowRunner | 22321.82 | 22300.0 | -0.1 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_batch | RuntimeMs | DirectRunner | 6488.75 | 6294.64 | -2.99 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_3_batch | RuntimeMs | FlinkRunner | 2085.43 | 2079.95 | -0.26 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_batch | RuntimeMs | SparkRunner | 3425.25 | 3213.77 | -6.17 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_sql_batch | RuntimeMs | DataflowRunner | 23700.09 | 25020.83 | 5.57
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_sql_batch | RuntimeMs | DirectRunner | 7581.96 | 7127.55 | -5.99 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_sql_batch | RuntimeMs | FlinkRunner | 1593.71 | 1555.14 | -2.42 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_batch | RuntimeMs | SparkRunner | 4223.89 | 4604.86 | 9.02 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_sql_streaming | RuntimeMs | DataflowRunner | 38421.09 | 38313.82 |
-0.28 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_sql_streaming | RuntimeMs | DirectRunner | 22912.38 | 23015.0 | 0.45
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_sql_streaming | RuntimeMs | FlinkRunner | 1826.68 | 2147.45 | 17.56
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_streaming | RuntimeMs | DataflowRunner | 26374.75 | 24805.89 | -5.95
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_streaming | RuntimeMs | DirectRunner | 19865.0 | 18528.19 | -6.73 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_streaming | RuntimeMs | FlinkRunner | 1133.21 | 1127.77 | -0.48 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_zetasql_batch | RuntimeMs | DataflowRunner | 63234.46 | 60833.14 |
-3.8 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_batch | RuntimeMs | DirectRunner | 9966.89 | 8187.45 |
-17.85 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_3_zetasql_batch | RuntimeMs | FlinkRunner | 2202.82 | 2010.09 | -8.75
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_zetasql_batch | RuntimeMs | SparkRunner | 4204.54 | 4526.32 | 7.65 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_3_zetasql_streaming | RuntimeMs | DataflowRunner | 53551.52 | 53252.3
| -0.56 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_streaming | RuntimeMs | DirectRunner | 24421.93 | 29500.5 |
20.8 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_zetasql_streaming | RuntimeMs | FlinkRunner | 2125.44 | 1987.32 |
-6.5 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_4_batch | RuntimeMs | DataflowRunner | 26410.3 | 27188.7 | 2.95 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_batch | RuntimeMs | DirectRunner | 4693.0 | 4844.95 | 3.24 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_4_batch | RuntimeMs | FlinkRunner | 592.61 | 594.27 | 0.28 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_4_batch | RuntimeMs | SparkRunner | 1381.61 | 1318.77 | -4.55 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_4_batch | RuntimeMs | SparkStructuredStreamingRunner | 4551.79 |
4175.36 | -8.27 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_streaming | RuntimeMs | DataflowRunner | 52296.86 | 52734.02 | 0.84
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_4_streaming | RuntimeMs | DirectRunner | 5779.78 | 5231.9 | -9.48 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_streaming | RuntimeMs | FlinkRunner | 1039.18 | 998.41 | -3.92 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_batch | RuntimeMs | DataflowRunner | 30910.33 | 30137.28 | -2.5 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_5_batch | RuntimeMs | DirectRunner | 17994.82 | 19529.45 | 8.53 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_5_batch | RuntimeMs | FlinkRunner | 1847.11 | 2007.82 | 8.7 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_batch | RuntimeMs | SparkRunner | 2121.68 | 1933.64 | -8.86 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_5_batch | RuntimeMs | SparkStructuredStreamingRunner | 2877.68 |
2595.32 | -9.81 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_streaming | RuntimeMs | DataflowRunner | 124030.45 | 123149.95 |
-0.71 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_5_streaming | RuntimeMs | DirectRunner | 36480.78 | 35343.67 | -3.12 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_streaming | RuntimeMs | FlinkRunner | 3140.86 | 3011.0 | -4.13 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_6_batch | RuntimeMs | DataflowRunner | 26111.61 | 25630.73 | -1.84 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_6_batch | RuntimeMs | DirectRunner | 3454.14 | 3483.18 | 0.84 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_6_batch | RuntimeMs | FlinkRunner | 329.54 | 316.77 | -3.87 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_batch | RuntimeMs | SparkRunner | 936.5 | 966.91 | 3.25 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_6_batch | RuntimeMs | SparkStructuredStreamingRunner | 2311.04 |
2163.55 | -6.38 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_6_streaming | RuntimeMs | DataflowRunner | 40569.61 | 36128.0 | -10.95
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_6_streaming | RuntimeMs | DirectRunner | 4470.74 | 4700.0 | 5.13 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_6_streaming | RuntimeMs | FlinkRunner | 599.93 | 497.14 | -17.13 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_batch | RuntimeMs | DataflowRunner | 46680.79 | 46072.84 | -1.3 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_batch | RuntimeMs | DirectRunner | 55128.93 | 53743.5 | -2.51 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_7_batch | RuntimeMs | FlinkRunner | 1193.0 | 1138.0 | -4.61 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_batch | RuntimeMs | SparkRunner | 1798.11 | 1662.55 | -7.54 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_batch | RuntimeMs | SparkStructuredStreamingRunner | 1764.07 |
1728.23 | -2.03 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_sql_batch | RuntimeMs | DataflowRunner | 76040.73 | 79562.17 | 4.63
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_sql_batch | RuntimeMs | DirectRunner | 616203.75 | 597554.09 | -3.03
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_sql_batch | RuntimeMs | FlinkRunner | 4264.04 | 4240.64 | -0.55 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_batch | RuntimeMs | SparkRunner | 12640.54 | 14141.64 | 11.88 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 9379.39 |
9378.09 | -0.01 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_sql_streaming | RuntimeMs | DataflowRunner | 937248.64 | 937834.0 |
0.06 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_streaming | RuntimeMs | DirectRunner | 4412831.5 | 6478084.57 |
46.8 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_streaming | RuntimeMs | FlinkRunner | 7035.21 | 7732.68 | 9.91 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_7_streaming | RuntimeMs | DataflowRunner | 59835.64 | 59619.91 | -0.36
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_7_streaming | RuntimeMs | DirectRunner | 2509334.26 | 2443463.19 |
-2.63 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_streaming | RuntimeMs | FlinkRunner | 2058.18 | 2198.41 | 6.81 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_batch | RuntimeMs | DataflowRunner | 22169.18 | 21699.47 | -2.12 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_8_batch | RuntimeMs | DirectRunner | 5776.36 | 5694.36 | -1.42 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_batch | RuntimeMs | FlinkRunner | 714.36 | 733.09 | 2.62 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_batch | RuntimeMs | SparkRunner | 1932.79 | 1748.59 | -9.53 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_8_batch | RuntimeMs | SparkStructuredStreamingRunner | 1853.29 |
1904.82 | 2.78 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_streaming | RuntimeMs | DataflowRunner | 53878.29 | 49594.07 | -7.95
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_streaming | RuntimeMs | DirectRunner | 19005.7 | 17876.48 | -5.94 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_streaming | RuntimeMs | FlinkRunner | 1034.61 | 862.45 | -16.64 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_9_batch | RuntimeMs | DataflowRunner | 23808.64 | 23472.41 | -1.41 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_9_batch | RuntimeMs | DirectRunner | 2873.0 | 2668.82 | -7.11 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_batch | RuntimeMs | FlinkRunner | 258.25 | 244.27 | -5.41 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_9_batch | RuntimeMs | SparkRunner | 950.14 | 809.41 | -14.81 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_9_batch | RuntimeMs | SparkStructuredStreamingRunner | 1569.75 |
1481.95 | -5.59 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_streaming | RuntimeMs | DataflowRunner | 35028.34 | 33787.64 | -3.54
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_9_streaming | RuntimeMs | DirectRunner | 3836.37 | 3587.86 | -6.48 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_streaming | RuntimeMs | FlinkRunner | 441.64 | 437.09 | -1.03 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
tpcds_query10_Calcite_1GB | RuntimeMs | DataflowRunner | 379048.93 | 393367.65
| 3.78 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query10_Calcite_1GB | RuntimeMs | FlinkRunner | 32983.57 | 31282.05 |
-5.16 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query10_Calcite_1GB | RuntimeMs | SparkRunner | 63427.57 | 63786.77 |
0.57 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query10_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
47362.21 | 46659.0 | -1.48 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query25_Calcite_1GB | RuntimeMs | DataflowRunner | 0.0 | 0.0 | 0.0 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query25_Calcite_1GB | RuntimeMs | FlinkRunner | 0.0 | 0.0 | 0.0 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query25_Calcite_1GB | RuntimeMs | SparkRunner | 0.0 | 0.0 | 0.0 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query25_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner | 0.0 |
0.0 | 0.0 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query26_Calcite_1GB | RuntimeMs | DataflowRunner | 389407.93 | 361849.0
| -7.08 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query26_Calcite_1GB | RuntimeMs | FlinkRunner | 19226.18 | 18460.73 |
-3.98 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query26_Calcite_1GB | RuntimeMs | SparkRunner | 24453.71 | 23377.91 |
-4.4 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query26_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
21961.96 | 21107.82 | -3.89 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query29_Calcite_1GB | RuntimeMs | DataflowRunner | 0.0 | 0.0 | 0.0 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query29_Calcite_1GB | RuntimeMs | FlinkRunner | 0.0 | 0.0 | 0.0 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query29_Calcite_1GB | RuntimeMs | SparkRunner | 0.0 | 0.0 | 0.0 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query29_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner | 0.0 |
0.0 | 0.0 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query35_Calcite_1GB | RuntimeMs | DataflowRunner | 391728.26 | 383950.1
| -1.99 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query35_Calcite_1GB | RuntimeMs | FlinkRunner | 27097.54 | 25344.45 |
-6.47 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query35_Calcite_1GB | RuntimeMs | SparkRunner | 57201.11 | 57147.45 |
-0.09 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query35_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
40659.14 | 38742.95 | -4.71 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query38_Calcite_1GB | RuntimeMs | DataflowRunner | 371048.74 | 367891.75
| -0.85 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query38_Calcite_1GB | RuntimeMs | FlinkRunner | 20687.43 | 18906.45 |
-8.61 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query38_Calcite_1GB | RuntimeMs | SparkRunner | 26293.32 | 26658.0 |
1.39 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query38_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner | 0.0 |
0.0 | 0.0 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query3_Calcite_1GB | RuntimeMs | DataflowRunner | 348960.81 | 353545.3 |
1.31 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query3_Calcite_1GB | RuntimeMs | FlinkRunner | 33570.36 | 32633.0 |
-2.79 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query3_Calcite_1GB | RuntimeMs | SparkRunner | 43314.04 | 41314.05 |
-4.62 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query3_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
46316.36 | 44561.0 | -3.79 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query40_Calcite_1GB | RuntimeMs | DataflowRunner | 0.0 | 0.0 | 0.0 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query40_Calcite_1GB | RuntimeMs | FlinkRunner | 0.0 | 0.0 | 0.0 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query40_Calcite_1GB | RuntimeMs | SparkRunner | 0.0 | 0.0 | 0.0 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query40_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner | 0.0 |
0.0 | 0.0 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query42_Calcite_1GB | RuntimeMs | DataflowRunner | 342528.81 | 342512.0
| -0.0 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query42_Calcite_1GB | RuntimeMs | FlinkRunner | 16572.57 | 16278.32 |
-1.78 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query42_Calcite_1GB | RuntimeMs | SparkRunner | 22100.61 | 22366.32 |
1.2 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query42_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
18297.79 | 18457.18 | 0.87 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query43_Calcite_1GB | RuntimeMs | DataflowRunner | 0.0 | 0.0 | 0.0 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query43_Calcite_1GB | RuntimeMs | FlinkRunner | 0.0 | 0.0 | 0.0 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query43_Calcite_1GB | RuntimeMs | SparkRunner | 0.0 | 0.0 | 0.0 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query43_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner | 0.0 |
0.0 | 0.0 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query52_Calcite_1GB | RuntimeMs | DataflowRunner | 342201.48 | 347362.2
| 1.51 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query52_Calcite_1GB | RuntimeMs | FlinkRunner | 18055.43 | 16009.86 |
-11.33 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query52_Calcite_1GB | RuntimeMs | SparkRunner | 23618.14 | 21647.09 |
-8.35 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query52_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
17887.21 | 17129.55 | -4.24 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query55_Calcite_1GB | RuntimeMs | DataflowRunner | 357387.26 | 341030.4
| -4.58 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query55_Calcite_1GB | RuntimeMs | FlinkRunner | 17306.39 | 16214.82 |
-6.31 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query55_Calcite_1GB | RuntimeMs | SparkRunner | 23013.04 | 21104.73 |
-8.29 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query55_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
17781.07 | 16784.82 | -5.6 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query69_Calcite_1GB | RuntimeMs | DataflowRunner | 380879.74 | 391252.7
| 2.72 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query69_Calcite_1GB | RuntimeMs | FlinkRunner | 26790.64 | 27013.95 |
0.83 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query69_Calcite_1GB | RuntimeMs | SparkRunner | 58288.86 | 54632.64 |
-6.27 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query69_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
40718.82 | 41517.18 | 1.96 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query79_Calcite_1GB | RuntimeMs | DataflowRunner | 397813.22 | 390727.85
| -1.78 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query79_Calcite_1GB | RuntimeMs | FlinkRunner | 31901.14 | 31433.59 |
-1.47 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query79_Calcite_1GB | RuntimeMs | SparkRunner | 40982.43 | 39263.82 |
-4.19 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query79_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
36165.93 | 35231.23 | -2.58 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query7_Calcite_1GB | RuntimeMs | DataflowRunner | 371087.19 | 369780.8 |
-0.35 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query7_Calcite_1GB | RuntimeMs | FlinkRunner | 33418.29 | 34414.36 |
2.98 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query7_Calcite_1GB | RuntimeMs | SparkRunner | 45705.5 | 44206.36 |
-3.28 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query7_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
38470.04 | 37926.23 | -1.41 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query83_Calcite_1GB | RuntimeMs | DataflowRunner | 367752.26 | 357379.1
| -2.82 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query83_Calcite_1GB | RuntimeMs | FlinkRunner | 9734.71 | 9837.73 | 1.06
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query83_Calcite_1GB | RuntimeMs | SparkRunner | 8540.75 | 8429.18 |
-1.31 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query83_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
11854.25 | 12262.09 | 3.44 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query84_Calcite_1GB | RuntimeMs | DataflowRunner | 359631.85 | 343508.5
| -4.48 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query84_Calcite_1GB | RuntimeMs | FlinkRunner | 16889.54 | 18367.23 |
8.75 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query84_Calcite_1GB | RuntimeMs | SparkRunner | 17975.0 | 17949.09 |
-0.14 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query84_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
15401.25 | 15869.5 | 3.04 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query87_Calcite_1GB | RuntimeMs | DataflowRunner | 370033.81 | 366825.25
| -0.87 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query87_Calcite_1GB | RuntimeMs | FlinkRunner | 20527.89 | 20165.86 |
-1.76 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query87_Calcite_1GB | RuntimeMs | SparkRunner | 26685.0 | 25783.73 |
-3.38 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query87_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
22628.21 | 21885.59 | -3.28 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query93_Calcite_1GB | RuntimeMs | DataflowRunner | 376998.26 | 379678.55
| 0.71 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query93_Calcite_1GB | RuntimeMs | FlinkRunner | 34591.68 | 33078.0 |
-4.38 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query93_Calcite_1GB | RuntimeMs | SparkRunner | 46122.04 | 48892.27 |
6.01 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query93_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
35875.89 | 34805.55 | -2.98 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query96_Calcite_1GB | RuntimeMs | DataflowRunner | 355005.26 | 356961.4
| 0.55 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query96_Calcite_1GB | RuntimeMs | FlinkRunner | 24283.68 | 22766.0 |
-6.25 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query96_Calcite_1GB | RuntimeMs | SparkRunner | 20268.21 | 20215.0 |
-0.26 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query96_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
30839.75 | 29170.5 | -5.41 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)