You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/01/31 11:56:24 UTC
Beam Metrics Report (2023-01-31)
# Beam Metrics Report
Color legend: >= 20 | >= 10 | <= -10 | <= -20
---|---|---|---
## Possible regression
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
go_batch_gbk_7 | dataflow_runtime | - | 105.09 | 126.32 | 20.19 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_cogbk_1 | dataflow_v2_java11_runtime_sec | - | 41.07 | 46.85 |
14.08 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | dataflow_v2_java17_runtime_sec | - | 42.4 | 48.29 | 13.9
| [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | dataflow_v2_java11_runtime_sec | - | 11.21 | 14.8 | 32.09
| [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_gbk_3 | sparkstructuredstreaming_runtime_sec | - | 7.84 | 8.74 |
11.49 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | sparkstructuredstreaming_runtime_sec | - | 45.96 | 52.31 |
13.82 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | dataflow_runtime_sec | - | 50.43 | 56.18 | 11.39 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | dataflow_v2_java11_runtime_sec | - | 33.74 | 41.62 | 23.34
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | dataflow_v2_java17_runtime_sec | - | 36.62 | 48.67 | 32.91
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_pardo_2 | dataflow_runtime_sec | - | 199.2 | 221.86 | 11.38 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_gbk_4 | dataflow_v2_java17_runtime_sec | - | 545.05 | 604.18 |
10.85 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_pardo_1 | dataflow_v2_java17_runtime_sec | - | 23.89 | 27.0 |
13.02 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_3 | dataflow_v2_java11_runtime_sec | - | 21.31 | 23.85 |
11.89 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_3 | dataflow_v2_java17_runtime_sec | - | 20.81 | 28.59 |
37.43 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_4 | dataflow_v2_java11_runtime_sec | - | 36.71 | 41.13 |
12.04 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_combine_4 | python_dataflow_batch_combine_4_runtime | - | 39.0 |
58.0 | 48.72 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_gbk_5 | python_dataflow_batch_gbk_5_runtime | - | 85.29 | 112.5 |
31.91 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_sideinput_1 | python_dataflow_batch_sideinput_1_runtime | - | 2.0
| 2.5 | 25.0 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_2 | python_dataflow_batch_sideinput_2_runtime | - | 2.0
| 2.33 | 16.67 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_3 | python_dataflow_batch_sideinput_3_runtime | - |
2.43 | 3.0 | 23.53 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_6 | python_dataflow_batch_sideinput_6_runtime | - |
2.29 | 3.0 | 31.25 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_kafkaio_results | write_runtime | - | 349.5 | 434.4 | 24.29 |
[[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_psio_2GB_results | pubsub_io_perf_read_runtime | - | 334.43 | 369.33 |
10.44 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_psio_2GB_results | pubsub_io_perf_write_runtime | - | 121.14 | 138.67 |
14.47 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_streaming_pardo_1 | python_dataflow_streaming_pardo_1_runtime | - |
172.29 | 200.0 | 16.09 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_3 | python_dataflow_streaming_pardo_3_runtime | - |
146.57 | 169.25 | 15.47 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
singlestoreioit_results | read_time | - | 85.55 | 95.0 | 11.05 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
sparkreceiverioit_results | read_time | - | 713.7 | 824.81 | 15.57 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
tfrecordioit_results | read_time | - | 16.86 | 18.64 | 10.56 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_hdfs_results | write_time | - | 23.44 | 26.17 | 11.61 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
nexmark_16_streaming | RuntimeMs | FlinkRunner | 450.56 | 520.76 | 15.58 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_PRs_12_batch | RuntimeMs | DataflowRunner | 13832.0 | 18226.75 | 31.77
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_PRs_15_batch | RuntimeMs | DataflowRunner | 41480.0 | 46634.5 | 12.43
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_PRs_1_batch | RuntimeMs | DataflowRunner | 15785.0 | 20258.0 | 28.34 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_PRs_5_batch | RuntimeMs | DataflowRunner | 23434.0 | 31875.25 | 36.02
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
## Possible improvement
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
hadoopformatioit_results | read_time | - | 14.49 | 12.48 | -13.88 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
java_batch_cogbk_2 | dataflow_runtime_sec | - | 86.99 | 43.77 | -49.68 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_combine_5 | dataflow_runtime_sec | - | 28.65 | 25.47 | -11.1 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_gbk_1 | dataflow_v2_java11_runtime_sec | - | 131.0 | 88.63 | -32.34
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_runtime_sec | - | 13.14 | 9.93 | -24.4 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_v2_java11_runtime_sec | - | 14.19 | 12.12 | -14.59
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_v2_java17_runtime_sec | - | 14.97 | 12.82 | -14.31
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | dataflow_v2_java11_runtime_sec | - | 24.85 | 20.53 | -17.37
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | dataflow_v2_java11_runtime_sec | - | 29.15 | 25.52 | -12.43
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_pardo_1 | dataflow_v2_java11_runtime_sec | - | 14.17 | 11.58 |
-18.27 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_4 | dataflow_v2_java17_runtime_sec | - | 26.01 | 23.28 |
-10.5 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_cogbk_4 | dataflow_v2_java11_runtime_sec | - | 379.66 | 295.08
| -22.28 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_gbk_1 | dataflow_v2_java17_runtime_sec | - | 940.79 | 829.95 |
-11.78 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_2 | dataflow_v2_java11_runtime_sec | - | 2848.0 | 2340.98 |
-17.8 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_3 | dataflow_v2_java11_runtime_sec | - | 75.57 | 49.67 |
-34.28 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_3 | dataflow_v2_java17_runtime_sec | - | 89.55 | 48.44 |
-45.91 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_5 | dataflow_v2_java17_runtime_sec | - | 570.67 | 505.59 |
-11.4 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_6 | dataflow_v2_java11_runtime_sec | - | 267.5 | 173.81 |
-35.02 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_7 | dataflow_v2_java17_runtime_sec | - | 238.47 | 192.63 |
-19.22 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
kafkaioit_results | write_time | - | 173.33 | 155.09 | -10.52 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
python_batch_cogbk_2 | python_dataflow_batch_cogbk_2_runtime | - | 281.71 |
234.6 | -16.72 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_combine_5 | python_dataflow_batch_combine_5_runtime | - | 60.86 |
33.0 | -45.77 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_gbk_3 | python_dataflow_batch_gbk_3_runtime | - | 22.43 | 19.75 |
-11.94 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_4 | python_dataflow_batch_gbk_4_runtime | - | 114.86 | 90.25
| -21.42 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_pardo_1 | python_dataflow_batch_pardo_1_runtime | - | 167.71 |
138.5 | -17.42 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_3 | python_dataflow_batch_pardo_3_runtime | - | 148.71 |
116.75 | -21.49 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_sideinput_7 | python_dataflow_batch_sideinput_7_runtime | - |
146.86 | 110.5 | -24.76 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_9 | python_dataflow_batch_sideinput_9_runtime | - |
874.0 | 732.5 | -16.19 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_bqio_read_10GB_results | bqio_read_10GB_results_runtime | - | 124.29 |
99.4 | -20.02 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_kafkaio_results | read_runtime | - | 280.88 | 252.2 | -10.21 |
[[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_streaming_gbk_3 | python_dataflow_streaming_gbk_3_runtime | - | 111.0 |
85.2 | -23.24 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
xmlioit_results | read_time | - | 24.38 | 21.27 | -12.76 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
nexmark_3_batch | RuntimeMs | DataflowRunner | 26288.96 | 22512.45 | -14.37 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_batch | RuntimeMs | DataflowRunner | 31659.36 | 27949.68 | -11.72 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_streaming | RuntimeMs | FlinkRunner | 1247.59 | 1116.38 | -10.52 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_batch | RuntimeMs | DataflowRunner | 60445.54 | 47545.68 | -21.34 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_sql_batch | RuntimeMs | DirectRunner | 326207.81 | 234895.57 |
-27.99 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_8_batch | RuntimeMs | DirectRunner | 741.35 | 666.81 | -10.05 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
tpcds_query3_Calcite_1GB | RuntimeMs | SparkRunner | 45043.04 | 40246.6 |
-10.65 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
## All metrics
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
avroioit_hdfs_results | read_time | - | 83.65 | 86.12 | 2.95 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_hdfs_results | write_time | - | 120.72 | 120.78 | 0.05 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_results | read_time | - | 81.81 | 88.51 | 8.2 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_results | write_time | - | 118.05 | 121.1 | 2.59 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_avro | avro_write_time | - | 35.05 | 34.18 |
-2.49 | [[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_avro | read_time | - | 41.28 | 42.88 | 3.88 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_json | read_time | - | 40.0 | 40.66 | 1.65 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_json | write_time | - | 56.1 | 54.69 | -2.52 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_stream | read_time | - | 43.38 | 42.78 | -1.37 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_stream | write_time | - | 215.57 | 207.42 | -3.78 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
cdapioit_results | read_time | - | 16.22 | 16.63 | 2.56 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
cdapioit_results | write_time | - | 26.43 | 26.65 | 0.85 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_hdfs_results | read_time | - | 135.35 | 133.74 | -1.18 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_hdfs_results | write_time | - | 214.9 | 217.92 | 1.41 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_results | read_time | - | 135.43 | 132.12 | -2.44 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_results | write_time | - | 209.38 | 213.68 | 2.05 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
go_batch_cogbk_1 | dataflow_runtime | - | 262.56 | 263.41 | 0.32 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_cogbk_2 | dataflow_runtime | - | 145.25 | 154.16 | 6.13 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_cogbk_3 | dataflow_runtime | - | 111.44 | 114.51 | 2.75 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_cogbk_4 | dataflow_runtime | - | 108.37 | 113.51 | 4.74 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_combine_1 | dataflow_runtime | - | 441.97 | 443.85 | 0.42 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
go_batch_combine_4 | dataflow_runtime | - | 74.28 | 76.77 | 3.36 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
go_batch_combine_5 | dataflow_runtime | - | 69.97 | 71.28 | 1.87 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
go_batch_gbk_1 | dataflow_runtime | - | 403.82 | 400.37 | -0.86 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_2 | dataflow_runtime | - | 101.33 | 104.27 | 2.9 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_3 | dataflow_runtime | - | 26.16 | 24.91 | -4.79 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_4 | dataflow_runtime | - | 54.79 | 53.89 | -1.64 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_5 | dataflow_runtime | - | 44.55 | 43.86 | -1.54 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_6 | dataflow_runtime | - | 102.65 | 105.87 | 3.13 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_7 | dataflow_runtime | - | 105.09 | 126.32 | 20.19 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_pardo_1 | dataflow_runtime | - | 82.61 | 86.74 | 5.01 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_1 | flink_runtime | - | 410.72 | 375.67 | -8.54 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_2 | dataflow_runtime | - | 601.32 | 635.69 | 5.72 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_2 | flink_runtime | - | 2822.18 | 2836.45 | 0.51 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_3 | dataflow_runtime | - | 65.65 | 64.44 | -1.84 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_3 | flink_runtime | - | 273.71 | 273.71 | 0.0 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_4 | dataflow_runtime | - | 70.97 | 70.55 | -0.59 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_4 | flink_runtime | - | 307.59 | 311.24 | 1.19 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_sideinput_3 | dataflow_runtime | - | 2.46 | 2.6 | 5.58 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
go_batch_sideinput_4 | dataflow_runtime | - | 234.88 | 237.19 | 0.98 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
hadoopformatioit_results | read_time | - | 14.49 | 12.48 | -13.88 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
hadoopformatioit_results | write_time | - | 25.59 | 23.91 | -6.56 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
java_batch_cogbk_1 | dataflow_runtime_sec | - | 43.31 | 40.03 | -7.55 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_1 | dataflow_v2_java11_runtime_sec | - | 41.07 | 46.85 |
14.08 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_1 | dataflow_v2_java17_runtime_sec | - | 45.73 | 45.66 |
-0.15 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_1 | sparkstructuredstreaming_runtime_sec | - | 71.51 | 67.88
| -5.08 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | dataflow_runtime_sec | - | 86.99 | 43.77 | -49.68 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | dataflow_v2_java11_runtime_sec | - | 47.52 | 46.39 |
-2.38 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | dataflow_v2_java17_runtime_sec | - | 42.4 | 48.29 | 13.9
| [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | sparkstructuredstreaming_runtime_sec | - | 68.75 | 68.2 |
-0.79 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | dataflow_runtime_sec | - | 14.59 | 15.17 | 4.01 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | dataflow_v2_java11_runtime_sec | - | 14.08 | 12.77 |
-9.29 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | dataflow_v2_java17_runtime_sec | - | 15.17 | 13.97 |
-7.95 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | sparkstructuredstreaming_runtime_sec | - | 13.37 | 13.43
| 0.49 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | dataflow_runtime_sec | - | 14.14 | 14.61 | 3.31 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | dataflow_v2_java11_runtime_sec | - | 11.21 | 14.8 | 32.09
| [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | dataflow_v2_java17_runtime_sec | - | 12.32 | 12.41 | 0.75
| [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | sparkstructuredstreaming_runtime_sec | - | 13.86 | 13.53
| -2.43 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_combine_1 | dataflow_runtime_sec | - | 65.11 | 64.85 | -0.4 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_1 | sparkstructuredstreaming_runtime_sec | - | 258.46 |
256.36 | -0.81 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_4 | dataflow_runtime_sec | - | 30.22 | 28.07 | -7.11 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_4 | sparkstructuredstreaming_runtime_sec | - | 61.88 |
60.35 | -2.48 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_5 | dataflow_runtime_sec | - | 28.65 | 25.47 | -11.1 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_5 | sparkstructuredstreaming_runtime_sec | - | 62.53 |
57.39 | -8.22 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_gbk_1 | dataflow_runtime_sec | - | 122.57 | 122.84 | 0.22 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_1 | dataflow_v2_java11_runtime_sec | - | 131.0 | 88.63 | -32.34
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_1 | dataflow_v2_java17_runtime_sec | - | 87.14 | 92.8 | 6.5 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_1 | sparkstructuredstreaming_runtime_sec | - | 270.6 | 275.52 |
1.82 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | dataflow_runtime_sec | - | 37.61 | 35.25 | -6.26 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | dataflow_v2_java11_runtime_sec | - | 43.36 | 41.37 | -4.58
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | dataflow_v2_java17_runtime_sec | - | 41.69 | 40.61 | -2.6 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | sparkstructuredstreaming_runtime_sec | - | 53.87 | 56.57 |
5.0 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_runtime_sec | - | 13.14 | 9.93 | -24.4 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_v2_java11_runtime_sec | - | 14.19 | 12.12 | -14.59
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_v2_java17_runtime_sec | - | 14.97 | 12.82 | -14.31
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | sparkstructuredstreaming_runtime_sec | - | 7.84 | 8.74 |
11.49 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | dataflow_runtime_sec | - | 20.34 | 19.78 | -2.77 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | dataflow_v2_java11_runtime_sec | - | 24.85 | 20.53 | -17.37
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | dataflow_v2_java17_runtime_sec | - | 22.29 | 22.38 | 0.4 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | sparkstructuredstreaming_runtime_sec | - | 45.96 | 52.31 |
13.82 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | dataflow_runtime_sec | - | 18.18 | 18.23 | 0.29 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | dataflow_v2_java11_runtime_sec | - | 19.24 | 18.19 | -5.5 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | dataflow_v2_java17_runtime_sec | - | 18.82 | 19.43 | 3.21 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | sparkstructuredstreaming_runtime_sec | - | 45.04 | 47.29 |
5.0 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | dataflow_runtime_sec | - | 38.43 | 38.81 | 0.98 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | dataflow_v2_java11_runtime_sec | - | 29.15 | 25.52 | -12.43
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | dataflow_v2_java17_runtime_sec | - | 27.83 | 27.17 | -2.38
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | sparkstructuredstreaming_runtime_sec | - | 30.44 | 31.41 |
3.19 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | dataflow_runtime_sec | - | 50.43 | 56.18 | 11.39 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | dataflow_v2_java11_runtime_sec | - | 33.74 | 41.62 | 23.34
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | dataflow_v2_java17_runtime_sec | - | 36.62 | 48.67 | 32.91
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | sparkstructuredstreaming_runtime_sec | - | 38.54 | 36.04 |
-6.49 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_pardo_1 | dataflow_runtime_sec | - | 19.18 | 19.53 | 1.81 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_1 | dataflow_v2_java11_runtime_sec | - | 14.17 | 11.58 |
-18.27 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_1 | dataflow_v2_java17_runtime_sec | - | 13.76 | 12.91 |
-6.16 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_1 | sparkstructuredstreaming_runtime_sec | - | 22.96 | 23.34
| 1.69 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_2 | dataflow_runtime_sec | - | 199.2 | 221.86 | 11.38 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_2 | dataflow_v2_java11_runtime_sec | - | 64.33 | 65.54 | 1.87
| [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_2 | dataflow_v2_java17_runtime_sec | - | 64.79 | 64.09 |
-1.07 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_2 | sparkstructuredstreaming_runtime_sec | - | 221.52 |
214.51 | -3.17 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | dataflow_runtime_sec | - | 14.2 | 12.78 | -9.96 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | dataflow_v2_java11_runtime_sec | - | 11.1 | 11.15 | 0.47
| [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | dataflow_v2_java17_runtime_sec | - | 12.6 | 13.18 | 4.56
| [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | sparkstructuredstreaming_runtime_sec | - | 15.16 | 15.98
| 5.4 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_4 | dataflow_runtime_sec | - | 24.92 | 24.89 | -0.12 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_4 | dataflow_v2_java11_runtime_sec | - | 23.39 | 24.98 | 6.83
| [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_4 | dataflow_v2_java17_runtime_sec | - | 26.01 | 23.28 |
-10.5 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_4 | sparkstructuredstreaming_runtime_sec | - | 46.69 | 48.19
| 3.21 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_cogbk_1 | dataflow_runtime_sec | - | 919.81 | 886.48 | -3.62 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_1 | dataflow_v2_java11_runtime_sec | - | 2815.99 |
2918.68 | 3.65 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_1 | dataflow_v2_java17_runtime_sec | - | 2508.74 |
2714.59 | 8.21 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_2 | dataflow_runtime_sec | - | 898.46 | 902.3 | 0.43 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_2 | dataflow_v2_java11_runtime_sec | - | 3006.08 |
3291.53 | 9.5 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_2 | dataflow_v2_java17_runtime_sec | - | 3124.24 |
3055.43 | -2.2 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_3 | dataflow_runtime_sec | - | 119.56 | 118.82 | -0.62 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_3 | dataflow_v2_java11_runtime_sec | - | 381.35 | 344.03
| -9.78 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_3 | dataflow_v2_java17_runtime_sec | - | 355.93 | 341.34
| -4.1 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_4 | dataflow_runtime_sec | - | 122.35 | 118.47 | -3.17 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_4 | dataflow_v2_java11_runtime_sec | - | 379.66 | 295.08
| -22.28 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_4 | dataflow_v2_java17_runtime_sec | - | 322.42 | 318.94
| -1.08 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_combine_1 | dataflow_runtime_sec | - | 521.95 | 475.56 | -8.89
| [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_combine_4 | dataflow_runtime_sec | - | 328.3 | 327.83 | -0.14 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_combine_5 | dataflow_runtime_sec | - | 330.75 | 310.51 | -6.12
| [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_gbk_1 | dataflow_runtime_sec | - | 691.83 | 698.28 | 0.93 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_1 | dataflow_v2_java11_runtime_sec | - | 920.13 | 889.93 |
-3.28 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_1 | dataflow_v2_java17_runtime_sec | - | 940.79 | 829.95 |
-11.78 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_2 | dataflow_runtime_sec | - | 806.86 | 778.86 | -3.47 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_2 | dataflow_v2_java11_runtime_sec | - | 2848.0 | 2340.98 |
-17.8 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_2 | dataflow_v2_java17_runtime_sec | - | 3095.3 | 3177.05 |
2.64 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_3 | dataflow_runtime_sec | - | 24.19 | 23.81 | -1.56 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_3 | dataflow_v2_java11_runtime_sec | - | 75.57 | 49.67 |
-34.28 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_3 | dataflow_v2_java17_runtime_sec | - | 89.55 | 48.44 |
-45.91 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_4 | dataflow_runtime_sec | - | 301.1 | 291.65 | -3.14 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_4 | dataflow_v2_java11_runtime_sec | - | 612.55 | 554.06 |
-9.55 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_4 | dataflow_v2_java17_runtime_sec | - | 545.05 | 604.18 |
10.85 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_5 | dataflow_runtime_sec | - | 306.13 | 284.11 | -7.19 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_5 | dataflow_v2_java11_runtime_sec | - | 579.84 | 551.75 |
-4.84 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_5 | dataflow_v2_java17_runtime_sec | - | 570.67 | 505.59 |
-11.4 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_6 | dataflow_runtime_sec | - | 76.74 | 74.99 | -2.28 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_6 | dataflow_v2_java11_runtime_sec | - | 267.5 | 173.81 |
-35.02 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_6 | dataflow_v2_java17_runtime_sec | - | 183.56 | 183.32 |
-0.13 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_7 | dataflow_runtime_sec | - | 141.31 | 131.1 | -7.22 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_7 | dataflow_v2_java11_runtime_sec | - | 239.05 | 218.78 |
-8.48 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_7 | dataflow_v2_java17_runtime_sec | - | 238.47 | 192.63 |
-19.22 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_pardo_1 | dataflow_runtime_sec | - | 19.31 | 20.76 | 7.54 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_1 | dataflow_v2_java11_runtime_sec | - | 25.42 | 26.24 |
3.23 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_1 | dataflow_v2_java17_runtime_sec | - | 23.89 | 27.0 |
13.02 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_2 | dataflow_runtime_sec | - | 210.53 | 208.43 | -1.0 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_2 | dataflow_v2_java11_runtime_sec | - | 109.02 | 108.15
| -0.8 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_2 | dataflow_v2_java17_runtime_sec | - | 114.18 | 110.54
| -3.19 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_3 | dataflow_runtime_sec | - | 12.25 | 11.88 | -3.05 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_3 | dataflow_v2_java11_runtime_sec | - | 21.31 | 23.85 |
11.89 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_3 | dataflow_v2_java17_runtime_sec | - | 20.81 | 28.59 |
37.43 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_4 | dataflow_runtime_sec | - | 30.84 | 31.1 | 0.84 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_4 | dataflow_v2_java11_runtime_sec | - | 36.71 | 41.13 |
12.04 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_4 | dataflow_v2_java17_runtime_sec | - | 35.05 | 34.73 |
-0.92 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
jdbcioit_results | read_time | - | 25.66 | 23.93 | -6.75 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
jdbcioit_results | write_time | - | 38.61 | 35.56 | -7.89 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results | read_time | - | 917.18 | 948.81 | 3.45 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results | write_time | - | 173.33 | 155.09 | -10.52 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results_runner_v2 | read_time | - | 969.4 | 915.55 | -5.55 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results_runner_v2 | write_time | - | 185.63 | 175.96 | -5.21 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_hdfs_results | read_time | - | 15.11 | 13.6 | -9.98 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_hdfs_results | write_time | - | 67.03 | 60.89 | -9.17 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_results | read_time | - | 22.54 | 23.97 | 6.34 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_results | write_time | - | 62.19 | 62.39 | 0.33 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
mongodbioit_results | read_time | - | 27.26 | 29.24 | 7.26 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
mongodbioit_results | write_time | - | 50.31 | 49.48 | -1.65 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_hdfs_results | read_time | - | 80.67 | 83.13 | 3.05 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_hdfs_results | write_time | - | 135.29 | 141.88 | 4.87 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_results | read_time | - | 88.83 | 90.57 | 1.95 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_results | write_time | - | 146.53 | 147.46 | 0.63 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
python_batch_cogbk_1 | python_dataflow_batch_cogbk_1_runtime | - | 365.57 |
350.8 | -4.04 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_2 | python_dataflow_batch_cogbk_2_runtime | - | 281.71 |
234.6 | -16.72 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_3 | python_dataflow_batch_cogbk_3_runtime | - | 214.43 |
216.8 | 1.11 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_4 | python_dataflow_batch_cogbk_4_runtime | - | 223.0 |
206.0 | -7.62 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_combine_1 | python_dataflow_batch_combine_1_runtime | - | 752.29
| 751.6 | -0.09 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_1 | python_flink_batch_combine_1_runtime | - | 5258.67 |
5296.4 | 0.72 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_4 | python_dataflow_batch_combine_4_runtime | - | 39.0 |
58.0 | 48.72 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_4 | python_flink_batch_combine_4_runtime | - | 198.83 |
203.0 | 2.1 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_5 | python_dataflow_batch_combine_5_runtime | - | 60.86 |
33.0 | -45.77 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_5 | python_flink_batch_combine_5_runtime | - | 204.0 |
216.8 | 6.27 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_gbk_1 | python_dataflow_batch_gbk_1_runtime | - | 1309.14 |
1304.25 | -0.37 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_2 | python_dataflow_batch_gbk_2_runtime | - | 256.71 | 256.5
| -0.08 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_3 | python_dataflow_batch_gbk_3_runtime | - | 22.43 | 19.75 |
-11.94 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_4 | python_dataflow_batch_gbk_4_runtime | - | 114.86 | 90.25
| -21.42 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_5 | python_dataflow_batch_gbk_5_runtime | - | 85.29 | 112.5 |
31.91 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_6 | python_dataflow_batch_gbk_6_runtime | - | 226.29 | 208.5
| -7.86 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_7 | python_dataflow_batch_gbk_7_runtime | - | 258.29 | 240.25
| -6.98 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_pardo_1 | python_dataflow_batch_pardo_1_runtime | - | 167.71 |
138.5 | -17.42 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_1 | python_flink_batch_pardo_1_runtime | - | 894.0 | 900.2
| 0.69 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_2 | python_dataflow_batch_pardo_2_runtime | - | 1370.71 |
1358.5 | -0.89 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_3 | python_dataflow_batch_pardo_3_runtime | - | 148.71 |
116.75 | -21.49 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_3 | python_flink_batch_pardo_3_runtime | - | 718.43 | 741.0
| 3.14 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_4 | python_dataflow_batch_pardo_4_runtime | - | 352.71 |
319.0 | -9.56 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_4 | python_flink_batch_pardo_4_runtime | - | 2401.86 |
2439.4 | 1.56 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_sideinput_1 | python_dataflow_batch_sideinput_1_runtime | - | 2.0
| 2.5 | 25.0 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_10 | python_dataflow_batch_sideinput_10_runtime | - |
765.43 | 714.75 | -6.62 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_2 | python_dataflow_batch_sideinput_2_runtime | - | 2.0
| 2.33 | 16.67 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_3 | python_dataflow_batch_sideinput_3_runtime | - |
2.43 | 3.0 | 23.53 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_4 | python_dataflow_batch_sideinput_4_runtime | - |
27.86 | 29.2 | 4.82 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_5 | python_dataflow_batch_sideinput_5_runtime | - | 2.0
| 2.0 | 0.0 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_6 | python_dataflow_batch_sideinput_6_runtime | - |
2.29 | 3.0 | 31.25 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_7 | python_dataflow_batch_sideinput_7_runtime | - |
146.86 | 110.5 | -24.76 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_8 | python_dataflow_batch_sideinput_8_runtime | - |
149.57 | 143.25 | -4.23 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_9 | python_dataflow_batch_sideinput_9_runtime | - |
874.0 | 732.5 | -16.19 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_bqio_read_10GB_results | bqio_read_10GB_results_runtime | - | 124.29 |
99.4 | -20.02 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_bqio_write_10GB_results | bqio_write_10GB_results_runtime | - | 289.0 |
265.4 | -8.17 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_direct_microbenchmarks | fn_api_runner_microbenchmark_runtime_sec | - |
561.19 | 542.15 | -3.39 |
python_direct_microbenchmarks | teststream_microbenchmark_runtime_sec | - |
344.7 | 329.26 | -4.48 |
python_kafkaio_results | read_runtime | - | 280.88 | 252.2 | -10.21 |
[[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_kafkaio_results | write_runtime | - | 349.5 | 434.4 | 24.29 |
[[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_psio_2GB_results | pubsub_io_perf_read_runtime | - | 334.43 | 369.33 |
10.44 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_psio_2GB_results | pubsub_io_perf_write_runtime | - | 121.14 | 138.67 |
14.47 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_spanner_write_2GB_results | pyspanner_write_2GB_results_runtime | - |
1799.86 | 1802.6 | 0.15 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_spannerio_read_2GB_results | pyspanner_read_2GB_results_runtime | - |
26.0 | 26.0 | 0.0 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_streaming_cogbk_1 | python_dataflow_streaming_cogbk_1_runtime | - |
589.29 | 548.8 | -6.87 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_2 | python_dataflow_streaming_cogbk_2_runtime | - |
351.71 | 328.4 | -6.63 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_3 | python_dataflow_streaming_cogbk_3_runtime | - |
391.86 | 364.6 | -6.96 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_4 | python_dataflow_streaming_cogbk_4_runtime | - |
328.71 | 309.2 | -5.94 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_gbk_3 | python_dataflow_streaming_gbk_3_runtime | - | 111.0 |
85.2 | -23.24 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_gbk_6 | python_dataflow_streaming_gbk_6_runtime | - | 509.0 |
462.0 | -9.23 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_gbk_7 | python_dataflow_streaming_gbk_7_runtime | - | 463.0 |
455.5 | -1.62 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_pardo_1 | python_dataflow_streaming_pardo_1_runtime | - |
172.29 | 200.0 | 16.09 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_1 | python_flink_streaming_pardo_5_runtime | - | 293.86
| 306.2 | 4.2 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_2 | python_dataflow_streaming_pardo_2_runtime | - |
2435.0 | 2543.0 | 4.44 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_2 | python_flink_streaming_pardo_2_runtime | - |
11376.29 | 11173.2 | -1.79 | [[1]](http://metrics.beam.apache.org/d/MOi-
kf3Zk)
python_streaming_pardo_3 | python_dataflow_streaming_pardo_3_runtime | - |
146.57 | 169.25 | 15.47 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_3 | python_flink_streaming_pardo_3_runtime | - | 416.29
| 399.0 | -4.15 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_4 | python_dataflow_streaming_pardo_4_runtime | - |
409.57 | 417.75 | 2.0 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_4 | python_flink_streaming_pardo_4_runtime | - |
1025.71 | 1058.2 | 3.17 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_6 | python_flink_streaming_pardo_6_runtime | - | 459.14
| 488.4 | 6.37 |
python_textio_1GB_results | read_runtime | - | 142.43 | 133.67 | -6.15 |
[[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_textio_1GB_results | write_runtime | - | 188.57 | 187.17 | -0.74 |
[[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
singlestoreioit_results | read_time | - | 85.55 | 95.0 | 11.05 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
singlestoreioit_results | write_time | - | 26.06 | 26.06 | 0.01 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
sparkreceiverioit_results | read_time | - | 713.7 | 824.81 | 15.57 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_hdfs_results | read_time | - | 15.54 | 15.84 | 1.91 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_hdfs_results | write_time | - | 30.37 | 31.93 | 5.14 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_results | read_time | - | 18.96 | 19.03 | 0.34 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_results | write_time | - | 34.46 | 31.48 | -8.65 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
tfrecordioit_results | read_time | - | 16.86 | 18.64 | 10.56 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
tfrecordioit_results | write_time | - | 23.29 | 21.55 | -7.46 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
wordcount_py37_results | runtime | - | 953.16 | 883.74 | -7.28 |
[[1]](http://metrics.beam.apache.org/d/1cnwVDkGk)
xmlioit_hdfs_results | read_time | - | 20.15 | 21.01 | 4.27 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_hdfs_results | write_time | - | 23.44 | 26.17 | 11.61 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_results | read_time | - | 24.38 | 21.27 | -12.76 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_results | write_time | - | 24.82 | 22.82 | -8.07 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
nexmark_0_batch | RuntimeMs | DataflowRunner | 27895.97 | 26513.74 | -4.95 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_batch | RuntimeMs | DirectRunner | 1813.87 | 1804.6 | -0.51 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_batch | RuntimeMs | FlinkRunner | 1115.96 | 1152.19 | 3.25 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_batch | RuntimeMs | SparkRunner | 1400.86 | 1405.05 | 0.3 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_batch | RuntimeMs | SparkStructuredStreamingRunner | 1316.75 |
1313.52 | -0.25 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_python_batch | RuntimeMs | DirectRunner | 12366.22 | 12520.57 | 1.25
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_sql_batch | RuntimeMs | DataflowRunner | 34593.18 | 34032.86 | -1.62
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_sql_batch | RuntimeMs | DirectRunner | 5825.41 | 5809.29 | -0.28 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_sql_batch | RuntimeMs | FlinkRunner | 1235.44 | 1150.14 | -6.9 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_sql_batch | RuntimeMs | SparkRunner | 3362.57 | 3414.9 | 1.56 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1565.71 |
1529.0 | -2.34 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_sql_streaming | RuntimeMs | DataflowRunner | 23516.43 | 23213.67 |
-1.29 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_sql_streaming | RuntimeMs | DirectRunner | 15696.48 | 15831.1 | 0.86
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_sql_streaming | RuntimeMs | FlinkRunner | 1684.3 | 1684.38 | 0.01 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_streaming | RuntimeMs | DataflowRunner | 40538.61 | 40179.32 | -0.89
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_streaming | RuntimeMs | DirectRunner | 12107.48 | 12234.38 | 1.05 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_streaming | RuntimeMs | FlinkRunner | 1536.15 | 1598.43 | 4.05 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_batch | RuntimeMs | DataflowRunner | 119389.75 | 117475.05 |
-1.6 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_batch | RuntimeMs | DirectRunner | 6941.93 | 6809.95 | -1.9
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_batch | RuntimeMs | FlinkRunner | 2224.04 | 2258.86 | 1.57 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_batch | RuntimeMs | SparkRunner | 2964.29 | 2957.43 | -0.23
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_zetasql_batch | RuntimeMs | SparkStructuredStreamingRunner | 2936.82
| 2889.38 | -1.62 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_streaming | RuntimeMs | DataflowRunner | 68404.04 | 70263.48
| 2.72 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_streaming | RuntimeMs | DirectRunner | 17356.37 | 17046.62 |
-1.78 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_streaming | RuntimeMs | FlinkRunner | 3267.44 | 3262.33 |
-0.16 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_10_batch | RuntimeMs | DataflowRunner | 47224.15 | 46132.45 | -2.31 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_batch | RuntimeMs | DirectRunner | 5039.89 | 4872.83 | -3.31 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_10_batch | RuntimeMs | FlinkRunner | 651.41 | 618.67 | -5.03 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_batch | RuntimeMs | SparkRunner | 744.57 | 707.67 | -4.96 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_batch | RuntimeMs | SparkStructuredStreamingRunner | 946.0 | 957.67
| 1.23 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_10_python_batch | RuntimeMs | DirectRunner | 26554.7 | 26240.67 |
-1.18 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_10_streaming | RuntimeMs | DataflowRunner | 102446.8 | 99426.49 |
-2.95 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_10_streaming | RuntimeMs | DirectRunner | 44513.59 | 44593.24 | 0.18 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_streaming | RuntimeMs | FlinkRunner | 1710.7 | 1576.95 | -7.82 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_batch | RuntimeMs | DataflowRunner | 38105.01 | 36824.16 | -3.36 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_11_batch | RuntimeMs | DirectRunner | 1467.65 | 1470.98 | 0.23 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_11_batch | RuntimeMs | FlinkRunner | 280.48 | 266.71 | -4.91 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_11_batch | RuntimeMs | SparkRunner | 1588.18 | 1603.05 | 0.94 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_11_batch | RuntimeMs | SparkStructuredStreamingRunner | 1266.82 |
1271.67 | 0.38 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_python_batch | RuntimeMs | DirectRunner | 20338.89 | 20844.67 |
2.49 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_11_streaming | RuntimeMs | DataflowRunner | 179385.23 | 174666.61 |
-2.63 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_streaming | RuntimeMs | DirectRunner | 10752.15 | 10647.1 | -0.98 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_11_streaming | RuntimeMs | FlinkRunner | 1547.93 | 1515.48 | -2.1 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_batch | RuntimeMs | DataflowRunner | 19037.61 | 17914.53 | -5.9 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_12_batch | RuntimeMs | DirectRunner | 2712.0 | 2785.71 | 2.72 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_12_batch | RuntimeMs | FlinkRunner | 187.0 | 176.24 | -5.76 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_batch | RuntimeMs | SparkRunner | 935.29 | 995.67 | 6.46 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_batch | RuntimeMs | SparkStructuredStreamingRunner | 915.25 |
964.52 | 5.38 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_12_streaming | RuntimeMs | DataflowRunner | 93578.44 | 89537.44 |
-4.32 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_12_streaming | RuntimeMs | DirectRunner | 9308.96 | 9388.67 | 0.86 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_streaming | RuntimeMs | FlinkRunner | 606.04 | 608.57 | 0.42 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_batch | RuntimeMs | DataflowRunner | 33631.75 | 31287.64 | -6.97 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_batch | RuntimeMs | DirectRunner | 3300.11 | 3479.14 | 5.43 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_batch | RuntimeMs | FlinkRunner | 438.48 | 451.24 | 2.91 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_batch | RuntimeMs | SparkRunner | 377.54 | 377.19 | -0.09 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_batch | RuntimeMs | SparkStructuredStreamingRunner | 1068.14 |
1078.29 | 0.95 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_sql_batch | RuntimeMs | DataflowRunner | 57777.11 | 57624.48 |
-0.26 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_batch | RuntimeMs | DirectRunner | 9280.0 | 9312.9 | 0.35 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_sql_batch | RuntimeMs | FlinkRunner | 1147.63 | 1131.38 | -1.42 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_batch | RuntimeMs | SparkRunner | 3557.36 | 3599.1 | 1.17 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1527.57 |
1599.81 | 4.73 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_sql_streaming | RuntimeMs | DataflowRunner | 37100.29 | 34823.1 |
-6.14 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_streaming | RuntimeMs | DirectRunner | 19224.15 | 19714.05 |
2.55 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_streaming | RuntimeMs | FlinkRunner | 2463.7 | 2491.19 | 1.12 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_streaming | RuntimeMs | DataflowRunner | 24902.46 | 24616.0 | -1.15
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_streaming | RuntimeMs | DirectRunner | 10036.52 | 10050.05 | 0.13 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_streaming | RuntimeMs | FlinkRunner | 1408.78 | 1484.76 | 5.39 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_batch | RuntimeMs | DataflowRunner | 267373.32 | 274329.62
| 2.6 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_batch | RuntimeMs | DirectRunner | 10248.81 | 10263.1 |
0.14 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_zetasql_batch | RuntimeMs | FlinkRunner | 2814.85 | 2807.14 | -0.27
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_zetasql_batch | RuntimeMs | SparkRunner | 3217.0 | 3241.19 | 0.75 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_zetasql_batch | RuntimeMs | SparkStructuredStreamingRunner |
4014.25 | 4056.71 | 1.06 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_zetasql_streaming | RuntimeMs | DataflowRunner | 114698.46 |
111653.81 | -2.65 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_zetasql_streaming | RuntimeMs | DirectRunner | 21012.56 | 21082.9 |
0.33 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_streaming | RuntimeMs | FlinkRunner | 4240.59 | 4027.57 |
-5.02 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_14_batch | RuntimeMs | DataflowRunner | 61428.89 | 58604.36 | -4.6 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_14_batch | RuntimeMs | DirectRunner | 4224.22 | 4167.38 | -1.35 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_14_batch | RuntimeMs | FlinkRunner | 506.3 | 551.9 | 9.01 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_14_batch | RuntimeMs | SparkRunner | 894.11 | 901.48 | 0.82 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_batch | RuntimeMs | SparkStructuredStreamingRunner | 1116.57 |
1038.52 | -6.99 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_14_streaming | RuntimeMs | DataflowRunner | 129254.75 | 128328.0 |
-0.72 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_streaming | RuntimeMs | DirectRunner | 12193.07 | 12641.86 | 3.68 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_14_streaming | RuntimeMs | FlinkRunner | 1223.81 | 1205.81 | -1.47 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_15_batch | RuntimeMs | DataflowRunner | 47491.14 | 45281.43 | -4.65 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_15_batch | RuntimeMs | DirectRunner | 16046.11 | 16443.9 | 2.48 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_15_batch | RuntimeMs | FlinkRunner | 424.52 | 459.19 | 8.17 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_15_batch | RuntimeMs | SparkRunner | 1658.96 | 1725.38 | 4.0 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_15_batch | RuntimeMs | SparkStructuredStreamingRunner | 1042.25 |
1011.52 | -2.95 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_16_batch | RuntimeMs | DataflowRunner | 51786.12 | 49473.48 | -4.47 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_16_batch | RuntimeMs | DirectRunner | 86346.33 | 87915.57 | 1.82 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_16_batch | RuntimeMs | FlinkRunner | 210.33 | 217.81 | 3.55 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_16_batch | RuntimeMs | SparkRunner | 1406.82 | 1468.33 | 4.37 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_16_batch | RuntimeMs | SparkStructuredStreamingRunner | 656.21 |
629.71 | -4.04 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_16_streaming | RuntimeMs | DataflowRunner | 94883.35 | 93624.52 |
-1.33 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_16_streaming | RuntimeMs | DirectRunner | 139216.67 | 134943.71 |
-3.07 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_16_streaming | RuntimeMs | FlinkRunner | 450.56 | 520.76 | 15.58 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_batch | RuntimeMs | DataflowRunner | 21743.11 | 20566.55 | -5.41 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_batch | RuntimeMs | DirectRunner | 3166.78 | 3167.71 | 0.03 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_batch | RuntimeMs | FlinkRunner | 335.56 | 318.05 | -5.22 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_batch | RuntimeMs | SparkRunner | 484.57 | 495.38 | 2.23 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_1_batch | RuntimeMs | SparkStructuredStreamingRunner | 428.11 | 419.29
| -2.06 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_sql_batch | RuntimeMs | DataflowRunner | 31016.04 | 30931.0 | -0.27
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_sql_batch | RuntimeMs | DirectRunner | 3620.33 | 3787.9 | 4.63 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_1_sql_batch | RuntimeMs | FlinkRunner | 597.33 | 595.19 | -0.36 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_sql_batch | RuntimeMs | SparkRunner | 2457.82 | 2472.1 | 0.58 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 660.46 |
646.1 | -2.18 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_sql_streaming | RuntimeMs | DataflowRunner | 20786.14 | 21009.24 |
1.07 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_sql_streaming | RuntimeMs | DirectRunner | 11562.85 | 11587.33 |
0.21 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_sql_streaming | RuntimeMs | FlinkRunner | 721.78 | 736.24 | 2.0 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_streaming | RuntimeMs | DataflowRunner | 30614.69 | 30593.17 | -0.07
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_streaming | RuntimeMs | DirectRunner | 8262.59 | 8363.38 | 1.22 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_streaming | RuntimeMs | FlinkRunner | 669.0 | 679.43 | 1.56 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_batch | RuntimeMs | DataflowRunner | 15651.06 | 14406.14 | -7.95 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_batch | RuntimeMs | DirectRunner | 178.37 | 193.79 | 8.64 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_batch | RuntimeMs | FlinkRunner | 172.19 | 163.05 | -5.31 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_batch | RuntimeMs | SparkRunner | 291.11 | 302.67 | 3.97 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_batch | RuntimeMs | SparkStructuredStreamingRunner | 253.79 | 256.29
| 0.99 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_python_batch | RuntimeMs | DirectRunner | 7817.7 | 7795.05 | -0.29 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_sql_batch | RuntimeMs | DataflowRunner | 22630.21 | 22022.24 | -2.69
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_batch | RuntimeMs | DirectRunner | 1561.63 | 1570.67 | 0.58 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_batch | RuntimeMs | FlinkRunner | 408.85 | 385.62 | -5.68 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_batch | RuntimeMs | SparkRunner | 795.5 | 780.62 | -1.87 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 638.39 |
613.24 | -3.94 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_sql_streaming | RuntimeMs | DataflowRunner | 14326.18 | 14301.0 |
-0.18 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_streaming | RuntimeMs | DirectRunner | 6813.81 | 6851.0 | 0.55 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_streaming | RuntimeMs | FlinkRunner | 461.85 | 445.24 | -3.6 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_streaming | RuntimeMs | DataflowRunner | 21382.99 | 20507.32 | -4.1
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_streaming | RuntimeMs | DirectRunner | 5205.7 | 5290.57 | 1.63 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_streaming | RuntimeMs | FlinkRunner | 295.67 | 281.76 | -4.7 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_zetasql_batch | RuntimeMs | DataflowRunner | 72793.71 | 74305.14 |
2.08 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_batch | RuntimeMs | DirectRunner | 2872.04 | 2842.0 | -1.05
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_zetasql_batch | RuntimeMs | FlinkRunner | 887.19 | 873.14 | -1.58 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_zetasql_batch | RuntimeMs | SparkRunner | 1081.39 | 1071.62 | -0.9 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1067.11
| 1068.95 | 0.17 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_zetasql_streaming | RuntimeMs | DataflowRunner | 41046.0 | 41959.38
| 2.23 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_streaming | RuntimeMs | DirectRunner | 8219.78 | 8240.86 |
0.26 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_streaming | RuntimeMs | FlinkRunner | 1282.78 | 1314.29 |
2.46 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_batch | RuntimeMs | DataflowRunner | 26288.96 | 22512.45 | -14.37 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_batch | RuntimeMs | DirectRunner | 1007.28 | 997.24 | -1.0 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_3_batch | RuntimeMs | FlinkRunner | 1247.85 | 1281.29 | 2.68 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_batch | RuntimeMs | SparkRunner | 2249.39 | 2261.57 | 0.54 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_python_batch | RuntimeMs | DirectRunner | 10883.19 | 10970.57 | 0.8
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_sql_batch | RuntimeMs | DataflowRunner | 25554.75 | 26882.62 | 5.2 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_batch | RuntimeMs | DirectRunner | 3313.22 | 3376.76 | 1.92 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_sql_batch | RuntimeMs | FlinkRunner | 1456.37 | 1449.33 | -0.48 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_batch | RuntimeMs | SparkRunner | 3761.39 | 3698.1 | -1.68 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_streaming | RuntimeMs | DataflowRunner | 33378.89 | 33490.48 |
0.33 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_streaming | RuntimeMs | DirectRunner | 8597.11 | 8576.24 | -0.24
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_streaming | RuntimeMs | FlinkRunner | 1096.56 | 1049.05 | -4.33
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_streaming | RuntimeMs | DataflowRunner | 46087.77 | 45596.19 | -1.07
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_streaming | RuntimeMs | DirectRunner | 8130.3 | 8002.48 | -1.57 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_streaming | RuntimeMs | FlinkRunner | 624.3 | 622.29 | -0.32 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_zetasql_batch | RuntimeMs | DataflowRunner | 59427.82 | 59380.71 |
-0.08 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_batch | RuntimeMs | DirectRunner | 3732.96 | 3791.52 | 1.57
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_3_zetasql_batch | RuntimeMs | FlinkRunner | 1821.07 | 1862.71 | 2.29 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_batch | RuntimeMs | SparkRunner | 3424.14 | 3425.29 | 0.03 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_streaming | RuntimeMs | DataflowRunner | 49195.32 | 48601.67
| -1.21 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_zetasql_streaming | RuntimeMs | DirectRunner | 8953.37 | 8961.95 |
0.1 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_streaming | RuntimeMs | FlinkRunner | 1567.78 | 1581.24 |
0.86 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_batch | RuntimeMs | DataflowRunner | 31659.36 | 27949.68 | -11.72 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_batch | RuntimeMs | DirectRunner | 2500.81 | 2465.62 | -1.41 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_batch | RuntimeMs | FlinkRunner | 965.33 | 988.14 | 2.36 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_batch | RuntimeMs | SparkRunner | 1242.64 | 1247.95 | 0.43 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_4_batch | RuntimeMs | SparkStructuredStreamingRunner | 3208.29 |
3276.0 | 2.11 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_4_streaming | RuntimeMs | DataflowRunner | 50662.54 | 52298.38 | 3.23
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_streaming | RuntimeMs | DirectRunner | 2891.19 | 2912.48 | 0.74 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_streaming | RuntimeMs | FlinkRunner | 1247.59 | 1116.38 | -10.52 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_batch | RuntimeMs | DataflowRunner | 31800.55 | 29930.43 | -5.88 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_5_batch | RuntimeMs | DirectRunner | 4736.52 | 4452.5 | -6.0 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_batch | RuntimeMs | FlinkRunner | 906.22 | 919.19 | 1.43 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_5_batch | RuntimeMs | SparkRunner | 1622.5 | 1635.81 | 0.82 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_5_batch | RuntimeMs | SparkStructuredStreamingRunner | 1697.11 |
1659.52 | -2.21 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_5_python_batch | RuntimeMs | DirectRunner | 17675.78 | 17055.14 |
-3.51 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_streaming | RuntimeMs | DataflowRunner | 207716.95 | 206968.67 |
-0.36 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_streaming | RuntimeMs | DirectRunner | 24188.33 | 24299.0 | 0.46 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_streaming | RuntimeMs | FlinkRunner | 1529.22 | 1497.62 | -2.07 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_6_batch | RuntimeMs | DataflowRunner | 28115.0 | 25983.73 | -7.58 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_6_batch | RuntimeMs | DirectRunner | 1844.96 | 1807.1 | -2.05 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_6_batch | RuntimeMs | FlinkRunner | 618.78 | 641.05 | 3.6 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_batch | RuntimeMs | SparkRunner | 752.68 | 761.43 | 1.16 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_6_batch | RuntimeMs | SparkStructuredStreamingRunner | 1346.54 |
1368.67 | 1.64 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_6_streaming | RuntimeMs | DataflowRunner | 40687.25 | 41098.95 | 1.01
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_6_streaming | RuntimeMs | DirectRunner | 2184.85 | 2234.48 | 2.27 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_streaming | RuntimeMs | FlinkRunner | 566.56 | 572.48 | 1.05 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_7_batch | RuntimeMs | DataflowRunner | 60445.54 | 47545.68 | -21.34 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_batch | RuntimeMs | DirectRunner | 8859.04 | 8759.55 | -1.12 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_7_batch | RuntimeMs | FlinkRunner | 738.78 | 782.81 | 5.96 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_7_batch | RuntimeMs | SparkRunner | 1546.46 | 1593.95 | 3.07 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_batch | RuntimeMs | SparkStructuredStreamingRunner | 1593.14 |
1630.14 | 2.32 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_python_batch | RuntimeMs | DirectRunner | 20060.3 | 20029.95 | -0.15
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_sql_batch | RuntimeMs | DataflowRunner | 77379.36 | 78077.48 | 0.9 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_batch | RuntimeMs | DirectRunner | 326207.81 | 234895.57 |
-27.99 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_7_sql_batch | RuntimeMs | FlinkRunner | 2734.44 | 2746.38 | 0.44 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_batch | RuntimeMs | SparkRunner | 7420.39 | 7394.71 | -0.35 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 5586.82 |
5636.9 | 0.9 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_sql_streaming | RuntimeMs | DataflowRunner | 1024239.43 | 1056237.43
| 3.12 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_streaming | RuntimeMs | DirectRunner | 1037326.74 | 972176.48 |
-6.28 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_streaming | RuntimeMs | FlinkRunner | 3592.52 | 3665.71 | 2.04 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_streaming | RuntimeMs | DataflowRunner | 125741.63 | 122539.45 |
-2.55 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_streaming | RuntimeMs | DirectRunner | 861746.89 | 868400.86 | 0.77
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_streaming | RuntimeMs | FlinkRunner | 1291.56 | 1336.95 | 3.51 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_8_batch | RuntimeMs | DataflowRunner | 22129.38 | 19918.0 | -9.99 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_8_batch | RuntimeMs | DirectRunner | 741.35 | 666.81 | -10.05 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_batch | RuntimeMs | FlinkRunner | 534.52 | 568.67 | 6.39 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_8_batch | RuntimeMs | SparkRunner | 1554.5 | 1571.76 | 1.11 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_batch | RuntimeMs | SparkStructuredStreamingRunner | 1533.11 |
1547.43 | 0.93 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_8_python_batch | RuntimeMs | DirectRunner | 10666.89 | 10673.43 | 0.06
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_8_streaming | RuntimeMs | DataflowRunner | 60775.46 | 59663.89 | -1.83
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_streaming | RuntimeMs | DirectRunner | 7363.48 | 7111.14 | -3.43 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_streaming | RuntimeMs | FlinkRunner | 576.63 | 563.19 | -2.33 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_batch | RuntimeMs | DataflowRunner | 27142.71 | 24953.5 | -8.07 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_9_batch | RuntimeMs | DirectRunner | 1442.41 | 1447.1 | 0.33 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_9_batch | RuntimeMs | FlinkRunner | 387.19 | 385.62 | -0.4 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_9_batch | RuntimeMs | SparkRunner | 626.86 | 609.9 | -2.7 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_batch | RuntimeMs | SparkStructuredStreamingRunner | 1085.89 |
1104.81 | 1.74 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_9_streaming | RuntimeMs | DataflowRunner | 32481.07 | 32494.29 | 0.04
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_9_streaming | RuntimeMs | DirectRunner | 1793.67 | 1795.0 | 0.07 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_streaming | RuntimeMs | FlinkRunner | 379.93 | 369.0 | -2.88 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_PRs_0_batch | RuntimeMs | DataflowRunner | 22378.0 | 24488.0 | 9.43 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_PRs_10_batch | RuntimeMs | DataflowRunner | 45609.0 | 45568.75 | -0.09
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_PRs_11_batch | RuntimeMs | DataflowRunner | 36017.0 | 36639.25 | 1.73
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_PRs_12_batch | RuntimeMs | DataflowRunner | 13832.0 | 18226.75 | 31.77
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_PRs_15_batch | RuntimeMs | DataflowRunner | 41480.0 | 46634.5 | 12.43
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_PRs_16_batch | RuntimeMs | DataflowRunner | 53288.0 | 48511.75 | -8.96
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_PRs_1_batch | RuntimeMs | DataflowRunner | 15785.0 | 20258.0 | 28.34 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_PRs_2_batch | RuntimeMs | DataflowRunner | 12502.0 | 13473.0 | 7.77 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_PRs_5_batch | RuntimeMs | DataflowRunner | 23434.0 | 31875.25 | 36.02
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_PRs_8_batch | RuntimeMs | DataflowRunner | 16878.0 | 18556.25 | 9.94 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
tpcds_query10_Calcite_1GB | RuntimeMs | DataflowRunner | 365563.89 | 369865.77
| 1.18 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query10_Calcite_1GB | RuntimeMs | FlinkRunner | 34904.86 | 34925.14 |
0.06 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query10_Calcite_1GB | RuntimeMs | SparkRunner | 59470.11 | 59434.92 |
-0.06 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query10_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
52362.78 | 52770.24 | 0.78 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query25_Calcite_1GB | RuntimeMs | DataflowRunner | 373050.86 | 389173.77
| 4.32 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query25_Calcite_1GB | RuntimeMs | FlinkRunner | 40730.82 | 40530.32 |
-0.49 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query25_Calcite_1GB | RuntimeMs | SparkRunner | 61086.15 | 60449.16 |
-1.04 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query25_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
56619.89 | 57061.36 | 0.78 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query26_Calcite_1GB | RuntimeMs | DataflowRunner | 333824.04 | 337431.45
| 1.08 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query26_Calcite_1GB | RuntimeMs | FlinkRunner | 21159.71 | 21113.82 |
-0.22 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query26_Calcite_1GB | RuntimeMs | SparkRunner | 23830.04 | 24314.52 |
2.03 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query26_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
22811.3 | 23197.0 | 1.69 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query29_Calcite_1GB | RuntimeMs | DataflowRunner | 388209.32 | 393187.32
| 1.28 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query29_Calcite_1GB | RuntimeMs | FlinkRunner | 39113.14 | 39158.91 |
0.12 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query29_Calcite_1GB | RuntimeMs | SparkRunner | 57881.81 | 57879.0 |
-0.0 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query29_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
56270.07 | 56845.68 | 1.02 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query35_Calcite_1GB | RuntimeMs | DataflowRunner | 370973.71 | 377670.32
| 1.81 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query35_Calcite_1GB | RuntimeMs | FlinkRunner | 29593.14 | 29245.41 |
-1.18 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query35_Calcite_1GB | RuntimeMs | SparkRunner | 54077.37 | 54412.76 |
0.62 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query35_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
46587.59 | 46823.08 | 0.51 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query38_Calcite_1GB | RuntimeMs | DataflowRunner | 358846.61 | 351723.0
| -1.99 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query38_Calcite_1GB | RuntimeMs | FlinkRunner | 22174.36 | 21607.82 |
-2.55 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query38_Calcite_1GB | RuntimeMs | SparkRunner | 22897.52 | 23032.52 |
0.59 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query38_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner | 0.0 |
0.0 | 0.0 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query3_Calcite_1GB | RuntimeMs | DataflowRunner | 337804.21 | 327131.45
| -3.16 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query3_Calcite_1GB | RuntimeMs | FlinkRunner | 41051.14 | 37996.32 |
-7.44 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query3_Calcite_1GB | RuntimeMs | SparkRunner | 45043.04 | 40246.6 |
-10.65 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query3_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
40896.11 | 40623.56 | -0.67 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query40_Calcite_1GB | RuntimeMs | DataflowRunner | 352997.32 | 340269.91
| -3.61 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query40_Calcite_1GB | RuntimeMs | FlinkRunner | 28824.89 | 28541.32 |
-0.98 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query40_Calcite_1GB | RuntimeMs | SparkRunner | 26759.3 | 27131.32 |
1.39 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query40_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
25157.74 | 25705.16 | 2.18 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query42_Calcite_1GB | RuntimeMs | DataflowRunner | 337055.21 | 329066.5
| -2.37 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query42_Calcite_1GB | RuntimeMs | FlinkRunner | 22888.89 | 22649.64 |
-1.05 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query42_Calcite_1GB | RuntimeMs | SparkRunner | 24072.3 | 23907.36 |
-0.69 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query42_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
21595.11 | 22622.96 | 4.76 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query43_Calcite_1GB | RuntimeMs | DataflowRunner | 346840.04 | 327810.41
| -5.49 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query43_Calcite_1GB | RuntimeMs | FlinkRunner | 22861.07 | 22618.23 |
-1.06 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query43_Calcite_1GB | RuntimeMs | SparkRunner | 23809.78 | 24198.52 |
1.63 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query43_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
21283.67 | 21630.28 | 1.63 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query52_Calcite_1GB | RuntimeMs | DataflowRunner | 336967.46 | 331605.05
| -1.59 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query52_Calcite_1GB | RuntimeMs | FlinkRunner | 22843.43 | 22514.36 |
-1.44 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query52_Calcite_1GB | RuntimeMs | SparkRunner | 24143.96 | 24421.6 |
1.15 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query52_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
19843.22 | 20561.88 | 3.62 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query55_Calcite_1GB | RuntimeMs | DataflowRunner | 327120.25 | 328027.14
| 0.28 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query55_Calcite_1GB | RuntimeMs | FlinkRunner | 22377.54 | 22055.64 |
-1.44 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query55_Calcite_1GB | RuntimeMs | SparkRunner | 24188.85 | 24678.44 |
2.02 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query55_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
20234.0 | 20480.12 | 1.22 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query69_Calcite_1GB | RuntimeMs | DataflowRunner | 383546.82 | 366307.32
| -4.49 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query69_Calcite_1GB | RuntimeMs | FlinkRunner | 30478.04 | 30163.18 |
-1.03 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query69_Calcite_1GB | RuntimeMs | SparkRunner | 51913.78 | 52820.8 |
1.75 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query69_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
45882.81 | 46488.6 | 1.32 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query79_Calcite_1GB | RuntimeMs | DataflowRunner | 364570.39 | 356397.41
| -2.24 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query79_Calcite_1GB | RuntimeMs | FlinkRunner | 35120.57 | 35086.41 |
-0.1 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query79_Calcite_1GB | RuntimeMs | SparkRunner | 40606.22 | 41014.72 |
1.01 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query79_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
37862.78 | 38546.36 | 1.81 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query7_Calcite_1GB | RuntimeMs | DataflowRunner | 362796.82 | 351065.82
| -3.23 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query7_Calcite_1GB | RuntimeMs | FlinkRunner | 42262.39 | 42187.32 |
-0.18 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query7_Calcite_1GB | RuntimeMs | SparkRunner | 44039.78 | 44081.12 |
0.09 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query7_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
40840.85 | 40908.16 | 0.16 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query83_Calcite_1GB | RuntimeMs | DataflowRunner | 366510.68 | 365438.0
| -0.29 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query83_Calcite_1GB | RuntimeMs | FlinkRunner | 9463.11 | 9442.32 |
-0.22 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query83_Calcite_1GB | RuntimeMs | SparkRunner | 10092.96 | 10073.68 |
-0.19 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query83_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
23426.85 | 22628.36 | -3.41 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query84_Calcite_1GB | RuntimeMs | DataflowRunner | 342277.14 | 346658.18
| 1.28 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query84_Calcite_1GB | RuntimeMs | FlinkRunner | 19917.14 | 19439.41 |
-2.4 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query84_Calcite_1GB | RuntimeMs | SparkRunner | 18498.74 | 18526.48 |
0.15 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query84_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
17848.19 | 18191.24 | 1.92 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query87_Calcite_1GB | RuntimeMs | DataflowRunner | 348499.5 | 349028.82
| 0.15 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query87_Calcite_1GB | RuntimeMs | FlinkRunner | 21933.07 | 21660.5 |
-1.24 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query87_Calcite_1GB | RuntimeMs | SparkRunner | 23312.59 | 22675.44 |
-2.73 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query87_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
26797.37 | 26377.08 | -1.57 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query93_Calcite_1GB | RuntimeMs | DataflowRunner | 363191.14 | 365865.95
| 0.74 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query93_Calcite_1GB | RuntimeMs | FlinkRunner | 46215.46 | 46223.14 |
0.02 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query93_Calcite_1GB | RuntimeMs | SparkRunner | 48057.78 | 48341.08 |
0.59 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query93_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
38854.07 | 39227.44 | 0.96 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query96_Calcite_1GB | RuntimeMs | DataflowRunner | 340096.36 | 343878.77
| 1.11 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query96_Calcite_1GB | RuntimeMs | FlinkRunner | 18749.43 | 19634.77 |
4.72 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query96_Calcite_1GB | RuntimeMs | SparkRunner | 21106.81 | 21111.84 |
0.02 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query96_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
22980.07 | 23092.64 | 0.49 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)