You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/04/04 11:56:10 UTC

Beam Metrics Report (2023-04-04)

# Beam Metrics Report

Color legend:  >= 20 | >= 10 | <= -10 | <= -20  
---|---|---|---  
  
## Possible regression

**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**  
---|---|---|---|---|---|---  
compressed_textioit_results | read_time | - | 131.04 | 158.1 | 20.65 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
go_batch_cogbk_3 | dataflow_runtime | - | 111.61 | 159.65 | 43.04 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
go_batch_gbk_7 | dataflow_runtime | - | 108.87 | 123.67 | 13.59 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_cogbk_2 | dataflow_runtime_sec | - | 41.67 | 47.59 | 14.2 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_3 | dataflow_runtime_sec | - | 13.52 | 18.32 | 35.48 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_4 | dataflow_runtime_sec | - | 13.63 | 18.6 | 36.49 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_combine_1 | dataflow_runtime_sec | - | 62.22 | 69.1 | 11.06 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_4 | dataflow_runtime_sec | - | 27.81 | 31.58 | 13.55 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_5 | dataflow_runtime_sec | - | 25.02 | 29.67 | 18.59 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_gbk_4 | dataflow_runtime_sec | - | 18.29 | 22.58 | 23.44 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_4 | dataflow_v2_java17_runtime_sec | - | 20.82 | 23.47 | 12.7 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_5 | dataflow_v2_java11_runtime_sec | - | 19.23 | 22.58 | 17.42
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_6 | dataflow_runtime_sec | - | 33.73 | 42.07 | 24.74 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_pardo_1 | dataflow_runtime_sec | - | 18.76 | 23.99 | 27.86 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_1 | dataflow_v2_java17_runtime_sec | - | 11.89 | 13.46 |
13.14 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_3 | dataflow_runtime_sec | - | 13.39 | 16.65 | 24.34 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_3 | dataflow_v2_java11_runtime_sec | - | 10.78 | 18.3 | 69.83
|  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_3 | dataflow_v2_java17_runtime_sec | - | 10.76 | 14.89 |
38.36 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_4 | dataflow_runtime_sec | - | 26.31 | 31.21 | 18.63 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_cogbk_3 | dataflow_v2_java17_runtime_sec | - | 381.68 | 422.3 |
10.64 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_gbk_3 | dataflow_v2_java11_runtime_sec | - | 45.72 | 58.5 |
27.96 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_5 | dataflow_v2_java11_runtime_sec | - | 566.09 | 626.76 |
10.72 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
parquetioit_hdfs_results | write_time | - | 140.87 | 190.4 | 35.16 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
python_batch_gbk_3 | python_dataflow_batch_gbk_3_runtime | - | 31.71 | 39.8 |
25.5 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_sideinput_1 | python_dataflow_batch_sideinput_1_runtime | - | 2.0
| 2.5 | 25.0 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_5 | python_dataflow_batch_sideinput_5_runtime | - |
2.43 | 2.8 | 15.29 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_bqio_read_10GB_results | bqio_read_10GB_results_runtime | - | 101.86 |
113.2 | 11.14 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_spannerio_read_2GB_results | pyspanner_read_2GB_results_runtime | - |
22.0 | 24.33 | 10.61 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_textio_1GB_results | read_runtime | - | 104.57 | 117.0 | 11.89 |
[[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
tfrecordioit_results | read_time | - | 17.53 | 21.25 | 21.24 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
tfrecordioit_results | write_time | - | 21.74 | 24.2 | 11.32 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
xmlioit_results | write_time | - | 24.34 | 27.27 | 12.02 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
nexmark_0_sql_batch | RuntimeMs | DataflowRunner | 32638.44 | 37569.27 | 15.11
|  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_11_batch | RuntimeMs | DataflowRunner | 36195.29 | 40108.01 | 10.81 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_15_batch | RuntimeMs | DataflowRunner | 46358.44 | 52501.76 | 13.25 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_1_sql_batch | RuntimeMs | DataflowRunner | 30340.85 | 33899.55 | 11.73
|  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_sql_batch | RuntimeMs | DataflowRunner | 22041.63 | 25056.05 | 13.68
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_batch | RuntimeMs | DataflowRunner | 22735.19 | 26213.59 | 15.3 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_sql_batch | RuntimeMs | DataflowRunner | 25632.93 | 28425.5 | 10.89
|  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_7_batch | RuntimeMs | DataflowRunner | 47690.63 | 52532.86 | 10.15 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_sql_batch | RuntimeMs | DirectRunner | 883504.23 | 1137242.25 |
28.72 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_9_batch | RuntimeMs | DataflowRunner | 25482.67 | 28704.41 | 12.64 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
tpcds_query29_Calcite_1GB | RuntimeMs | FlinkRunner | 38733.96 | 42884.68 |
10.72 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)  
tpcds_query83_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
13698.67 | 17402.1 | 27.03 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)  
  
## Possible improvement

**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**  
---|---|---|---|---|---|---  
go_batch_cogbk_1 | dataflow_runtime | - | 304.33 | 258.0 | -15.22 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
go_batch_gbk_3 | dataflow_runtime | - | 63.29 | 23.93 | -62.18 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_cogbk_1 | dataflow_v2_java17_runtime_sec | - | 47.68 | 40.57 |
-14.91 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_4 | dataflow_v2_java11_runtime_sec | - | 15.72 | 12.86 |
-18.22 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_gbk_1 | dataflow_runtime_sec | - | 143.51 | 117.45 | -18.16 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_2 | dataflow_runtime_sec | - | 42.61 | 36.38 | -14.64 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_3 | dataflow_v2_java11_runtime_sec | - | 17.28 | 12.92 | -25.22
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_4 | dataflow_v2_java11_runtime_sec | - | 26.02 | 22.72 | -12.68
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_7 | dataflow_runtime_sec | - | 101.84 | 58.09 | -42.96 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_7 | dataflow_v2_java11_runtime_sec | - | 44.89 | 38.13 | -15.06
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_pardo_1 | dataflow_v2_java11_runtime_sec | - | 16.36 | 12.07 |
-26.22 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_1 | sparkstructuredstreaming_runtime_sec | - | 16.1 | 14.37 |
-10.77 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_3 | sparkstructuredstreaming_runtime_sec | - | 14.37 | 12.82
| -10.79 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_4 | sparkstructuredstreaming_runtime_sec | - | 41.84 | 36.97
| -11.66 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_cogbk_1 | dataflow_runtime_sec | - | 909.46 | 815.21 | -10.36 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_4 | dataflow_v2_java11_runtime_sec | - | 374.27 | 328.15
| -12.32 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_4 | dataflow_v2_java17_runtime_sec | - | 384.29 | 331.45
| -13.75 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_gbk_2 | dataflow_v2_java11_runtime_sec | - | 3024.99 | 2707.59
| -10.49 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_3 | dataflow_v2_java17_runtime_sec | - | 81.12 | 54.66 |
-32.62 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_6 | dataflow_v2_java17_runtime_sec | - | 222.21 | 190.4 |
-14.32 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
jdbcioit_results | read_time | - | 43.48 | 25.34 | -41.71 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
kafkaioit_results_runner_v2 | write_time | - | 161.54 | 141.8 | -12.22 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
python_batch_cogbk_2 | python_dataflow_batch_cogbk_2_runtime | - | 261.29 |
231.0 | -11.59 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_batch_gbk_4 | python_dataflow_batch_gbk_4_runtime | - | 105.0 | 70.2 |
-33.14 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_5 | python_dataflow_batch_gbk_5_runtime | - | 62.43 | 49.4 |
-20.87 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_7 | python_dataflow_batch_gbk_7_runtime | - | 278.43 | 243.2
| -12.65 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_pardo_1 | python_dataflow_batch_pardo_1_runtime | - | 160.57 |
135.0 | -15.93 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_sideinput_7 | python_dataflow_batch_sideinput_7_runtime | - |
149.43 | 111.4 | -25.45 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_psio_2GB_results | pubsub_io_perf_write_runtime | - | 146.86 | 98.0 |
-33.27 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_streaming_gbk_3 | python_dataflow_streaming_gbk_3_runtime | - | 107.71
| 88.4 | -17.93 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_streaming_pardo_6 | python_flink_streaming_pardo_6_runtime | - | 498.0
| 391.8 | -21.33 |  
sparkreceiverioit_results | read_time | - | 630.14 | 477.26 | -24.26 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
nexmark_2_streaming | RuntimeMs | FlinkRunner | 337.96 | 294.52 | -12.85 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_sql_streaming | RuntimeMs | DirectRunner | 3112150.33 | 2185927.13 |
-29.76 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
  
## All metrics

**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**  
---|---|---|---|---|---|---  
avroioit_hdfs_results | read_time | - | 83.04 | 76.12 | -8.33 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
avroioit_hdfs_results | write_time | - | 119.56 | 112.24 | -6.13 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
avroioit_results | read_time | - | 83.58 | 86.71 | 3.75 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
avroioit_results | write_time | - | 118.43 | 120.85 | 2.04 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_batch_avro | avro_write_time | - | 32.21 | 31.16 |
-3.24 |  [[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_batch_avro | read_time | - | 42.65 | 43.45 | 1.88 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_batch_json | read_time | - | 42.37 | 42.14 | -0.53 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_batch_json | write_time | - | 54.25 | 52.79 | -2.68 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_stream | read_time | - | 45.15 | 43.51 | -3.64 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_stream | write_time | - | 193.24 | 206.64 | 6.94 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
cdapioit_results | read_time | - | 16.82 | 15.59 | -7.34 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
cdapioit_results | write_time | - | 27.26 | 26.23 | -3.79 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
compressed_textioit_hdfs_results | read_time | - | 132.21 | 136.23 | 3.04 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
compressed_textioit_hdfs_results | write_time | - | 225.26 | 216.89 | -3.72 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
compressed_textioit_results | read_time | - | 131.04 | 158.1 | 20.65 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
compressed_textioit_results | write_time | - | 209.66 | 216.9 | 3.45 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
go_batch_cogbk_1 | dataflow_runtime | - | 304.33 | 258.0 | -15.22 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
go_batch_cogbk_2 | dataflow_runtime | - | 154.27 | 147.78 | -4.21 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
go_batch_cogbk_3 | dataflow_runtime | - | 111.61 | 159.65 | 43.04 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
go_batch_cogbk_4 | dataflow_runtime | - | 113.44 | 120.4 | 6.14 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
go_batch_combine_1 | dataflow_runtime | - | 438.4 | 477.77 | 8.98 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
go_batch_combine_4 | dataflow_runtime | - | 76.99 | 75.86 | -1.47 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
go_batch_combine_5 | dataflow_runtime | - | 71.62 | 70.16 | -2.04 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
go_batch_gbk_1 | dataflow_runtime | - | 394.13 | 396.22 | 0.53 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_2 | dataflow_runtime | - | 106.83 | 102.9 | -3.68 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_3 | dataflow_runtime | - | 63.29 | 23.93 | -62.18 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_4 | dataflow_runtime | - | 53.53 | 52.86 | -1.25 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_5 | dataflow_runtime | - | 44.87 | 44.63 | -0.54 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_6 | dataflow_runtime | - | 104.79 | 102.55 | -2.14 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_7 | dataflow_runtime | - | 108.87 | 123.67 | 13.59 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_pardo_1 | dataflow_runtime | - | 83.87 | 84.16 | 0.34 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
go_batch_pardo_1 | flink_runtime | - | 385.37 | 384.08 | -0.34 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
go_batch_pardo_2 | dataflow_runtime | - | 602.86 | 644.92 | 6.98 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
go_batch_pardo_2 | flink_runtime | - | 3013.98 | 3043.83 | 0.99 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
go_batch_pardo_3 | dataflow_runtime | - | 66.15 | 66.39 | 0.36 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
go_batch_pardo_3 | flink_runtime | - | 272.59 | 273.61 | 0.37 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
go_batch_pardo_4 | dataflow_runtime | - | 68.94 | 69.41 | 0.68 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
go_batch_pardo_4 | flink_runtime | - | 308.11 | 308.0 | -0.04 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
go_batch_sideinput_3 | dataflow_runtime | - | 2.81 | 2.85 | 1.46 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
go_batch_sideinput_4 | dataflow_runtime | - | 250.92 | 251.48 | 0.22 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
hadoopformatioit_results | read_time | - | 17.08 | 16.83 | -1.44 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
hadoopformatioit_results | write_time | - | 26.15 | 25.38 | -2.94 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
java_batch_cogbk_1 | dataflow_runtime_sec | - | 39.46 | 42.75 | 8.34 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_1 | dataflow_v2_java11_runtime_sec | - | 45.23 | 49.07 | 8.48
|  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_1 | dataflow_v2_java17_runtime_sec | - | 47.68 | 40.57 |
-14.91 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_1 | sparkstructuredstreaming_runtime_sec | - | 66.53 | 67.79
| 1.89 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_2 | dataflow_runtime_sec | - | 41.67 | 47.59 | 14.2 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_2 | dataflow_v2_java11_runtime_sec | - | 45.92 | 46.6 | 1.49
|  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_2 | dataflow_v2_java17_runtime_sec | - | 43.89 | 41.81 |
-4.73 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_2 | sparkstructuredstreaming_runtime_sec | - | 62.44 | 61.71
| -1.18 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_3 | dataflow_runtime_sec | - | 13.52 | 18.32 | 35.48 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_3 | dataflow_v2_java11_runtime_sec | - | 13.99 | 13.03 |
-6.83 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_3 | dataflow_v2_java17_runtime_sec | - | 13.07 | 12.11 |
-7.33 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_3 | sparkstructuredstreaming_runtime_sec | - | 12.67 | 12.0 |
-5.28 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_4 | dataflow_runtime_sec | - | 13.63 | 18.6 | 36.49 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_4 | dataflow_v2_java11_runtime_sec | - | 15.72 | 12.86 |
-18.22 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_4 | dataflow_v2_java17_runtime_sec | - | 13.35 | 12.27 |
-8.05 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_4 | sparkstructuredstreaming_runtime_sec | - | 13.3 | 12.48 |
-6.12 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_combine_1 | dataflow_runtime_sec | - | 62.22 | 69.1 | 11.06 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_1 | sparkstructuredstreaming_runtime_sec | - | 229.43 |
228.32 | -0.48 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_4 | dataflow_runtime_sec | - | 27.81 | 31.58 | 13.55 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_4 | sparkstructuredstreaming_runtime_sec | - | 59.36 |
54.91 | -7.49 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_5 | dataflow_runtime_sec | - | 25.02 | 29.67 | 18.59 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_5 | sparkstructuredstreaming_runtime_sec | - | 58.99 |
53.38 | -9.51 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_gbk_1 | dataflow_runtime_sec | - | 143.51 | 117.45 | -18.16 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_1 | dataflow_v2_java11_runtime_sec | - | 91.66 | 90.78 | -0.96
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_1 | dataflow_v2_java17_runtime_sec | - | 91.21 | 91.02 | -0.21
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_1 | sparkstructuredstreaming_runtime_sec | - | 260.45 | 252.79
| -2.94 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_2 | dataflow_runtime_sec | - | 42.61 | 36.38 | -14.64 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_2 | dataflow_v2_java11_runtime_sec | - | 42.03 | 42.79 | 1.79 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_2 | dataflow_v2_java17_runtime_sec | - | 41.17 | 40.24 | -2.26
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_2 | sparkstructuredstreaming_runtime_sec | - | 54.88 | 55.43 |
0.99 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_3 | dataflow_runtime_sec | - | 11.46 | 12.08 | 5.37 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_3 | dataflow_v2_java11_runtime_sec | - | 17.28 | 12.92 | -25.22
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_3 | dataflow_v2_java17_runtime_sec | - | 15.73 | 15.54 | -1.2 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_3 | sparkstructuredstreaming_runtime_sec | - | 8.46 | 8.26 |
-2.38 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_4 | dataflow_runtime_sec | - | 18.29 | 22.58 | 23.44 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_4 | dataflow_v2_java11_runtime_sec | - | 26.02 | 22.72 | -12.68
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_4 | dataflow_v2_java17_runtime_sec | - | 20.82 | 23.47 | 12.7 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_4 | sparkstructuredstreaming_runtime_sec | - | 47.65 | 47.94 |
0.61 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_5 | dataflow_runtime_sec | - | 19.54 | 21.45 | 9.76 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_5 | dataflow_v2_java11_runtime_sec | - | 19.23 | 22.58 | 17.42
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_5 | dataflow_v2_java17_runtime_sec | - | 20.07 | 19.31 | -3.77
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_5 | sparkstructuredstreaming_runtime_sec | - | 44.9 | 46.19 |
2.86 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_6 | dataflow_runtime_sec | - | 33.73 | 42.07 | 24.74 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_6 | dataflow_v2_java11_runtime_sec | - | 29.42 | 28.43 | -3.36
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_6 | dataflow_v2_java17_runtime_sec | - | 27.64 | 27.69 | 0.15 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_6 | sparkstructuredstreaming_runtime_sec | - | 34.11 | 32.28 |
-5.38 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_7 | dataflow_runtime_sec | - | 101.84 | 58.09 | -42.96 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_7 | dataflow_v2_java11_runtime_sec | - | 44.89 | 38.13 | -15.06
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_7 | dataflow_v2_java17_runtime_sec | - | 33.81 | 36.04 | 6.6 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_7 | sparkstructuredstreaming_runtime_sec | - | 34.87 | 34.49 |
-1.09 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_pardo_1 | dataflow_runtime_sec | - | 18.76 | 23.99 | 27.86 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_1 | dataflow_v2_java11_runtime_sec | - | 16.36 | 12.07 |
-26.22 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_1 | dataflow_v2_java17_runtime_sec | - | 11.89 | 13.46 |
13.14 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_1 | sparkstructuredstreaming_runtime_sec | - | 16.1 | 14.37 |
-10.77 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_2 | dataflow_runtime_sec | - | 201.46 | 212.08 | 5.27 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_2 | dataflow_v2_java11_runtime_sec | - | 56.35 | 55.65 |
-1.25 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_2 | dataflow_v2_java17_runtime_sec | - | 53.77 | 57.02 | 6.04
|  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_2 | sparkstructuredstreaming_runtime_sec | - | 87.31 | 83.44
| -4.43 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_3 | dataflow_runtime_sec | - | 13.39 | 16.65 | 24.34 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_3 | dataflow_v2_java11_runtime_sec | - | 10.78 | 18.3 | 69.83
|  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_3 | dataflow_v2_java17_runtime_sec | - | 10.76 | 14.89 |
38.36 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_3 | sparkstructuredstreaming_runtime_sec | - | 14.37 | 12.82
| -10.79 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_4 | dataflow_runtime_sec | - | 26.31 | 31.21 | 18.63 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_4 | dataflow_v2_java11_runtime_sec | - | 24.26 | 26.03 | 7.3
|  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_4 | dataflow_v2_java17_runtime_sec | - | 24.95 | 23.49 |
-5.86 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_4 | sparkstructuredstreaming_runtime_sec | - | 41.84 | 36.97
| -11.66 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_cogbk_1 | dataflow_runtime_sec | - | 909.46 | 815.21 | -10.36 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_1 | dataflow_v2_java11_runtime_sec | - | 3040.83 |
3116.48 | 2.49 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_1 | dataflow_v2_java17_runtime_sec | - | 2367.67 |
2550.98 | 7.74 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_2 | dataflow_runtime_sec | - | 874.39 | 903.25 | 3.3 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_2 | dataflow_v2_java11_runtime_sec | - | 3590.12 |
3387.73 | -5.64 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_2 | dataflow_v2_java17_runtime_sec | - | 2922.75 | 2918.5
| -0.15 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_3 | dataflow_runtime_sec | - | 120.84 | 114.02 | -5.64 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_3 | dataflow_v2_java11_runtime_sec | - | 380.99 | 352.61
| -7.45 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_3 | dataflow_v2_java17_runtime_sec | - | 381.68 | 422.3 |
10.64 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_4 | dataflow_runtime_sec | - | 123.97 | 112.5 | -9.25 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_4 | dataflow_v2_java11_runtime_sec | - | 374.27 | 328.15
| -12.32 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_4 | dataflow_v2_java17_runtime_sec | - | 384.29 | 331.45
| -13.75 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_combine_1 | dataflow_runtime_sec | - | 452.83 | 452.85 | 0.01 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_streaming_combine_4 | dataflow_runtime_sec | - | 310.27 | 307.06 | -1.03
|  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_streaming_combine_5 | dataflow_runtime_sec | - | 302.09 | 290.71 | -3.77
|  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_streaming_gbk_1 | dataflow_runtime_sec | - | 646.07 | 608.12 | -5.87 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_1 | dataflow_v2_java11_runtime_sec | - | 828.71 | 908.41 |
9.62 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_1 | dataflow_v2_java17_runtime_sec | - | 884.12 | 912.65 |
3.23 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_2 | dataflow_runtime_sec | - | 803.75 | 777.78 | -3.23 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_2 | dataflow_v2_java11_runtime_sec | - | 3024.99 | 2707.59
| -10.49 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_2 | dataflow_v2_java17_runtime_sec | - | 3293.57 | 3195.69
| -2.97 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_3 | dataflow_runtime_sec | - | 23.63 | 23.83 | 0.84 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_3 | dataflow_v2_java11_runtime_sec | - | 45.72 | 58.5 |
27.96 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_3 | dataflow_v2_java17_runtime_sec | - | 81.12 | 54.66 |
-32.62 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_4 | dataflow_runtime_sec | - | 296.53 | 281.52 | -5.06 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_4 | dataflow_v2_java11_runtime_sec | - | 625.78 | 635.81 |
1.6 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_4 | dataflow_v2_java17_runtime_sec | - | 669.1 | 607.32 |
-9.23 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_5 | dataflow_runtime_sec | - | 290.18 | 284.29 | -2.03 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_5 | dataflow_v2_java11_runtime_sec | - | 566.09 | 626.76 |
10.72 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_5 | dataflow_v2_java17_runtime_sec | - | 607.95 | 563.21 |
-7.36 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_6 | dataflow_runtime_sec | - | 72.8 | 72.98 | 0.25 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_6 | dataflow_v2_java11_runtime_sec | - | 186.68 | 178.58 |
-4.34 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_6 | dataflow_v2_java17_runtime_sec | - | 222.21 | 190.4 |
-14.32 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_7 | dataflow_runtime_sec | - | 122.86 | 130.73 | 6.4 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_7 | dataflow_v2_java11_runtime_sec | - | 247.57 | 231.62 |
-6.44 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_7 | dataflow_v2_java17_runtime_sec | - | 231.35 | 215.4 |
-6.89 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_pardo_1 | dataflow_runtime_sec | - | 19.25 | 19.55 | 1.57 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_1 | dataflow_v2_java11_runtime_sec | - | 25.35 | 26.48 |
4.44 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_1 | dataflow_v2_java17_runtime_sec | - | 21.82 | 23.21 |
6.37 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_2 | dataflow_runtime_sec | - | 223.42 | 208.37 | -6.73 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_2 | dataflow_v2_java11_runtime_sec | - | 93.45 | 84.12 |
-9.99 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_2 | dataflow_v2_java17_runtime_sec | - | 83.55 | 84.63 |
1.29 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_3 | dataflow_runtime_sec | - | 12.15 | 12.33 | 1.52 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_3 | dataflow_v2_java11_runtime_sec | - | 23.18 | 22.08 |
-4.76 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_3 | dataflow_v2_java17_runtime_sec | - | 20.54 | 21.91 |
6.64 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_4 | dataflow_runtime_sec | - | 31.49 | 31.71 | 0.7 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_4 | dataflow_v2_java11_runtime_sec | - | 39.66 | 36.88 |
-7.01 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_4 | dataflow_v2_java17_runtime_sec | - | 34.01 | 36.05 |
5.97 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
jdbcioit_results | read_time | - | 43.48 | 25.34 | -41.71 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
jdbcioit_results | write_time | - | 37.54 | 35.07 | -6.58 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
kafkaioit_results | read_time | - | 982.11 | 1013.57 | 3.2 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
kafkaioit_results | write_time | - | 139.32 | 135.19 | -2.96 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
kafkaioit_results_runner_v2 | read_time | - | 993.49 | 1002.76 | 0.93 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
kafkaioit_results_runner_v2 | write_time | - | 161.54 | 141.8 | -12.22 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
many_files_textioit_hdfs_results | read_time | - | 15.61 | 15.28 | -2.12 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
many_files_textioit_hdfs_results | write_time | - | 64.34 | 66.05 | 2.66 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
many_files_textioit_results | read_time | - | 24.73 | 22.84 | -7.62 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
many_files_textioit_results | write_time | - | 59.38 | 58.98 | -0.68 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
mongodbioit_results | read_time | - | 29.03 | 30.46 | 4.92 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
mongodbioit_results | write_time | - | 48.3 | 48.49 | 0.39 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
parquetioit_hdfs_results | read_time | - | 85.09 | 82.18 | -3.42 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
parquetioit_hdfs_results | write_time | - | 140.87 | 190.4 | 35.16 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
parquetioit_results | read_time | - | 84.91 | 88.78 | 4.56 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
parquetioit_results | write_time | - | 138.24 | 143.22 | 3.6 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
python_batch_cogbk_1 | python_dataflow_batch_cogbk_1_runtime | - | 381.57 |
345.8 | -9.37 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_batch_cogbk_2 | python_dataflow_batch_cogbk_2_runtime | - | 261.29 |
231.0 | -11.59 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_batch_cogbk_3 | python_dataflow_batch_cogbk_3_runtime | - | 205.71 |
206.0 | 0.14 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_batch_cogbk_4 | python_dataflow_batch_cogbk_4_runtime | - | 207.57 |
209.0 | 0.69 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_batch_combine_1 | python_dataflow_batch_combine_1_runtime | - | 770.33
| 706.6 | -8.27 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_combine_1 | python_flink_batch_combine_1_runtime | - | 5438.83 |
5386.6 | -0.96 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_combine_4 | python_dataflow_batch_combine_4_runtime | - | 49.83 |
50.0 | 0.33 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_combine_4 | python_flink_batch_combine_4_runtime | - | 207.33 |
202.4 | -2.38 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_combine_5 | python_dataflow_batch_combine_5_runtime | - | 29.33 |
30.0 | 2.27 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_combine_5 | python_flink_batch_combine_5_runtime | - | 179.0 |
181.8 | 1.56 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_gbk_1 | python_dataflow_batch_gbk_1_runtime | - | 1365.29 |
1390.8 | 1.87 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_2 | python_dataflow_batch_gbk_2_runtime | - | 249.0 | 248.2 |
-0.32 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_3 | python_dataflow_batch_gbk_3_runtime | - | 31.71 | 39.8 |
25.5 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_4 | python_dataflow_batch_gbk_4_runtime | - | 105.0 | 70.2 |
-33.14 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_5 | python_dataflow_batch_gbk_5_runtime | - | 62.43 | 49.4 |
-20.87 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_6 | python_dataflow_batch_gbk_6_runtime | - | 220.29 | 225.4
| 2.32 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_7 | python_dataflow_batch_gbk_7_runtime | - | 278.43 | 243.2
| -12.65 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_pardo_1 | python_dataflow_batch_pardo_1_runtime | - | 160.57 |
135.0 | -15.93 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_1 | python_flink_batch_pardo_1_runtime | - | 919.86 | 935.8
| 1.73 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_2 | python_dataflow_batch_pardo_2_runtime | - | 1322.14 |
1329.6 | 0.56 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_3 | python_dataflow_batch_pardo_3_runtime | - | 150.57 |
146.6 | -2.64 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_3 | python_flink_batch_pardo_3_runtime | - | 745.86 | 748.4
| 0.34 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_4 | python_dataflow_batch_pardo_4_runtime | - | 318.57 |
327.8 | 2.9 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_4 | python_flink_batch_pardo_4_runtime | - | 2434.0 |
2476.2 | 1.73 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_sideinput_1 | python_dataflow_batch_sideinput_1_runtime | - | 2.0
| 2.5 | 25.0 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_10 | python_dataflow_batch_sideinput_10_runtime | - |
905.71 | 874.0 | -3.5 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_2 | python_dataflow_batch_sideinput_2_runtime | - |
2.43 | 2.67 | 9.8 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_3 | python_dataflow_batch_sideinput_3_runtime | - | 3.0
| 2.8 | -6.67 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_4 | python_dataflow_batch_sideinput_4_runtime | - |
30.86 | 28.8 | -6.67 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_5 | python_dataflow_batch_sideinput_5_runtime | - |
2.43 | 2.8 | 15.29 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_6 | python_dataflow_batch_sideinput_6_runtime | - |
2.43 | 2.2 | -9.41 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_7 | python_dataflow_batch_sideinput_7_runtime | - |
149.43 | 111.4 | -25.45 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_8 | python_dataflow_batch_sideinput_8_runtime | - |
154.14 | 142.6 | -7.49 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_9 | python_dataflow_batch_sideinput_9_runtime | - |
941.29 | 976.2 | 3.71 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_bqio_read_10GB_results | bqio_read_10GB_results_runtime | - | 101.86 |
113.2 | 11.14 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_bqio_write_10GB_results | bqio_write_10GB_results_runtime | - | 246.83
| 258.5 | 4.73 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_direct_microbenchmarks | fn_api_runner_microbenchmark_runtime_sec | - |
612.52 | 566.29 | -7.55 |  
python_direct_microbenchmarks | teststream_microbenchmark_runtime_sec | - |
366.48 | 346.38 | -5.49 |  
python_kafkaio_results | read_runtime | - | 228.86 | 234.0 | 2.25 |
[[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_kafkaio_results | write_runtime | - | 384.14 | 382.0 | -0.56 |
[[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_psio_2GB_results | pubsub_io_perf_read_runtime | - | 173.0 | 161.33 |
-6.74 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_psio_2GB_results | pubsub_io_perf_write_runtime | - | 146.86 | 98.0 |
-33.27 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_spanner_write_2GB_results | pyspanner_write_2GB_results_runtime | - |
1785.17 | 1812.0 | 1.5 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_spannerio_read_2GB_results | pyspanner_read_2GB_results_runtime | - |
22.0 | 24.33 | 10.61 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_streaming_cogbk_1 | python_dataflow_streaming_cogbk_1_runtime | - |
620.43 | 575.2 | -7.29 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_streaming_cogbk_2 | python_dataflow_streaming_cogbk_2_runtime | - |
378.29 | 350.2 | -7.42 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_streaming_cogbk_3 | python_dataflow_streaming_cogbk_3_runtime | - |
375.0 | 375.4 | 0.11 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_streaming_cogbk_4 | python_dataflow_streaming_cogbk_4_runtime | - |
332.43 | 316.0 | -4.94 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_streaming_gbk_3 | python_dataflow_streaming_gbk_3_runtime | - | 107.71
| 88.4 | -17.93 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_streaming_gbk_6 | python_dataflow_streaming_gbk_6_runtime | - | 469.86
| 471.8 | 0.41 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_streaming_gbk_7 | python_dataflow_streaming_gbk_7_runtime | - | 476.29
| 460.8 | -3.25 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_streaming_pardo_1 | python_dataflow_streaming_pardo_1_runtime | - |
214.14 | 211.8 | -1.09 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_1 | python_flink_streaming_pardo_5_runtime | - | 281.67
| 283.0 | 0.47 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_2 | python_dataflow_streaming_pardo_2_runtime | - |
2323.86 | 2474.2 | 6.47 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_2 | python_flink_streaming_pardo_2_runtime | - |
11442.67 | 11799.8 | 3.12 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_3 | python_dataflow_streaming_pardo_3_runtime | - |
148.57 | 153.2 | 3.12 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_3 | python_flink_streaming_pardo_3_runtime | - | 420.67
| 438.0 | 4.12 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_4 | python_dataflow_streaming_pardo_4_runtime | - |
447.14 | 405.6 | -9.29 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_4 | python_flink_streaming_pardo_4_runtime | - | 1018.0
| 1013.2 | -0.47 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_6 | python_flink_streaming_pardo_6_runtime | - | 498.0
| 391.8 | -21.33 |  
python_textio_1GB_results | read_runtime | - | 104.57 | 117.0 | 11.89 |
[[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_textio_1GB_results | write_runtime | - | 190.0 | 187.5 | -1.32 |
[[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
singlestoreioit_results | read_time | - | 92.75 | 91.45 | -1.4 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
singlestoreioit_results | write_time | - | 25.36 | 23.73 | -6.41 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
sparkreceiverioit_results | read_time | - | 630.14 | 477.26 | -24.26 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
textioit_hdfs_results | read_time | - | 17.04 | 17.85 | 4.79 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
textioit_hdfs_results | write_time | - | 32.7 | 33.85 | 3.51 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
textioit_results | read_time | - | 18.48 | 19.57 | 5.91 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
textioit_results | write_time | - | 31.0 | 31.38 | 1.24 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
tfrecordioit_results | read_time | - | 17.53 | 21.25 | 21.24 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
tfrecordioit_results | write_time | - | 21.74 | 24.2 | 11.32 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
wordcount_py37_results | runtime | - | 828.04 | 823.51 | -0.55 |
[[1]](http://metrics.beam.apache.org/d/1cnwVDkGk)  
xmlioit_hdfs_results | read_time | - | 22.64 | 20.9 | -7.7 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
xmlioit_hdfs_results | write_time | - | 25.9 | 27.44 | 5.94 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
xmlioit_results | read_time | - | 24.75 | 23.44 | -5.26 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
xmlioit_results | write_time | - | 24.34 | 27.27 | 12.02 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
nexmark_0_batch | RuntimeMs | DataflowRunner | 26998.3 | 28308.22 | 4.85 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_batch | RuntimeMs | DirectRunner | 1820.32 | 1783.46 | -2.02 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_batch | RuntimeMs | FlinkRunner | 1092.89 | 1103.33 | 0.96 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_0_batch | RuntimeMs | SparkRunner | 1311.96 | 1381.05 | 5.27 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_batch | RuntimeMs | SparkStructuredStreamingRunner | 1217.63 |
1233.29 | 1.29 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_python_batch | RuntimeMs | DirectRunner | 12267.78 | 12293.43 | 0.21
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_sql_batch | RuntimeMs | DataflowRunner | 32638.44 | 37569.27 | 15.11
|  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_sql_batch | RuntimeMs | DirectRunner | 5750.31 | 5759.75 | 0.16 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_0_sql_batch | RuntimeMs | FlinkRunner | 1135.26 | 1175.81 | 3.57 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_sql_batch | RuntimeMs | SparkRunner | 3439.0 | 3391.38 | -1.38 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_0_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1380.78 |
1437.14 | 4.08 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_sql_streaming | RuntimeMs | DataflowRunner | 23400.89 | 21944.14 |
-6.23 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_sql_streaming | RuntimeMs | DirectRunner | 16024.54 | 15811.33 |
-1.33 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_sql_streaming | RuntimeMs | FlinkRunner | 1704.93 | 1750.24 | 2.66 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_streaming | RuntimeMs | DataflowRunner | 37885.29 | 37711.53 | -0.46
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_streaming | RuntimeMs | DirectRunner | 12239.5 | 12441.95 | 1.65 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_streaming | RuntimeMs | FlinkRunner | 1561.67 | 1601.71 | 2.56 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_zetasql_batch | RuntimeMs | DataflowRunner | 117280.37 | 121455.45 |
3.56 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_0_zetasql_batch | RuntimeMs | DirectRunner | 6997.12 | 6938.33 | -0.84
|  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_zetasql_batch | RuntimeMs | FlinkRunner | 2499.81 | 2480.1 | -0.79 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_zetasql_batch | RuntimeMs | SparkRunner | 4793.48 | 4873.67 | 1.67 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_zetasql_batch | RuntimeMs | SparkStructuredStreamingRunner | 2756.15
| 2861.67 | 3.83 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_zetasql_streaming | RuntimeMs | DataflowRunner | 67023.81 | 67407.09
| 0.57 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_zetasql_streaming | RuntimeMs | DirectRunner | 18116.5 | 18208.73 |
0.51 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_zetasql_streaming | RuntimeMs | FlinkRunner | 3649.89 | 3856.0 |
5.65 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_10_batch | RuntimeMs | DataflowRunner | 48656.4 | 46527.77 | -4.37 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_10_batch | RuntimeMs | DirectRunner | 4687.89 | 4792.71 | 2.24 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_10_batch | RuntimeMs | FlinkRunner | 646.85 | 651.1 | 0.66 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_10_batch | RuntimeMs | SparkRunner | 682.48 | 705.29 | 3.34 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_10_batch | RuntimeMs | SparkStructuredStreamingRunner | 908.78 | 941.9
| 3.65 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_10_python_batch | RuntimeMs | DirectRunner | 26068.11 | 26074.95 |
0.03 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_10_streaming | RuntimeMs | DataflowRunner | 105425.8 | 102793.38 |
-2.5 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_10_streaming | RuntimeMs | DirectRunner | 45291.73 | 44500.1 | -1.75 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_10_streaming | RuntimeMs | FlinkRunner | 1733.96 | 1587.52 | -8.45 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_11_batch | RuntimeMs | DataflowRunner | 36195.29 | 40108.01 | 10.81 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_11_batch | RuntimeMs | DirectRunner | 1375.02 | 1455.73 | 5.87 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_11_batch | RuntimeMs | FlinkRunner | 256.7 | 254.52 | -0.85 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_11_batch | RuntimeMs | SparkRunner | 1548.37 | 1577.24 | 1.86 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_11_batch | RuntimeMs | SparkStructuredStreamingRunner | 1225.07 |
1208.1 | -1.39 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_11_python_batch | RuntimeMs | DirectRunner | 20455.89 | 20383.86 |
-0.35 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_11_streaming | RuntimeMs | DataflowRunner | 184559.05 | 181814.47 |
-1.49 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_11_streaming | RuntimeMs | DirectRunner | 10880.42 | 10836.1 | -0.41 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_11_streaming | RuntimeMs | FlinkRunner | 1492.7 | 1485.43 | -0.49 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_12_batch | RuntimeMs | DataflowRunner | 18227.07 | 19533.57 | 7.17 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_12_batch | RuntimeMs | DirectRunner | 2598.31 | 2758.8 | 6.18 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_12_batch | RuntimeMs | FlinkRunner | 186.74 | 172.57 | -7.59 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_12_batch | RuntimeMs | SparkRunner | 937.11 | 959.76 | 2.42 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_12_batch | RuntimeMs | SparkStructuredStreamingRunner | 829.44 | 881.0
| 6.22 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_12_streaming | RuntimeMs | DataflowRunner | 94218.39 | 91751.51 |
-2.62 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_12_streaming | RuntimeMs | DirectRunner | 9477.46 | 9406.45 | -0.75 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_12_streaming | RuntimeMs | FlinkRunner | 704.04 | 659.81 | -6.28 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_batch | RuntimeMs | DataflowRunner | 32510.07 | 33340.41 | 2.55 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_batch | RuntimeMs | DirectRunner | 3554.77 | 3404.1 | -4.24 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_13_batch | RuntimeMs | FlinkRunner | 452.19 | 446.48 | -1.26 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_batch | RuntimeMs | SparkRunner | 359.33 | 376.1 | 4.66 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_batch | RuntimeMs | SparkStructuredStreamingRunner | 996.7 | 996.48
| -0.02 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_sql_batch | RuntimeMs | DataflowRunner | 59889.37 | 61041.32 | 1.92
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_13_sql_batch | RuntimeMs | DirectRunner | 9204.88 | 9250.95 | 0.5 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_sql_batch | RuntimeMs | FlinkRunner | 1067.59 | 1171.1 | 9.69 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_13_sql_batch | RuntimeMs | SparkRunner | 3460.56 | 3471.95 | 0.33 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_13_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1474.07 |
1532.86 | 3.99 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_sql_streaming | RuntimeMs | DataflowRunner | 33715.33 | 34148.77 |
1.29 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_sql_streaming | RuntimeMs | DirectRunner | 18926.33 | 18825.8 |
-0.53 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_sql_streaming | RuntimeMs | FlinkRunner | 2627.15 | 2624.71 | -0.09
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_streaming | RuntimeMs | DataflowRunner | 25534.81 | 27515.91 | 7.76
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_streaming | RuntimeMs | DirectRunner | 10093.38 | 10113.65 | 0.2 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_streaming | RuntimeMs | FlinkRunner | 1463.15 | 1436.86 | -1.8 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_zetasql_batch | RuntimeMs | DataflowRunner | 270981.04 | 269882.18
| -0.41 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_zetasql_batch | RuntimeMs | DirectRunner | 10341.08 | 10439.47 |
0.95 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_zetasql_batch | RuntimeMs | FlinkRunner | 2828.19 | 3003.43 | 6.2 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_13_zetasql_batch | RuntimeMs | SparkRunner | 5340.44 | 5413.76 | 1.37
|  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_zetasql_batch | RuntimeMs | SparkStructuredStreamingRunner |
3968.15 | 4086.1 | 2.97 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_zetasql_streaming | RuntimeMs | DataflowRunner | 111017.74 |
112147.05 | 1.02 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_zetasql_streaming | RuntimeMs | DirectRunner | 22609.5 | 22770.73 |
0.71 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_zetasql_streaming | RuntimeMs | FlinkRunner | 4238.78 | 4280.0 |
0.97 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_14_batch | RuntimeMs | DataflowRunner | 63124.56 | 63467.32 | 0.54 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_14_batch | RuntimeMs | DirectRunner | 4123.35 | 4330.8 | 5.03 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_14_batch | RuntimeMs | FlinkRunner | 479.96 | 495.1 | 3.15 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_14_batch | RuntimeMs | SparkRunner | 869.26 | 868.38 | -0.1 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_14_batch | RuntimeMs | SparkStructuredStreamingRunner | 1010.04 |
1009.95 | -0.01 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_14_streaming | RuntimeMs | DataflowRunner | 124566.0 | 126146.18 |
1.27 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_14_streaming | RuntimeMs | DirectRunner | 12462.35 | 12406.35 | -0.45
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_14_streaming | RuntimeMs | FlinkRunner | 1281.44 | 1241.86 | -3.09 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_15_batch | RuntimeMs | DataflowRunner | 46358.44 | 52501.76 | 13.25 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_15_batch | RuntimeMs | DirectRunner | 16791.04 | 16508.85 | -1.68 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_15_batch | RuntimeMs | FlinkRunner | 453.11 | 439.14 | -3.08 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_15_batch | RuntimeMs | SparkRunner | 1576.63 | 1604.38 | 1.76 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_15_batch | RuntimeMs | SparkStructuredStreamingRunner | 968.26 |
970.38 | 0.22 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_16_batch | RuntimeMs | DataflowRunner | 50837.85 | 54174.72 | 6.56 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_16_batch | RuntimeMs | DirectRunner | 87710.92 | 89892.95 | 2.49 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_16_batch | RuntimeMs | FlinkRunner | 251.37 | 226.62 | -9.85 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_16_batch | RuntimeMs | SparkRunner | 1318.04 | 1341.62 | 1.79 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_16_batch | RuntimeMs | SparkStructuredStreamingRunner | 614.81 |
610.57 | -0.69 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_16_streaming | RuntimeMs | DataflowRunner | 96092.38 | 102254.83 |
6.41 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_16_streaming | RuntimeMs | DirectRunner | 154210.46 | 166567.1 | 8.01
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_16_streaming | RuntimeMs | FlinkRunner | 484.7 | 494.43 | 2.01 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_batch | RuntimeMs | DataflowRunner | 21114.9 | 22143.1 | 4.87 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_batch | RuntimeMs | DirectRunner | 3240.73 | 3353.55 | 3.48 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_1_batch | RuntimeMs | FlinkRunner | 327.44 | 342.24 | 4.52 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_1_batch | RuntimeMs | SparkRunner | 433.81 | 450.1 | 3.75 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_batch | RuntimeMs | SparkStructuredStreamingRunner | 364.63 | 380.71
| 4.41 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_sql_batch | RuntimeMs | DataflowRunner | 30340.85 | 33899.55 | 11.73
|  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_1_sql_batch | RuntimeMs | DirectRunner | 3737.04 | 3892.3 | 4.15 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_1_sql_batch | RuntimeMs | FlinkRunner | 595.04 | 606.1 | 1.86 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_1_sql_batch | RuntimeMs | SparkRunner | 2501.3 | 2435.0 | -2.65 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 586.78 |
606.1 | 3.29 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_sql_streaming | RuntimeMs | DataflowRunner | 20550.85 | 20819.0 |
1.3 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_sql_streaming | RuntimeMs | DirectRunner | 11632.08 | 11616.07 |
-0.14 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_sql_streaming | RuntimeMs | FlinkRunner | 731.22 | 751.29 | 2.74 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_streaming | RuntimeMs | DataflowRunner | 27608.21 | 28178.3 | 2.06 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_streaming | RuntimeMs | DirectRunner | 8176.54 | 8330.45 | 1.88 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_streaming | RuntimeMs | FlinkRunner | 681.93 | 670.95 | -1.61 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_batch | RuntimeMs | DataflowRunner | 14824.02 | 16046.99 | 8.25 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_batch | RuntimeMs | DirectRunner | 200.64 | 195.12 | -2.75 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_batch | RuntimeMs | FlinkRunner | 164.48 | 174.33 | 5.99 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_batch | RuntimeMs | SparkRunner | 286.74 | 304.48 | 6.19 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_batch | RuntimeMs | SparkStructuredStreamingRunner | 229.59 | 230.9
| 0.57 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_python_batch | RuntimeMs | DirectRunner | 7721.59 | 7771.57 | 0.65 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_2_sql_batch | RuntimeMs | DataflowRunner | 22041.63 | 25056.05 | 13.68
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_sql_batch | RuntimeMs | DirectRunner | 1586.08 | 1633.5 | 2.99 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_sql_batch | RuntimeMs | FlinkRunner | 391.19 | 403.1 | 3.04 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_sql_batch | RuntimeMs | SparkRunner | 840.41 | 820.38 | -2.38 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 666.07 |
693.62 | 4.14 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_sql_streaming | RuntimeMs | DataflowRunner | 13960.63 | 13459.77 |
-3.59 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_sql_streaming | RuntimeMs | DirectRunner | 6880.71 | 6833.2 | -0.69
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_sql_streaming | RuntimeMs | FlinkRunner | 456.33 | 467.71 | 2.49 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_streaming | RuntimeMs | DataflowRunner | 19102.92 | 18834.16 | -1.41
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_2_streaming | RuntimeMs | DirectRunner | 5246.08 | 5291.15 | 0.86 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_streaming | RuntimeMs | FlinkRunner | 337.96 | 294.52 | -12.85 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_zetasql_batch | RuntimeMs | DataflowRunner | 72626.96 | 77606.64 |
6.86 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_zetasql_batch | RuntimeMs | DirectRunner | 2965.12 | 2966.27 | 0.04
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_zetasql_batch | RuntimeMs | FlinkRunner | 1000.93 | 1013.1 | 1.22 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_zetasql_batch | RuntimeMs | SparkRunner | 1215.22 | 1251.62 | 3.0 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_zetasql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1009.3
| 1056.38 | 4.67 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_zetasql_streaming | RuntimeMs | DataflowRunner | 41000.26 | 40218.18
| -1.91 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_zetasql_streaming | RuntimeMs | DirectRunner | 8647.46 | 8589.47 |
-0.67 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_zetasql_streaming | RuntimeMs | FlinkRunner | 1289.04 | 1344.1 |
4.27 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_3_batch | RuntimeMs | DataflowRunner | 22735.19 | 26213.59 | 15.3 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_batch | RuntimeMs | DirectRunner | 1083.42 | 1131.49 | 4.44 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_3_batch | RuntimeMs | FlinkRunner | 1236.74 | 1286.86 | 4.05 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_3_batch | RuntimeMs | SparkRunner | 2149.63 | 2207.29 | 2.68 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_3_python_batch | RuntimeMs | DirectRunner | 10825.56 | 10806.29 |
-0.18 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_sql_batch | RuntimeMs | DataflowRunner | 25632.93 | 28425.5 | 10.89
|  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_3_sql_batch | RuntimeMs | DirectRunner | 3483.62 | 3359.25 | -3.57 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_3_sql_batch | RuntimeMs | FlinkRunner | 1430.48 | 1522.05 | 6.4 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_3_sql_batch | RuntimeMs | SparkRunner | 3701.26 | 3815.76 | 3.09 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_3_sql_streaming | RuntimeMs | DataflowRunner | 33467.56 | 32751.18 |
-2.14 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_sql_streaming | RuntimeMs | DirectRunner | 8885.92 | 8689.73 | -2.21
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_3_sql_streaming | RuntimeMs | FlinkRunner | 1160.96 | 1176.29 | 1.32 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_streaming | RuntimeMs | DataflowRunner | 48099.35 | 48596.23 | 1.03
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_3_streaming | RuntimeMs | DirectRunner | 8316.54 | 8791.0 | 5.71 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_3_streaming | RuntimeMs | FlinkRunner | 666.11 | 658.57 | -1.13 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_zetasql_batch | RuntimeMs | DataflowRunner | 58650.3 | 61732.32 |
5.25 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_zetasql_batch | RuntimeMs | DirectRunner | 3804.96 | 3822.2 | 0.45 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_3_zetasql_batch | RuntimeMs | FlinkRunner | 1905.67 | 1906.0 | 0.02 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_3_zetasql_batch | RuntimeMs | SparkRunner | 3823.3 | 3888.9 | 1.72 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_3_zetasql_streaming | RuntimeMs | DataflowRunner | 47337.41 | 46877.55
| -0.97 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_zetasql_streaming | RuntimeMs | DirectRunner | 9182.17 | 9200.8 |
0.2 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_3_zetasql_streaming | RuntimeMs | FlinkRunner | 1574.93 | 1665.9 |
5.78 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_4_batch | RuntimeMs | DataflowRunner | 29832.44 | 31706.59 | 6.28 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_4_batch | RuntimeMs | DirectRunner | 2662.0 | 2621.45 | -1.52 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_4_batch | RuntimeMs | FlinkRunner | 970.26 | 998.76 | 2.94 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_4_batch | RuntimeMs | SparkRunner | 1233.59 | 1275.33 | 3.38 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_4_batch | RuntimeMs | SparkStructuredStreamingRunner | 3192.26 |
3297.57 | 3.3 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_4_streaming | RuntimeMs | DataflowRunner | 49936.81 | 50546.05 | 1.22
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_4_streaming | RuntimeMs | DirectRunner | 3008.19 | 3011.0 | 0.09 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_4_streaming | RuntimeMs | FlinkRunner | 1130.44 | 1139.05 | 0.76 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_5_batch | RuntimeMs | DataflowRunner | 30848.12 | 31106.69 | 0.84 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_5_batch | RuntimeMs | DirectRunner | 4694.87 | 5106.39 | 8.77 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_5_batch | RuntimeMs | FlinkRunner | 914.3 | 929.33 | 1.64 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_5_batch | RuntimeMs | SparkRunner | 1541.19 | 1591.71 | 3.28 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_5_batch | RuntimeMs | SparkStructuredStreamingRunner | 1637.3 | 1665.9
| 1.75 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_5_python_batch | RuntimeMs | DirectRunner | 17159.44 | 17244.67 | 0.5
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_5_streaming | RuntimeMs | DataflowRunner | 220569.33 | 219605.49 |
-0.44 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_5_streaming | RuntimeMs | DirectRunner | 33473.23 | 35684.05 | 6.6 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_5_streaming | RuntimeMs | FlinkRunner | 1523.33 | 1564.86 | 2.73 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_6_batch | RuntimeMs | DataflowRunner | 27370.52 | 29660.0 | 8.36 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_6_batch | RuntimeMs | DirectRunner | 1830.62 | 1850.0 | 1.06 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_6_batch | RuntimeMs | FlinkRunner | 610.44 | 598.29 | -1.99 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_6_batch | RuntimeMs | SparkRunner | 748.89 | 757.76 | 1.18 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_6_batch | RuntimeMs | SparkStructuredStreamingRunner | 1318.59 |
1348.62 | 2.28 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_6_streaming | RuntimeMs | DataflowRunner | 40164.56 | 41582.09 | 3.53
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_6_streaming | RuntimeMs | DirectRunner | 2203.08 | 2244.15 | 1.86 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_6_streaming | RuntimeMs | FlinkRunner | 568.0 | 588.24 | 3.56 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_batch | RuntimeMs | DataflowRunner | 47690.63 | 52532.86 | 10.15 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_batch | RuntimeMs | DirectRunner | 8807.47 | 8891.15 | 0.95 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_7_batch | RuntimeMs | FlinkRunner | 740.33 | 724.05 | -2.2 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_7_batch | RuntimeMs | SparkRunner | 1513.26 | 1521.76 | 0.56 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_batch | RuntimeMs | SparkStructuredStreamingRunner | 1356.44 |
1420.81 | 4.75 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_python_batch | RuntimeMs | DirectRunner | 19997.37 | 19891.71 |
-0.53 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_7_sql_batch | RuntimeMs | DataflowRunner | 75064.74 | 80061.86 | 6.66
|  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_sql_batch | RuntimeMs | DirectRunner | 883504.23 | 1137242.25 |
28.72 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_7_sql_batch | RuntimeMs | FlinkRunner | 2834.81 | 2887.29 | 1.85 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_7_sql_batch | RuntimeMs | SparkRunner | 7120.67 | 7213.81 | 1.31 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 5408.3 |
5565.9 | 2.91 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_7_sql_streaming | RuntimeMs | DataflowRunner | 994496.22 | 1000042.14
| 0.56 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_sql_streaming | RuntimeMs | DirectRunner | 3112150.33 | 2185927.13 |
-29.76 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_7_sql_streaming | RuntimeMs | FlinkRunner | 3635.59 | 3636.0 | 0.01 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_streaming | RuntimeMs | DataflowRunner | 124094.72 | 121608.56 |
-2.0 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_7_streaming | RuntimeMs | DirectRunner | 870026.85 | 868110.85 | -0.22
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_7_streaming | RuntimeMs | FlinkRunner | 1357.56 | 1469.0 | 8.21 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_8_batch | RuntimeMs | DataflowRunner | 20446.38 | 21606.17 | 5.67 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_8_batch | RuntimeMs | DirectRunner | 805.79 | 821.02 | 1.89 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_8_batch | RuntimeMs | FlinkRunner | 540.41 | 540.67 | 0.05 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_8_batch | RuntimeMs | SparkRunner | 1514.93 | 1538.24 | 1.54 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_8_batch | RuntimeMs | SparkStructuredStreamingRunner | 1465.44 |
1439.95 | -1.74 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_8_python_batch | RuntimeMs | DirectRunner | 10523.41 | 10569.29 | 0.44
|  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_8_streaming | RuntimeMs | DataflowRunner | 64476.26 | 65621.77 | 1.78
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_8_streaming | RuntimeMs | DirectRunner | 7840.81 | 7959.9 | 1.52 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_8_streaming | RuntimeMs | FlinkRunner | 552.19 | 569.0 | 3.05 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_9_batch | RuntimeMs | DataflowRunner | 25482.67 | 28704.41 | 12.64 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_9_batch | RuntimeMs | DirectRunner | 1418.46 | 1462.85 | 3.13 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_9_batch | RuntimeMs | FlinkRunner | 361.52 | 374.24 | 3.52 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_9_batch | RuntimeMs | SparkRunner | 608.48 | 621.05 | 2.07 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_9_batch | RuntimeMs | SparkStructuredStreamingRunner | 1039.67 |
1082.95 | 4.16 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_9_streaming | RuntimeMs | DataflowRunner | 31923.56 | 29519.09 | -7.53
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_9_streaming | RuntimeMs | DirectRunner | 1785.42 | 1823.3 | 2.12 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_9_streaming | RuntimeMs | FlinkRunner | 401.59 | 427.24 | 6.39 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
tpcds_query10_Calcite_1GB | RuntimeMs | DataflowRunner | 360764.57 | 385389.82
| 6.83 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)  
tpcds_query10_Calcite_1GB | RuntimeMs | FlinkRunner | 34660.64 | 34823.73 |
0.47 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)  
tpcds_query10_Calcite_1GB | RuntimeMs | SparkRunner | 55269.93 | 55177.05 |
-0.17 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)  
tpcds_query10_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
45782.78 | 46537.38 | 1.65 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)  
tpcds_query25_Calcite_1GB | RuntimeMs | DataflowRunner | 379011.36 | 371051.27
| -2.1 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)  
tpcds_query25_Calcite_1GB | RuntimeMs | FlinkRunner | 40119.11 | 40639.27 |
1.3 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)  
tpcds_query25_Calcite_1GB | RuntimeMs | SparkRunner | 55674.11 | 55718.0 |
0.08 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)  
tpcds_query25_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
53426.67 | 53607.33 | 0.34 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)  
tpcds_query26_Calcite_1GB | RuntimeMs | DataflowRunner | 328578.11 | 334529.27
| 1.81 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)  
tpcds_query26_Calcite_1GB | RuntimeMs | FlinkRunner | 20699.43 | 21094.86 |
1.91 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)  
tpcds_query26_Calcite_1GB | RuntimeMs | SparkRunner | 22329.41 | 21882.71 |
-2.0 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)  
tpcds_query26_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
20756.19 | 20929.76 | 0.84 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)  
tpcds_query29_Calcite_1GB | RuntimeMs | DataflowRunner | 356747.54 | 377654.82
| 5.86 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)  
tpcds_query29_Calcite_1GB | RuntimeMs | FlinkRunner | 38733.96 | 42884.68 |
10.72 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)  
tpcds_query29_Calcite_1GB | RuntimeMs | SparkRunner | 53290.89 | 53113.43 |
-0.33 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)  
tpcds_query29_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
52373.11 | 52820.1 | 0.85 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)  
tpcds_query35_Calcite_1GB | RuntimeMs | DataflowRunner | 365128.18 | 375607.73
| 2.87 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)  
tpcds_query35_Calcite_1GB | RuntimeMs | FlinkRunner | 28991.86 | 29548.18 |
1.92 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)  
tpcds_query35_Calcite_1GB | RuntimeMs | SparkRunner | 52135.15 | 51298.05 |
-1.61 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)  
tpcds_query35_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
39917.33 | 40072.05 | 0.39 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)  
tpcds_query38_Calcite_1GB | RuntimeMs | DataflowRunner | 347405.04 | 371787.41
| 7.02 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)  
tpcds_query38_Calcite_1GB | RuntimeMs | FlinkRunner | 21717.14 | 22165.77 |
2.07 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)  
tpcds_query38_Calcite_1GB | RuntimeMs | SparkRunner | 20714.41 | 20408.38 |
-1.48 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)  
tpcds_query38_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner | 0.0 |
0.0 | 0.0 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)  
tpcds_query3_Calcite_1GB | RuntimeMs | DataflowRunner | 333778.21 | 329874.82
| -1.17 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)  
tpcds_query3_Calcite_1GB | RuntimeMs | FlinkRunner | 39716.0 | 37599.18 |
-5.33 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)  
tpcds_query3_Calcite_1GB | RuntimeMs | SparkRunner | 37821.11 | 35977.05 |
-4.88 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)  
tpcds_query3_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
36776.04 | 37300.62 | 1.43 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)  
tpcds_query40_Calcite_1GB | RuntimeMs | DataflowRunner | 331710.36 | 347263.77
| 4.69 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)  
tpcds_query40_Calcite_1GB | RuntimeMs | FlinkRunner | 28318.68 | 28984.73 |
2.35 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)  
tpcds_query40_Calcite_1GB | RuntimeMs | SparkRunner | 25119.22 | 24501.29 |
-2.46 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)  
tpcds_query40_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
25010.67 | 24860.14 | -0.6 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)  
tpcds_query42_Calcite_1GB | RuntimeMs | DataflowRunner | 318927.5 | 334668.41
| 4.94 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)  
tpcds_query42_Calcite_1GB | RuntimeMs | FlinkRunner | 22394.61 | 22898.77 |
2.25 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)  
tpcds_query42_Calcite_1GB | RuntimeMs | SparkRunner | 21435.96 | 20987.48 |
-2.09 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)  
tpcds_query42_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
18397.3 | 18661.81 | 1.44 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)  
tpcds_query43_Calcite_1GB | RuntimeMs | DataflowRunner | 322167.32 | 322369.91
| 0.06 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)  
tpcds_query43_Calcite_1GB | RuntimeMs | FlinkRunner | 22407.25 | 22551.32 |
0.64 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)  
tpcds_query43_Calcite_1GB | RuntimeMs | SparkRunner | 21612.74 | 21382.52 |
-1.07 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)  
tpcds_query43_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
19033.0 | 18810.29 | -1.17 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)  
tpcds_query52_Calcite_1GB | RuntimeMs | DataflowRunner | 317932.71 | 326180.0
| 2.59 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)  
tpcds_query52_Calcite_1GB | RuntimeMs | FlinkRunner | 22438.14 | 22479.09 |
0.18 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)  
tpcds_query52_Calcite_1GB | RuntimeMs | SparkRunner | 21164.59 | 20928.05 |
-1.12 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)  
tpcds_query52_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
18968.93 | 18904.52 | -0.34 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)  
tpcds_query55_Calcite_1GB | RuntimeMs | DataflowRunner | 323876.18 | 325112.41
| 0.38 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)  
tpcds_query55_Calcite_1GB | RuntimeMs | FlinkRunner | 21986.36 | 22194.59 |
0.95 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)  
tpcds_query55_Calcite_1GB | RuntimeMs | SparkRunner | 21051.15 | 20884.48 |
-0.79 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)  
tpcds_query55_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
17860.19 | 17736.71 | -0.69 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)  
tpcds_query69_Calcite_1GB | RuntimeMs | DataflowRunner | 354471.39 | 370748.86
| 4.59 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)  
tpcds_query69_Calcite_1GB | RuntimeMs | FlinkRunner | 29951.57 | 30699.41 |
2.5 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)  
tpcds_query69_Calcite_1GB | RuntimeMs | SparkRunner | 48706.22 | 49195.0 | 1.0
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)  
tpcds_query69_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
39016.59 | 39133.14 | 0.3 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)  
tpcds_query79_Calcite_1GB | RuntimeMs | DataflowRunner | 351170.93 | 370253.23
| 5.43 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)  
tpcds_query79_Calcite_1GB | RuntimeMs | FlinkRunner | 34704.46 | 34916.45 |
0.61 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)  
tpcds_query79_Calcite_1GB | RuntimeMs | SparkRunner | 38993.26 | 39124.33 |
0.34 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)  
tpcds_query79_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
34390.93 | 34321.62 | -0.2 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)  
tpcds_query7_Calcite_1GB | RuntimeMs | DataflowRunner | 354355.32 | 345299.59
| -2.56 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)  
tpcds_query7_Calcite_1GB | RuntimeMs | FlinkRunner | 42007.82 | 40161.59 |
-4.39 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)  
tpcds_query7_Calcite_1GB | RuntimeMs | SparkRunner | 41330.0 | 40271.0 | -2.56
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)  
tpcds_query7_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
37245.48 | 37138.71 | -0.29 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)  
tpcds_query83_Calcite_1GB | RuntimeMs | DataflowRunner | 339539.82 | 354972.27
| 4.55 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)  
tpcds_query83_Calcite_1GB | RuntimeMs | FlinkRunner | 9287.54 | 9763.27 | 5.12
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)  
tpcds_query83_Calcite_1GB | RuntimeMs | SparkRunner | 9804.3 | 9867.57 | 0.65
|  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)  
tpcds_query83_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
13698.67 | 17402.1 | 27.03 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)  
tpcds_query84_Calcite_1GB | RuntimeMs | DataflowRunner | 328787.29 | 328897.45
| 0.03 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)  
tpcds_query84_Calcite_1GB | RuntimeMs | FlinkRunner | 19491.82 | 19775.5 |
1.46 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)  
tpcds_query84_Calcite_1GB | RuntimeMs | SparkRunner | 17319.0 | 17175.95 |
-0.83 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)  
tpcds_query84_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
15153.37 | 15145.38 | -0.05 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)  
tpcds_query87_Calcite_1GB | RuntimeMs | DataflowRunner | 342652.04 | 352442.32
| 2.86 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)  
tpcds_query87_Calcite_1GB | RuntimeMs | FlinkRunner | 21807.0 | 22575.55 |
3.52 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)  
tpcds_query87_Calcite_1GB | RuntimeMs | SparkRunner | 19902.37 | 19867.67 |
-0.17 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)  
tpcds_query87_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
20589.59 | 20861.57 | 1.32 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)  
tpcds_query93_Calcite_1GB | RuntimeMs | DataflowRunner | 342834.82 | 354583.0
| 3.43 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)  
tpcds_query93_Calcite_1GB | RuntimeMs | FlinkRunner | 45712.71 | 46305.91 |
1.3 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)  
tpcds_query93_Calcite_1GB | RuntimeMs | SparkRunner | 43759.04 | 43695.81 |
-0.14 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)  
tpcds_query93_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
35556.04 | 35699.81 | 0.4 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)  
tpcds_query96_Calcite_1GB | RuntimeMs | DataflowRunner | 331510.07 | 340565.23
| 2.73 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)  
tpcds_query96_Calcite_1GB | RuntimeMs | FlinkRunner | 18667.07 | 18770.68 |
0.56 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)  
tpcds_query96_Calcite_1GB | RuntimeMs | SparkRunner | 18571.74 | 18955.95 |
2.07 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)  
tpcds_query96_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
20237.93 | 20564.1 | 1.61 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)