You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/07/26 11:55:57 UTC

Beam Metrics Report (2022-07-26)

# Beam Metrics Report

Color legend:  >= 20 | >= 10 | <= -10 | <= -20  
---|---|---|---  
  
## Possible regression

**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**  
---|---|---|---|---|---|---  
go_batch_pardo_2 | dataflow_runtime | - | 354.49 | 399.66 | 12.74 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
hadoopformatioit_results | write_time | - | 7.32 | 8.37 | 14.42 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
java_batch_gbk_3 | dataflow_runtime_sec | - | 10.12 | 12.08 | 19.32 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_7 | dataflow_v2_java17_runtime_sec | - | 31.64 | 39.01 | 23.27
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_pardo_3 | dataflow_v2_java11_runtime_sec | - | 10.65 | 12.16 |
14.14 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_cogbk_1 | dataflow_v2_java11_runtime_sec | - | 2806.65 | 3173.0
| 13.05 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_2 | dataflow_v2_java11_runtime_sec | - | 2630.41 |
3211.67 | 22.1 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_3 | dataflow_v2_java17_runtime_sec | - | 300.24 | 400.58
| 33.42 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_gbk_1 | dataflow_v2_java11_runtime_sec | - | 827.68 | 986.66 |
19.21 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_pardo_3 | dataflow_v2_java11_runtime_sec | - | 20.39 | 25.53 |
25.22 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
kafkaioit_results_sdf_wrapper | read_time | - | 2.73 | 3.22 | 17.79 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
mongodbioit_results | read_time | - | 31.52 | 34.88 | 10.68 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
nexmark_4_streaming | RuntimeMs | FlinkRunner | 1002.07 | 1121.82 | 11.95 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_9_streaming | RuntimeMs | FlinkRunner | 451.11 | 542.45 | 20.25 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
  
## Possible improvement

**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**  
---|---|---|---|---|---|---  
java_batch_cogbk_4 | dataflow_v2_java11_runtime_sec | - | 15.58 | 12.01 |
-22.95 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_4 | dataflow_v2_java17_runtime_sec | - | 13.03 | 11.56 |
-11.28 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_combine_5 | dataflow_runtime_sec | - | 28.72 | 25.37 | -11.67 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_gbk_3 | dataflow_v2_java11_runtime_sec | - | 18.03 | 13.92 | -22.8
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_3 | dataflow_v2_java17_runtime_sec | - | 14.75 | 12.98 | -12.01
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_4 | dataflow_v2_java11_runtime_sec | - | 21.99 | 19.25 | -12.46
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_4 | dataflow_v2_java17_runtime_sec | - | 24.34 | 18.71 | -23.13
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_6 | dataflow_v2_java17_runtime_sec | - | 27.67 | 24.71 | -10.71
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_7 | dataflow_runtime_sec | - | 59.64 | 46.0 | -22.86 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_pardo_1 | dataflow_v2_java11_runtime_sec | - | 15.16 | 11.74 |
-22.55 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_1 | dataflow_v2_java17_runtime_sec | - | 17.27 | 12.24 |
-29.15 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_2 | dataflow_v2_java11_runtime_sec | - | 70.84 | 61.97 |
-12.53 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_3 | dataflow_v2_java17_runtime_sec | - | 15.27 | 12.19 |
-20.12 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_4 | dataflow_v2_java17_runtime_sec | - | 24.65 | 21.38 |
-13.26 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_gbk_3 | dataflow_v2_java11_runtime_sec | - | 80.68 | 53.16 |
-34.11 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_3 | dataflow_v2_java17_runtime_sec | - | 70.71 | 56.77 |
-19.72 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_5 | dataflow_v2_java11_runtime_sec | - | 640.08 | 558.14 |
-12.8 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
kafkaioit_results_runner_v2 | write_time | - | 5.14 | 3.1 | -39.74 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
kafkaioit_results_sdf_wrapper | write_time | - | 5.09 | 3.52 | -30.88 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
python_batch_combine_4 | python_dataflow_batch_combine_4_runtime | - | 48.14 |
37.2 | -22.73 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_combine_5 | python_dataflow_batch_combine_5_runtime | - | 51.29 |
26.0 | -49.3 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_gbk_4 | python_dataflow_batch_gbk_4_runtime | - | 128.71 | 112.4
| -12.67 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_5 | python_dataflow_batch_gbk_5_runtime | - | 131.0 | 104.6 |
-20.15 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_7 | python_dataflow_batch_gbk_7_runtime | - | 374.86 | 326.8
| -12.82 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_pardo_1 | python_dataflow_batch_pardo_1_runtime | - | 180.57 |
160.6 | -11.06 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_sideinput_8 | python_dataflow_batch_sideinput_8_runtime | - |
5601.86 | 4353.6 | -22.28 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
nexmark_0_sql_batch | RuntimeMs | DataflowRunner | 35049.54 | 31544.77 | -10.0
|  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_12_batch | RuntimeMs | DataflowRunner | 19723.74 | 17171.83 | -12.94 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_1_sql_batch | RuntimeMs | DataflowRunner | 31580.93 | 28419.73 |
-10.01 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_batch | RuntimeMs | DataflowRunner | 15553.6 | 12913.27 | -16.98 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_batch | RuntimeMs | DirectRunner | 1550.36 | 1304.82 | -15.84 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_sql_batch | RuntimeMs | DataflowRunner | 25073.75 | 19362.14 |
-22.78 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_batch | RuntimeMs | DataflowRunner | 26538.14 | 22534.45 | -15.09 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_3_sql_batch | RuntimeMs | DataflowRunner | 27349.0 | 23927.0 | -12.51
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_4_batch | RuntimeMs | DataflowRunner | 32791.79 | 28603.73 | -12.77 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_6_batch | RuntimeMs | DataflowRunner | 31073.93 | 25403.55 | -18.25 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_6_streaming | RuntimeMs | DataflowRunner | 41906.43 | 37098.91 |
-11.47 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_batch | RuntimeMs | DataflowRunner | 55471.93 | 47579.77 | -14.23 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_sql_batch | RuntimeMs | DirectRunner | 353209.46 | 207664.73 |
-41.21 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_sql_streaming | RuntimeMs | DirectRunner | 1023436.39 | 569691.27 |
-44.34 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_8_batch | RuntimeMs | DataflowRunner | 22237.27 | 19225.12 | -13.55 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_9_batch | RuntimeMs | DataflowRunner | 29320.61 | 23842.73 | -18.68 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
  
## All metrics

**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**  
---|---|---|---|---|---|---  
avroioit_hdfs_results | read_time | - | 94.65 | 96.5 | 1.95 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
avroioit_hdfs_results | write_time | - | 118.58 | 120.9 | 1.96 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
avroioit_results | read_time | - | 89.74 | 96.34 | 7.36 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
avroioit_results | write_time | - | 117.32 | 120.29 | 2.53 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_batch_avro | avro_write_time | - | 35.16 | 36.8 | 4.66
|  [[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_batch_avro | read_time | - | 39.95 | 40.67 | 1.8 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_batch_json | read_time | - | 38.46 | 38.08 | -0.99 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_batch_json | write_time | - | 51.37 | 54.47 | 6.03 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
compressed_textioit_hdfs_results | read_time | - | 160.31 | 165.48 | 3.22 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
compressed_textioit_hdfs_results | write_time | - | 209.4 | 216.87 | 3.57 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
compressed_textioit_results | read_time | - | 157.76 | 172.86 | 9.57 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
compressed_textioit_results | write_time | - | 204.62 | 214.12 | 4.64 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
go_batch_cogbk_1 | dataflow_runtime | - | 243.15 | 252.95 | 4.03 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
go_batch_cogbk_2 | dataflow_runtime | - | 142.77 | 144.84 | 1.45 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
go_batch_cogbk_3 | dataflow_runtime | - | 114.12 | 114.45 | 0.29 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
go_batch_cogbk_4 | dataflow_runtime | - | 112.75 | 114.25 | 1.33 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
go_batch_combine_1 | dataflow_runtime | - | 397.27 | 412.59 | 3.86 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
go_batch_combine_4 | dataflow_runtime | - | 74.6 | 72.99 | -2.15 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
go_batch_combine_5 | dataflow_runtime | - | 71.4 | 71.34 | -0.08 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
go_batch_gbk_1 | dataflow_runtime | - | 393.79 | 386.21 | -1.92 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_2 | dataflow_runtime | - | 98.77 | 104.05 | 5.35 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_3 | dataflow_runtime | - | 29.56 | 28.61 | -3.21 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_4 | dataflow_runtime | - | 55.46 | 54.1 | -2.46 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_5 | dataflow_runtime | - | 45.18 | 42.51 | -5.9 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_6 | dataflow_runtime | - | 104.27 | 104.62 | 0.33 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_7 | dataflow_runtime | - | 103.13 | 113.39 | 9.95 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_pardo_1 | dataflow_runtime | - | 75.77 | 77.69 | 2.53 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
go_batch_pardo_2 | dataflow_runtime | - | 354.49 | 399.66 | 12.74 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
go_batch_pardo_3 | dataflow_runtime | - | 61.98 | 65.07 | 4.98 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
go_batch_pardo_4 | dataflow_runtime | - | 73.35 | 67.5 | -7.98 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
go_batch_sideinput_3 | dataflow_runtime | - | 2.33 | 2.45 | 5.21 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
go_batch_sideinput_4 | dataflow_runtime | - | 198.86 | 206.97 | 4.08 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
hadoopformatioit_results | read_time | - | 6.2 | 6.81 | 9.77 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
hadoopformatioit_results | write_time | - | 7.32 | 8.37 | 14.42 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
java_batch_cogbk_1 | dataflow_runtime_sec | - | 42.93 | 45.24 | 5.37 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_1 | dataflow_v2_java11_runtime_sec | - | 46.94 | 44.93 |
-4.29 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_1 | dataflow_v2_java17_runtime_sec | - | 49.09 | 47.77 |
-2.68 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_1 | sparkstructuredstreaming_runtime_sec | - | 125.96 |
123.89 | -1.64 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_2 | dataflow_runtime_sec | - | 38.83 | 41.19 | 6.08 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_2 | dataflow_v2_java11_runtime_sec | - | 46.22 | 46.35 | 0.28
|  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_2 | dataflow_v2_java17_runtime_sec | - | 44.36 | 45.07 | 1.6
|  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_2 | sparkstructuredstreaming_runtime_sec | - | 123.01 |
120.09 | -2.37 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_3 | dataflow_runtime_sec | - | 15.08 | 14.92 | -1.1 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_3 | dataflow_v2_java11_runtime_sec | - | 12.87 | 12.49 |
-3.01 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_3 | dataflow_v2_java17_runtime_sec | - | 12.48 | 11.78 |
-5.65 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_3 | sparkstructuredstreaming_runtime_sec | - | 20.07 | 19.71
| -1.79 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_4 | dataflow_runtime_sec | - | 13.34 | 13.05 | -2.2 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_4 | dataflow_v2_java11_runtime_sec | - | 15.58 | 12.01 |
-22.95 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_4 | dataflow_v2_java17_runtime_sec | - | 13.03 | 11.56 |
-11.28 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_4 | sparkstructuredstreaming_runtime_sec | - | 20.58 | 20.76
| 0.89 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_combine_1 | dataflow_runtime_sec | - | 62.81 | 64.43 | 2.57 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_1 | sparkstructuredstreaming_runtime_sec | - | 571.51 |
567.12 | -0.77 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_4 | dataflow_runtime_sec | - | 27.08 | 27.46 | 1.43 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_4 | sparkstructuredstreaming_runtime_sec | - | 126.94 |
131.44 | 3.55 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_5 | dataflow_runtime_sec | - | 28.72 | 25.37 | -11.67 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_5 | sparkstructuredstreaming_runtime_sec | - | 126.21 |
129.4 | 2.53 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_gbk_1 | dataflow_runtime_sec | - | 113.29 | 124.1 | 9.54 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_1 | dataflow_v2_java11_runtime_sec | - | 85.53 | 91.95 | 7.5 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_1 | dataflow_v2_java17_runtime_sec | - | 94.52 | 89.41 | -5.41
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_1 | sparkstructuredstreaming_runtime_sec | - | 514.47 | 505.68
| -1.71 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_2 | dataflow_runtime_sec | - | 30.72 | 32.45 | 5.63 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_2 | dataflow_v2_java11_runtime_sec | - | 41.15 | 37.11 | -9.81
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_2 | dataflow_v2_java17_runtime_sec | - | 40.48 | 39.57 | -2.25
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_2 | sparkstructuredstreaming_runtime_sec | - | 103.07 | 101.75
| -1.28 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_3 | dataflow_runtime_sec | - | 10.12 | 12.08 | 19.32 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_3 | dataflow_v2_java11_runtime_sec | - | 18.03 | 13.92 | -22.8
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_3 | dataflow_v2_java17_runtime_sec | - | 14.75 | 12.98 | -12.01
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_3 | sparkstructuredstreaming_runtime_sec | - | 8.26 | 7.98 |
-3.4 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_4 | dataflow_runtime_sec | - | 18.42 | 18.04 | -2.07 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_4 | dataflow_v2_java11_runtime_sec | - | 21.99 | 19.25 | -12.46
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_4 | dataflow_v2_java17_runtime_sec | - | 24.34 | 18.71 | -23.13
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_4 | sparkstructuredstreaming_runtime_sec | - | 99.67 | 100.12 |
0.44 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_5 | dataflow_runtime_sec | - | 18.81 | 17.52 | -6.87 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_5 | dataflow_v2_java11_runtime_sec | - | 18.8 | 19.48 | 3.63 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_5 | dataflow_v2_java17_runtime_sec | - | 21.17 | 19.37 | -8.52
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_5 | sparkstructuredstreaming_runtime_sec | - | 102.11 | 100.59
| -1.49 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_6 | dataflow_runtime_sec | - | 36.82 | 34.11 | -7.35 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_6 | dataflow_v2_java11_runtime_sec | - | 27.01 | 25.4 | -5.95 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_6 | dataflow_v2_java17_runtime_sec | - | 27.67 | 24.71 | -10.71
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_6 | sparkstructuredstreaming_runtime_sec | - | 57.85 | 60.11 |
3.9 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_7 | dataflow_runtime_sec | - | 59.64 | 46.0 | -22.86 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_7 | dataflow_v2_java11_runtime_sec | - | 36.77 | 35.29 | -4.04
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_7 | dataflow_v2_java17_runtime_sec | - | 31.64 | 39.01 | 23.27
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_7 | sparkstructuredstreaming_runtime_sec | - | 86.08 | 86.62 |
0.62 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_pardo_1 | dataflow_runtime_sec | - | 17.91 | 18.76 | 4.73 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_1 | dataflow_v2_java11_runtime_sec | - | 15.16 | 11.74 |
-22.55 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_1 | dataflow_v2_java17_runtime_sec | - | 17.27 | 12.24 |
-29.15 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_1 | sparkstructuredstreaming_runtime_sec | - | 55.95 | 56.41
| 0.82 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_2 | dataflow_runtime_sec | - | 198.89 | 199.77 | 0.44 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_2 | dataflow_v2_java11_runtime_sec | - | 70.84 | 61.97 |
-12.53 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_2 | dataflow_v2_java17_runtime_sec | - | 56.5 | 58.41 | 3.38
|  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_3 | dataflow_runtime_sec | - | 11.8 | 12.13 | 2.8 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_3 | dataflow_v2_java11_runtime_sec | - | 10.65 | 12.16 |
14.14 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_3 | dataflow_v2_java17_runtime_sec | - | 15.27 | 12.19 |
-20.12 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_4 | dataflow_runtime_sec | - | 24.29 | 24.38 | 0.37 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_4 | dataflow_v2_java11_runtime_sec | - | 23.68 | 21.8 | -7.93
|  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_4 | dataflow_v2_java17_runtime_sec | - | 24.65 | 21.38 |
-13.26 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_cogbk_1 | dataflow_runtime_sec | - | 847.06 | 863.55 | 1.95 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_1 | dataflow_v2_java11_runtime_sec | - | 2806.65 | 3173.0
| 13.05 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_1 | dataflow_v2_java17_runtime_sec | - | 2434.71 |
2397.91 | -1.51 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_2 | dataflow_runtime_sec | - | 845.05 | 815.5 | -3.5 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_2 | dataflow_v2_java11_runtime_sec | - | 2630.41 |
3211.67 | 22.1 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_2 | dataflow_v2_java17_runtime_sec | - | 3085.36 | 3097.7
| 0.4 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_3 | dataflow_runtime_sec | - | 116.42 | 115.87 | -0.47 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_3 | dataflow_v2_java11_runtime_sec | - | 342.88 | 357.09
| 4.14 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_3 | dataflow_v2_java17_runtime_sec | - | 300.24 | 400.58
| 33.42 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_4 | dataflow_runtime_sec | - | 114.36 | 114.53 | 0.15 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_4 | dataflow_v2_java11_runtime_sec | - | 334.6 | 328.23 |
-1.9 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_4 | dataflow_v2_java17_runtime_sec | - | 333.71 | 362.24
| 8.55 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_combine_1 | dataflow_runtime_sec | - | 505.27 | 492.79 | -2.47
|  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_streaming_combine_4 | dataflow_runtime_sec | - | 311.68 | 307.03 | -1.49
|  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_streaming_combine_5 | dataflow_runtime_sec | - | 293.22 | 310.12 | 5.76 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_streaming_gbk_1 | dataflow_runtime_sec | - | 647.64 | 683.29 | 5.5 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_1 | dataflow_v2_java11_runtime_sec | - | 827.68 | 986.66 |
19.21 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_1 | dataflow_v2_java17_runtime_sec | - | 940.39 | 968.31 |
2.97 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_2 | dataflow_runtime_sec | - | 754.57 | 756.98 | 0.32 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_2 | dataflow_v2_java11_runtime_sec | - | 3130.81 | 2886.04
| -7.82 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_2 | dataflow_v2_java17_runtime_sec | - | 3074.39 | 3307.21
| 7.57 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_3 | dataflow_runtime_sec | - | 25.1 | 24.57 | -2.09 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_3 | dataflow_v2_java11_runtime_sec | - | 80.68 | 53.16 |
-34.11 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_3 | dataflow_v2_java17_runtime_sec | - | 70.71 | 56.77 |
-19.72 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_4 | dataflow_runtime_sec | - | 279.27 | 281.61 | 0.84 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_4 | dataflow_v2_java11_runtime_sec | - | 669.3 | 657.32 |
-1.79 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_4 | dataflow_v2_java17_runtime_sec | - | 752.0 | 759.18 |
0.95 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_5 | dataflow_runtime_sec | - | 272.03 | 269.64 | -0.88 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_5 | dataflow_v2_java11_runtime_sec | - | 640.08 | 558.14 |
-12.8 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_5 | dataflow_v2_java17_runtime_sec | - | 616.07 | 619.8 |
0.6 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_6 | dataflow_runtime_sec | - | 74.23 | 74.7 | 0.63 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_6 | dataflow_v2_java11_runtime_sec | - | 148.67 | 149.14 |
0.31 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_6 | dataflow_v2_java17_runtime_sec | - | 162.44 | 157.44 |
-3.08 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_7 | dataflow_runtime_sec | - | 134.8 | 132.82 | -1.47 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_7 | dataflow_v2_java11_runtime_sec | - | 209.23 | 203.59 |
-2.69 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_7 | dataflow_v2_java17_runtime_sec | - | 223.46 | 210.75 |
-5.69 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_pardo_1 | dataflow_runtime_sec | - | 19.2 | 18.71 | -2.56 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_1 | dataflow_v2_java11_runtime_sec | - | 27.02 | 24.98 |
-7.56 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_1 | dataflow_v2_java17_runtime_sec | - | 24.92 | 23.25 |
-6.71 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_2 | dataflow_runtime_sec | - | 204.26 | 209.58 | 2.61 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_2 | dataflow_v2_java11_runtime_sec | - | 121.91 | 113.3 |
-7.06 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_2 | dataflow_v2_java17_runtime_sec | - | 112.41 | 103.17
| -8.21 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_3 | dataflow_runtime_sec | - | 12.27 | 12.09 | -1.43 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_3 | dataflow_v2_java11_runtime_sec | - | 20.39 | 25.53 |
25.22 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_3 | dataflow_v2_java17_runtime_sec | - | 21.75 | 22.47 |
3.33 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_4 | dataflow_runtime_sec | - | 31.45 | 30.98 | -1.48 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_4 | dataflow_v2_java11_runtime_sec | - | 38.31 | 38.8 |
1.29 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_4 | dataflow_v2_java17_runtime_sec | - | 36.18 | 38.32 |
5.91 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
jdbcioit_results | read_time | - | 24.8 | 24.86 | 0.21 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
jdbcioit_results | write_time | - | 37.82 | 37.73 | -0.24 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
kafkaioit_results | read_time | - | 0.0 | 0.0 | 0.0 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
kafkaioit_results | write_time | - | 13.15 | 14.32 | 8.9 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
kafkaioit_results_runner_v2 | read_time | - | 2.43 | 2.47 | 1.55 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
kafkaioit_results_runner_v2 | write_time | - | 5.14 | 3.1 | -39.74 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
kafkaioit_results_sdf_wrapper | read_time | - | 2.73 | 3.22 | 17.79 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
kafkaioit_results_sdf_wrapper | write_time | - | 5.09 | 3.52 | -30.88 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
many_files_textioit_hdfs_results | read_time | - | 17.47 | 17.75 | 1.6 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
many_files_textioit_hdfs_results | write_time | - | 57.88 | 57.85 | -0.06 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
many_files_textioit_results | read_time | - | 24.31 | 22.34 | -8.11 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
many_files_textioit_results | write_time | - | 58.05 | 56.67 | -2.38 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
mongodbioit_results | read_time | - | 31.52 | 34.88 | 10.68 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
mongodbioit_results | write_time | - | 59.75 | 59.49 | -0.43 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
parquetioit_hdfs_results | read_time | - | 86.28 | 92.59 | 7.3 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
parquetioit_hdfs_results | write_time | - | 141.9 | 143.52 | 1.15 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
parquetioit_results | read_time | - | 86.54 | 93.45 | 7.98 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
parquetioit_results | write_time | - | 139.19 | 147.14 | 5.71 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
python_batch_cogbk_1 | python_dataflow_batch_cogbk_1_runtime | - | 467.86 |
451.0 | -3.6 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_batch_cogbk_2 | python_dataflow_batch_cogbk_2_runtime | - | 293.71 |
283.0 | -3.65 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_batch_cogbk_3 | python_dataflow_batch_cogbk_3_runtime | - | 276.86 |
256.2 | -7.46 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_batch_cogbk_4 | python_dataflow_batch_cogbk_4_runtime | - | 271.14 |
252.2 | -6.99 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_batch_combine_1 | python_dataflow_batch_combine_1_runtime | - | 875.57
| 902.0 | 3.02 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_combine_4 | python_dataflow_batch_combine_4_runtime | - | 48.14 |
37.2 | -22.73 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_combine_5 | python_dataflow_batch_combine_5_runtime | - | 51.29 |
26.0 | -49.3 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_gbk_1 | python_dataflow_batch_gbk_1_runtime | - | 1912.14 |
1877.0 | -1.84 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_2 | python_dataflow_batch_gbk_2_runtime | - | 369.57 | 358.2
| -3.08 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_3 | python_dataflow_batch_gbk_3_runtime | - | 23.29 | 25.4 |
9.08 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_4 | python_dataflow_batch_gbk_4_runtime | - | 128.71 | 112.4
| -12.67 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_5 | python_dataflow_batch_gbk_5_runtime | - | 131.0 | 104.6 |
-20.15 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_6 | python_dataflow_batch_gbk_6_runtime | - | 356.43 | 352.8
| -1.02 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_7 | python_dataflow_batch_gbk_7_runtime | - | 374.86 | 326.8
| -12.82 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_pardo_1 | python_dataflow_batch_pardo_1_runtime | - | 180.57 |
160.6 | -11.06 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_2 | python_dataflow_batch_pardo_2_runtime | - | 1626.29 |
1591.4 | -2.15 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_3 | python_dataflow_batch_pardo_3_runtime | - | 138.14 |
135.0 | -2.28 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_4 | python_dataflow_batch_pardo_4_runtime | - | 348.57 |
320.6 | -8.02 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_sideinput_1 | python_dataflow_batch_sideinput_1_runtime | - |
47.14 | 46.33 | -1.72 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_2 | python_dataflow_batch_sideinput_2_runtime | - |
47.29 | 45.17 | -4.48 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_3 | python_dataflow_batch_sideinput_3_runtime | - |
6.29 | 6.2 | -1.36 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_4 | python_dataflow_batch_sideinput_4_runtime | - |
456.0 | 466.0 | 2.19 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_5 | python_dataflow_batch_sideinput_5_runtime | - |
46.43 | 47.0 | 1.23 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_6 | python_dataflow_batch_sideinput_6_runtime | - |
46.0 | 47.2 | 2.61 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_7 | python_dataflow_batch_sideinput_7_runtime | - |
5526.71 | 5436.2 | -1.64 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_8 | python_dataflow_batch_sideinput_8_runtime | - |
5601.86 | 4353.6 | -22.28 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_bqio_read_10GB_results | bqio_read_10GB_results_runtime | - | 109.0 |
112.6 | 3.3 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_bqio_write_10GB_results | bqio_write_10GB_results_runtime | - | 260.29
| 250.0 | -3.95 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_direct_microbenchmarks | fn_api_runner_microbenchmark_runtime_sec | - |
94.62 | 92.26 | -2.49 |  
python_direct_microbenchmarks | teststream_microbenchmark_runtime_sec | - |
344.58 | 331.76 | -3.72 |  
python_spanner_write_2GB_results | pyspanner_write_2GB_results_runtime | - |
1601.29 | 1627.2 | 1.62 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_spannerio_read_2GB_results | pyspanner_read_2GB_results_runtime | - |
24.6 | 26.2 | 6.5 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_streaming_cogbk_1 | python_dataflow_streaming_cogbk_1_runtime | - |
651.0 | 665.4 | 2.21 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_streaming_cogbk_2 | python_dataflow_streaming_cogbk_2_runtime | - |
407.0 | 425.4 | 4.52 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_streaming_cogbk_3 | python_dataflow_streaming_cogbk_3_runtime | - |
502.57 | 458.4 | -8.79 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_streaming_cogbk_4 | python_dataflow_streaming_cogbk_4_runtime | - |
439.29 | 413.4 | -5.89 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
textioit_hdfs_results | read_time | - | 18.72 | 20.46 | 9.3 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
textioit_hdfs_results | write_time | - | 31.61 | 31.71 | 0.31 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
textioit_results | read_time | - | 20.3 | 21.4 | 5.41 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
textioit_results | write_time | - | 31.68 | 31.11 | -1.81 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
tfrecordioit_results | read_time | - | 15.89 | 15.88 | -0.01 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
tfrecordioit_results | write_time | - | 21.03 | 20.52 | -2.4 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
wordcount_py37_results | runtime | - | 837.79 | 822.86 | -1.78 |
[[1]](http://metrics.beam.apache.org/d/1cnwVDkGk)  
xmlioit_hdfs_results | read_time | - | 22.27 | 21.81 | -2.06 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
xmlioit_hdfs_results | write_time | - | 25.42 | 23.24 | -8.57 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
xmlioit_results | read_time | - | 23.8 | 23.94 | 0.58 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
xmlioit_results | write_time | - | 25.54 | 24.19 | -5.3 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
nexmark_0_batch | RuntimeMs | DataflowRunner | 27383.03 | 25356.88 | -7.4 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_batch | RuntimeMs | DirectRunner | 4756.25 | 4620.82 | -2.85 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_0_batch | RuntimeMs | FlinkRunner | 1092.39 | 1065.36 | -2.47 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_0_batch | RuntimeMs | SparkRunner | 1240.23 | 1214.2 | -2.1 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_batch | RuntimeMs | SparkStructuredStreamingRunner | 1551.8 |
1533.34 | -1.19 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_0_sql_batch | RuntimeMs | DataflowRunner | 35049.54 | 31544.77 | -10.0
|  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_sql_batch | RuntimeMs | DirectRunner | 5612.5 | 5606.41 | -0.11 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_0_sql_batch | RuntimeMs | SparkRunner | 3145.04 | 3121.55 | -0.75 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 2914.04 |
2722.16 | -6.58 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_0_sql_streaming | RuntimeMs | DataflowRunner | 23104.18 | 22876.5 |
-0.99 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_sql_streaming | RuntimeMs | DirectRunner | 15512.32 | 15357.09 |
-1.0 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_sql_streaming | RuntimeMs | FlinkRunner | 1662.32 | 1641.41 | -1.26
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_streaming | RuntimeMs | DataflowRunner | 37916.28 | 38598.49 | 1.8 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_streaming | RuntimeMs | DirectRunner | 11824.68 | 11694.41 | -1.1 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_streaming | RuntimeMs | FlinkRunner | 1418.68 | 1391.32 | -1.93 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_zetasql_batch | RuntimeMs | DataflowRunner | 108882.54 | 115457.18 |
6.04 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_0_zetasql_batch | RuntimeMs | DirectRunner | 6801.07 | 6724.27 | -1.13
|  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_0_zetasql_streaming | RuntimeMs | DataflowRunner | 65847.11 | 65925.95
| 0.12 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_zetasql_streaming | RuntimeMs | DirectRunner | 17084.46 | 17020.23 |
-0.38 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_zetasql_streaming | RuntimeMs | FlinkRunner | 3203.82 | 3188.73 |
-0.47 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_10_batch | RuntimeMs | DataflowRunner | 48344.96 | 45117.05 | -6.68 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_10_batch | RuntimeMs | DirectRunner | 10535.86 | 10394.91 | -1.34 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_10_batch | RuntimeMs | FlinkRunner | 772.36 | 741.18 | -4.04 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_10_batch | RuntimeMs | SparkRunner | 735.34 | 738.41 | 0.42 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_10_batch | RuntimeMs | SparkStructuredStreamingRunner | 1197.71 |
1149.82 | -4.0 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_10_streaming | RuntimeMs | DataflowRunner | 101910.58 | 100330.35 |
-1.55 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_10_streaming | RuntimeMs | DirectRunner | 43892.46 | 44182.41 | 0.66 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_10_streaming | RuntimeMs | FlinkRunner | 1436.68 | 1429.36 | -0.51 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_11_batch | RuntimeMs | DataflowRunner | 39675.74 | 36509.71 | -7.98 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_11_batch | RuntimeMs | DirectRunner | 3719.18 | 3739.14 | 0.54 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_11_batch | RuntimeMs | FlinkRunner | 329.64 | 334.95 | 1.61 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_11_batch | RuntimeMs | SparkRunner | 1391.84 | 1362.45 | -2.11 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_11_batch | RuntimeMs | SparkStructuredStreamingRunner | 1019.16 |
1057.52 | 3.76 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_11_streaming | RuntimeMs | DataflowRunner | 178973.99 | 178968.47 |
-0.0 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_11_streaming | RuntimeMs | DirectRunner | 10682.71 | 10589.68 | -0.87
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_11_streaming | RuntimeMs | FlinkRunner | 1295.86 | 1308.09 | 0.94 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_12_batch | RuntimeMs | DataflowRunner | 19723.74 | 17171.83 | -12.94 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_12_batch | RuntimeMs | DirectRunner | 2557.43 | 2557.68 | 0.01 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_12_batch | RuntimeMs | FlinkRunner | 180.79 | 164.82 | -8.83 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_12_batch | RuntimeMs | SparkRunner | 923.88 | 920.59 | -0.36 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_12_batch | RuntimeMs | SparkStructuredStreamingRunner | 833.57 |
852.66 | 2.29 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_12_streaming | RuntimeMs | DataflowRunner | 95535.59 | 94546.91 |
-1.03 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_12_streaming | RuntimeMs | DirectRunner | 9410.61 | 9331.27 | -0.84 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_12_streaming | RuntimeMs | FlinkRunner | 614.93 | 620.41 | 0.89 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_batch | RuntimeMs | DataflowRunner | 33256.93 | 31287.86 | -5.92 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_13_batch | RuntimeMs | DirectRunner | 3283.54 | 3123.0 | -4.89 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_13_batch | RuntimeMs | FlinkRunner | 417.32 | 447.05 | 7.12 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_batch | RuntimeMs | SparkRunner | 352.64 | 346.5 | -1.74 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_batch | RuntimeMs | SparkStructuredStreamingRunner | 528.57 |
522.73 | -1.11 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_13_sql_batch | RuntimeMs | DataflowRunner | 57994.43 | 56702.73 |
-2.23 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_13_sql_batch | RuntimeMs | DirectRunner | 9049.57 | 8976.36 | -0.81 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_13_sql_batch | RuntimeMs | SparkRunner | 3451.54 | 3403.52 | -1.39 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 3060.79 |
2945.84 | -3.76 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_13_sql_streaming | RuntimeMs | DataflowRunner | 34516.89 | 35210.5 |
2.01 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_sql_streaming | RuntimeMs | DirectRunner | 19110.79 | 18951.5 |
-0.83 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_sql_streaming | RuntimeMs | FlinkRunner | 29016.68 | 29205.68 |
0.65 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_streaming | RuntimeMs | DataflowRunner | 25010.18 | 25457.18 | 1.79
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_streaming | RuntimeMs | DirectRunner | 10006.54 | 9903.23 | -1.03 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_streaming | RuntimeMs | FlinkRunner | 28858.11 | 26274.91 | -8.95 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_zetasql_batch | RuntimeMs | DataflowRunner | 251053.46 | 257265.73
| 2.47 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_zetasql_batch | RuntimeMs | DirectRunner | 10168.5 | 10134.41 |
-0.34 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_13_zetasql_streaming | RuntimeMs | DataflowRunner | 109638.37 |
108632.52 | -0.92 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_zetasql_streaming | RuntimeMs | DirectRunner | 21164.57 | 21016.18
| -0.7 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_zetasql_streaming | RuntimeMs | FlinkRunner | 34625.5 | 33648.95 |
-2.82 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_14_batch | RuntimeMs | DataflowRunner | 60946.0 | 58759.5 | -3.59 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_14_batch | RuntimeMs | DirectRunner | 4084.71 | 4015.55 | -1.69 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_14_batch | RuntimeMs | FlinkRunner | 660.39 | 613.09 | -7.16 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_14_batch | RuntimeMs | SparkRunner | 937.7 | 1003.2 | 6.99 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_14_batch | RuntimeMs | SparkStructuredStreamingRunner | 973.07 |
986.27 | 1.36 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_14_streaming | RuntimeMs | DataflowRunner | 122776.79 | 119901.86 |
-2.34 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_14_streaming | RuntimeMs | DirectRunner | 12188.86 | 12214.32 | 0.21 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_14_streaming | RuntimeMs | FlinkRunner | 1785.79 | 1773.95 | -0.66 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_15_batch | RuntimeMs | DataflowRunner | 47485.61 | 43256.57 | -8.91 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_15_batch | RuntimeMs | DirectRunner | 15298.36 | 15093.73 | -1.34 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_15_batch | RuntimeMs | FlinkRunner | 603.57 | 629.27 | 4.26 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_15_batch | RuntimeMs | SparkRunner | 1655.21 | 1650.57 | -0.28 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_15_batch | RuntimeMs | SparkStructuredStreamingRunner | 1488.89 |
1434.52 | -3.65 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_16_batch | RuntimeMs | DataflowRunner | 52063.23 | 49765.15 | -4.41 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_16_batch | RuntimeMs | DirectRunner | 84952.64 | 84757.14 | -0.23 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_16_batch | RuntimeMs | FlinkRunner | 224.96 | 208.91 | -7.14 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_16_batch | RuntimeMs | SparkRunner | 1442.41 | 1352.25 | -6.25 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_16_batch | RuntimeMs | SparkStructuredStreamingRunner | 1237.02 |
1272.7 | 2.88 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_16_streaming | RuntimeMs | DataflowRunner | 100018.48 | 93278.06 |
-6.74 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_16_streaming | RuntimeMs | DirectRunner | 124758.36 | 116187.41 |
-6.87 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_16_streaming | RuntimeMs | FlinkRunner | 436.5 | 413.41 | -5.29 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_batch | RuntimeMs | DataflowRunner | 21350.51 | 19817.6 | -7.18 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_1_batch | RuntimeMs | DirectRunner | 3474.43 | 3672.5 | 5.7 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_batch | RuntimeMs | FlinkRunner | 306.36 | 320.95 | 4.76 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_1_batch | RuntimeMs | SparkRunner | 435.95 | 434.7 | -0.28 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_1_batch | RuntimeMs | SparkStructuredStreamingRunner | 597.86 | 586.91
| -1.83 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_sql_batch | RuntimeMs | DataflowRunner | 31580.93 | 28419.73 |
-10.01 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_1_sql_batch | RuntimeMs | DirectRunner | 3704.79 | 3562.32 | -3.85 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_sql_batch | RuntimeMs | SparkRunner | 2415.14 | 2366.07 | -2.03 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_1_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1633.04 |
1659.11 | 1.6 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_1_sql_streaming | RuntimeMs | DataflowRunner | 20733.07 | 20628.86 |
-0.5 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_1_sql_streaming | RuntimeMs | DirectRunner | 11477.79 | 11470.5 |
-0.06 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_1_sql_streaming | RuntimeMs | FlinkRunner | 657.64 | 650.82 | -1.04 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_streaming | RuntimeMs | DataflowRunner | 28953.95 | 29088.82 | 0.47
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_streaming | RuntimeMs | DirectRunner | 8175.89 | 8108.09 | -0.83 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_1_streaming | RuntimeMs | FlinkRunner | 656.04 | 615.23 | -6.22 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_batch | RuntimeMs | DataflowRunner | 15553.6 | 12913.27 | -16.98 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_batch | RuntimeMs | DirectRunner | 1550.36 | 1304.82 | -15.84 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_batch | RuntimeMs | FlinkRunner | 204.07 | 206.77 | 1.32 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_batch | RuntimeMs | SparkRunner | 313.95 | 301.95 | -3.82 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_batch | RuntimeMs | SparkStructuredStreamingRunner | 452.11 | 450.98
| -0.25 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_sql_batch | RuntimeMs | DataflowRunner | 25073.75 | 19362.14 |
-22.78 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_sql_batch | RuntimeMs | DirectRunner | 1546.04 | 1529.59 | -1.06 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_sql_batch | RuntimeMs | SparkRunner | 744.71 | 722.09 | -3.04 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_2_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 972.5 |
1008.09 | 3.66 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_sql_streaming | RuntimeMs | DataflowRunner | 14480.71 | 13475.82 |
-6.94 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_2_sql_streaming | RuntimeMs | DirectRunner | 6786.82 | 6730.27 | -0.83
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_sql_streaming | RuntimeMs | FlinkRunner | 409.54 | 398.09 | -2.79 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_2_streaming | RuntimeMs | DataflowRunner | 18822.78 | 19687.65 | 4.59
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_streaming | RuntimeMs | DirectRunner | 5126.11 | 5106.23 | -0.39 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_2_streaming | RuntimeMs | FlinkRunner | 267.39 | 270.5 | 1.16 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_zetasql_batch | RuntimeMs | DataflowRunner | 68885.71 | 70736.91 |
2.69 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_zetasql_batch | RuntimeMs | DirectRunner | 2810.89 | 2770.82 | -1.43
|  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_zetasql_streaming | RuntimeMs | DataflowRunner | 40421.48 | 39563.43
| -2.12 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_2_zetasql_streaming | RuntimeMs | DirectRunner | 8162.14 | 8145.82 |
-0.2 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_zetasql_streaming | RuntimeMs | FlinkRunner | 1203.07 | 1212.41 |
0.78 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_batch | RuntimeMs | DataflowRunner | 26538.14 | 22534.45 | -15.09 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_3_batch | RuntimeMs | DirectRunner | 3177.54 | 3125.23 | -1.65 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_3_batch | RuntimeMs | FlinkRunner | 1068.32 | 1076.91 | 0.8 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_3_batch | RuntimeMs | SparkRunner | 2068.45 | 2065.32 | -0.15 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_3_sql_batch | RuntimeMs | DataflowRunner | 27349.0 | 23927.0 | -12.51
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_3_sql_batch | RuntimeMs | DirectRunner | 3281.86 | 3230.32 | -1.57 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_3_sql_batch | RuntimeMs | SparkRunner | 3494.32 | 3444.52 | -1.43 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_3_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 2984.14 |
2880.3 | -3.48 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_3_sql_streaming | RuntimeMs | DataflowRunner | 32357.0 | 31207.09 |
-3.55 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_sql_streaming | RuntimeMs | DirectRunner | 8444.57 | 8350.0 | -1.12
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_sql_streaming | RuntimeMs | FlinkRunner | 947.86 | 950.0 | 0.23 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_streaming | RuntimeMs | DataflowRunner | 45015.4 | 44304.37 | -1.58
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_3_streaming | RuntimeMs | DirectRunner | 7661.39 | 7609.05 | -0.68 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_streaming | RuntimeMs | FlinkRunner | 435.18 | 415.27 | -4.57 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_zetasql_batch | RuntimeMs | DataflowRunner | 53895.0 | 56736.86 |
5.27 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_zetasql_batch | RuntimeMs | DirectRunner | 3690.21 | 3636.59 | -1.45
|  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_3_zetasql_streaming | RuntimeMs | DataflowRunner | 46191.81 | 43718.9
| -5.35 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_zetasql_streaming | RuntimeMs | DirectRunner | 8888.25 | 8803.36 |
-0.96 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_zetasql_streaming | RuntimeMs | FlinkRunner | 1200.43 | 1208.32 |
0.66 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_4_batch | RuntimeMs | DataflowRunner | 32791.79 | 28603.73 | -12.77 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_4_batch | RuntimeMs | DirectRunner | 2432.39 | 2624.86 | 7.91 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_4_batch | RuntimeMs | FlinkRunner | 843.21 | 824.23 | -2.25 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_4_batch | RuntimeMs | SparkRunner | 1001.66 | 995.66 | -0.6 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_4_batch | RuntimeMs | SparkStructuredStreamingRunner | 2203.75 |
2140.52 | -2.87 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_4_streaming | RuntimeMs | DataflowRunner | 51171.14 | 51611.05 | 0.86
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_4_streaming | RuntimeMs | DirectRunner | 2863.04 | 2828.09 | -1.22 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_4_streaming | RuntimeMs | FlinkRunner | 1002.07 | 1121.82 | 11.95 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_5_batch | RuntimeMs | DataflowRunner | 35150.94 | 32260.21 | -8.22 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_5_batch | RuntimeMs | DirectRunner | 10433.79 | 10327.0 | -1.02 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_5_batch | RuntimeMs | FlinkRunner | 785.25 | 759.36 | -3.3 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_5_batch | RuntimeMs | SparkRunner | 1523.75 | 1506.05 | -1.16 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_5_batch | RuntimeMs | SparkStructuredStreamingRunner | 1694.55 |
1734.66 | 2.37 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_5_streaming | RuntimeMs | DataflowRunner | 202353.63 | 198441.85 |
-1.93 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_5_streaming | RuntimeMs | DirectRunner | 20527.0 | 20249.32 | -1.35 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_5_streaming | RuntimeMs | FlinkRunner | 1642.86 | 1688.27 | 2.76 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_6_batch | RuntimeMs | DataflowRunner | 31073.93 | 25403.55 | -18.25 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_6_batch | RuntimeMs | DirectRunner | 1825.64 | 1972.68 | 8.05 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_6_batch | RuntimeMs | FlinkRunner | 558.82 | 545.45 | -2.39 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_6_batch | RuntimeMs | SparkRunner | 714.95 | 690.59 | -3.41 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_6_batch | RuntimeMs | SparkStructuredStreamingRunner | 957.11 | 990.52
| 3.49 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_6_streaming | RuntimeMs | DataflowRunner | 41906.43 | 37098.91 |
-11.47 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_6_streaming | RuntimeMs | DirectRunner | 2101.96 | 2099.18 | -0.13 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_6_streaming | RuntimeMs | FlinkRunner | 602.57 | 607.27 | 0.78 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_batch | RuntimeMs | DataflowRunner | 55471.93 | 47579.77 | -14.23 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_batch | RuntimeMs | DirectRunner | 18521.18 | 18589.91 | 0.37 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_7_batch | RuntimeMs | FlinkRunner | 691.39 | 644.41 | -6.8 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_7_batch | RuntimeMs | SparkRunner | 1420.0 | 1406.18 | -0.97 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_7_batch | RuntimeMs | SparkStructuredStreamingRunner | 2193.82 |
2234.84 | 1.87 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_7_sql_batch | RuntimeMs | DataflowRunner | 79321.82 | 73834.14 | -6.92
|  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_sql_batch | RuntimeMs | DirectRunner | 353209.46 | 207664.73 |
-41.21 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_sql_batch | RuntimeMs | SparkRunner | 7123.96 | 6997.5 | -1.78 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 5818.62 |
5867.11 | 0.83 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_7_sql_streaming | RuntimeMs | DataflowRunner | 1000511.89 | 967250.32
| -3.32 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_7_sql_streaming | RuntimeMs | DirectRunner | 1023436.39 | 569691.27 |
-44.34 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_sql_streaming | RuntimeMs | FlinkRunner | 3435.75 | 3439.27 | 0.1 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_streaming | RuntimeMs | DataflowRunner | 118661.04 | 121099.11 |
2.05 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_7_streaming | RuntimeMs | DirectRunner | 848229.14 | 849076.0 | 0.1 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_7_streaming | RuntimeMs | FlinkRunner | 13727.64 | 12914.32 | -5.92 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_8_batch | RuntimeMs | DataflowRunner | 22237.27 | 19225.12 | -13.55 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_8_batch | RuntimeMs | DirectRunner | 2373.46 | 2261.91 | -4.7 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_8_batch | RuntimeMs | FlinkRunner | 494.75 | 498.23 | 0.7 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_8_batch | RuntimeMs | SparkRunner | 1433.34 | 1415.5 | -1.24 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_8_batch | RuntimeMs | SparkStructuredStreamingRunner | 1055.88 |
1111.52 | 5.27 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_8_streaming | RuntimeMs | DataflowRunner | 60740.91 | 59651.91 | -1.79
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_8_streaming | RuntimeMs | DirectRunner | 6951.21 | 6891.45 | -0.86 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_8_streaming | RuntimeMs | FlinkRunner | 487.29 | 479.82 | -1.53 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_9_batch | RuntimeMs | DataflowRunner | 29320.61 | 23842.73 | -18.68 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_9_batch | RuntimeMs | DirectRunner | 1423.36 | 1396.36 | -1.9 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_9_batch | RuntimeMs | FlinkRunner | 329.39 | 335.95 | 1.99 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_9_batch | RuntimeMs | SparkRunner | 537.62 | 528.61 | -1.68 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_9_batch | RuntimeMs | SparkStructuredStreamingRunner | 749.05 | 722.64
| -3.53 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_9_streaming | RuntimeMs | DataflowRunner | 31050.79 | 31767.05 | 2.31
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_9_streaming | RuntimeMs | DirectRunner | 1764.39 | 1759.68 | -0.27 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_9_streaming | RuntimeMs | FlinkRunner | 451.11 | 542.45 | 20.25 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)