You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/06/07 11:56:06 UTC

Beam Metrics Report (2022-06-07)

# Beam Metrics Report

Color legend:  >= 20 | >= 10 | <= -10 | <= -20  
---|---|---|---  
  
## Possible regression

**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**  
---|---|---|---|---|---|---  
go_batch_cogbk_1 | dataflow_runtime | - | 243.78 | 274.01 | 12.4 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
go_batch_combine_1 | dataflow_runtime | - | 406.0 | 683.05 | 68.24 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
go_batch_gbk_7 | dataflow_runtime | - | 107.65 | 133.68 | 24.18 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_cogbk_1 | dataflow_runtime_sec | - | 38.54 | 45.26 | 17.45 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_gbk_7 | dataflow_v2_java11_runtime_sec | - | 40.36 | 53.18 | 31.76
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_pardo_1 | dataflow_v2_java11_runtime_sec | - | 14.63 | 16.85 |
15.21 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_gbk_3 | dataflow_v2_java17_runtime_sec | - | 66.34 | 85.2 |
28.44 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_5 | dataflow_v2_java11_runtime_sec | - | 594.44 | 663.12 |
11.55 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_6 | dataflow_v2_java11_runtime_sec | - | 143.59 | 168.9 |
17.63 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_6 | dataflow_v2_java17_runtime_sec | - | 157.25 | 189.98 |
20.81 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_7 | dataflow_v2_java17_runtime_sec | - | 200.71 | 252.81 |
25.96 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_pardo_1 | dataflow_runtime_sec | - | 18.16 | 20.29 | 11.73 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_1 | dataflow_v2_java11_runtime_sec | - | 29.1 | 34.64 |
19.06 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_2 | dataflow_v2_java17_runtime_sec | - | 146.98 | 169.42
| 15.27 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_3 | dataflow_v2_java11_runtime_sec | - | 24.17 | 26.76 |
10.69 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_4 | dataflow_v2_java17_runtime_sec | - | 44.09 | 49.9 |
13.16 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_2 | python_dataflow_streaming_pardo_2_runtime | - |
2921.57 | 3254.8 | 11.41 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
tfrecordioit_results | read_time | - | 15.5 | 18.2 | 17.42 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
xmlioit_results | write_time | - | 24.96 | 28.79 | 15.37 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
nexmark_11_batch | RuntimeMs | FlinkRunner | 287.89 | 319.59 | 11.01 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_sql_streaming | RuntimeMs | DataflowRunner | 36914.86 | 42544.73 |
15.25 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_14_batch | RuntimeMs | FlinkRunner | 538.61 | 617.91 | 14.72 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_14_streaming | RuntimeMs | DataflowRunner | 109147.82 | 124664.5 |
14.22 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_15_batch | RuntimeMs | FlinkRunner | 474.89 | 563.91 | 18.74 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_5_streaming | RuntimeMs | DataflowRunner | 203490.09 | 236892.9 |
16.41 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_9_batch | RuntimeMs | FlinkRunner | 303.61 | 347.77 | 14.55 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
  
## Possible improvement

**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**  
---|---|---|---|---|---|---  
go_batch_sideinput_3 | dataflow_runtime | - | 2.93 | 2.44 | -16.68 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
java_batch_cogbk_3 | dataflow_v2_java11_runtime_sec | - | 16.07 | 13.47 |
-16.18 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_3 | dataflow_v2_java17_runtime_sec | - | 15.92 | 13.11 |
-17.65 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_gbk_3 | dataflow_v2_java17_runtime_sec | - | 17.1 | 14.73 | -13.88
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_4 | dataflow_v2_java17_runtime_sec | - | 26.6 | 23.23 | -12.7 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_5 | dataflow_v2_java17_runtime_sec | - | 20.92 | 17.87 | -14.55
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_6 | dataflow_runtime_sec | - | 42.51 | 34.2 | -19.55 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_pardo_3 | dataflow_runtime_sec | - | 13.72 | 11.58 | -15.59 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_3 | dataflow_v2_java11_runtime_sec | - | 16.6 | 14.2 | -14.44
|  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_gbk_1 | dataflow_v2_java11_runtime_sec | - | 3936.29 | 1461.72
| -62.87 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_1 | dataflow_v2_java17_runtime_sec | - | 3338.54 | 1258.08
| -62.32 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_combine_5 | python_dataflow_batch_combine_5_runtime | - | 53.43 |
36.4 | -31.87 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_gbk_3 | python_dataflow_batch_gbk_3_runtime | - | 27.71 | 24.0 |
-13.4 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_sideinput_5 | python_dataflow_batch_sideinput_5_runtime | - |
46.14 | 40.8 | -11.58 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_streaming_cogbk_1 | python_dataflow_streaming_cogbk_1_runtime | - |
5931.0 | 1494.2 | -74.81 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_streaming_cogbk_2 | python_dataflow_streaming_cogbk_2_runtime | - |
1164.0 | 414.6 | -64.38 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_streaming_cogbk_3 | python_dataflow_streaming_cogbk_3_runtime | - |
10235.0 | 544.4 | -94.68 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_streaming_gbk_3 | python_dataflow_streaming_gbk_3_runtime | - | 147.86
| 89.8 | -39.27 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_streaming_gbk_6 | python_dataflow_streaming_gbk_6_runtime | - | 2378.33
| 649.6 | -72.69 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_streaming_gbk_7 | python_dataflow_streaming_gbk_7_runtime | - | 2211.67
| 530.5 | -76.01 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_streaming_pardo_1 | python_dataflow_streaming_pardo_1_runtime | - |
251.43 | 219.0 | -12.9 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
nexmark_12_batch | RuntimeMs | FlinkRunner | 204.25 | 176.86 | -13.41 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_16_batch | RuntimeMs | FlinkRunner | 250.21 | 214.0 | -14.47 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_6_streaming | RuntimeMs | FlinkRunner | 734.86 | 607.18 | -17.37 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_7_sql_batch | RuntimeMs | DirectRunner | 504902.43 | 371615.77 | -26.4
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_7_sql_streaming | RuntimeMs | DirectRunner | 2184798.29 | 1417868.68 |
-35.1 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
  
## All metrics

**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**  
---|---|---|---|---|---|---  
avroioit_hdfs_results | read_time | - | 88.81 | 91.22 | 2.72 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
avroioit_hdfs_results | write_time | - | 119.81 | 119.31 | -0.42 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
avroioit_results | read_time | - | 88.99 | 93.3 | 4.84 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
avroioit_results | write_time | - | 114.94 | 121.43 | 5.65 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_batch_avro | avro_write_time | - | 31.61 | 33.32 | 5.39
|  [[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_batch_avro | read_time | - | 43.15 | 42.04 | -2.58 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_batch_json | read_time | - | 38.55 | 38.65 | 0.25 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_batch_json | write_time | - | 47.79 | 47.29 | -1.03 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
compressed_textioit_hdfs_results | read_time | - | 149.12 | 162.05 | 8.67 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
compressed_textioit_hdfs_results | write_time | - | 201.46 | 207.1 | 2.8 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
compressed_textioit_results | read_time | - | 156.64 | 157.01 | 0.23 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
compressed_textioit_results | write_time | - | 197.4 | 205.18 | 3.94 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
go_batch_cogbk_1 | dataflow_runtime | - | 243.78 | 274.01 | 12.4 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
go_batch_cogbk_2 | dataflow_runtime | - | 152.05 | 160.76 | 5.73 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
go_batch_cogbk_3 | dataflow_runtime | - | 115.27 | 108.1 | -6.22 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
go_batch_cogbk_4 | dataflow_runtime | - | 116.26 | 115.51 | -0.65 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
go_batch_combine_1 | dataflow_runtime | - | 406.0 | 683.05 | 68.24 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
go_batch_combine_4 | dataflow_runtime | - | 75.36 | 75.62 | 0.34 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
go_batch_combine_5 | dataflow_runtime | - | 70.13 | 71.56 | 2.05 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
go_batch_gbk_1 | dataflow_runtime | - | 351.82 | 377.5 | 7.3 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_2 | dataflow_runtime | - | 101.5 | 104.03 | 2.5 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_3 | dataflow_runtime | - | 32.72 | 33.71 | 3.01 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_4 | dataflow_runtime | - | 55.25 | 55.97 | 1.31 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_5 | dataflow_runtime | - | 44.52 | 44.18 | -0.77 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_6 | dataflow_runtime | - | 106.02 | 104.36 | -1.56 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_7 | dataflow_runtime | - | 107.65 | 133.68 | 24.18 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_pardo_1 | dataflow_runtime | - | 72.08 | 73.31 | 1.71 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
go_batch_pardo_2 | dataflow_runtime | - | 344.34 | 373.06 | 8.34 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
go_batch_pardo_3 | dataflow_runtime | - | 63.78 | 64.54 | 1.18 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
go_batch_pardo_4 | dataflow_runtime | - | 69.12 | 68.51 | -0.88 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
go_batch_sideinput_3 | dataflow_runtime | - | 2.93 | 2.44 | -16.68 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
go_batch_sideinput_4 | dataflow_runtime | - | 217.2 | 230.26 | 6.02 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
hadoopformatioit_results | read_time | - | 6.26 | 6.3 | 0.79 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
hadoopformatioit_results | write_time | - | 7.88 | 7.53 | -4.44 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
java_batch_cogbk_1 | dataflow_runtime_sec | - | 38.54 | 45.26 | 17.45 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_1 | dataflow_v2_java11_runtime_sec | - | 47.65 | 48.65 | 2.1
|  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_1 | dataflow_v2_java17_runtime_sec | - | 47.17 | 48.62 | 3.07
|  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_1 | sparkstructuredstreaming_runtime_sec | - | 120.26 | 117.5
| -2.29 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_2 | dataflow_runtime_sec | - | 41.64 | 43.23 | 3.81 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_2 | dataflow_v2_java11_runtime_sec | - | 45.38 | 48.85 | 7.64
|  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_2 | dataflow_v2_java17_runtime_sec | - | 45.9 | 45.52 | -0.83
|  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_2 | sparkstructuredstreaming_runtime_sec | - | 117.01 |
114.95 | -1.76 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_3 | dataflow_runtime_sec | - | 14.02 | 14.78 | 5.46 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_3 | dataflow_v2_java11_runtime_sec | - | 16.07 | 13.47 |
-16.18 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_3 | dataflow_v2_java17_runtime_sec | - | 15.92 | 13.11 |
-17.65 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_3 | sparkstructuredstreaming_runtime_sec | - | 19.27 | 18.88
| -2.02 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_4 | dataflow_runtime_sec | - | 13.55 | 13.63 | 0.61 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_4 | dataflow_v2_java11_runtime_sec | - | 14.58 | 13.43 |
-7.89 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_4 | dataflow_v2_java17_runtime_sec | - | 14.32 | 13.44 |
-6.14 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_4 | sparkstructuredstreaming_runtime_sec | - | 19.14 | 18.77
| -1.91 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_combine_1 | dataflow_runtime_sec | - | 61.46 | 64.55 | 5.02 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_1 | sparkstructuredstreaming_runtime_sec | - | 545.81 |
563.57 | 3.25 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_4 | dataflow_runtime_sec | - | 27.43 | 26.53 | -3.26 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_4 | sparkstructuredstreaming_runtime_sec | - | 125.86 |
126.98 | 0.89 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_5 | dataflow_runtime_sec | - | 26.21 | 26.38 | 0.65 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_5 | sparkstructuredstreaming_runtime_sec | - | 118.14 |
119.36 | 1.03 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_gbk_1 | dataflow_runtime_sec | - | 126.21 | 122.68 | -2.8 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_1 | dataflow_v2_java11_runtime_sec | - | 102.35 | 101.08 |
-1.25 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_1 | dataflow_v2_java17_runtime_sec | - | 99.67 | 95.22 | -4.47
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_1 | sparkstructuredstreaming_runtime_sec | - | 478.31 | 480.92
| 0.55 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_2 | dataflow_runtime_sec | - | 32.2 | 34.84 | 8.19 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_2 | dataflow_v2_java11_runtime_sec | - | 41.3 | 44.34 | 7.35 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_2 | dataflow_v2_java17_runtime_sec | - | 43.26 | 46.32 | 7.08 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_2 | sparkstructuredstreaming_runtime_sec | - | 96.31 | 93.63 |
-2.79 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_3 | dataflow_runtime_sec | - | 11.46 | 10.49 | -8.43 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_3 | dataflow_v2_java11_runtime_sec | - | 15.38 | 14.75 | -4.06
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_3 | dataflow_v2_java17_runtime_sec | - | 17.1 | 14.73 | -13.88
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_3 | sparkstructuredstreaming_runtime_sec | - | 7.8 | 7.72 |
-0.98 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_4 | dataflow_runtime_sec | - | 18.1 | 19.31 | 6.68 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_4 | dataflow_v2_java11_runtime_sec | - | 22.12 | 21.85 | -1.22
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_4 | dataflow_v2_java17_runtime_sec | - | 26.6 | 23.23 | -12.7 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_4 | sparkstructuredstreaming_runtime_sec | - | 92.26 | 94.08 |
1.97 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_5 | dataflow_runtime_sec | - | 18.97 | 19.25 | 1.52 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_5 | dataflow_v2_java11_runtime_sec | - | 19.68 | 20.46 | 3.96 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_5 | dataflow_v2_java17_runtime_sec | - | 20.92 | 17.87 | -14.55
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_5 | sparkstructuredstreaming_runtime_sec | - | 95.22 | 93.75 |
-1.55 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_6 | dataflow_runtime_sec | - | 42.51 | 34.2 | -19.55 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_6 | dataflow_v2_java11_runtime_sec | - | 28.56 | 30.23 | 5.86 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_6 | dataflow_v2_java17_runtime_sec | - | 29.79 | 31.78 | 6.67 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_6 | sparkstructuredstreaming_runtime_sec | - | 56.03 | 55.47 |
-1.0 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_7 | dataflow_runtime_sec | - | 53.37 | 49.84 | -6.62 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_7 | dataflow_v2_java11_runtime_sec | - | 40.36 | 53.18 | 31.76
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_7 | dataflow_v2_java17_runtime_sec | - | 43.51 | 44.27 | 1.76 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_7 | sparkstructuredstreaming_runtime_sec | - | 82.42 | 80.23 |
-2.66 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_pardo_1 | dataflow_runtime_sec | - | 19.25 | 18.01 | -6.43 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_1 | dataflow_v2_java11_runtime_sec | - | 14.63 | 16.85 |
15.21 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_1 | dataflow_v2_java17_runtime_sec | - | 17.8 | 19.05 | 6.99
|  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_1 | sparkstructuredstreaming_runtime_sec | - | 54.31 | 58.84
| 8.35 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_2 | dataflow_runtime_sec | - | 181.78 | 195.82 | 7.73 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_2 | dataflow_v2_java11_runtime_sec | - | 78.52 | 76.23 |
-2.91 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_2 | dataflow_v2_java17_runtime_sec | - | 73.13 | 70.08 |
-4.17 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_3 | dataflow_runtime_sec | - | 13.72 | 11.58 | -15.59 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_3 | dataflow_v2_java11_runtime_sec | - | 16.6 | 14.2 | -14.44
|  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_3 | dataflow_v2_java17_runtime_sec | - | 12.73 | 11.75 |
-7.71 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_4 | dataflow_runtime_sec | - | 24.72 | 24.89 | 0.68 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_4 | dataflow_v2_java11_runtime_sec | - | 26.37 | 25.27 |
-4.19 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_4 | dataflow_v2_java17_runtime_sec | - | 24.84 | 24.65 |
-0.77 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_cogbk_1 | dataflow_runtime_sec | - | 842.65 | 869.6 | 3.2 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_1 | dataflow_v2_java11_runtime_sec | - | 2802.17 | 2977.3
| 6.25 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_1 | dataflow_v2_java17_runtime_sec | - | 2525.1 | 2682.2
| 6.22 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_2 | dataflow_runtime_sec | - | 874.3 | 838.63 | -4.08 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_2 | dataflow_v2_java11_runtime_sec | - | 2860.6 | 3136.21
| 9.63 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_2 | dataflow_v2_java17_runtime_sec | - | 2818.1 | 2930.15
| 3.98 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_3 | dataflow_runtime_sec | - | 112.49 | 118.42 | 5.27 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_3 | dataflow_v2_java11_runtime_sec | - | 316.15 | 326.05
| 3.13 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_3 | dataflow_v2_java17_runtime_sec | - | 324.74 | 344.06
| 5.95 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_4 | dataflow_runtime_sec | - | 113.18 | 109.69 | -3.08 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_4 | dataflow_v2_java11_runtime_sec | - | 295.89 | 285.46
| -3.52 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_4 | dataflow_v2_java17_runtime_sec | - | 340.68 | 349.12
| 2.48 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_combine_1 | dataflow_runtime_sec | - | 479.66 | 473.14 | -1.36
|  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_streaming_combine_4 | dataflow_runtime_sec | - | 311.99 | 317.44 | 1.74 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_streaming_combine_5 | dataflow_runtime_sec | - | 309.95 | 307.46 | -0.8 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_streaming_gbk_1 | dataflow_runtime_sec | - | 677.98 | 659.44 | -2.73 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_1 | dataflow_v2_java11_runtime_sec | - | 3936.29 | 1461.72
| -62.87 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_1 | dataflow_v2_java17_runtime_sec | - | 3338.54 | 1258.08
| -62.32 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_2 | dataflow_runtime_sec | - | 857.86 | 827.24 | -3.57 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_2 | dataflow_v2_java11_runtime_sec | - | 2818.94 | 3075.79
| 9.11 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_2 | dataflow_v2_java17_runtime_sec | - | 2828.43 | 2741.23
| -3.08 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_3 | dataflow_runtime_sec | - | 23.93 | 23.46 | -1.94 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_3 | dataflow_v2_java11_runtime_sec | - | 87.49 | 84.7 |
-3.18 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_3 | dataflow_v2_java17_runtime_sec | - | 66.34 | 85.2 |
28.44 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_4 | dataflow_runtime_sec | - | 287.14 | 293.09 | 2.07 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_4 | dataflow_v2_java11_runtime_sec | - | 658.1 | 672.38 |
2.17 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_4 | dataflow_v2_java17_runtime_sec | - | 619.02 | 649.53 |
4.93 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_5 | dataflow_runtime_sec | - | 283.67 | 299.93 | 5.74 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_5 | dataflow_v2_java11_runtime_sec | - | 594.44 | 663.12 |
11.55 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_5 | dataflow_v2_java17_runtime_sec | - | 658.1 | 600.54 |
-8.75 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_6 | dataflow_runtime_sec | - | 74.95 | 76.64 | 2.25 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_6 | dataflow_v2_java11_runtime_sec | - | 143.59 | 168.9 |
17.63 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_6 | dataflow_v2_java17_runtime_sec | - | 157.25 | 189.98 |
20.81 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_7 | dataflow_runtime_sec | - | 131.58 | 136.92 | 4.05 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_7 | dataflow_v2_java11_runtime_sec | - | 205.59 | 204.79 |
-0.39 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_7 | dataflow_v2_java17_runtime_sec | - | 200.71 | 252.81 |
25.96 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_pardo_1 | dataflow_runtime_sec | - | 18.16 | 20.29 | 11.73 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_1 | dataflow_v2_java11_runtime_sec | - | 29.1 | 34.64 |
19.06 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_1 | dataflow_v2_java17_runtime_sec | - | 29.71 | 29.27 |
-1.49 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_2 | dataflow_runtime_sec | - | 208.95 | 225.15 | 7.75 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_2 | dataflow_v2_java11_runtime_sec | - | 176.52 | 171.31
| -2.96 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_2 | dataflow_v2_java17_runtime_sec | - | 146.98 | 169.42
| 15.27 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_3 | dataflow_runtime_sec | - | 12.51 | 12.52 | 0.01 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_3 | dataflow_v2_java11_runtime_sec | - | 24.17 | 26.76 |
10.69 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_3 | dataflow_v2_java17_runtime_sec | - | 25.43 | 26.58 |
4.55 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_4 | dataflow_runtime_sec | - | 29.23 | 31.81 | 8.82 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_4 | dataflow_v2_java11_runtime_sec | - | 47.04 | 45.05 |
-4.23 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_4 | dataflow_v2_java17_runtime_sec | - | 44.09 | 49.9 |
13.16 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
jdbcioit_results | read_time | - | 24.81 | 24.94 | 0.53 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
jdbcioit_results | write_time | - | 40.6 | 43.06 | 6.07 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
many_files_textioit_hdfs_results | read_time | - | 17.73 | 17.14 | -3.29 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
many_files_textioit_hdfs_results | write_time | - | 60.77 | 61.83 | 1.74 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
many_files_textioit_results | read_time | - | 25.91 | 24.9 | -3.87 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
many_files_textioit_results | write_time | - | 58.73 | 58.83 | 0.16 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
mongodbioit_results | read_time | - | 28.66 | 30.09 | 4.97 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
mongodbioit_results | write_time | - | 62.05 | 65.95 | 6.29 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
parquetioit_hdfs_results | read_time | - | 86.9 | 86.78 | -0.14 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
parquetioit_hdfs_results | write_time | - | 143.65 | 145.6 | 1.36 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
parquetioit_results | read_time | - | 83.8 | 84.72 | 1.1 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
parquetioit_results | write_time | - | 135.94 | 137.62 | 1.24 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
python_batch_cogbk_1 | python_dataflow_batch_cogbk_1_runtime | - | 487.43 |
448.2 | -8.05 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_batch_cogbk_2 | python_dataflow_batch_cogbk_2_runtime | - | 295.14 |
317.0 | 7.41 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_batch_cogbk_3 | python_dataflow_batch_cogbk_3_runtime | - | 260.14 |
273.8 | 5.25 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_batch_cogbk_4 | python_dataflow_batch_cogbk_4_runtime | - | 270.0 |
271.6 | 0.59 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_batch_combine_1 | python_dataflow_batch_combine_1_runtime | - | 869.14
| 867.4 | -0.2 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_combine_4 | python_dataflow_batch_combine_4_runtime | - | 53.86 |
54.0 | 0.27 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_combine_5 | python_dataflow_batch_combine_5_runtime | - | 53.43 |
36.4 | -31.87 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_gbk_1 | python_dataflow_batch_gbk_1_runtime | - | 1889.71 |
1843.8 | -2.43 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_2 | python_dataflow_batch_gbk_2_runtime | - | 372.29 | 368.4
| -1.04 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_3 | python_dataflow_batch_gbk_3_runtime | - | 27.71 | 24.0 |
-13.4 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_4 | python_dataflow_batch_gbk_4_runtime | - | 128.43 | 140.6
| 9.48 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_5 | python_dataflow_batch_gbk_5_runtime | - | 128.0 | 122.6 |
-4.22 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_6 | python_dataflow_batch_gbk_6_runtime | - | 340.0 | 345.0 |
1.47 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_7 | python_dataflow_batch_gbk_7_runtime | - | 335.14 | 354.8
| 5.87 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_pardo_1 | python_dataflow_batch_pardo_1_runtime | - | 171.29 |
171.0 | -0.17 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_2 | python_dataflow_batch_pardo_2_runtime | - | 1532.86 |
1554.4 | 1.41 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_3 | python_dataflow_batch_pardo_3_runtime | - | 153.71 |
164.2 | 6.82 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_4 | python_dataflow_batch_pardo_4_runtime | - | 374.57 |
339.4 | -9.39 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_sideinput_1 | python_dataflow_batch_sideinput_1_runtime | - |
47.0 | 42.5 | -9.57 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_2 | python_dataflow_batch_sideinput_2_runtime | - |
44.43 | 47.33 | 6.54 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_3 | python_dataflow_batch_sideinput_3_runtime | - |
5.71 | 6.17 | 7.92 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_4 | python_dataflow_batch_sideinput_4_runtime | - |
442.86 | 464.4 | 4.86 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_5 | python_dataflow_batch_sideinput_5_runtime | - |
46.14 | 40.8 | -11.58 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_6 | python_dataflow_batch_sideinput_6_runtime | - |
44.43 | 44.6 | 0.39 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_7 | python_dataflow_batch_sideinput_7_runtime | - |
5342.29 | 5485.8 | 2.69 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_8 | python_dataflow_batch_sideinput_8_runtime | - |
5461.43 | 5552.6 | 1.67 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_bqio_read_10GB_results | bqio_read_10GB_results_runtime | - | 112.0 |
111.8 | -0.18 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_bqio_write_10GB_results | bqio_write_10GB_results_runtime | - | 242.86
| 226.0 | -6.94 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_direct_microbenchmarks | fn_api_runner_microbenchmark_runtime_sec | - |
90.75 | 93.34 | 2.85 |  
python_direct_microbenchmarks | teststream_microbenchmark_runtime_sec | - |
349.71 | 366.37 | 4.76 |  
python_spanner_write_2GB_results | pyspanner_write_2GB_results_runtime | - |
1654.71 | 1642.6 | -0.73 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_spannerio_read_2GB_results | pyspanner_read_2GB_results_runtime | - |
26.29 | 27.0 | 2.72 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_streaming_cogbk_1 | python_dataflow_streaming_cogbk_1_runtime | - |
5931.0 | 1494.2 | -74.81 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_streaming_cogbk_2 | python_dataflow_streaming_cogbk_2_runtime | - |
1164.0 | 414.6 | -64.38 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_streaming_cogbk_3 | python_dataflow_streaming_cogbk_3_runtime | - |
10235.0 | 544.4 | -94.68 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_streaming_gbk_3 | python_dataflow_streaming_gbk_3_runtime | - | 147.86
| 89.8 | -39.27 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_streaming_gbk_6 | python_dataflow_streaming_gbk_6_runtime | - | 2378.33
| 649.6 | -72.69 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_streaming_gbk_7 | python_dataflow_streaming_gbk_7_runtime | - | 2211.67
| 530.5 | -76.01 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_streaming_pardo_1 | python_dataflow_streaming_pardo_1_runtime | - |
251.43 | 219.0 | -12.9 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_2 | python_dataflow_streaming_pardo_2_runtime | - |
2921.57 | 3254.8 | 11.41 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_3 | python_dataflow_streaming_pardo_3_runtime | - |
206.14 | 188.8 | -8.41 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_4 | python_dataflow_streaming_pardo_4_runtime | - |
502.33 | 494.33 | -1.59 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
textioit_hdfs_results | read_time | - | 20.45 | 19.8 | -3.18 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
textioit_hdfs_results | write_time | - | 32.53 | 32.39 | -0.42 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
textioit_results | read_time | - | 21.31 | 21.75 | 2.03 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
textioit_results | write_time | - | 32.08 | 33.79 | 5.33 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
tfrecordioit_results | read_time | - | 15.5 | 18.2 | 17.42 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
tfrecordioit_results | write_time | - | 20.88 | 20.85 | -0.17 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
wordcount_py37_results | runtime | - | 794.33 | 801.53 | 0.91 |
[[1]](http://metrics.beam.apache.org/d/1cnwVDkGk)  
xmlioit_hdfs_results | read_time | - | 22.28 | 22.73 | 1.99 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
xmlioit_hdfs_results | write_time | - | 25.76 | 25.86 | 0.38 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
xmlioit_results | read_time | - | 24.09 | 23.45 | -2.66 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
xmlioit_results | write_time | - | 24.96 | 28.79 | 15.37 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
nexmark_0_batch | RuntimeMs | DataflowRunner | 27896.78 | 27530.86 | -1.31 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_batch | RuntimeMs | DirectRunner | 4862.32 | 4763.5 | -2.03 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_0_batch | RuntimeMs | FlinkRunner | 1158.25 | 1170.77 | 1.08 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_0_batch | RuntimeMs | SparkRunner | 1288.14 | 1257.91 | -2.35 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_batch | RuntimeMs | SparkStructuredStreamingRunner | 1599.27 |
1540.98 | -3.64 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_sql_batch | RuntimeMs | DataflowRunner | 34946.64 | 35171.27 | 0.64
|  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_sql_batch | RuntimeMs | DirectRunner | 5565.43 | 5682.86 | 2.11 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_sql_batch | RuntimeMs | SparkRunner | 3257.48 | 3211.3 | -1.42 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 2997.57 |
2845.91 | -5.06 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_0_sql_streaming | RuntimeMs | DataflowRunner | 22512.04 | 23962.5 |
6.44 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_sql_streaming | RuntimeMs | DirectRunner | 15442.46 | 15340.18 |
-0.66 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_sql_streaming | RuntimeMs | FlinkRunner | 1647.29 | 1676.86 | 1.8 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_streaming | RuntimeMs | DataflowRunner | 35829.53 | 37077.8 | 3.48 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_streaming | RuntimeMs | DirectRunner | 11889.71 | 11992.5 | 0.86 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_streaming | RuntimeMs | FlinkRunner | 1456.32 | 1433.36 | -1.58 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_zetasql_batch | RuntimeMs | DataflowRunner | 108027.82 | 115170.68 |
6.61 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_0_zetasql_batch | RuntimeMs | DirectRunner | 6772.29 | 6758.68 | -0.2
|  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_zetasql_streaming | RuntimeMs | DataflowRunner | 62171.52 | 66734.14
| 7.34 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_zetasql_streaming | RuntimeMs | DirectRunner | 17111.61 | 16917.36 |
-1.14 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_zetasql_streaming | RuntimeMs | FlinkRunner | 3239.93 | 3263.55 |
0.73 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_10_batch | RuntimeMs | DataflowRunner | 48353.1 | 49416.72 | 2.2 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_10_batch | RuntimeMs | DirectRunner | 10557.54 | 10510.95 | -0.44 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_10_batch | RuntimeMs | FlinkRunner | 762.5 | 704.41 | -7.62 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_10_batch | RuntimeMs | SparkRunner | 751.11 | 755.14 | 0.54 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_10_batch | RuntimeMs | SparkStructuredStreamingRunner | 1107.66 |
1108.73 | 0.1 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_10_streaming | RuntimeMs | DataflowRunner | 112813.16 | 118225.92 |
4.8 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_10_streaming | RuntimeMs | DirectRunner | 44489.54 | 44472.73 | -0.04
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_10_streaming | RuntimeMs | FlinkRunner | 1499.11 | 1520.0 | 1.39 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_11_batch | RuntimeMs | DataflowRunner | 42207.15 | 40625.94 | -3.75 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_11_batch | RuntimeMs | DirectRunner | 3790.25 | 3773.64 | -0.44 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_11_batch | RuntimeMs | FlinkRunner | 287.89 | 319.59 | 11.01 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_11_batch | RuntimeMs | SparkRunner | 1430.14 | 1396.86 | -2.33 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_11_batch | RuntimeMs | SparkStructuredStreamingRunner | 1059.11 |
1069.07 | 0.94 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_11_streaming | RuntimeMs | DataflowRunner | 193965.06 | 181747.53 |
-6.3 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_11_streaming | RuntimeMs | DirectRunner | 10622.79 | 10566.95 | -0.53
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_11_streaming | RuntimeMs | FlinkRunner | 1312.07 | 1350.41 | 2.92 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_12_batch | RuntimeMs | DataflowRunner | 22001.56 | 21512.56 | -2.22 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_12_batch | RuntimeMs | DirectRunner | 2647.68 | 2597.36 | -1.9 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_12_batch | RuntimeMs | FlinkRunner | 204.25 | 176.86 | -13.41 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_12_batch | RuntimeMs | SparkRunner | 930.32 | 958.14 | 2.99 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_12_batch | RuntimeMs | SparkStructuredStreamingRunner | 868.36 |
874.84 | 0.75 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_12_streaming | RuntimeMs | DataflowRunner | 91185.11 | 92485.07 | 1.43
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_12_streaming | RuntimeMs | DirectRunner | 9164.68 | 9205.05 | 0.44 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_12_streaming | RuntimeMs | FlinkRunner | 670.57 | 634.68 | -5.35 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_batch | RuntimeMs | DataflowRunner | 33929.96 | 34283.59 | 1.04 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_batch | RuntimeMs | DirectRunner | 3386.79 | 3146.64 | -7.09 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_batch | RuntimeMs | FlinkRunner | 419.54 | 407.36 | -2.9 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_batch | RuntimeMs | SparkRunner | 363.55 | 371.89 | 2.29 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_batch | RuntimeMs | SparkStructuredStreamingRunner | 551.88 |
548.11 | -0.68 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_13_sql_batch | RuntimeMs | DataflowRunner | 62807.18 | 61331.41 |
-2.35 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_sql_batch | RuntimeMs | DirectRunner | 9141.54 | 8989.45 | -1.66 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_13_sql_batch | RuntimeMs | SparkRunner | 3460.62 | 3513.73 | 1.53 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_13_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 3185.54 |
3069.02 | -3.66 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_sql_streaming | RuntimeMs | DataflowRunner | 36914.86 | 42544.73 |
15.25 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_sql_streaming | RuntimeMs | DirectRunner | 18617.93 | 18706.55 |
0.48 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_sql_streaming | RuntimeMs | FlinkRunner | 29187.07 | 27223.95 |
-6.73 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_streaming | RuntimeMs | DataflowRunner | 27632.79 | 30101.0 | 8.93
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_streaming | RuntimeMs | DirectRunner | 9882.96 | 10135.82 | 2.56 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_streaming | RuntimeMs | FlinkRunner | 28311.93 | 27738.0 | -2.03 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_zetasql_batch | RuntimeMs | DataflowRunner | 247934.96 | 255882.45
| 3.21 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_zetasql_batch | RuntimeMs | DirectRunner | 10088.36 | 10009.09 |
-0.79 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_13_zetasql_streaming | RuntimeMs | DataflowRunner | 109141.07 |
113348.18 | 3.85 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_zetasql_streaming | RuntimeMs | DirectRunner | 20988.5 | 21015.41 |
0.13 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_zetasql_streaming | RuntimeMs | FlinkRunner | 33556.36 | 33903.0 |
1.03 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_14_batch | RuntimeMs | DataflowRunner | 60613.29 | 62531.36 | 3.16 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_14_batch | RuntimeMs | DirectRunner | 4216.54 | 4137.18 | -1.88 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_14_batch | RuntimeMs | FlinkRunner | 538.61 | 617.91 | 14.72 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_14_batch | RuntimeMs | SparkRunner | 970.45 | 907.55 | -6.48 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_14_batch | RuntimeMs | SparkStructuredStreamingRunner | 979.96 | 947.3
| -3.33 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_14_streaming | RuntimeMs | DataflowRunner | 109147.82 | 124664.5 |
14.22 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_14_streaming | RuntimeMs | DirectRunner | 12058.5 | 12274.73 | 1.79 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_14_streaming | RuntimeMs | FlinkRunner | 1778.54 | 1750.68 | -1.57 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_15_batch | RuntimeMs | DataflowRunner | 46748.96 | 46678.53 | -0.15 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_15_batch | RuntimeMs | DirectRunner | 15486.64 | 15583.64 | 0.63 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_15_batch | RuntimeMs | FlinkRunner | 474.89 | 563.91 | 18.74 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_15_batch | RuntimeMs | SparkRunner | 1682.05 | 1619.93 | -3.69 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_15_batch | RuntimeMs | SparkStructuredStreamingRunner | 1442.3 |
1478.64 | 2.52 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_16_batch | RuntimeMs | DataflowRunner | 52893.21 | 53833.42 | 1.78 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_16_batch | RuntimeMs | DirectRunner | 86190.71 | 85858.95 | -0.38 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_16_batch | RuntimeMs | FlinkRunner | 250.21 | 214.0 | -14.47 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_16_batch | RuntimeMs | SparkRunner | 1411.27 | 1408.57 | -0.19 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_16_batch | RuntimeMs | SparkStructuredStreamingRunner | 1207.34 |
1245.23 | 3.14 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_16_streaming | RuntimeMs | DataflowRunner | 93974.36 | 97449.03 | 3.7
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_16_streaming | RuntimeMs | DirectRunner | 134466.75 | 126760.27 |
-5.73 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_16_streaming | RuntimeMs | FlinkRunner | 430.57 | 436.77 | 1.44 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_batch | RuntimeMs | DataflowRunner | 22471.95 | 22189.32 | -1.26 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_1_batch | RuntimeMs | DirectRunner | 3314.43 | 3262.23 | -1.57 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_batch | RuntimeMs | FlinkRunner | 328.64 | 330.59 | 0.59 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_batch | RuntimeMs | SparkRunner | 448.59 | 443.77 | -1.07 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_batch | RuntimeMs | SparkStructuredStreamingRunner | 611.68 | 596.39
| -2.5 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_sql_batch | RuntimeMs | DataflowRunner | 32417.36 | 32754.05 | 1.04
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_1_sql_batch | RuntimeMs | DirectRunner | 3589.75 | 3599.82 | 0.28 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_1_sql_batch | RuntimeMs | SparkRunner | 2466.46 | 2454.2 | -0.5 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1690.77 |
1649.34 | -2.45 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_sql_streaming | RuntimeMs | DataflowRunner | 20379.61 | 21721.14 |
6.58 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_sql_streaming | RuntimeMs | DirectRunner | 11384.21 | 11349.23 |
-0.31 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_1_sql_streaming | RuntimeMs | FlinkRunner | 662.04 | 668.86 | 1.03 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_streaming | RuntimeMs | DataflowRunner | 28237.68 | 28693.43 | 1.61
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_1_streaming | RuntimeMs | DirectRunner | 8068.96 | 8181.73 | 1.4 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_1_streaming | RuntimeMs | FlinkRunner | 683.75 | 680.68 | -0.45 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_batch | RuntimeMs | DataflowRunner | 16467.76 | 15531.44 | -5.69 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_batch | RuntimeMs | DirectRunner | 1491.07 | 1471.95 | -1.28 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_batch | RuntimeMs | FlinkRunner | 241.32 | 226.73 | -6.05 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_batch | RuntimeMs | SparkRunner | 324.46 | 309.41 | -4.64 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_2_batch | RuntimeMs | SparkStructuredStreamingRunner | 470.23 | 457.5
| -2.71 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_sql_batch | RuntimeMs | DataflowRunner | 25465.39 | 24656.73 | -3.18
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_2_sql_batch | RuntimeMs | DirectRunner | 1521.18 | 1547.82 | 1.75 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_sql_batch | RuntimeMs | SparkRunner | 762.11 | 731.0 | -4.08 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_2_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 987.71 |
942.57 | -4.57 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_sql_streaming | RuntimeMs | DataflowRunner | 12977.14 | 13844.5 |
6.68 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_sql_streaming | RuntimeMs | DirectRunner | 6751.04 | 6748.41 | -0.04
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_sql_streaming | RuntimeMs | FlinkRunner | 421.18 | 428.14 | 1.65 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_2_streaming | RuntimeMs | DataflowRunner | 20571.28 | 21219.08 | 3.15
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_2_streaming | RuntimeMs | DirectRunner | 5104.0 | 5114.73 | 0.21 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_streaming | RuntimeMs | FlinkRunner | 269.18 | 288.41 | 7.14 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_zetasql_batch | RuntimeMs | DataflowRunner | 69438.18 | 72849.82 |
4.91 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_zetasql_batch | RuntimeMs | DirectRunner | 2913.07 | 2893.41 | -0.67
|  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_zetasql_streaming | RuntimeMs | DataflowRunner | 37159.0 | 40107.73
| 7.94 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_2_zetasql_streaming | RuntimeMs | DirectRunner | 8207.14 | 8159.18 |
-0.58 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_zetasql_streaming | RuntimeMs | FlinkRunner | 1200.79 | 1190.68 |
-0.84 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_3_batch | RuntimeMs | DataflowRunner | 28141.43 | 28128.82 | -0.04 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_batch | RuntimeMs | DirectRunner | 3166.57 | 3249.05 | 2.6 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_3_batch | RuntimeMs | FlinkRunner | 1085.57 | 1082.59 | -0.27 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_3_batch | RuntimeMs | SparkRunner | 2132.18 | 2101.45 | -1.44 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_sql_batch | RuntimeMs | DataflowRunner | 29764.82 | 29707.23 | -0.19
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_sql_batch | RuntimeMs | DirectRunner | 3272.21 | 3332.09 | 1.83 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_3_sql_batch | RuntimeMs | SparkRunner | 3575.25 | 3507.73 | -1.89 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_3_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 3070.84 |
3003.2 | -2.2 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_sql_streaming | RuntimeMs | DataflowRunner | 31121.79 | 32963.5 |
5.92 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_sql_streaming | RuntimeMs | DirectRunner | 8477.46 | 8324.0 | -1.81
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_3_sql_streaming | RuntimeMs | FlinkRunner | 956.32 | 973.73 | 1.82 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_streaming | RuntimeMs | DataflowRunner | 42869.88 | 43296.49 | 1.0 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_3_streaming | RuntimeMs | DirectRunner | 7568.29 | 7678.0 | 1.45 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_streaming | RuntimeMs | FlinkRunner | 472.43 | 458.91 | -2.86 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_3_zetasql_batch | RuntimeMs | DataflowRunner | 54830.68 | 56090.73 |
2.3 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_zetasql_batch | RuntimeMs | DirectRunner | 3764.71 | 3730.86 | -0.9
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_3_zetasql_streaming | RuntimeMs | DataflowRunner | 42717.59 | 45931.36
| 7.52 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_zetasql_streaming | RuntimeMs | DirectRunner | 8995.43 | 8806.95 |
-2.1 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_zetasql_streaming | RuntimeMs | FlinkRunner | 1207.68 | 1183.59 |
-1.99 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_4_batch | RuntimeMs | DataflowRunner | 35286.75 | 35250.18 | -0.1 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_4_batch | RuntimeMs | DirectRunner | 2420.39 | 2464.32 | 1.81 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_4_batch | RuntimeMs | FlinkRunner | 873.29 | 853.14 | -2.31 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_4_batch | RuntimeMs | SparkRunner | 1028.02 | 1007.11 | -2.03 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_4_batch | RuntimeMs | SparkStructuredStreamingRunner | 2283.2 |
2251.05 | -1.41 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_4_streaming | RuntimeMs | DataflowRunner | 47523.82 | 49781.59 | 4.75
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_4_streaming | RuntimeMs | DirectRunner | 2897.54 | 2836.55 | -2.1 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_4_streaming | RuntimeMs | FlinkRunner | 992.64 | 994.27 | 0.16 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_5_batch | RuntimeMs | DataflowRunner | 38445.79 | 37458.39 | -2.57 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_5_batch | RuntimeMs | DirectRunner | 10752.75 | 10921.18 | 1.57 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_5_batch | RuntimeMs | FlinkRunner | 784.86 | 816.82 | 4.07 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_5_batch | RuntimeMs | SparkRunner | 1559.34 | 1527.18 | -2.06 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_5_batch | RuntimeMs | SparkStructuredStreamingRunner | 1686.84 |
1646.59 | -2.39 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_5_streaming | RuntimeMs | DataflowRunner | 203490.09 | 236892.9 |
16.41 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_5_streaming | RuntimeMs | DirectRunner | 21604.04 | 22533.41 | 4.3 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_5_streaming | RuntimeMs | FlinkRunner | 1459.43 | 1521.32 | 4.24 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_6_batch | RuntimeMs | DataflowRunner | 32182.89 | 31563.95 | -1.92 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_6_batch | RuntimeMs | DirectRunner | 1804.25 | 1814.36 | 0.56 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_6_batch | RuntimeMs | FlinkRunner | 555.57 | 586.0 | 5.48 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_6_batch | RuntimeMs | SparkRunner | 731.2 | 703.82 | -3.74 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_6_batch | RuntimeMs | SparkStructuredStreamingRunner | 907.09 | 900.91
| -0.68 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_6_streaming | RuntimeMs | DataflowRunner | 41271.11 | 40870.32 | -0.97
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_6_streaming | RuntimeMs | DirectRunner | 2116.29 | 2072.91 | -2.05 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_6_streaming | RuntimeMs | FlinkRunner | 734.86 | 607.18 | -17.37 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_7_batch | RuntimeMs | DataflowRunner | 56068.39 | 58640.82 | 4.59 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_7_batch | RuntimeMs | DirectRunner | 18311.18 | 18707.82 | 2.17 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_7_batch | RuntimeMs | FlinkRunner | 654.39 | 699.45 | 6.89 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_7_batch | RuntimeMs | SparkRunner | 1472.29 | 1459.16 | -0.89 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_7_batch | RuntimeMs | SparkStructuredStreamingRunner | 2181.61 |
2169.16 | -0.57 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_7_sql_batch | RuntimeMs | DataflowRunner | 78369.25 | 79109.77 | 0.94
|  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_7_sql_batch | RuntimeMs | DirectRunner | 504902.43 | 371615.77 | -26.4
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_7_sql_batch | RuntimeMs | SparkRunner | 7421.7 | 7287.43 | -1.81 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_7_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 5989.21 |
5792.25 | -3.29 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_sql_streaming | RuntimeMs | DataflowRunner | 1001460.39 | 995802.86
| -0.56 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_7_sql_streaming | RuntimeMs | DirectRunner | 2184798.29 | 1417868.68 |
-35.1 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_sql_streaming | RuntimeMs | FlinkRunner | 3583.68 | 3568.18 | -0.43
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_7_streaming | RuntimeMs | DataflowRunner | 136977.51 | 136784.78 |
-0.14 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_streaming | RuntimeMs | DirectRunner | 836652.82 | 840470.27 | 0.46
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_7_streaming | RuntimeMs | FlinkRunner | 12942.43 | 12986.64 | 0.34 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_8_batch | RuntimeMs | DataflowRunner | 22476.39 | 21884.45 | -2.63 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_8_batch | RuntimeMs | DirectRunner | 2215.57 | 2275.0 | 2.68 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_8_batch | RuntimeMs | FlinkRunner | 472.86 | 479.0 | 1.3 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_8_batch | RuntimeMs | SparkRunner | 1472.07 | 1430.11 | -2.85 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_8_batch | RuntimeMs | SparkStructuredStreamingRunner | 1124.02 |
1106.75 | -1.54 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_8_streaming | RuntimeMs | DataflowRunner | 61574.64 | 60011.5 | -2.54
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_8_streaming | RuntimeMs | DirectRunner | 7049.82 | 6955.14 | -1.34 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_8_streaming | RuntimeMs | FlinkRunner | 505.79 | 470.91 | -6.9 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_9_batch | RuntimeMs | DataflowRunner | 30338.89 | 30699.95 | 1.19 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_9_batch | RuntimeMs | DirectRunner | 1405.93 | 1421.77 | 1.13 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_9_batch | RuntimeMs | FlinkRunner | 303.61 | 347.77 | 14.55 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_9_batch | RuntimeMs | SparkRunner | 570.66 | 550.45 | -3.54 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_9_batch | RuntimeMs | SparkStructuredStreamingRunner | 719.73 | 699.84
| -2.76 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_9_streaming | RuntimeMs | DataflowRunner | 30382.86 | 31219.45 | 2.75
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_9_streaming | RuntimeMs | DirectRunner | 1747.14 | 1757.95 | 0.62 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_9_streaming | RuntimeMs | FlinkRunner | 375.36 | 412.86 | 9.99 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)