You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/08/02 11:56:13 UTC

Beam Metrics Report (2022-08-02)

# Beam Metrics Report

Color legend:  >= 20 | >= 10 | <= -10 | <= -20  
---|---|---|---  
  
## Possible regression

**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**  
---|---|---|---|---|---|---  
java_batch_cogbk_2 | dataflow_v2_java17_runtime_sec | - | 45.38 | 55.59 | 22.5
|  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_3 | dataflow_v2_java17_runtime_sec | - | 11.83 | 13.91 | 17.6
|  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_4 | dataflow_v2_java11_runtime_sec | - | 12.01 | 13.49 |
12.34 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_4 | dataflow_v2_java17_runtime_sec | - | 11.47 | 12.95 |
12.89 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_gbk_2 | dataflow_v2_java11_runtime_sec | - | 39.21 | 43.16 | 10.06
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_3 | dataflow_v2_java17_runtime_sec | - | 12.37 | 16.43 | 32.77
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_4 | dataflow_v2_java11_runtime_sec | - | 19.59 | 24.92 | 27.19
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_4 | dataflow_v2_java17_runtime_sec | - | 19.36 | 23.14 | 19.52
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_5 | dataflow_v2_java11_runtime_sec | - | 18.71 | 20.7 | 10.63 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_6 | dataflow_v2_java11_runtime_sec | - | 24.27 | 28.54 | 17.58
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_6 | dataflow_v2_java17_runtime_sec | - | 25.15 | 30.28 | 20.41
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_pardo_1 | dataflow_v2_java17_runtime_sec | - | 11.97 | 13.44 |
12.31 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_1 | sparkstructuredstreaming_runtime_sec | - | 60.03 | 66.5 |
10.77 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_4 | dataflow_v2_java11_runtime_sec | - | 21.59 | 25.21 |
16.77 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_gbk_2 | dataflow_v2_java11_runtime_sec | - | 2881.08 | 3261.11
| 13.19 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_3 | dataflow_v2_java11_runtime_sec | - | 53.7 | 60.09 |
11.89 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_pardo_1 | dataflow_v2_java11_runtime_sec | - | 25.28 | 27.82 |
10.06 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_2 | dataflow_v2_java17_runtime_sec | - | 104.27 | 119.13
| 14.25 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
kafkaioit_results_runner_v2 | write_time | - | 3.43 | 6.0 | 74.91 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
kafkaioit_results_sdf_wrapper | write_time | - | 3.53 | 5.09 | 44.08 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
python_batch_cogbk_2 | python_dataflow_batch_cogbk_2_runtime | - | 277.57 |
325.2 | 17.16 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_batch_combine_4 | python_dataflow_batch_combine_4_runtime | - | 34.86 |
64.8 | 85.9 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_combine_5 | python_dataflow_batch_combine_5_runtime | - | 28.43 |
68.6 | 141.31 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_gbk_4 | python_dataflow_batch_gbk_4_runtime | - | 112.71 | 127.75
| 13.34 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_5 | python_dataflow_batch_gbk_5_runtime | - | 105.29 | 116.0
| 10.18 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_pardo_3 | python_dataflow_batch_pardo_3_runtime | - | 130.71 |
168.5 | 28.91 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_sideinput_8 | python_dataflow_batch_sideinput_8_runtime | - |
4657.29 | 5616.4 | 20.59 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_streaming_gbk_3 | python_dataflow_streaming_gbk_3_runtime | - | 97.2 |
118.2 | 21.6 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
nexmark_0_sql_batch | RuntimeMs | DataflowRunner | 31472.75 | 36884.45 | 17.19
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_10_batch | RuntimeMs | FlinkRunner | 725.57 | 811.68 | 11.87 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_12_batch | RuntimeMs | DataflowRunner | 17126.19 | 19353.33 | 13.0 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_12_batch | RuntimeMs | FlinkRunner | 161.79 | 206.0 | 27.33 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_batch | RuntimeMs | DataflowRunner | 31219.89 | 34413.77 | 10.23 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_16_batch | RuntimeMs | FlinkRunner | 211.36 | 252.05 | 19.25 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_1_sql_batch | RuntimeMs | DataflowRunner | 28376.5 | 32492.55 | 14.51
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_batch | RuntimeMs | DataflowRunner | 13061.85 | 15587.82 | 19.34 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_2_sql_batch | RuntimeMs | DataflowRunner | 19385.18 | 24644.09 | 27.13
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_batch | RuntimeMs | DataflowRunner | 23162.71 | 26665.18 | 15.12 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_3_sql_batch | RuntimeMs | DataflowRunner | 23539.29 | 29393.05 | 24.87
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_4_batch | RuntimeMs | DataflowRunner | 28152.86 | 33096.77 | 17.56 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_6_batch | RuntimeMs | DataflowRunner | 25096.96 | 31537.68 | 25.66 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_7_batch | RuntimeMs | DataflowRunner | 46808.21 | 54712.82 | 16.89 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_7_sql_batch | RuntimeMs | DirectRunner | 200110.86 | 289618.64 | 44.73
|  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_sql_streaming | RuntimeMs | DirectRunner | 555645.43 | 873884.86 |
57.27 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_8_batch | RuntimeMs | DataflowRunner | 19435.54 | 21736.53 | 11.84 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_9_batch | RuntimeMs | DataflowRunner | 23913.93 | 30053.5 | 25.67 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
  
## Possible improvement

**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**  
---|---|---|---|---|---|---  
hadoopformatioit_results | read_time | - | 6.89 | 6.12 | -11.09 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
java_batch_pardo_3 | dataflow_v2_java17_runtime_sec | - | 11.27 | 9.97 |
-11.51 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_cogbk_1 | dataflow_v2_java17_runtime_sec | - | 2494.53 |
2224.48 | -10.83 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_2 | dataflow_v2_java17_runtime_sec | - | 3220.07 |
2825.25 | -12.26 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_gbk_1 | dataflow_v2_java11_runtime_sec | - | 964.06 | 847.5 |
-12.09 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_4 | dataflow_v2_java17_runtime_sec | - | 725.67 | 575.91 |
-20.64 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_pardo_3 | dataflow_v2_java11_runtime_sec | - | 24.24 | 21.21 |
-12.49 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_3 | dataflow_v2_java17_runtime_sec | - | 22.87 | 19.25 |
-15.84 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
kafkaioit_results_sdf_wrapper | read_time | - | 3.2 | 2.27 | -29.16 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
mongodbioit_results | read_time | - | 34.43 | 30.65 | -11.0 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
python_batch_sideinput_2 | python_dataflow_batch_sideinput_2_runtime | - |
45.29 | 39.67 | -12.41 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
nexmark_9_streaming | RuntimeMs | FlinkRunner | 517.57 | 451.0 | -12.86 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
  
## All metrics

**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**  
---|---|---|---|---|---|---  
avroioit_hdfs_results | read_time | - | 95.89 | 93.85 | -2.12 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
avroioit_hdfs_results | write_time | - | 121.15 | 119.67 | -1.22 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
avroioit_results | read_time | - | 95.91 | 89.88 | -6.29 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
avroioit_results | write_time | - | 119.86 | 115.39 | -3.73 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_batch_avro | avro_write_time | - | 36.58 | 33.45 |
-8.54 |  [[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_batch_avro | read_time | - | 40.72 | 42.24 | 3.75 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_batch_json | read_time | - | 38.23 | 37.9 | -0.85 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_batch_json | write_time | - | 53.64 | 49.47 | -7.79 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
compressed_textioit_hdfs_results | read_time | - | 165.89 | 162.37 | -2.12 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
compressed_textioit_hdfs_results | write_time | - | 216.61 | 210.85 | -2.66 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
compressed_textioit_results | read_time | - | 171.22 | 161.89 | -5.45 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
compressed_textioit_results | write_time | - | 213.84 | 208.49 | -2.5 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
go_batch_cogbk_1 | dataflow_runtime | - | 252.77 | 244.0 | -3.47 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
go_batch_cogbk_2 | dataflow_runtime | - | 144.92 | 145.1 | 0.12 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
go_batch_cogbk_3 | dataflow_runtime | - | 114.69 | 116.1 | 1.23 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
go_batch_cogbk_4 | dataflow_runtime | - | 113.63 | 112.34 | -1.13 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
go_batch_combine_1 | dataflow_runtime | - | 412.22 | 389.84 | -5.43 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
go_batch_combine_4 | dataflow_runtime | - | 73.27 | 76.28 | 4.11 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
go_batch_combine_5 | dataflow_runtime | - | 70.92 | 70.36 | -0.79 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
go_batch_gbk_1 | dataflow_runtime | - | 385.85 | 387.53 | 0.44 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_2 | dataflow_runtime | - | 103.29 | 100.66 | -2.55 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_3 | dataflow_runtime | - | 28.21 | 28.65 | 1.53 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_4 | dataflow_runtime | - | 53.88 | 55.28 | 2.6 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_5 | dataflow_runtime | - | 42.8 | 45.96 | 7.37 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_6 | dataflow_runtime | - | 103.86 | 102.68 | -1.14 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_7 | dataflow_runtime | - | 113.23 | 114.01 | 0.68 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_pardo_1 | dataflow_runtime | - | 77.11 | 77.8 | 0.9 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
go_batch_pardo_2 | dataflow_runtime | - | 399.97 | 365.93 | -8.51 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
go_batch_pardo_3 | dataflow_runtime | - | 64.71 | 65.99 | 1.98 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
go_batch_pardo_4 | dataflow_runtime | - | 68.45 | 73.16 | 6.89 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
go_batch_sideinput_3 | dataflow_runtime | - | 2.38 | 2.24 | -5.81 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
go_batch_sideinput_4 | dataflow_runtime | - | 203.54 | 197.1 | -3.17 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
hadoopformatioit_results | read_time | - | 6.89 | 6.12 | -11.09 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
hadoopformatioit_results | write_time | - | 8.12 | 8.32 | 2.38 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
java_batch_cogbk_1 | dataflow_runtime_sec | - | 44.41 | 40.83 | -8.08 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_1 | dataflow_v2_java11_runtime_sec | - | 45.6 | 46.92 | 2.89
|  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_1 | dataflow_v2_java17_runtime_sec | - | 47.48 | 43.97 |
-7.39 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_1 | sparkstructuredstreaming_runtime_sec | - | 122.93 |
128.76 | 4.75 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_2 | dataflow_runtime_sec | - | 41.4 | 40.29 | -2.69 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_2 | dataflow_v2_java11_runtime_sec | - | 45.68 | 44.02 |
-3.64 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_2 | dataflow_v2_java17_runtime_sec | - | 45.38 | 55.59 | 22.5
|  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_2 | sparkstructuredstreaming_runtime_sec | - | 120.43 |
121.59 | 0.96 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_3 | dataflow_runtime_sec | - | 14.4 | 14.08 | -2.19 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_3 | dataflow_v2_java11_runtime_sec | - | 12.34 | 13.56 | 9.91
|  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_3 | dataflow_v2_java17_runtime_sec | - | 11.83 | 13.91 | 17.6
|  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_3 | sparkstructuredstreaming_runtime_sec | - | 19.73 | 20.56
| 4.25 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_4 | dataflow_runtime_sec | - | 13.08 | 14.11 | 7.87 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_4 | dataflow_v2_java11_runtime_sec | - | 12.01 | 13.49 |
12.34 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_4 | dataflow_v2_java17_runtime_sec | - | 11.47 | 12.95 |
12.89 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_4 | sparkstructuredstreaming_runtime_sec | - | 21.58 | 21.24
| -1.56 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_combine_1 | dataflow_runtime_sec | - | 65.42 | 66.19 | 1.17 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_1 | sparkstructuredstreaming_runtime_sec | - | 555.59 |
531.82 | -4.28 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_4 | dataflow_runtime_sec | - | 27.18 | 25.63 | -5.71 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_4 | sparkstructuredstreaming_runtime_sec | - | 130.32 |
131.5 | 0.91 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_5 | dataflow_runtime_sec | - | 25.42 | 26.5 | 4.27 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_5 | sparkstructuredstreaming_runtime_sec | - | 127.72 |
123.73 | -3.12 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_gbk_1 | dataflow_runtime_sec | - | 125.71 | 125.44 | -0.22 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_1 | dataflow_v2_java11_runtime_sec | - | 90.97 | 91.7 | 0.8 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_1 | dataflow_v2_java17_runtime_sec | - | 89.95 | 90.2 | 0.28 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_1 | sparkstructuredstreaming_runtime_sec | - | 499.01 | 493.28
| -1.15 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_2 | dataflow_runtime_sec | - | 33.93 | 32.53 | -4.12 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_2 | dataflow_v2_java11_runtime_sec | - | 39.21 | 43.16 | 10.06
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_2 | dataflow_v2_java17_runtime_sec | - | 39.38 | 42.07 | 6.84 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_2 | sparkstructuredstreaming_runtime_sec | - | 100.33 | 98.51 |
-1.82 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_3 | dataflow_runtime_sec | - | 11.53 | 11.65 | 1.0 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_3 | dataflow_v2_java11_runtime_sec | - | 15.09 | 14.12 | -6.41
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_3 | dataflow_v2_java17_runtime_sec | - | 12.37 | 16.43 | 32.77
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_3 | sparkstructuredstreaming_runtime_sec | - | 8.0 | 8.0 | 0.02
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_4 | dataflow_runtime_sec | - | 18.14 | 17.37 | -4.25 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_4 | dataflow_v2_java11_runtime_sec | - | 19.59 | 24.92 | 27.19
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_4 | dataflow_v2_java17_runtime_sec | - | 19.36 | 23.14 | 19.52
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_4 | sparkstructuredstreaming_runtime_sec | - | 99.32 | 99.45 |
0.14 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_5 | dataflow_runtime_sec | - | 17.3 | 18.92 | 9.34 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_5 | dataflow_v2_java11_runtime_sec | - | 18.71 | 20.7 | 10.63 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_5 | dataflow_v2_java17_runtime_sec | - | 18.98 | 19.59 | 3.2 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_5 | sparkstructuredstreaming_runtime_sec | - | 99.89 | 97.39 |
-2.5 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_6 | dataflow_runtime_sec | - | 33.76 | 34.19 | 1.26 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_6 | dataflow_v2_java11_runtime_sec | - | 24.27 | 28.54 | 17.58
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_6 | dataflow_v2_java17_runtime_sec | - | 25.15 | 30.28 | 20.41
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_6 | sparkstructuredstreaming_runtime_sec | - | 59.85 | 58.38 |
-2.46 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_7 | dataflow_runtime_sec | - | 45.29 | 45.75 | 1.01 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_7 | dataflow_v2_java11_runtime_sec | - | 34.61 | 37.14 | 7.3 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_7 | dataflow_v2_java17_runtime_sec | - | 38.43 | 39.5 | 2.8 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_7 | sparkstructuredstreaming_runtime_sec | - | 85.29 | 84.34 |
-1.12 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_pardo_1 | dataflow_runtime_sec | - | 18.77 | 17.67 | -5.89 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_1 | dataflow_v2_java11_runtime_sec | - | 13.27 | 13.97 | 5.34
|  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_1 | dataflow_v2_java17_runtime_sec | - | 11.97 | 13.44 |
12.31 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_1 | sparkstructuredstreaming_runtime_sec | - | 60.03 | 66.5 |
10.77 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_2 | dataflow_runtime_sec | - | 203.5 | 191.63 | -5.83 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_2 | dataflow_v2_java11_runtime_sec | - | 61.82 | 58.32 |
-5.67 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_2 | dataflow_v2_java17_runtime_sec | - | 59.12 | 64.05 | 8.35
|  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_3 | dataflow_runtime_sec | - | 11.95 | 13.11 | 9.68 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_3 | dataflow_v2_java11_runtime_sec | - | 11.4 | 11.4 | 0.05 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_3 | dataflow_v2_java17_runtime_sec | - | 11.27 | 9.97 |
-11.51 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_4 | dataflow_runtime_sec | - | 23.98 | 23.29 | -2.89 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_4 | dataflow_v2_java11_runtime_sec | - | 21.59 | 25.21 |
16.77 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_4 | dataflow_v2_java17_runtime_sec | - | 21.34 | 21.73 | 1.82
|  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_cogbk_1 | dataflow_runtime_sec | - | 849.54 | 875.67 | 3.08 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_1 | dataflow_v2_java11_runtime_sec | - | 3260.36 |
3142.09 | -3.63 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_1 | dataflow_v2_java17_runtime_sec | - | 2494.53 |
2224.48 | -10.83 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_2 | dataflow_runtime_sec | - | 817.92 | 846.75 | 3.52 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_2 | dataflow_v2_java11_runtime_sec | - | 3145.38 |
2888.88 | -8.15 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_2 | dataflow_v2_java17_runtime_sec | - | 3220.07 |
2825.25 | -12.26 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_3 | dataflow_runtime_sec | - | 114.72 | 115.17 | 0.39 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_3 | dataflow_v2_java11_runtime_sec | - | 358.01 | 343.23
| -4.13 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_3 | dataflow_v2_java17_runtime_sec | - | 393.55 | 354.96
| -9.81 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_4 | dataflow_runtime_sec | - | 113.41 | 114.96 | 1.37 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_4 | dataflow_v2_java11_runtime_sec | - | 331.56 | 318.15
| -4.05 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_4 | dataflow_v2_java17_runtime_sec | - | 335.02 | 329.37
| -1.69 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_combine_1 | dataflow_runtime_sec | - | 488.67 | 464.04 | -5.04
|  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_streaming_combine_4 | dataflow_runtime_sec | - | 303.13 | 312.24 | 3.0 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_streaming_combine_5 | dataflow_runtime_sec | - | 304.56 | 313.63 | 2.98 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_streaming_gbk_1 | dataflow_runtime_sec | - | 668.58 | 622.3 | -6.92 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_1 | dataflow_v2_java11_runtime_sec | - | 964.06 | 847.5 |
-12.09 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_1 | dataflow_v2_java17_runtime_sec | - | 965.54 | 997.56 |
3.32 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_2 | dataflow_runtime_sec | - | 747.86 | 802.91 | 7.36 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_2 | dataflow_v2_java11_runtime_sec | - | 2881.08 | 3261.11
| 13.19 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_2 | dataflow_v2_java17_runtime_sec | - | 3303.0 | 3541.39 |
7.22 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_3 | dataflow_runtime_sec | - | 24.18 | 23.05 | -4.7 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_3 | dataflow_v2_java11_runtime_sec | - | 53.7 | 60.09 |
11.89 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_3 | dataflow_v2_java17_runtime_sec | - | 57.13 | 56.72 |
-0.72 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_4 | dataflow_runtime_sec | - | 287.34 | 274.47 | -4.48 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_4 | dataflow_v2_java11_runtime_sec | - | 626.95 | 641.36 |
2.3 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_4 | dataflow_v2_java17_runtime_sec | - | 725.67 | 575.91 |
-20.64 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_5 | dataflow_runtime_sec | - | 277.44 | 294.61 | 6.19 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_5 | dataflow_v2_java11_runtime_sec | - | 572.98 | 548.09 |
-4.34 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_5 | dataflow_v2_java17_runtime_sec | - | 609.74 | 607.31 |
-0.4 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_6 | dataflow_runtime_sec | - | 74.08 | 69.25 | -6.53 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_6 | dataflow_v2_java11_runtime_sec | - | 156.16 | 154.13 |
-1.3 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_6 | dataflow_v2_java17_runtime_sec | - | 153.29 | 142.94 |
-6.75 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_7 | dataflow_runtime_sec | - | 133.01 | 139.25 | 4.69 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_7 | dataflow_v2_java11_runtime_sec | - | 210.24 | 190.58 |
-9.35 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_7 | dataflow_v2_java17_runtime_sec | - | 213.59 | 203.39 |
-4.77 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_pardo_1 | dataflow_runtime_sec | - | 18.58 | 19.37 | 4.28 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_1 | dataflow_v2_java11_runtime_sec | - | 25.28 | 27.82 |
10.06 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_1 | dataflow_v2_java17_runtime_sec | - | 24.32 | 24.08 |
-0.97 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_2 | dataflow_runtime_sec | - | 210.35 | 213.48 | 1.49 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_2 | dataflow_v2_java11_runtime_sec | - | 111.21 | 107.43
| -3.4 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_2 | dataflow_v2_java17_runtime_sec | - | 104.27 | 119.13
| 14.25 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_3 | dataflow_runtime_sec | - | 12.09 | 12.23 | 1.15 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_3 | dataflow_v2_java11_runtime_sec | - | 24.24 | 21.21 |
-12.49 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_3 | dataflow_v2_java17_runtime_sec | - | 22.87 | 19.25 |
-15.84 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_4 | dataflow_runtime_sec | - | 30.99 | 30.77 | -0.71 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_4 | dataflow_v2_java11_runtime_sec | - | 37.98 | 36.82 |
-3.07 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_4 | dataflow_v2_java17_runtime_sec | - | 39.46 | 38.93 |
-1.34 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
jdbcioit_results | read_time | - | 24.86 | 25.04 | 0.72 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
jdbcioit_results | write_time | - | 37.27 | 37.86 | 1.58 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
kafkaioit_results | read_time | - | 0.0 | 0.0 | 0.0 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
kafkaioit_results | write_time | - | 13.8 | 14.37 | 4.15 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
kafkaioit_results_runner_v2 | read_time | - | 2.35 | 2.37 | 0.86 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
kafkaioit_results_runner_v2 | write_time | - | 3.43 | 6.0 | 74.91 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
kafkaioit_results_sdf_wrapper | read_time | - | 3.2 | 2.27 | -29.16 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
kafkaioit_results_sdf_wrapper | write_time | - | 3.53 | 5.09 | 44.08 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
many_files_textioit_hdfs_results | read_time | - | 17.41 | 16.94 | -2.72 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
many_files_textioit_hdfs_results | write_time | - | 57.62 | 58.67 | 1.82 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
many_files_textioit_results | read_time | - | 22.87 | 24.87 | 8.71 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
many_files_textioit_results | write_time | - | 57.58 | 59.05 | 2.55 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
mongodbioit_results | read_time | - | 34.43 | 30.65 | -11.0 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
mongodbioit_results | write_time | - | 58.74 | 58.87 | 0.21 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
parquetioit_hdfs_results | read_time | - | 92.81 | 83.64 | -9.88 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
parquetioit_hdfs_results | write_time | - | 143.31 | 150.83 | 5.25 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
parquetioit_results | read_time | - | 91.53 | 91.54 | 0.01 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
parquetioit_results | write_time | - | 146.37 | 142.2 | -2.85 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
python_batch_cogbk_1 | python_dataflow_batch_cogbk_1_runtime | - | 477.86 |
487.8 | 2.08 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_batch_cogbk_2 | python_dataflow_batch_cogbk_2_runtime | - | 277.57 |
325.2 | 17.16 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_batch_cogbk_3 | python_dataflow_batch_cogbk_3_runtime | - | 255.29 |
259.6 | 1.69 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_batch_cogbk_4 | python_dataflow_batch_cogbk_4_runtime | - | 255.71 |
276.6 | 8.17 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_batch_combine_1 | python_dataflow_batch_combine_1_runtime | - | 903.57
| 924.4 | 2.31 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_combine_4 | python_dataflow_batch_combine_4_runtime | - | 34.86 |
64.8 | 85.9 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_combine_5 | python_dataflow_batch_combine_5_runtime | - | 28.43 |
68.6 | 141.31 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_gbk_1 | python_dataflow_batch_gbk_1_runtime | - | 1872.43 |
1885.2 | 0.68 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_2 | python_dataflow_batch_gbk_2_runtime | - | 357.57 | 376.0
| 5.15 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_3 | python_dataflow_batch_gbk_3_runtime | - | 23.43 | 24.8 |
5.85 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_4 | python_dataflow_batch_gbk_4_runtime | - | 112.71 | 127.75
| 13.34 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_5 | python_dataflow_batch_gbk_5_runtime | - | 105.29 | 116.0
| 10.18 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_6 | python_dataflow_batch_gbk_6_runtime | - | 345.57 | 352.8
| 2.09 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_7 | python_dataflow_batch_gbk_7_runtime | - | 332.43 | 349.8
| 5.23 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_pardo_1 | python_dataflow_batch_pardo_1_runtime | - | 158.71 |
171.75 | 8.21 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_2 | python_dataflow_batch_pardo_2_runtime | - | 1599.86 |
1622.5 | 1.42 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_3 | python_dataflow_batch_pardo_3_runtime | - | 130.71 |
168.5 | 28.91 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_4 | python_dataflow_batch_pardo_4_runtime | - | 317.43 |
326.0 | 2.7 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_sideinput_1 | python_dataflow_batch_sideinput_1_runtime | - |
47.0 | 48.67 | 3.55 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_2 | python_dataflow_batch_sideinput_2_runtime | - |
45.29 | 39.67 | -12.41 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_3 | python_dataflow_batch_sideinput_3_runtime | - | 6.0
| 5.8 | -3.33 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_4 | python_dataflow_batch_sideinput_4_runtime | - |
462.86 | 472.4 | 2.06 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_5 | python_dataflow_batch_sideinput_5_runtime | - |
47.14 | 45.8 | -2.85 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_6 | python_dataflow_batch_sideinput_6_runtime | - |
46.43 | 46.6 | 0.37 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_7 | python_dataflow_batch_sideinput_7_runtime | - |
5183.57 | 5591.2 | 7.86 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_8 | python_dataflow_batch_sideinput_8_runtime | - |
4657.29 | 5616.4 | 20.59 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_bqio_read_10GB_results | bqio_read_10GB_results_runtime | - | 111.29 |
118.2 | 6.21 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_bqio_write_10GB_results | bqio_write_10GB_results_runtime | - | 247.57
| 242.4 | -2.09 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_direct_microbenchmarks | fn_api_runner_microbenchmark_runtime_sec | - |
92.57 | 93.25 | 0.74 |  
python_direct_microbenchmarks | teststream_microbenchmark_runtime_sec | - |
332.55 | 335.05 | 0.75 |  
python_spanner_write_2GB_results | pyspanner_write_2GB_results_runtime | - |
1623.71 | 1605.0 | -1.15 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_spannerio_read_2GB_results | pyspanner_read_2GB_results_runtime | - |
26.0 | 24.2 | -6.92 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_streaming_cogbk_1 | python_dataflow_streaming_cogbk_1_runtime | - |
661.29 | 658.4 | -0.44 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_streaming_cogbk_2 | python_dataflow_streaming_cogbk_2_runtime | - |
423.71 | 405.0 | -4.42 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_streaming_cogbk_3 | python_dataflow_streaming_cogbk_3_runtime | - |
463.86 | 486.2 | 4.82 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_streaming_cogbk_4 | python_dataflow_streaming_cogbk_4_runtime | - |
417.0 | 405.0 | -2.88 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_streaming_gbk_3 | python_dataflow_streaming_gbk_3_runtime | - | 97.2 |
118.2 | 21.6 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_streaming_gbk_6 | python_dataflow_streaming_gbk_6_runtime | - | 546.0 |
545.25 | -0.14 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_streaming_gbk_7 | python_dataflow_streaming_gbk_7_runtime | - | 541.2 |
563.0 | 4.03 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_streaming_pardo_1 | python_dataflow_streaming_pardo_1_runtime | - |
229.83 | 229.8 | -0.01 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_2 | python_dataflow_streaming_pardo_2_runtime | - |
2940.0 | 3065.25 | 4.26 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_3 | python_dataflow_streaming_pardo_3_runtime | - |
179.67 | 173.5 | -3.43 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_4 | python_dataflow_streaming_pardo_4_runtime | - |
485.5 | 498.0 | 2.57 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
textioit_hdfs_results | read_time | - | 20.3 | 18.38 | -9.47 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
textioit_hdfs_results | write_time | - | 31.35 | 32.01 | 2.13 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
textioit_results | read_time | - | 21.38 | 19.49 | -8.8 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
textioit_results | write_time | - | 30.82 | 30.58 | -0.8 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
tfrecordioit_results | read_time | - | 15.76 | 15.37 | -2.47 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
tfrecordioit_results | write_time | - | 20.42 | 21.07 | 3.22 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
wordcount_py37_results | runtime | - | 825.69 | 826.72 | 0.13 |
[[1]](http://metrics.beam.apache.org/d/1cnwVDkGk)  
xmlioit_hdfs_results | read_time | - | 21.91 | 20.97 | -4.29 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
xmlioit_hdfs_results | write_time | - | 23.41 | 25.25 | 7.87 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
xmlioit_results | read_time | - | 23.68 | 23.83 | 0.62 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
xmlioit_results | write_time | - | 23.65 | 25.99 | 9.93 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
nexmark_0_batch | RuntimeMs | DataflowRunner | 25507.82 | 27278.62 | 6.94 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_batch | RuntimeMs | DirectRunner | 4617.21 | 4661.91 | 0.97 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_0_batch | RuntimeMs | FlinkRunner | 1075.75 | 1099.91 | 2.25 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_0_batch | RuntimeMs | SparkRunner | 1212.86 | 1282.36 | 5.73 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_0_batch | RuntimeMs | SparkStructuredStreamingRunner | 1536.62 |
1571.66 | 2.28 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_sql_batch | RuntimeMs | DataflowRunner | 31472.75 | 36884.45 | 17.19
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_0_sql_batch | RuntimeMs | DirectRunner | 5601.89 | 5555.18 | -0.83 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_0_sql_batch | RuntimeMs | SparkRunner | 3122.82 | 3159.7 | 1.18 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_0_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 2718.0 |
2862.59 | 5.32 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_0_sql_streaming | RuntimeMs | DataflowRunner | 22807.11 | 23327.23 |
2.28 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_sql_streaming | RuntimeMs | DirectRunner | 15394.0 | 15535.41 | 0.92
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_sql_streaming | RuntimeMs | FlinkRunner | 1636.36 | 1670.41 | 2.08 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_streaming | RuntimeMs | DataflowRunner | 39007.68 | 38814.19 | -0.5
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_streaming | RuntimeMs | DirectRunner | 11714.11 | 11720.73 | 0.06 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_streaming | RuntimeMs | FlinkRunner | 1393.36 | 1408.55 | 1.09 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_zetasql_batch | RuntimeMs | DataflowRunner | 115760.89 | 115279.82 |
-0.42 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_zetasql_batch | RuntimeMs | DirectRunner | 6741.96 | 6887.91 | 2.16
|  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_0_zetasql_streaming | RuntimeMs | DataflowRunner | 65865.44 | 66986.64
| 1.7 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_zetasql_streaming | RuntimeMs | DirectRunner | 17011.43 | 17329.27 |
1.87 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_zetasql_streaming | RuntimeMs | FlinkRunner | 3231.0 | 3327.77 | 3.0
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_10_batch | RuntimeMs | DataflowRunner | 45166.51 | 47703.91 | 5.62 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_10_batch | RuntimeMs | DirectRunner | 10417.75 | 10468.5 | 0.49 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_10_batch | RuntimeMs | FlinkRunner | 725.57 | 811.68 | 11.87 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_10_batch | RuntimeMs | SparkRunner | 734.02 | 758.45 | 3.33 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_10_batch | RuntimeMs | SparkStructuredStreamingRunner | 1142.61 |
1180.16 | 3.29 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_10_streaming | RuntimeMs | DataflowRunner | 100322.03 | 95981.18 |
-4.33 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_10_streaming | RuntimeMs | DirectRunner | 44045.07 | 43497.86 | -1.24
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_10_streaming | RuntimeMs | FlinkRunner | 1448.79 | 1490.32 | 2.87 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_11_batch | RuntimeMs | DataflowRunner | 36735.4 | 39188.62 | 6.68 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_11_batch | RuntimeMs | DirectRunner | 3755.61 | 3797.18 | 1.11 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_11_batch | RuntimeMs | FlinkRunner | 331.89 | 302.86 | -8.75 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_11_batch | RuntimeMs | SparkRunner | 1357.73 | 1390.59 | 2.42 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_11_batch | RuntimeMs | SparkStructuredStreamingRunner | 1058.02 |
1079.25 | 2.01 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_11_streaming | RuntimeMs | DataflowRunner | 178562.19 | 184162.66 |
3.14 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_11_streaming | RuntimeMs | DirectRunner | 10623.64 | 10616.91 | -0.06
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_11_streaming | RuntimeMs | FlinkRunner | 1304.43 | 1304.95 | 0.04 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_12_batch | RuntimeMs | DataflowRunner | 17126.19 | 19353.33 | 13.0 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_12_batch | RuntimeMs | DirectRunner | 2559.25 | 2673.55 | 4.47 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_12_batch | RuntimeMs | FlinkRunner | 161.79 | 206.0 | 27.33 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_12_batch | RuntimeMs | SparkRunner | 919.66 | 944.36 | 2.69 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_12_batch | RuntimeMs | SparkStructuredStreamingRunner | 885.73 |
862.91 | -2.58 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_12_streaming | RuntimeMs | DataflowRunner | 95069.95 | 91129.61 |
-4.14 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_12_streaming | RuntimeMs | DirectRunner | 9349.68 | 9265.18 | -0.9 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_12_streaming | RuntimeMs | FlinkRunner | 621.54 | 629.73 | 1.32 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_batch | RuntimeMs | DataflowRunner | 31219.89 | 34413.77 | 10.23 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_batch | RuntimeMs | DirectRunner | 3134.14 | 3220.36 | 2.75 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_13_batch | RuntimeMs | FlinkRunner | 436.96 | 408.32 | -6.56 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_batch | RuntimeMs | SparkRunner | 345.86 | 360.66 | 4.28 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_batch | RuntimeMs | SparkStructuredStreamingRunner | 534.54 |
541.93 | 1.38 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_13_sql_batch | RuntimeMs | DataflowRunner | 56402.75 | 61358.14 | 8.79
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_13_sql_batch | RuntimeMs | DirectRunner | 8972.5 | 9134.32 | 1.8 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_sql_batch | RuntimeMs | SparkRunner | 3397.88 | 3434.18 | 1.07 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_13_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 2964.57 |
3102.52 | 4.65 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_13_sql_streaming | RuntimeMs | DataflowRunner | 35078.79 | 36428.77 |
3.85 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_sql_streaming | RuntimeMs | DirectRunner | 18992.68 | 19253.27 |
1.37 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_sql_streaming | RuntimeMs | FlinkRunner | 29256.93 | 27087.05 |
-7.42 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_streaming | RuntimeMs | DataflowRunner | 25160.11 | 24633.77 |
-2.09 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_streaming | RuntimeMs | DirectRunner | 9904.07 | 9873.55 | -0.31 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_streaming | RuntimeMs | FlinkRunner | 25901.61 | 27321.05 | 5.48 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_zetasql_batch | RuntimeMs | DataflowRunner | 256142.21 | 261132.45
| 1.95 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_zetasql_batch | RuntimeMs | DirectRunner | 10155.39 | 10216.55 |
0.6 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_zetasql_streaming | RuntimeMs | DataflowRunner | 108515.85 |
107458.14 | -0.97 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_zetasql_streaming | RuntimeMs | DirectRunner | 21055.0 | 21201.86 |
0.7 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_zetasql_streaming | RuntimeMs | FlinkRunner | 33407.86 | 33667.68 |
0.78 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_14_batch | RuntimeMs | DataflowRunner | 59379.29 | 62817.77 | 5.79 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_14_batch | RuntimeMs | DirectRunner | 4021.32 | 4081.5 | 1.5 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_14_batch | RuntimeMs | FlinkRunner | 630.04 | 625.27 | -0.76 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_14_batch | RuntimeMs | SparkRunner | 972.41 | 953.39 | -1.96 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_14_batch | RuntimeMs | SparkStructuredStreamingRunner | 986.55 | 984.5
| -0.21 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_14_streaming | RuntimeMs | DataflowRunner | 120311.82 | 119846.05 |
-0.39 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_14_streaming | RuntimeMs | DirectRunner | 12243.82 | 12136.77 | -0.87
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_14_streaming | RuntimeMs | FlinkRunner | 1769.61 | 1776.09 | 0.37 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_15_batch | RuntimeMs | DataflowRunner | 43373.86 | 45810.13 | 5.62 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_15_batch | RuntimeMs | DirectRunner | 15151.43 | 15295.14 | 0.95 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_15_batch | RuntimeMs | FlinkRunner | 617.25 | 629.36 | 1.96 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_15_batch | RuntimeMs | SparkRunner | 1637.18 | 1662.11 | 1.52 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_15_batch | RuntimeMs | SparkStructuredStreamingRunner | 1430.02 |
1524.05 | 6.58 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_16_batch | RuntimeMs | DataflowRunner | 49850.41 | 51408.16 | 3.12 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_16_batch | RuntimeMs | DirectRunner | 84867.61 | 86249.77 | 1.63 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_16_batch | RuntimeMs | FlinkRunner | 211.36 | 252.05 | 19.25 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_16_batch | RuntimeMs | SparkRunner | 1368.5 | 1484.68 | 8.49 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_16_batch | RuntimeMs | SparkStructuredStreamingRunner | 1266.36 |
1282.3 | 1.26 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_16_streaming | RuntimeMs | DataflowRunner | 92862.29 | 91672.61 |
-1.28 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_16_streaming | RuntimeMs | DirectRunner | 115153.96 | 126652.55 | 9.99
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_16_streaming | RuntimeMs | FlinkRunner | 414.25 | 428.05 | 3.33 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_1_batch | RuntimeMs | DataflowRunner | 19771.5 | 21560.4 | 9.05 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_1_batch | RuntimeMs | DirectRunner | 3658.25 | 3625.55 | -0.89 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_1_batch | RuntimeMs | FlinkRunner | 322.79 | 320.18 | -0.81 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_batch | RuntimeMs | SparkRunner | 436.18 | 444.66 | 1.94 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_1_batch | RuntimeMs | SparkStructuredStreamingRunner | 587.73 | 591.98
| 0.72 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_1_sql_batch | RuntimeMs | DataflowRunner | 28376.5 | 32492.55 | 14.51
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_1_sql_batch | RuntimeMs | DirectRunner | 3588.75 | 3546.59 | -1.17 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_sql_batch | RuntimeMs | SparkRunner | 2370.2 | 2405.18 | 1.48 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_1_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1637.89 |
1681.91 | 2.69 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_1_sql_streaming | RuntimeMs | DataflowRunner | 20597.96 | 21275.64 |
3.29 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_1_sql_streaming | RuntimeMs | DirectRunner | 11467.14 | 11474.82 |
0.07 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_sql_streaming | RuntimeMs | FlinkRunner | 654.54 | 677.41 | 3.49 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_streaming | RuntimeMs | DataflowRunner | 29106.97 | 29374.34 | 0.92
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_streaming | RuntimeMs | DirectRunner | 8100.71 | 8124.05 | 0.29 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_1_streaming | RuntimeMs | FlinkRunner | 619.68 | 638.32 | 3.01 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_batch | RuntimeMs | DataflowRunner | 13061.85 | 15587.82 | 19.34 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_2_batch | RuntimeMs | DirectRunner | 1328.5 | 1313.59 | -1.12 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_2_batch | RuntimeMs | FlinkRunner | 212.29 | 226.14 | 6.52 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_batch | RuntimeMs | SparkRunner | 303.12 | 316.61 | 4.45 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_batch | RuntimeMs | SparkStructuredStreamingRunner | 451.16 | 455.8
| 1.03 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_sql_batch | RuntimeMs | DataflowRunner | 19385.18 | 24644.09 | 27.13
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_sql_batch | RuntimeMs | DirectRunner | 1538.07 | 1514.5 | -1.53 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_2_sql_batch | RuntimeMs | SparkRunner | 724.36 | 733.91 | 1.32 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 983.96 |
955.23 | -2.92 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_sql_streaming | RuntimeMs | DataflowRunner | 13570.32 | 12518.91 |
-7.75 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_2_sql_streaming | RuntimeMs | DirectRunner | 6736.07 | 6787.45 | 0.76
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_sql_streaming | RuntimeMs | FlinkRunner | 397.5 | 397.23 | -0.07 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_streaming | RuntimeMs | DataflowRunner | 19451.08 | 18757.95 | -3.56
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_2_streaming | RuntimeMs | DirectRunner | 5098.25 | 5112.82 | 0.29 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_streaming | RuntimeMs | FlinkRunner | 271.57 | 261.64 | -3.66 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_zetasql_batch | RuntimeMs | DataflowRunner | 70490.75 | 73179.27 |
3.81 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_2_zetasql_batch | RuntimeMs | DirectRunner | 2774.82 | 2802.32 | 0.99
|  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_zetasql_streaming | RuntimeMs | DataflowRunner | 39583.48 | 40647.82
| 2.69 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_zetasql_streaming | RuntimeMs | DirectRunner | 8164.93 | 8352.23 |
2.29 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_2_zetasql_streaming | RuntimeMs | FlinkRunner | 1199.43 | 1170.59 |
-2.4 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_3_batch | RuntimeMs | DataflowRunner | 23162.71 | 26665.18 | 15.12 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_3_batch | RuntimeMs | DirectRunner | 3133.43 | 3184.27 | 1.62 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_3_batch | RuntimeMs | FlinkRunner | 1077.82 | 1094.41 | 1.54 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_3_batch | RuntimeMs | SparkRunner | 2071.14 | 2114.64 | 2.1 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_3_sql_batch | RuntimeMs | DataflowRunner | 23539.29 | 29393.05 | 24.87
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_3_sql_batch | RuntimeMs | DirectRunner | 3227.07 | 3225.73 | -0.04 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_sql_batch | RuntimeMs | SparkRunner | 3439.79 | 3496.98 | 1.66 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_3_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 2884.09 |
2912.66 | 0.99 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_3_sql_streaming | RuntimeMs | DataflowRunner | 31025.29 | 32179.95 |
3.72 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_sql_streaming | RuntimeMs | DirectRunner | 8375.71 | 8511.36 | 1.62
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_3_sql_streaming | RuntimeMs | FlinkRunner | 946.11 | 962.36 | 1.72 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_streaming | RuntimeMs | DataflowRunner | 44489.02 | 43556.14 | -2.1
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_streaming | RuntimeMs | DirectRunner | 7676.18 | 7735.18 | 0.77 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_3_streaming | RuntimeMs | FlinkRunner | 419.61 | 425.14 | 1.32 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_zetasql_batch | RuntimeMs | DataflowRunner | 56345.86 | 56093.82 |
-0.45 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_zetasql_batch | RuntimeMs | DirectRunner | 3652.18 | 3647.86 | -0.12
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_zetasql_streaming | RuntimeMs | DataflowRunner | 43670.81 | 45284.05
| 3.69 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_zetasql_streaming | RuntimeMs | DirectRunner | 8821.71 | 8996.09 |
1.98 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_3_zetasql_streaming | RuntimeMs | FlinkRunner | 1208.86 | 1185.86 |
-1.9 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_4_batch | RuntimeMs | DataflowRunner | 28152.86 | 33096.77 | 17.56 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_4_batch | RuntimeMs | DirectRunner | 2614.5 | 2601.41 | -0.5 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_4_batch | RuntimeMs | FlinkRunner | 820.61 | 864.05 | 5.29 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_4_batch | RuntimeMs | SparkRunner | 996.73 | 1014.27 | 1.76 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_4_batch | RuntimeMs | SparkStructuredStreamingRunner | 2140.05 |
2166.16 | 1.22 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_4_streaming | RuntimeMs | DataflowRunner | 51007.79 | 50952.45 | -0.11
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_4_streaming | RuntimeMs | DirectRunner | 2834.21 | 2837.41 | 0.11 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_4_streaming | RuntimeMs | FlinkRunner | 1123.07 | 1111.95 | -0.99 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_5_batch | RuntimeMs | DataflowRunner | 32324.5 | 35004.39 | 8.29 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_5_batch | RuntimeMs | DirectRunner | 10308.18 | 10600.73 | 2.84 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_5_batch | RuntimeMs | FlinkRunner | 770.82 | 761.55 | -1.2 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_5_batch | RuntimeMs | SparkRunner | 1508.43 | 1520.93 | 0.83 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_5_batch | RuntimeMs | SparkStructuredStreamingRunner | 1711.75 |
1703.02 | -0.51 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_5_streaming | RuntimeMs | DataflowRunner | 200411.95 | 200754.2 | 0.17
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_5_streaming | RuntimeMs | DirectRunner | 20237.21 | 21052.27 | 4.03 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_5_streaming | RuntimeMs | FlinkRunner | 1666.75 | 1639.59 | -1.63 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_6_batch | RuntimeMs | DataflowRunner | 25096.96 | 31537.68 | 25.66 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_6_batch | RuntimeMs | DirectRunner | 1960.5 | 2020.86 | 3.08 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_6_batch | RuntimeMs | FlinkRunner | 548.75 | 578.86 | 5.49 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_6_batch | RuntimeMs | SparkRunner | 688.27 | 701.48 | 1.92 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_6_batch | RuntimeMs | SparkStructuredStreamingRunner | 978.38 | 987.32
| 0.91 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_6_streaming | RuntimeMs | DataflowRunner | 36738.57 | 39552.09 | 7.66
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_6_streaming | RuntimeMs | DirectRunner | 2099.04 | 2153.68 | 2.6 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_6_streaming | RuntimeMs | FlinkRunner | 587.68 | 635.32 | 8.11 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_batch | RuntimeMs | DataflowRunner | 46808.21 | 54712.82 | 16.89 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_7_batch | RuntimeMs | DirectRunner | 18558.5 | 18639.82 | 0.44 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_7_batch | RuntimeMs | FlinkRunner | 639.75 | 687.95 | 7.53 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_7_batch | RuntimeMs | SparkRunner | 1406.34 | 1423.25 | 1.2 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_batch | RuntimeMs | SparkStructuredStreamingRunner | 2237.29 |
2296.27 | 2.64 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_7_sql_batch | RuntimeMs | DataflowRunner | 73777.79 | 79411.45 | 7.64
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_7_sql_batch | RuntimeMs | DirectRunner | 200110.86 | 289618.64 | 44.73
|  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_sql_batch | RuntimeMs | SparkRunner | 7003.25 | 7076.41 | 1.04 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_7_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 5828.61 |
5945.68 | 2.01 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_7_sql_streaming | RuntimeMs | DataflowRunner | 965225.71 | 987999.09 |
2.36 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_7_sql_streaming | RuntimeMs | DirectRunner | 555645.43 | 873884.86 |
57.27 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_sql_streaming | RuntimeMs | FlinkRunner | 3448.71 | 3499.09 | 1.46 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_streaming | RuntimeMs | DataflowRunner | 120439.29 | 115045.47 |
-4.48 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_7_streaming | RuntimeMs | DirectRunner | 848639.79 | 852311.73 | 0.43
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_streaming | RuntimeMs | FlinkRunner | 12722.71 | 13343.32 | 4.88 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_8_batch | RuntimeMs | DataflowRunner | 19435.54 | 21736.53 | 11.84 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_8_batch | RuntimeMs | DirectRunner | 2244.14 | 2233.5 | -0.47 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_8_batch | RuntimeMs | FlinkRunner | 488.57 | 519.14 | 6.26 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_8_batch | RuntimeMs | SparkRunner | 1413.09 | 1447.93 | 2.47 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_8_batch | RuntimeMs | SparkStructuredStreamingRunner | 1128.96 |
1129.57 | 0.05 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_8_streaming | RuntimeMs | DataflowRunner | 60204.83 | 58715.08 | -2.47
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_8_streaming | RuntimeMs | DirectRunner | 6999.29 | 7108.64 | 1.56 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_8_streaming | RuntimeMs | FlinkRunner | 472.04 | 456.86 | -3.21 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_9_batch | RuntimeMs | DataflowRunner | 23913.93 | 30053.5 | 25.67 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_9_batch | RuntimeMs | DirectRunner | 1400.43 | 1428.86 | 2.03 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_9_batch | RuntimeMs | FlinkRunner | 334.25 | 317.77 | -4.93 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_9_batch | RuntimeMs | SparkRunner | 531.32 | 547.5 | 3.04 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_9_batch | RuntimeMs | SparkStructuredStreamingRunner | 735.09 | 781.98
| 6.38 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_9_streaming | RuntimeMs | DataflowRunner | 31829.32 | 31598.45 | -0.73
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_9_streaming | RuntimeMs | DirectRunner | 1764.29 | 1732.86 | -1.78 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_9_streaming | RuntimeMs | FlinkRunner | 517.57 | 451.0 | -12.86 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)