You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/02/01 12:01:34 UTC

Beam Metrics Report (2021-02-01)

# Beam Metrics Report

Color legend:  >= 20 | >= 10 | <= -10 | <= -20  
---|---|---|---  
  
## Possible regression

**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**  
---|---|---|---|---|---|---  
go_batch_combine_5 | dataflow_runtime | - | 89.74 | 102.49 | 14.2 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
go_batch_gbk_3 | dataflow_runtime | - | 40.98 | 45.1 | 10.07 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_cogbk_3 | dataflow_runtime_sec | - | 28.39 | 32.17 | 13.3 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
kafkaioit_results_sdf_wrapper | read_time | - | 8.71 | 9.73 | 11.68 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
python_batch_gbk_3 | python_dataflow_batch_gbk_3_runtime | - | 31.86 | 40.5 |
27.13 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_streaming_combine_5 | python_flink_streaming_combine_5_runtime | - |
215.17 | 256.0 | 18.98 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_streaming_gbk_7 | python_dataflow_streaming_gbk_7_runtime | - | 406.86
| 458.5 | 12.69 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_streaming_pardo_2 | python_flink_streaming_pardo_2_runtime | - |
3585.71 | 3967.25 | 10.64 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
nexmark_12_batch | RuntimeMs | DataflowRunner | 61975.32 | 71980.94 | 16.14 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_batch | RuntimeMs | DataflowRunner | 82074.11 | 98000.33 | 19.4 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_1_batch | RuntimeMs | FlinkRunner | 222.79 | 255.82 | 14.83 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_batch | RuntimeMs | FlinkRunner | 100.54 | 112.0 | 11.4 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_sql_batch | RuntimeMs | DataflowRunner | 49686.54 | 56610.5 | 13.94
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_3_batch | RuntimeMs | DataflowRunner | 60657.04 | 69865.72 | 15.18 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
  
## Possible improvement

**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**  
---|---|---|---|---|---|---  
go_batch_sideinput_3 | dataflow_runtime | - | 259.38 | 217.07 | -16.31 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
java_batch_cogbk_2 | sparkstructuredstreaming_runtime_sec | - | 205.01 |
132.81 | -35.22 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_4 | sparkstructuredstreaming_runtime_sec | - | 25.6 | 20.3 |
-20.7 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
mongodbioit_results | read_time | - | 32.01 | 26.17 | -18.26 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
parquetioit_hdfs_results | read_time | - | 132.91 | 117.39 | -11.68 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
python_batch_sideinput_1 | python_dataflow_batch_sideinput_1_runtime | - |
3.14 | 2.25 | -28.41 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_10 | python_dataflow_batch_sideinput_10_runtime | - |
1440.14 | 1014.67 | -29.54 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_2 | python_dataflow_batch_sideinput_2_runtime | - |
2.57 | 2.25 | -12.5 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_5 | python_dataflow_batch_sideinput_5_runtime | - |
2.43 | 2.0 | -17.65 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_6 | python_dataflow_batch_sideinput_6_runtime | - |
2.43 | 2.0 | -17.65 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_7 | python_dataflow_batch_sideinput_7_runtime | - |
236.71 | 180.33 | -23.82 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_8 | python_dataflow_batch_sideinput_8_runtime | - |
232.29 | 183.0 | -21.22 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_9 | python_dataflow_batch_sideinput_9_runtime | - |
1440.86 | 1041.0 | -27.75 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_psio_2GB_results | pubsub_io_perf_read_runtime | - | 158.86 | 96.25 |
-39.41 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_streaming_cogbk_4 | python_dataflow_streaming_cogbk_4_runtime | - |
424.29 | 294.75 | -30.53 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_streaming_pardo_6 | python_flink_streaming_pardo_6_runtime | - | 120.14
| 0.0 | -100.0 |  
textioit_hdfs_results | read_time | - | 65.58 | 28.95 | -55.86 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
tfrecordioit_results | write_time | - | 34.1 | 30.43 | -10.75 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
xmlioit_hdfs_results | read_time | - | 35.1 | 29.11 | -17.08 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
xmlioit_hdfs_results | write_time | - | 57.54 | 45.36 | -21.17 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
xmlioit_results | write_time | - | 79.57 | 42.5 | -46.59 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
nexmark_0_zetasql_batch | RuntimeMs | DataflowRunner | 427138.43 | 191295.47 |
-55.21 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_0_zetasql_batch | RuntimeMs | DirectRunner | 7649.11 | 4734.44 | -38.1
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_0_zetasql_streaming | RuntimeMs | DataflowRunner | 177869.07 |
72690.88 | -59.13 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_zetasql_streaming | RuntimeMs | DirectRunner | 9955.39 | 7248.17 |
-27.19 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_zetasql_streaming | RuntimeMs | FlinkRunner | 7354.71 | 3385.35 |
-53.97 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_11_batch | RuntimeMs | DataflowRunner | 95031.71 | 68475.89 | -27.94 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_13_zetasql_batch | RuntimeMs | DataflowRunner | 893700.54 | 372774.12
| -58.29 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_13_zetasql_batch | RuntimeMs | DirectRunner | 14248.68 | 7054.89 |
-50.49 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_13_zetasql_streaming | RuntimeMs | DataflowRunner | 352108.75 |
129273.44 | -63.29 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_zetasql_streaming | RuntimeMs | DirectRunner | 10648.79 | 6512.17 |
-38.85 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_zetasql_streaming | RuntimeMs | FlinkRunner | 43169.07 | 36231.06 |
-16.07 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_sql_streaming | RuntimeMs | FlinkRunner | 448.32 | 390.18 | -12.97 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_zetasql_batch | RuntimeMs | DataflowRunner | 290091.82 | 111867.71 |
-61.44 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_zetasql_batch | RuntimeMs | DirectRunner | 4167.0 | 2101.22 | -49.57
|  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_zetasql_streaming | RuntimeMs | DataflowRunner | 126235.39 |
39765.38 | -68.5 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_zetasql_streaming | RuntimeMs | DirectRunner | 4931.14 | 3268.56 |
-33.72 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_zetasql_streaming | RuntimeMs | FlinkRunner | 4230.86 | 1199.29 |
-71.65 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_zetasql_streaming | RuntimeMs | DataflowRunner | 56637.54 | 44263.75
| -21.85 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_zetasql_streaming | RuntimeMs | FlinkRunner | 1602.79 | 1209.76 |
-24.52 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_4_batch | RuntimeMs | DataflowRunner | 71484.71 | 59865.33 | -16.25 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_6_batch | RuntimeMs | DataflowRunner | 75004.25 | 57746.89 | -23.01 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_7_streaming | RuntimeMs | FlinkRunner | 9171.07 | 8083.06 | -11.86 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_9_batch | RuntimeMs | DataflowRunner | 66648.39 | 56970.28 | -14.52 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
  
## All metrics

**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**  
---|---|---|---|---|---|---  
avroioit_hdfs_results | read_time | - | 135.22 | 128.13 | -5.24 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
avroioit_hdfs_results | write_time | - | 174.35 | 172.32 | -1.16 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
avroioit_results | read_time | - | 126.13 | 126.17 | 0.03 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
avroioit_results | write_time | - | 163.83 | 160.1 | -2.27 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_batch_avro | avro_write_time | - | 56.86 | 57.84 | 1.72
|  [[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_batch_avro | read_time | - | 80.35 | 80.74 | 0.49 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_batch_json | read_time | - | 70.38 | 69.4 | -1.4 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_batch_json | write_time | - | 93.65 | 89.96 | -3.95 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_stream | read_time | - | 0.0 | 0.0 | 0.0 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_stream | write_time | - | 104.63 | 104.46 | -0.16 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
compressed_textioit_hdfs_results | read_time | - | 214.82 | 211.12 | -1.72 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
compressed_textioit_hdfs_results | write_time | - | 314.52 | 303.98 | -3.35 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
compressed_textioit_results | read_time | - | 205.33 | 197.59 | -3.77 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
compressed_textioit_results | write_time | - | 282.57 | 279.36 | -1.14 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
go_batch_cogbk_1 | dataflow_runtime | - | 335.47 | 334.46 | -0.3 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
go_batch_cogbk_2 | dataflow_runtime | - | 217.3 | 210.63 | -3.07 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
go_batch_cogbk_2 | flink_runtime | - | 651.43 | 671.82 | 3.13 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
go_batch_cogbk_3 | dataflow_runtime | - | 192.51 | 189.94 | -1.33 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
go_batch_cogbk_3 | flink_runtime | - | 704.47 | 717.12 | 1.79 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
go_batch_cogbk_4 | dataflow_runtime | - | 193.39 | 192.17 | -0.63 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
go_batch_cogbk_4 | flink_runtime | - | 653.25 | 646.54 | -1.03 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
go_batch_combine_1 | dataflow_runtime | - | 1544.85 | 1518.19 | -1.73 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
go_batch_combine_1 | flink_runtime | - | 4001.43 | 4014.53 | 0.33 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
go_batch_combine_4 | dataflow_runtime | - | 91.08 | 90.66 | -0.46 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
go_batch_combine_4 | flink_runtime | - | 148.23 | 149.06 | 0.56 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
go_batch_combine_5 | dataflow_runtime | - | 89.74 | 102.49 | 14.2 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
go_batch_combine_5 | flink_runtime | - | 110.56 | 110.38 | -0.16 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
go_batch_gbk_1 | dataflow_runtime | - | 742.95 | 748.59 | 0.76 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_1 | flink_runtime | - | 3296.71 | 3266.01 | -0.93 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_2 | dataflow_runtime | - | 168.84 | 169.68 | 0.5 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_2 | flink_runtime | - | 512.31 | 511.06 | -0.24 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_3 | dataflow_runtime | - | 40.98 | 45.1 | 10.07 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_3 | flink_runtime | - | 21.73 | 21.53 | -0.91 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_4 | dataflow_runtime | - | 73.95 | 73.37 | -0.78 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_4 | flink_runtime | - | 144.17 | 146.35 | 1.51 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_5 | dataflow_runtime | - | 70.96 | 69.23 | -2.43 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_5 | flink_runtime | - | 111.03 | 106.5 | -4.08 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_6 | dataflow_runtime | - | 169.05 | 171.41 | 1.39 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_6 | flink_runtime | - | 608.2 | 596.52 | -1.92 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_gbk_7 | dataflow_runtime | - | 171.14 | 167.51 | -2.12 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
go_batch_pardo_1 | dataflow_runtime | - | 166.97 | 164.28 | -1.61 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
go_batch_pardo_1 | flink_runtime | - | 595.5 | 593.26 | -0.38 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
go_batch_pardo_2 | dataflow_runtime | - | 1698.31 | 1661.17 | -2.19 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
go_batch_pardo_2 | flink_runtime | - | 6939.96 | 6859.63 | -1.16 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
go_batch_pardo_3 | dataflow_runtime | - | 96.2 | 96.55 | 0.37 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
go_batch_pardo_3 | flink_runtime | - | 308.13 | 306.05 | -0.68 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
go_batch_pardo_4 | dataflow_runtime | - | 103.37 | 103.83 | 0.44 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
go_batch_pardo_4 | flink_runtime | - | 346.3 | 343.18 | -0.9 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
go_batch_sideinput_3 | dataflow_runtime | - | 259.38 | 217.07 | -16.31 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
go_batch_sideinput_3 | flink_runtime | - | 13.86 | 13.9 | 0.28 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
go_batch_sideinput_4 | dataflow_runtime | - | 263.17 | 269.87 | 2.55 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
go_batch_sideinput_4 | flink_runtime | - | 14.64 | 14.81 | 1.19 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
hadoopformatioit_results | read_time | - | 8.67 | 8.64 | -0.28 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
hadoopformatioit_results | write_time | - | 13.16 | 13.16 | 0.01 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
java_batch_cogbk_1 | dataflow_runtime_sec | - | 73.14 | 72.23 | -1.24 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_1 | sparkstructuredstreaming_runtime_sec | - | 140.9 | 139.03
| -1.33 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_2 | dataflow_runtime_sec | - | 75.51 | 73.63 | -2.5 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_2 | sparkstructuredstreaming_runtime_sec | - | 205.01 |
132.81 | -35.22 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_3 | dataflow_runtime_sec | - | 28.39 | 32.17 | 13.3 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_3 | sparkstructuredstreaming_runtime_sec | - | 21.68 | 21.61
| -0.33 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_4 | dataflow_runtime_sec | - | 28.98 | 29.13 | 0.51 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_4 | sparkstructuredstreaming_runtime_sec | - | 25.6 | 20.3 |
-20.7 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_combine_1 | dataflow_runtime_sec | - | 87.23 | 85.68 | -1.78 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_1 | sparkstructuredstreaming_runtime_sec | - | 666.12 |
714.85 | 7.31 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_4 | dataflow_runtime_sec | - | 39.36 | 37.2 | -5.49 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_4 | sparkstructuredstreaming_runtime_sec | - | 130.97 |
142.55 | 8.84 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_5 | dataflow_runtime_sec | - | 39.83 | 38.06 | -4.45 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_5 | sparkstructuredstreaming_runtime_sec | - | 137.79 |
145.43 | 5.54 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_gbk_1 | dataflow_runtime_sec | - | 253.29 | 248.34 | -1.96 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_1 | sparkstructuredstreaming_runtime_sec | - | 627.51 | 596.95
| -4.87 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_2 | dataflow_runtime_sec | - | 60.9 | 63.42 | 4.14 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_2 | sparkstructuredstreaming_runtime_sec | - | 127.08 | 125.92
| -0.91 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_3 | dataflow_runtime_sec | - | 26.09 | 26.7 | 2.34 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_3 | sparkstructuredstreaming_runtime_sec | - | 9.75 | 10.52 |
7.88 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_4 | dataflow_runtime_sec | - | 33.01 | 32.78 | -0.69 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_4 | sparkstructuredstreaming_runtime_sec | - | 122.37 | 119.33
| -2.48 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_5 | dataflow_runtime_sec | - | 34.74 | 34.71 | -0.07 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_5 | sparkstructuredstreaming_runtime_sec | - | 123.09 | 120.36
| -2.23 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_6 | dataflow_runtime_sec | - | 71.1 | 73.31 | 3.11 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_6 | sparkstructuredstreaming_runtime_sec | - | 59.28 | 59.6 |
0.55 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_7 | dataflow_runtime_sec | - | 100.97 | 107.43 | 6.4 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_7 | sparkstructuredstreaming_runtime_sec | - | 87.81 | 88.51 |
0.8 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_pardo_1 | dataflow_runtime_sec | - | 28.68 | 27.53 | -4.01 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_1 | sparkstructuredstreaming_runtime_sec | - | 53.48 | 50.0 |
-6.5 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_2 | dataflow_runtime_sec | - | 187.43 | 189.89 | 1.31 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_3 | dataflow_runtime_sec | - | 21.47 | 19.69 | -8.27 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_4 | dataflow_runtime_sec | - | 35.03 | 36.73 | 4.87 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_cogbk_1 | dataflow_runtime_sec | - | 944.56 | 1002.47 | 6.13 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_2 | dataflow_runtime_sec | - | 1015.45 | 994.94 | -2.02 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_3 | dataflow_runtime_sec | - | 129.55 | 128.76 | -0.61 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_4 | dataflow_runtime_sec | - | 124.64 | 125.14 | 0.4 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_combine_1 | dataflow_runtime_sec | - | 545.31 | 541.08 | -0.78
|  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_streaming_combine_4 | dataflow_runtime_sec | - | 351.44 | 336.1 | -4.36 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_streaming_combine_5 | dataflow_runtime_sec | - | 337.96 | 322.38 | -4.61
|  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_streaming_gbk_1 | dataflow_runtime_sec | - | 755.41 | 690.56 | -8.58 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_2 | dataflow_runtime_sec | - | 941.16 | 922.16 | -2.02 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_3 | dataflow_runtime_sec | - | 24.08 | 24.79 | 2.98 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_4 | dataflow_runtime_sec | - | 339.8 | 312.54 | -8.02 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_5 | dataflow_runtime_sec | - | 314.37 | 315.15 | 0.25 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_6 | dataflow_runtime_sec | - | 76.05 | 77.37 | 1.73 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_7 | dataflow_runtime_sec | - | 131.54 | 135.93 | 3.33 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_pardo_1 | dataflow_runtime_sec | - | 19.24 | 19.29 | 0.25 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_2 | dataflow_runtime_sec | - | 213.5 | 217.1 | 1.69 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_3 | dataflow_runtime_sec | - | 11.85 | 12.08 | 1.96 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_4 | dataflow_runtime_sec | - | 30.94 | 31.3 | 1.16 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
jdbcioit_results | read_time | - | 37.99 | 37.44 | -1.47 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
jdbcioit_results | write_time | - | 58.23 | 58.14 | -0.16 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
kafkaioit_results | read_time | - | 793.47 | 796.41 | 0.37 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
kafkaioit_results | write_time | - | 212.59 | 195.77 | -7.91 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
kafkaioit_results_runner_v2 | read_time | - | 2.86 | 2.81 | -1.86 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
kafkaioit_results_runner_v2 | write_time | - | 11.04 | 10.6 | -3.91 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
kafkaioit_results_sdf_wrapper | read_time | - | 8.71 | 9.73 | 11.68 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
kafkaioit_results_sdf_wrapper | write_time | - | 11.12 | 10.86 | -2.32 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
many_files_textioit_hdfs_results | read_time | - | 28.16 | 27.4 | -2.69 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
many_files_textioit_hdfs_results | write_time | - | 110.76 | 108.51 | -2.03 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
many_files_textioit_results | read_time | - | 47.27 | 46.0 | -2.68 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
many_files_textioit_results | write_time | - | 112.18 | 111.51 | -0.59 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
mongodbioit_results | read_time | - | 32.01 | 26.17 | -18.26 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
mongodbioit_results | write_time | - | 82.04 | 85.95 | 4.76 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
parquetioit_hdfs_results | read_time | - | 132.91 | 117.39 | -11.68 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
parquetioit_hdfs_results | write_time | - | 204.87 | 211.02 | 3.0 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
parquetioit_results | read_time | - | 119.29 | 118.73 | -0.46 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
parquetioit_results | write_time | - | 193.46 | 192.25 | -0.62 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
python_batch_cogbk_1 | python_dataflow_batch_cogbk_1_runtime | - | 462.0 |
436.25 | -5.57 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_batch_cogbk_2 | python_dataflow_batch_cogbk_2_runtime | - | 310.57 |
312.25 | 0.54 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_batch_cogbk_3 | python_dataflow_batch_cogbk_3_runtime | - | 302.29 |
305.75 | 1.15 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_batch_cogbk_4 | python_dataflow_batch_cogbk_4_runtime | - | 305.14 |
303.75 | -0.46 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_batch_combine_1 | python_dataflow_batch_combine_1_runtime | - | 939.29
| 935.0 | -0.46 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_combine_4 | python_dataflow_batch_combine_4_runtime | - | 39.29 |
39.25 | -0.09 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_combine_5 | python_dataflow_batch_combine_5_runtime | - | 37.0 |
35.5 | -4.05 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_gbk_1 | python_dataflow_batch_gbk_1_runtime | - | 1936.57 |
1949.5 | 0.67 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_2 | python_dataflow_batch_gbk_2_runtime | - | 347.86 | 345.25
| -0.75 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_3 | python_dataflow_batch_gbk_3_runtime | - | 31.86 | 40.5 |
27.13 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_4 | python_dataflow_batch_gbk_4_runtime | - | 102.29 | 106.25
| 3.88 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_5 | python_dataflow_batch_gbk_5_runtime | - | 103.29 | 97.75
| -5.36 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_6 | python_dataflow_batch_gbk_6_runtime | - | 381.0 | 371.25
| -2.56 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_7 | python_dataflow_batch_gbk_7_runtime | - | 369.57 | 373.5
| 1.06 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_pardo_1 | python_dataflow_batch_pardo_1_runtime | - | 159.71 |
149.25 | -6.55 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_1 | python_flink_batch_pardo_1_runtime | - | 688.43 |
712.75 | 3.53 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_2 | python_dataflow_batch_pardo_2_runtime | - | 1405.57 |
1422.25 | 1.19 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_3 | python_dataflow_batch_pardo_3_runtime | - | 137.57 |
129.0 | -6.23 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_3 | python_flink_batch_pardo_3_runtime | - | 633.71 | 661.5
| 4.38 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_4 | python_dataflow_batch_pardo_4_runtime | - | 333.71 |
332.5 | -0.36 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_4 | python_flink_batch_pardo_4_runtime | - | 2003.86 |
2120.0 | 5.8 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_sideinput_1 | python_dataflow_batch_sideinput_1_runtime | - |
3.14 | 2.25 | -28.41 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_10 | python_dataflow_batch_sideinput_10_runtime | - |
1440.14 | 1014.67 | -29.54 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_2 | python_dataflow_batch_sideinput_2_runtime | - |
2.57 | 2.25 | -12.5 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_3 | python_dataflow_batch_sideinput_3_runtime | - |
19.29 | 17.75 | -7.96 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_4 | python_dataflow_batch_sideinput_4_runtime | - |
20.14 | 18.67 | -7.33 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_5 | python_dataflow_batch_sideinput_5_runtime | - |
2.43 | 2.0 | -17.65 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_6 | python_dataflow_batch_sideinput_6_runtime | - |
2.43 | 2.0 | -17.65 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_7 | python_dataflow_batch_sideinput_7_runtime | - |
236.71 | 180.33 | -23.82 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_8 | python_dataflow_batch_sideinput_8_runtime | - |
232.29 | 183.0 | -21.22 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_9 | python_dataflow_batch_sideinput_9_runtime | - |
1440.86 | 1041.0 | -27.75 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_bqio_read_10GB_results | bqio_read_10GB_results_runtime | - | 163.86 |
161.75 | -1.29 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_bqio_write_10GB_results | bqio_write_10GB_results_runtime | - | 260.29
| 267.0 | 2.58 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_psio_2GB_results | pubsub_io_perf_read_runtime | - | 158.86 | 96.25 |
-39.41 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_psio_2GB_results | pubsub_io_perf_write_runtime | - | 84.86 | 90.75 |
6.94 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_streaming_cogbk_1 | python_dataflow_streaming_cogbk_1_runtime | - |
615.86 | 586.75 | -4.73 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_streaming_cogbk_2 | python_dataflow_streaming_cogbk_2_runtime | - |
355.71 | 324.5 | -8.78 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_streaming_cogbk_3 | python_dataflow_streaming_cogbk_3_runtime | - |
761.86 | 769.0 | 0.94 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_streaming_cogbk_4 | python_dataflow_streaming_cogbk_4_runtime | - |
424.29 | 294.75 | -30.53 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_streaming_combine_4 | python_flink_streaming_combine_4_runtime | - |
228.29 | 233.5 | 2.28 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_streaming_combine_5 | python_flink_streaming_combine_5_runtime | - |
215.17 | 256.0 | 18.98 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_streaming_gbk_3 | python_dataflow_streaming_gbk_3_runtime | - | 161.71
| 153.5 | -5.08 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_streaming_gbk_6 | python_dataflow_streaming_gbk_6_runtime | - | 413.86
| 415.5 | 0.4 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_streaming_gbk_7 | python_dataflow_streaming_gbk_7_runtime | - | 406.86
| 458.5 | 12.69 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_streaming_pardo_1 | python_dataflow_streaming_pardo_1_runtime | - |
183.29 | 176.5 | -3.7 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_1 | python_flink_streaming_pardo_5_runtime | - | 162.71
| 166.0 | 2.02 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_2 | python_dataflow_streaming_pardo_2_runtime | - |
2507.57 | 2546.5 | 1.55 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_2 | python_flink_streaming_pardo_2_runtime | - |
3585.71 | 3967.25 | 10.64 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_3 | python_dataflow_streaming_pardo_3_runtime | - |
152.71 | 145.0 | -5.05 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_3 | python_flink_streaming_pardo_3_runtime | - | 248.57
| 233.5 | -6.06 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_4 | python_dataflow_streaming_pardo_4_runtime | - |
462.86 | 459.5 | -0.73 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_4 | python_flink_streaming_pardo_4_runtime | - | 599.43
| 589.75 | -1.61 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_6 | python_flink_streaming_pardo_6_runtime | - | 120.14
| 0.0 | -100.0 |  
textioit_hdfs_results | read_time | - | 65.58 | 28.95 | -55.86 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
textioit_hdfs_results | write_time | - | 47.87 | 47.3 | -1.2 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
textioit_results | read_time | - | 31.17 | 28.81 | -7.59 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
textioit_results | write_time | - | 47.61 | 45.85 | -3.69 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
tfrecordioit_results | read_time | - | 24.55 | 23.94 | -2.5 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
tfrecordioit_results | write_time | - | 34.1 | 30.43 | -10.75 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
wordcount_py37_results | runtime | - | 856.76 | 822.89 | -3.95 |
[[1]](http://metrics.beam.apache.org/d/1cnwVDkGk)  
xmlioit_hdfs_results | read_time | - | 35.1 | 29.11 | -17.08 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
xmlioit_hdfs_results | write_time | - | 57.54 | 45.36 | -21.17 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
xmlioit_results | read_time | - | 30.87 | 30.0 | -2.84 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
xmlioit_results | write_time | - | 79.57 | 42.5 | -46.59 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
nexmark_0_batch | RuntimeMs | DataflowRunner | 74295.46 | 71406.44 | -3.89 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_batch | RuntimeMs | DirectRunner | 2589.86 | 2776.83 | 7.22 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_batch | RuntimeMs | FlinkRunner | 1126.25 | 1117.35 | -0.79 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_0_batch | RuntimeMs | SparkRunner | 1218.21 | 1204.94 | -1.09 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_0_batch | RuntimeMs | SparkStructuredStreamingRunner | 1090.5 | 1092.5
| 0.18 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_0_sql_batch | RuntimeMs | DataflowRunner | 73530.79 | 71147.06 | -3.24
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_0_sql_batch | RuntimeMs | DirectRunner | 3605.64 | 3653.17 | 1.32 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_0_sql_batch | RuntimeMs | SparkRunner | 1101.54 | 1087.0 | -1.32 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_0_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1075.79 |
1100.72 | 2.32 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_sql_streaming | RuntimeMs | DataflowRunner | 23052.5 | 22676.65 |
-1.63 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_sql_streaming | RuntimeMs | DirectRunner | 6138.57 | 5915.06 | -3.64
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_sql_streaming | RuntimeMs | FlinkRunner | 1764.86 | 1749.65 | -0.86
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_streaming | RuntimeMs | DataflowRunner | 22473.25 | 22461.17 | -0.05
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_streaming | RuntimeMs | DirectRunner | 5018.68 | 5061.67 | 0.86 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_streaming | RuntimeMs | FlinkRunner | 1609.75 | 1617.41 | 0.48 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_zetasql_batch | RuntimeMs | DataflowRunner | 427138.43 | 191295.47 |
-55.21 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_0_zetasql_batch | RuntimeMs | DirectRunner | 7649.11 | 4734.44 | -38.1
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_0_zetasql_streaming | RuntimeMs | DataflowRunner | 177869.07 |
72690.88 | -59.13 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_zetasql_streaming | RuntimeMs | DirectRunner | 9955.39 | 7248.17 |
-27.19 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_zetasql_streaming | RuntimeMs | FlinkRunner | 7354.71 | 3385.35 |
-53.97 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_10_batch | RuntimeMs | DataflowRunner | 95996.89 | 93061.28 | -3.06 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_10_batch | RuntimeMs | DirectRunner | 2790.18 | 2891.67 | 3.64 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_10_batch | RuntimeMs | FlinkRunner | 585.18 | 560.88 | -4.15 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_10_batch | RuntimeMs | SparkRunner | 587.43 | 599.44 | 2.05 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_10_batch | RuntimeMs | SparkStructuredStreamingRunner | 883.43 |
881.83 | -0.18 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_10_streaming | RuntimeMs | DataflowRunner | 90540.61 | 90407.56 |
-0.15 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_10_streaming | RuntimeMs | DirectRunner | 15012.43 | 14826.94 | -1.24
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_10_streaming | RuntimeMs | FlinkRunner | 1567.61 | 1468.65 | -6.31 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_11_batch | RuntimeMs | DataflowRunner | 95031.71 | 68475.89 | -27.94 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_11_batch | RuntimeMs | DirectRunner | 2481.82 | 2555.56 | 2.97 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_11_batch | RuntimeMs | FlinkRunner | 252.11 | 243.65 | -3.36 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_11_batch | RuntimeMs | SparkRunner | 496.07 | 504.72 | 1.74 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_11_batch | RuntimeMs | SparkStructuredStreamingRunner | 599.04 |
584.61 | -2.41 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_11_streaming | RuntimeMs | DataflowRunner | 156518.18 | 156386.22 |
-0.08 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_11_streaming | RuntimeMs | DirectRunner | 3362.79 | 3338.83 | -0.71 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_11_streaming | RuntimeMs | FlinkRunner | 1613.68 | 1601.65 | -0.75 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_12_batch | RuntimeMs | DataflowRunner | 61975.32 | 71980.94 | 16.14 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_12_batch | RuntimeMs | DirectRunner | 1706.46 | 1740.39 | 1.99 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_12_batch | RuntimeMs | FlinkRunner | 180.75 | 173.53 | -3.99 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_12_batch | RuntimeMs | SparkRunner | 215.5 | 208.83 | -3.09 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_12_batch | RuntimeMs | SparkStructuredStreamingRunner | 342.43 |
336.94 | -1.6 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_12_streaming | RuntimeMs | DataflowRunner | 77366.79 | 78258.33 | 1.15
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_12_streaming | RuntimeMs | DirectRunner | 2234.25 | 2225.11 | -0.41 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_12_streaming | RuntimeMs | FlinkRunner | 771.86 | 762.41 | -1.22 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_batch | RuntimeMs | DataflowRunner | 65257.07 | 60858.61 | -6.74 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_batch | RuntimeMs | DirectRunner | 1655.71 | 1668.5 | 0.77 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_13_batch | RuntimeMs | FlinkRunner | 334.86 | 308.35 | -7.92 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_13_batch | RuntimeMs | SparkRunner | 269.18 | 269.44 | 0.1 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_13_batch | RuntimeMs | SparkStructuredStreamingRunner | 376.61 |
375.72 | -0.23 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_13_sql_batch | RuntimeMs | DataflowRunner | 144414.18 | 143343.56 |
-0.74 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_13_sql_batch | RuntimeMs | DirectRunner | 4631.57 | 4586.28 | -0.98 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_13_sql_batch | RuntimeMs | SparkRunner | 1061.57 | 1080.44 | 1.78 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 931.21 |
958.33 | 2.91 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_13_sql_streaming | RuntimeMs | DataflowRunner | 36789.93 | 35424.41 |
-3.71 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_sql_streaming | RuntimeMs | DirectRunner | 5392.32 | 5365.72 |
-0.49 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_sql_streaming | RuntimeMs | FlinkRunner | 32048.86 | 30978.18 |
-3.34 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_streaming | RuntimeMs | DataflowRunner | 29877.0 | 29875.17 | -0.01
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_streaming | RuntimeMs | DirectRunner | 2665.71 | 2629.11 | -1.37 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_streaming | RuntimeMs | FlinkRunner | 29037.68 | 29964.88 | 3.19 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_zetasql_batch | RuntimeMs | DataflowRunner | 893700.54 | 372774.12
| -58.29 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_13_zetasql_batch | RuntimeMs | DirectRunner | 14248.68 | 7054.89 |
-50.49 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_13_zetasql_streaming | RuntimeMs | DataflowRunner | 352108.75 |
129273.44 | -63.29 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_zetasql_streaming | RuntimeMs | DirectRunner | 10648.79 | 6512.17 |
-38.85 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_zetasql_streaming | RuntimeMs | FlinkRunner | 43169.07 | 36231.06 |
-16.07 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_14_batch | RuntimeMs | DataflowRunner | 146179.25 | 148115.44 | 1.32 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_14_batch | RuntimeMs | DirectRunner | 2623.86 | 2660.89 | 1.41 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_14_batch | RuntimeMs | FlinkRunner | 492.36 | 504.71 | 2.51 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_14_batch | RuntimeMs | SparkRunner | 817.04 | 807.22 | -1.2 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_14_batch | RuntimeMs | SparkStructuredStreamingRunner | 830.86 |
845.06 | 1.71 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_14_streaming | RuntimeMs | DataflowRunner | 121951.0 | 124978.22 |
2.48 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_14_streaming | RuntimeMs | DirectRunner | 3449.07 | 3446.56 | -0.07 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_14_streaming | RuntimeMs | FlinkRunner | 1618.32 | 1615.59 | -0.17 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_batch | RuntimeMs | DataflowRunner | 82074.11 | 98000.33 | 19.4 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_1_batch | RuntimeMs | DirectRunner | 1555.54 | 1707.61 | 9.78 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_1_batch | RuntimeMs | FlinkRunner | 222.79 | 255.82 | 14.83 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_1_batch | RuntimeMs | SparkRunner | 329.68 | 322.5 | -2.18 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_1_batch | RuntimeMs | SparkStructuredStreamingRunner | 378.61 | 377.89
| -0.19 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_sql_batch | RuntimeMs | DataflowRunner | 72824.71 | 72281.89 | -0.75
|  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_1_sql_batch | RuntimeMs | DirectRunner | 2044.86 | 2084.17 | 1.92 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_1_sql_batch | RuntimeMs | SparkRunner | 401.89 | 395.33 | -1.63 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 475.61 |
495.78 | 4.24 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_sql_streaming | RuntimeMs | DataflowRunner | 20326.46 | 20331.06 |
0.02 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_sql_streaming | RuntimeMs | DirectRunner | 3679.5 | 3590.5 | -2.42 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_sql_streaming | RuntimeMs | FlinkRunner | 764.07 | 737.76 | -3.44 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_streaming | RuntimeMs | DataflowRunner | 18231.36 | 17512.94 | -3.94
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_streaming | RuntimeMs | DirectRunner | 3401.39 | 3572.17 | 5.02 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_streaming | RuntimeMs | FlinkRunner | 717.82 | 714.82 | -0.42 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_batch | RuntimeMs | DataflowRunner | 50022.86 | 48281.5 | -3.48 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_batch | RuntimeMs | DirectRunner | 988.18 | 1037.39 | 4.98 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_batch | RuntimeMs | FlinkRunner | 100.54 | 112.0 | 11.4 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_batch | RuntimeMs | SparkRunner | 135.5 | 136.72 | 0.9 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_batch | RuntimeMs | SparkStructuredStreamingRunner | 206.46 | 199.06
| -3.59 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_sql_batch | RuntimeMs | DataflowRunner | 49686.54 | 56610.5 | 13.94
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_2_sql_batch | RuntimeMs | DirectRunner | 1009.57 | 1015.06 | 0.54 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_sql_batch | RuntimeMs | SparkRunner | 183.82 | 185.0 | 0.64 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 212.71 |
221.72 | 4.23 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_2_sql_streaming | RuntimeMs | DataflowRunner | 12086.82 | 11588.29 |
-4.12 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_sql_streaming | RuntimeMs | DirectRunner | 1877.21 | 1771.94 | -5.61
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_sql_streaming | RuntimeMs | FlinkRunner | 448.32 | 390.18 | -12.97 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_streaming | RuntimeMs | DataflowRunner | 10769.86 | 10838.78 | 0.64
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_streaming | RuntimeMs | DirectRunner | 1641.61 | 1620.72 | -1.27 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_streaming | RuntimeMs | FlinkRunner | 356.39 | 369.24 | 3.6 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_zetasql_batch | RuntimeMs | DataflowRunner | 290091.82 | 111867.71 |
-61.44 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_zetasql_batch | RuntimeMs | DirectRunner | 4167.0 | 2101.22 | -49.57
|  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_zetasql_streaming | RuntimeMs | DataflowRunner | 126235.39 |
39765.38 | -68.5 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_zetasql_streaming | RuntimeMs | DirectRunner | 4931.14 | 3268.56 |
-33.72 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_zetasql_streaming | RuntimeMs | FlinkRunner | 4230.86 | 1199.29 |
-71.65 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_batch | RuntimeMs | DataflowRunner | 60657.04 | 69865.72 | 15.18 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_3_batch | RuntimeMs | DirectRunner | 2168.54 | 2191.0 | 1.04 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_batch | RuntimeMs | FlinkRunner | 1165.75 | 1183.65 | 1.54 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_3_batch | RuntimeMs | SparkRunner | 890.18 | 903.0 | 1.44 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_3_sql_batch | RuntimeMs | DataflowRunner | 80186.11 | 83429.94 | 4.05
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_3_sql_batch | RuntimeMs | DirectRunner | 2488.61 | 2460.78 | -1.12 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_3_sql_batch | RuntimeMs | SparkRunner | 1097.57 | 1079.5 | -1.65 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_3_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 627.07 |
645.17 | 2.89 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_sql_streaming | RuntimeMs | DataflowRunner | 33504.18 | 32016.29 |
-4.44 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_sql_streaming | RuntimeMs | DirectRunner | 3588.57 | 3431.72 | -4.37
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_sql_streaming | RuntimeMs | FlinkRunner | 967.64 | 953.82 | -1.43 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_streaming | RuntimeMs | DataflowRunner | 19230.0 | 18278.11 | -4.95
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_streaming | RuntimeMs | DirectRunner | 3118.79 | 3097.83 | -0.67 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_streaming | RuntimeMs | FlinkRunner | 466.64 | 455.06 | -2.48 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_zetasql_batch | RuntimeMs | DataflowRunner | 117620.71 | 107472.94 |
-8.63 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_zetasql_batch | RuntimeMs | DirectRunner | 2874.25 | 2600.06 | -9.54
|  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_3_zetasql_streaming | RuntimeMs | DataflowRunner | 56637.54 | 44263.75
| -21.85 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_zetasql_streaming | RuntimeMs | DirectRunner | 4046.75 | 3933.44 |
-2.8 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_zetasql_streaming | RuntimeMs | FlinkRunner | 1602.79 | 1209.76 |
-24.52 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_4_batch | RuntimeMs | DataflowRunner | 71484.71 | 59865.33 | -16.25 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_4_batch | RuntimeMs | DirectRunner | 1617.46 | 1633.94 | 1.02 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_4_batch | RuntimeMs | FlinkRunner | 975.54 | 1011.18 | 3.65 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_4_batch | RuntimeMs | SparkRunner | 596.18 | 607.28 | 1.86 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_4_batch | RuntimeMs | SparkStructuredStreamingRunner | 1214.93 |
1228.67 | 1.13 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_4_streaming | RuntimeMs | DataflowRunner | 51021.89 | 50131.17 | -1.75
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_4_streaming | RuntimeMs | DirectRunner | 1306.39 | 1330.06 | 1.81 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_4_streaming | RuntimeMs | FlinkRunner | 1340.61 | 1301.53 | -2.91 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_5_batch | RuntimeMs | DataflowRunner | 87604.82 | 93970.39 | 7.27 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_5_batch | RuntimeMs | DirectRunner | 6974.14 | 7268.11 | 4.22 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_5_batch | RuntimeMs | FlinkRunner | 837.07 | 797.12 | -4.77 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_5_batch | RuntimeMs | SparkRunner | 603.61 | 610.61 | 1.16 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_5_batch | RuntimeMs | SparkStructuredStreamingRunner | 1292.89 |
1306.89 | 1.08 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_5_streaming | RuntimeMs | DataflowRunner | 118747.96 | 120196.94 |
1.22 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_5_streaming | RuntimeMs | DirectRunner | 7519.79 | 7676.78 | 2.09 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_5_streaming | RuntimeMs | FlinkRunner | 1517.89 | 1459.24 | -3.86 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_6_batch | RuntimeMs | DataflowRunner | 75004.25 | 57746.89 | -23.01 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_6_batch | RuntimeMs | DirectRunner | 1178.29 | 1219.11 | 3.46 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_6_batch | RuntimeMs | FlinkRunner | 499.61 | 470.71 | -5.78 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_6_batch | RuntimeMs | SparkRunner | 334.68 | 319.33 | -4.59 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_6_batch | RuntimeMs | SparkStructuredStreamingRunner | 315.39 | 303.94
| -3.63 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_6_streaming | RuntimeMs | DataflowRunner | 43911.39 | 40848.33 | -6.98
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_6_streaming | RuntimeMs | DirectRunner | 1039.14 | 1043.06 | 0.38 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_6_streaming | RuntimeMs | FlinkRunner | 668.07 | 690.59 | 3.37 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_batch | RuntimeMs | DataflowRunner | 117963.71 | 107872.0 | -8.55 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_7_batch | RuntimeMs | DirectRunner | 3482.32 | 3507.5 | 0.72 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_7_batch | RuntimeMs | FlinkRunner | 629.5 | 619.41 | -1.6 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_7_batch | RuntimeMs | SparkRunner | 479.43 | 474.83 | -0.96 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_7_batch | RuntimeMs | SparkStructuredStreamingRunner | 1576.86 |
1623.56 | 2.96 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_sql_batch | RuntimeMs | DataflowRunner | 147948.93 | 141841.56 |
-4.13 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_7_sql_batch | RuntimeMs | DirectRunner | 94387.57 | 92128.72 | -2.39 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_7_sql_batch | RuntimeMs | SparkRunner | 2515.61 | 2526.17 | 0.42 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 2892.39 |
2939.61 | 1.63 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_7_sql_streaming | RuntimeMs | DataflowRunner | 1130504.14 | 1131402.06
| 0.08 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_sql_streaming | RuntimeMs | DirectRunner | 108590.89 | 105896.72 |
-2.48 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_sql_streaming | RuntimeMs | FlinkRunner | 4256.46 | 4190.94 | -1.54
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_streaming | RuntimeMs | DataflowRunner | 106612.89 | 107952.17 |
1.26 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_streaming | RuntimeMs | DirectRunner | 8080.43 | 7974.28 | -1.31 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_streaming | RuntimeMs | FlinkRunner | 9171.07 | 8083.06 | -11.86 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_8_batch | RuntimeMs | DataflowRunner | 72036.89 | 76476.33 | 6.16 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_8_batch | RuntimeMs | DirectRunner | 1581.96 | 1578.61 | -0.21 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_8_batch | RuntimeMs | FlinkRunner | 511.36 | 491.82 | -3.82 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_8_batch | RuntimeMs | SparkRunner | 397.21 | 399.39 | 0.55 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_8_batch | RuntimeMs | SparkStructuredStreamingRunner | 369.61 | 369.5
| -0.03 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_8_streaming | RuntimeMs | DataflowRunner | 46084.39 | 44629.56 | -3.16
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_8_streaming | RuntimeMs | DirectRunner | 2594.96 | 2538.94 | -2.16 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_8_streaming | RuntimeMs | FlinkRunner | 479.89 | 453.59 | -5.48 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_9_batch | RuntimeMs | DataflowRunner | 66648.39 | 56970.28 | -14.52 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_9_batch | RuntimeMs | DirectRunner | 715.39 | 709.83 | -0.78 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_9_batch | RuntimeMs | FlinkRunner | 324.14 | 313.88 | -3.17 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_9_batch | RuntimeMs | SparkRunner | 207.5 | 214.06 | 3.16 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_9_batch | RuntimeMs | SparkStructuredStreamingRunner | 181.64 | 183.44
| 0.99 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_9_streaming | RuntimeMs | DataflowRunner | 31856.86 | 30981.56 | -2.75
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_9_streaming | RuntimeMs | DirectRunner | 689.5 | 678.22 | -1.64 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_9_streaming | RuntimeMs | FlinkRunner | 417.79 | 422.47 | 1.12 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)