You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/03/29 12:01:47 UTC
Beam Metrics Report (2021-03-29)
# Beam Metrics Report
Color legend: >= 20 | >= 10 | <= -10 | <= -20
---|---|---|---
## Possible regression
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
hadoopformatioit_results | write_time | - | 11.51 | 12.91 | 12.18 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
java_batch_combine_4 | sparkstructuredstreaming_runtime_sec | - | 151.25 |
170.42 | 12.68 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_gbk_7 | dataflow_runtime_sec | - | 87.62 | 121.31 | 38.45 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_5 | dataflow_runtime_sec | - | 298.68 | 375.0 | 25.55 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_sideinput_3 | python_dataflow_batch_sideinput_3_runtime | - |
4.29 | 9.0 | 110.0 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_psio_2GB_results | pubsub_io_perf_read_runtime | - | 99.0 | 154.5 |
56.06 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_psio_2GB_results | pubsub_io_perf_write_runtime | - | 83.57 | 95.75 |
14.57 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_streaming_gbk_3 | python_dataflow_streaming_gbk_3_runtime | - | 139.14
| 160.75 | 15.53 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_gbk_6 | python_dataflow_streaming_gbk_6_runtime | - | 447.86
| 499.0 | 11.42 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_pardo_1 | python_flink_streaming_pardo_5_runtime | - | 141.83
| 170.25 | 20.04 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
## Possible improvement
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
go_batch_sideinput_4 | flink_runtime | - | 16.54 | 14.01 | -15.26 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
java_batch_cogbk_1 | dataflow_runtime_sec | - | 68.95 | 59.96 | -13.05 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | sparkstructuredstreaming_runtime_sec | - | 25.28 | 22.71
| -10.16 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_combine_4 | dataflow_runtime_sec | - | 40.46 | 33.81 | -16.42 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_gbk_2 | sparkstructuredstreaming_runtime_sec | - | 152.83 | 124.15
| -18.77 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_runtime_sec | - | 27.65 | 22.41 | -18.95 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | sparkstructuredstreaming_runtime_sec | - | 11.39 | 10.18 |
-10.56 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | dataflow_runtime_sec | - | 31.59 | 27.19 | -13.94 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | dataflow_runtime_sec | - | 569.6 | 400.58 | -29.67 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | sparkstructuredstreaming_runtime_sec | - | 137.66 | 119.33
| -13.31 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_pardo_1 | dataflow_runtime_sec | - | 31.1 | 27.7 | -10.92 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_1 | sparkstructuredstreaming_runtime_sec | - | 69.87 | 60.82
| -12.94 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_gbk_1 | dataflow_runtime_sec | - | 851.03 | 708.72 | -16.72 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
kafkaioit_results_sdf_wrapper | read_time | - | 3.05 | 2.54 | -16.51 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_hdfs_results | write_time | - | -57721398.01 | 105.02 |
-100.0 | [[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
mongodbioit_results | read_time | - | 27.09 | 23.8 | -12.15 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
python_batch_combine_5 | python_flink_batch_combine_5_runtime | - | 124.0 |
109.0 | -12.1 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_streaming_cogbk_1 | python_dataflow_streaming_cogbk_1_runtime | - |
636.86 | 561.5 | -11.83 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_pardo_3 | python_flink_streaming_pardo_3_runtime | - | 233.5
| 207.5 | -11.13 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_6 | python_flink_streaming_pardo_6_runtime | - | 107.67
| 0.25 | -99.77 |
xmlioit_hdfs_results | read_time | - | 33.81 | 26.62 | -21.26 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
nexmark_13_sql_batch | RuntimeMs | DataflowRunner | 123130.67 | 110374.28 |
-10.36 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_3_sql_batch | RuntimeMs | DataflowRunner | 46501.59 | 41573.28 | -10.6
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_batch | RuntimeMs | DataflowRunner | 53447.93 | 46124.28 | -13.7 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_streaming | RuntimeMs | FlinkRunner | 9679.0 | 7208.78 | -25.52 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_batch | RuntimeMs | DataflowRunner | 48650.14 | 42405.22 | -12.84 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
## All metrics
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
avroioit_hdfs_results | read_time | - | 124.77 | 122.62 | -1.73 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_hdfs_results | write_time | - | 175.15 | 173.12 | -1.16 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_results | read_time | - | 125.62 | 123.36 | -1.8 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_results | write_time | - | 162.61 | 161.12 | -0.91 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_avro | avro_write_time | - | 57.23 | 55.83 |
-2.45 | [[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_avro | read_time | - | 69.01 | 72.07 | 4.44 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_json | read_time | - | 61.15 | 61.17 | 0.03 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_json | write_time | - | 92.86 | 89.17 | -3.97 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_hdfs_results | read_time | - | 216.55 | 208.37 | -3.78 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_hdfs_results | write_time | - | 308.07 | 295.86 | -3.96 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_results | read_time | - | 200.97 | 200.65 | -0.16 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_results | write_time | - | 276.61 | 279.61 | 1.09 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
go_batch_cogbk_1 | dataflow_runtime | - | 385.37 | 394.8 | 2.45 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_cogbk_2 | dataflow_runtime | - | 209.05 | 212.22 | 1.51 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_cogbk_2 | flink_runtime | - | 663.55 | 619.61 | -6.62 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_cogbk_3 | dataflow_runtime | - | 186.76 | 189.93 | 1.69 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_cogbk_3 | flink_runtime | - | 710.86 | 719.9 | 1.27 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_cogbk_4 | dataflow_runtime | - | 189.03 | 190.06 | 0.54 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_cogbk_4 | flink_runtime | - | 660.38 | 639.41 | -3.17 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_combine_1 | dataflow_runtime | - | 1543.15 | 1552.6 | 0.61 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
go_batch_combine_1 | flink_runtime | - | 3985.52 | 3959.65 | -0.65 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
go_batch_combine_4 | dataflow_runtime | - | 87.63 | 90.72 | 3.52 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
go_batch_combine_4 | flink_runtime | - | 146.6 | 138.68 | -5.4 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
go_batch_combine_5 | dataflow_runtime | - | 85.71 | 87.27 | 1.83 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
go_batch_combine_5 | flink_runtime | - | 109.74 | 106.84 | -2.65 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
go_batch_gbk_1 | dataflow_runtime | - | 750.85 | 756.39 | 0.74 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_1 | flink_runtime | - | 3263.94 | 3177.66 | -2.64 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_2 | dataflow_runtime | - | 162.56 | 167.46 | 3.01 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_2 | flink_runtime | - | 515.78 | 505.13 | -2.06 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_3 | dataflow_runtime | - | 38.5 | 40.08 | 4.13 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_3 | flink_runtime | - | 21.57 | 21.11 | -2.13 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_4 | dataflow_runtime | - | 73.57 | 74.93 | 1.85 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_4 | flink_runtime | - | 140.73 | 135.74 | -3.55 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_5 | dataflow_runtime | - | 66.59 | 67.27 | 1.02 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_5 | flink_runtime | - | 106.97 | 103.26 | -3.47 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_6 | dataflow_runtime | - | 165.15 | 167.61 | 1.49 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_6 | flink_runtime | - | 596.79 | 595.4 | -0.23 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_7 | dataflow_runtime | - | 169.2 | 168.9 | -0.18 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_pardo_1 | dataflow_runtime | - | 167.96 | 166.86 | -0.66 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_1 | flink_runtime | - | 603.75 | 599.98 | -0.62 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_2 | dataflow_runtime | - | 1697.81 | 1704.9 | 0.42 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_2 | flink_runtime | - | 7129.53 | 7142.35 | 0.18 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_3 | dataflow_runtime | - | 95.91 | 98.64 | 2.85 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_3 | flink_runtime | - | 306.92 | 309.03 | 0.69 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_4 | dataflow_runtime | - | 102.52 | 102.51 | -0.01 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_4 | flink_runtime | - | 344.36 | 346.59 | 0.65 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_sideinput_3 | dataflow_runtime | - | 237.96 | 239.25 | 0.54 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
go_batch_sideinput_3 | flink_runtime | - | 13.87 | 13.41 | -3.29 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
go_batch_sideinput_4 | dataflow_runtime | - | 243.03 | 241.37 | -0.68 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
go_batch_sideinput_4 | flink_runtime | - | 16.54 | 14.01 | -15.26 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
hadoopformatioit_results | read_time | - | 8.67 | 9.0 | 3.81 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
hadoopformatioit_results | write_time | - | 11.51 | 12.91 | 12.18 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
java_batch_cogbk_1 | dataflow_runtime_sec | - | 68.95 | 59.96 | -13.05 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_1 | sparkstructuredstreaming_runtime_sec | - | 133.94 |
134.76 | 0.61 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | dataflow_runtime_sec | - | 67.07 | 62.99 | -6.08 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | sparkstructuredstreaming_runtime_sec | - | 140.48 |
133.73 | -4.81 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | dataflow_runtime_sec | - | 29.28 | 26.42 | -9.76 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | sparkstructuredstreaming_runtime_sec | - | 25.02 | 24.65
| -1.48 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | dataflow_runtime_sec | - | 29.6 | 26.79 | -9.48 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | sparkstructuredstreaming_runtime_sec | - | 25.28 | 22.71
| -10.16 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_combine_1 | dataflow_runtime_sec | - | 85.24 | 89.53 | 5.03 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_1 | sparkstructuredstreaming_runtime_sec | - | 863.15 |
926.63 | 7.35 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_4 | dataflow_runtime_sec | - | 40.46 | 33.81 | -16.42 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_4 | sparkstructuredstreaming_runtime_sec | - | 151.25 |
170.42 | 12.68 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_5 | dataflow_runtime_sec | - | 36.55 | 38.34 | 4.9 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_5 | sparkstructuredstreaming_runtime_sec | - | 153.46 |
151.91 | -1.01 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_gbk_1 | dataflow_runtime_sec | - | 207.09 | 197.91 | -4.43 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_1 | sparkstructuredstreaming_runtime_sec | - | 778.76 | 748.36
| -3.9 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | dataflow_runtime_sec | - | 53.51 | 51.83 | -3.14 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | sparkstructuredstreaming_runtime_sec | - | 152.83 | 124.15
| -18.77 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_runtime_sec | - | 27.65 | 22.41 | -18.95 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | sparkstructuredstreaming_runtime_sec | - | 11.39 | 10.18 |
-10.56 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | dataflow_runtime_sec | - | 31.59 | 27.19 | -13.94 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | sparkstructuredstreaming_runtime_sec | - | 143.59 | 146.28
| 1.88 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | dataflow_runtime_sec | - | 569.6 | 400.58 | -29.67 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | sparkstructuredstreaming_runtime_sec | - | 137.66 | 119.33
| -13.31 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | dataflow_runtime_sec | - | 69.7 | 67.57 | -3.05 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | sparkstructuredstreaming_runtime_sec | - | 71.8 | 70.51 |
-1.8 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | dataflow_runtime_sec | - | 87.62 | 121.31 | 38.45 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | sparkstructuredstreaming_runtime_sec | - | 111.73 | 104.59
| -6.39 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_pardo_1 | dataflow_runtime_sec | - | 31.1 | 27.7 | -10.92 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_1 | sparkstructuredstreaming_runtime_sec | - | 69.87 | 60.82
| -12.94 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_2 | dataflow_runtime_sec | - | 186.93 | 179.39 | -4.03 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | dataflow_runtime_sec | - | 21.63 | 22.22 | 2.71 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_4 | dataflow_runtime_sec | - | 34.1 | 32.25 | -5.42 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_cogbk_1 | dataflow_runtime_sec | - | 954.85 | 939.92 | -1.56 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_2 | dataflow_runtime_sec | - | 969.33 | 916.15 | -5.49 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_3 | dataflow_runtime_sec | - | 128.8 | 124.68 | -3.2 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_4 | dataflow_runtime_sec | - | 129.54 | 124.84 | -3.63 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_combine_1 | dataflow_runtime_sec | - | 525.48 | 527.87 | 0.46 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_combine_4 | dataflow_runtime_sec | - | 325.51 | 305.74 | -6.07
| [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_combine_5 | dataflow_runtime_sec | - | 315.83 | 299.42 | -5.2 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_gbk_1 | dataflow_runtime_sec | - | 851.03 | 708.72 | -16.72 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_2 | dataflow_runtime_sec | - | 849.74 | 830.97 | -2.21 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_3 | dataflow_runtime_sec | - | 25.11 | 22.76 | -9.35 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_4 | dataflow_runtime_sec | - | 296.62 | 298.87 | 0.76 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_5 | dataflow_runtime_sec | - | 298.68 | 375.0 | 25.55 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_6 | dataflow_runtime_sec | - | 76.68 | 79.43 | 3.58 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_7 | dataflow_runtime_sec | - | 133.3 | 131.3 | -1.5 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_pardo_1 | dataflow_runtime_sec | - | 19.18 | 19.58 | 2.07 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_2 | dataflow_runtime_sec | - | 216.56 | 213.7 | -1.32 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_3 | dataflow_runtime_sec | - | 11.63 | 12.67 | 8.96 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_4 | dataflow_runtime_sec | - | 30.79 | 30.6 | -0.61 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
jdbcioit_results | read_time | - | 39.52 | 38.0 | -3.84 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
jdbcioit_results | write_time | - | 56.1 | 58.59 | 4.45 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results | read_time | - | 774.25 | 777.1 | 0.37 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results | write_time | - | 192.89 | 199.11 | 3.22 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results_runner_v2 | read_time | - | 2.74 | 2.73 | -0.22 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results_runner_v2 | write_time | - | 10.71 | 10.58 | -1.22 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results_sdf_wrapper | read_time | - | 3.05 | 2.54 | -16.51 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results_sdf_wrapper | write_time | - | 10.96 | 10.36 | -5.46 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_hdfs_results | read_time | - | 26.47 | 24.5 | -7.43 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_hdfs_results | write_time | - | -57721398.01 | 105.02 |
-100.0 | [[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_results | read_time | - | 44.38 | 41.98 | -5.41 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_results | write_time | - | 107.25 | 106.36 | -0.84 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
mongodbioit_results | read_time | - | 27.09 | 23.8 | -12.15 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
mongodbioit_results | write_time | - | 82.28 | 81.7 | -0.7 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_hdfs_results | read_time | - | 115.35 | 120.89 | 4.8 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_hdfs_results | write_time | - | 201.17 | 197.68 | -1.74 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_results | read_time | - | 122.54 | 121.88 | -0.54 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_results | write_time | - | 203.98 | 191.9 | -5.92 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
python_batch_cogbk_1 | python_dataflow_batch_cogbk_1_runtime | - | 494.29 |
475.75 | -3.75 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_2 | python_dataflow_batch_cogbk_2_runtime | - | 324.57 |
324.0 | -0.18 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_3 | python_dataflow_batch_cogbk_3_runtime | - | 294.57 |
290.75 | -1.3 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_4 | python_dataflow_batch_cogbk_4_runtime | - | 304.71 |
286.25 | -6.06 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_combine_1 | python_dataflow_batch_combine_1_runtime | - | 987.57
| 947.25 | -4.08 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_1 | python_flink_batch_combine_1_runtime | - | 4545.8 |
4213.0 | -7.32 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_4 | python_dataflow_batch_combine_4_runtime | - | 36.0 |
37.75 | 4.86 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_4 | python_flink_batch_combine_4_runtime | - | 167.0 |
152.75 | -8.53 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_5 | python_dataflow_batch_combine_5_runtime | - | 34.14 |
35.0 | 2.51 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_5 | python_flink_batch_combine_5_runtime | - | 124.0 |
109.0 | -12.1 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_gbk_1 | python_dataflow_batch_gbk_1_runtime | - | 1957.71 |
1919.0 | -1.98 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_2 | python_dataflow_batch_gbk_2_runtime | - | 363.86 | 358.5
| -1.47 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_3 | python_dataflow_batch_gbk_3_runtime | - | 32.86 | 33.0 |
0.43 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_4 | python_dataflow_batch_gbk_4_runtime | - | 104.86 | 107.25
| 2.28 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_5 | python_dataflow_batch_gbk_5_runtime | - | 106.86 | 98.5 |
-7.82 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_6 | python_dataflow_batch_gbk_6_runtime | - | 411.14 | 396.75
| -3.5 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_7 | python_dataflow_batch_gbk_7_runtime | - | 371.29 | 364.25
| -1.89 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_pardo_1 | python_dataflow_batch_pardo_1_runtime | - | 161.71 |
159.0 | -1.68 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_1 | python_flink_batch_pardo_1_runtime | - | 632.43 | 641.5
| 1.43 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_2 | python_dataflow_batch_pardo_2_runtime | - | 1491.71 |
1479.0 | -0.85 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_3 | python_dataflow_batch_pardo_3_runtime | - | 145.0 |
139.5 | -3.79 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_3 | python_flink_batch_pardo_3_runtime | - | 539.67 | 562.5
| 4.23 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_4 | python_dataflow_batch_pardo_4_runtime | - | 333.43 |
336.75 | 1.0 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_4 | python_flink_batch_pardo_4_runtime | - | 1539.17 |
1592.0 | 3.43 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_sideinput_1 | python_dataflow_batch_sideinput_1_runtime | - |
32.57 | 31.6 | -2.98 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_2 | python_dataflow_batch_sideinput_2_runtime | - |
32.86 | 31.8 | -3.22 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_3 | python_dataflow_batch_sideinput_3_runtime | - |
4.29 | 9.0 | 110.0 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_4 | python_dataflow_batch_sideinput_4_runtime | - |
308.57 | 310.75 | 0.71 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_5 | python_dataflow_batch_sideinput_5_runtime | - |
31.86 | 33.25 | 4.37 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_6 | python_dataflow_batch_sideinput_6_runtime | - |
32.86 | 32.0 | -2.61 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_7 | python_dataflow_batch_sideinput_7_runtime | - |
4313.43 | 4150.0 | -3.79 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_8 | python_dataflow_batch_sideinput_8_runtime | - |
4186.57 | 4122.75 | -1.52 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_bqio_read_10GB_results | bqio_read_10GB_results_runtime | - | 158.57 |
157.0 | -0.99 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_bqio_write_10GB_results | bqio_write_10GB_results_runtime | - | 262.57
| 258.75 | -1.46 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_direct_microbenchmarks | fn_api_runner_microbenchmark_runtime_sec | - |
106.77 | 108.09 | 1.23 |
python_direct_microbenchmarks | teststream_microbenchmark_runtime_sec | - |
366.05 | 355.38 | -2.91 |
python_psio_2GB_results | pubsub_io_perf_read_runtime | - | 99.0 | 154.5 |
56.06 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_psio_2GB_results | pubsub_io_perf_write_runtime | - | 83.57 | 95.75 |
14.57 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_streaming_cogbk_1 | python_dataflow_streaming_cogbk_1_runtime | - |
636.86 | 561.5 | -11.83 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_2 | python_dataflow_streaming_cogbk_2_runtime | - |
348.43 | 353.75 | 1.53 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_3 | python_dataflow_streaming_cogbk_3_runtime | - |
742.57 | 738.25 | -0.58 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_4 | python_dataflow_streaming_cogbk_4_runtime | - |
282.71 | 268.75 | -4.94 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_combine_4 | python_flink_streaming_combine_4_runtime | - |
215.33 | 206.5 | -4.1 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_streaming_combine_5 | python_flink_streaming_combine_5_runtime | - |
212.75 | 194.0 | -8.81 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_streaming_gbk_3 | python_dataflow_streaming_gbk_3_runtime | - | 139.14
| 160.75 | 15.53 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_gbk_6 | python_dataflow_streaming_gbk_6_runtime | - | 447.86
| 499.0 | 11.42 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_gbk_7 | python_dataflow_streaming_gbk_7_runtime | - | 438.43
| 414.5 | -5.46 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_pardo_1 | python_dataflow_streaming_pardo_1_runtime | - |
158.0 | 167.0 | 5.7 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_1 | python_flink_streaming_pardo_5_runtime | - | 141.83
| 170.25 | 20.04 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_2 | python_dataflow_streaming_pardo_2_runtime | - |
2526.33 | 2388.0 | -5.48 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_2 | python_flink_streaming_pardo_2_runtime | - |
3562.83 | 3492.25 | -1.98 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_3 | python_dataflow_streaming_pardo_3_runtime | - |
124.67 | 121.5 | -2.54 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_3 | python_flink_streaming_pardo_3_runtime | - | 233.5
| 207.5 | -11.13 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_4 | python_dataflow_streaming_pardo_4_runtime | - |
455.67 | 443.75 | -2.62 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_4 | python_flink_streaming_pardo_4_runtime | - | 532.33
| 529.0 | -0.63 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_6 | python_flink_streaming_pardo_6_runtime | - | 107.67
| 0.25 | -99.77 |
textioit_hdfs_results | read_time | - | 25.87 | 25.44 | -1.68 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_hdfs_results | write_time | - | 46.73 | 45.3 | -3.05 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_results | read_time | - | 27.76 | 26.66 | -3.96 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_results | write_time | - | 45.9 | 44.51 | -3.03 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
tfrecordioit_results | read_time | - | 25.99 | 27.07 | 4.17 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
tfrecordioit_results | write_time | - | 31.91 | 31.69 | -0.69 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
wordcount_py37_results | runtime | - | 921.88 | 874.51 | -5.14 |
[[1]](http://metrics.beam.apache.org/d/1cnwVDkGk)
xmlioit_hdfs_results | read_time | - | 33.81 | 26.62 | -21.26 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_hdfs_results | write_time | - | 41.73 | 41.16 | -1.36 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_results | read_time | - | 29.96 | 29.03 | -3.09 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_results | write_time | - | 39.56 | 38.59 | -2.45 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
nexmark_0_batch | RuntimeMs | DataflowRunner | 56071.79 | 57359.39 | 2.3 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_batch | RuntimeMs | DirectRunner | 2462.82 | 2415.05 | -1.94 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_batch | RuntimeMs | FlinkRunner | 1042.04 | 1029.06 | -1.25 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_batch | RuntimeMs | SparkRunner | 933.71 | 934.22 | 0.05 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_batch | RuntimeMs | SparkStructuredStreamingRunner | 928.86 | 920.06
| -0.95 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_sql_batch | RuntimeMs | DataflowRunner | 55971.3 | 56039.44 | 0.12 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_sql_batch | RuntimeMs | DirectRunner | 3244.89 | 3238.89 | -0.19 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_sql_batch | RuntimeMs | SparkRunner | 957.04 | 949.89 | -0.75 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1030.43 |
1034.78 | 0.42 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_sql_streaming | RuntimeMs | DataflowRunner | 21692.26 | 21406.11 |
-1.32 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_sql_streaming | RuntimeMs | DirectRunner | 5671.89 | 5579.28 | -1.63
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_sql_streaming | RuntimeMs | FlinkRunner | 1684.75 | 1800.89 | 6.89 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_streaming | RuntimeMs | DataflowRunner | 21056.68 | 21164.06 | 0.51
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_streaming | RuntimeMs | DirectRunner | 4579.39 | 4613.17 | 0.74 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_streaming | RuntimeMs | FlinkRunner | 1466.5 | 1450.39 | -1.1 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_batch | RuntimeMs | DataflowRunner | 172622.3 | 174393.11 |
1.03 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_batch | RuntimeMs | DirectRunner | 4381.79 | 4430.39 | 1.11
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_streaming | RuntimeMs | DataflowRunner | 70705.15 | 70994.72
| 0.41 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_streaming | RuntimeMs | DirectRunner | 6857.14 | 6780.17 |
-1.12 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_streaming | RuntimeMs | FlinkRunner | 3201.39 | 3198.11 |
-0.1 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_batch | RuntimeMs | DataflowRunner | 80356.93 | 78128.17 | -2.77 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_10_batch | RuntimeMs | DirectRunner | 2620.14 | 2617.21 | -0.11 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_batch | RuntimeMs | FlinkRunner | 545.21 | 547.22 | 0.37 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_10_batch | RuntimeMs | SparkRunner | 589.46 | 575.78 | -2.32 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_10_batch | RuntimeMs | SparkStructuredStreamingRunner | 871.75 |
847.67 | -2.76 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_10_streaming | RuntimeMs | DataflowRunner | 90074.96 | 90756.17 | 0.76
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_streaming | RuntimeMs | DirectRunner | 14317.86 | 14246.28 | -0.5 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_streaming | RuntimeMs | FlinkRunner | 1408.89 | 1426.56 | 1.25 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_batch | RuntimeMs | DataflowRunner | 57358.89 | 58792.11 | 2.5 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_11_batch | RuntimeMs | DirectRunner | 2403.32 | 2402.37 | -0.04 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_batch | RuntimeMs | FlinkRunner | 280.43 | 302.33 | 7.81 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_11_batch | RuntimeMs | SparkRunner | 491.0 | 519.94 | 5.89 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_11_batch | RuntimeMs | SparkStructuredStreamingRunner | 573.14 |
600.33 | 4.74 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_11_streaming | RuntimeMs | DataflowRunner | 180281.46 | 187593.89 |
4.06 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_streaming | RuntimeMs | DirectRunner | 3165.61 | 3177.61 | 0.38 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_streaming | RuntimeMs | FlinkRunner | 1490.61 | 1471.61 | -1.27 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_batch | RuntimeMs | DataflowRunner | 42493.54 | 41269.11 | -2.88 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_batch | RuntimeMs | DirectRunner | 1622.75 | 1628.68 | 0.37 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_12_batch | RuntimeMs | FlinkRunner | 184.0 | 174.67 | -5.07 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_12_batch | RuntimeMs | SparkRunner | 196.29 | 195.22 | -0.54 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_12_batch | RuntimeMs | SparkStructuredStreamingRunner | 361.57 |
348.28 | -3.68 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_streaming | RuntimeMs | DataflowRunner | 92506.96 | 95958.0 | 3.73
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_streaming | RuntimeMs | DirectRunner | 2129.75 | 2132.89 | 0.15 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_streaming | RuntimeMs | FlinkRunner | 693.11 | 695.17 | 0.3 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_batch | RuntimeMs | DataflowRunner | 45650.46 | 46233.89 | 1.28 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_batch | RuntimeMs | DirectRunner | 1569.32 | 1570.0 | 0.04 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_batch | RuntimeMs | FlinkRunner | 304.75 | 282.28 | -7.37 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_batch | RuntimeMs | SparkRunner | 233.79 | 234.78 | 0.42 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_batch | RuntimeMs | SparkStructuredStreamingRunner | 347.64 | 322.5
| -7.23 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_sql_batch | RuntimeMs | DataflowRunner | 123130.67 | 110374.28 |
-10.36 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_sql_batch | RuntimeMs | DirectRunner | 4426.54 | 4446.5 | 0.45 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_sql_batch | RuntimeMs | SparkRunner | 1061.71 | 1032.17 | -2.78 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 871.54 |
869.33 | -0.25 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_streaming | RuntimeMs | DataflowRunner | 36175.89 | 36267.89 |
0.25 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_streaming | RuntimeMs | DirectRunner | 5058.18 | 5067.11 | 0.18
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_streaming | RuntimeMs | FlinkRunner | 28768.39 | 29178.33 |
1.42 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_streaming | RuntimeMs | DataflowRunner | 28663.43 | 27252.39 |
-4.92 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_streaming | RuntimeMs | DirectRunner | 2490.0 | 2515.44 | 1.02 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_streaming | RuntimeMs | FlinkRunner | 27011.43 | 26733.44 | -1.03 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_batch | RuntimeMs | DataflowRunner | 362077.41 | 344348.28
| -4.9 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_zetasql_batch | RuntimeMs | DirectRunner | 6645.29 | 6662.72 | 0.26
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_zetasql_streaming | RuntimeMs | DataflowRunner | 128014.22 |
125497.22 | -1.97 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_streaming | RuntimeMs | DirectRunner | 6135.32 | 6172.28 |
0.6 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_streaming | RuntimeMs | FlinkRunner | 33046.18 | 34015.17 |
2.93 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_batch | RuntimeMs | DataflowRunner | 106028.39 | 101062.83 | -4.68
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_14_batch | RuntimeMs | DirectRunner | 2519.36 | 2532.37 | 0.52 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_14_batch | RuntimeMs | FlinkRunner | 495.32 | 483.89 | -2.31 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_14_batch | RuntimeMs | SparkRunner | 760.93 | 755.89 | -0.66 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_14_batch | RuntimeMs | SparkStructuredStreamingRunner | 785.07 |
762.39 | -2.89 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_14_streaming | RuntimeMs | DataflowRunner | 126328.64 | 133756.44 |
5.88 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_streaming | RuntimeMs | DirectRunner | 3282.46 | 3285.17 | 0.08 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_streaming | RuntimeMs | FlinkRunner | 1698.29 | 1692.28 | -0.35 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_batch | RuntimeMs | DataflowRunner | 46745.14 | 46484.78 | -0.56 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_1_batch | RuntimeMs | DirectRunner | 1404.29 | 1386.32 | -1.28 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_1_batch | RuntimeMs | FlinkRunner | 240.25 | 242.72 | 1.03 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_batch | RuntimeMs | SparkRunner | 339.96 | 340.83 | 0.26 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_1_batch | RuntimeMs | SparkStructuredStreamingRunner | 310.93 | 306.72
| -1.35 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_1_sql_batch | RuntimeMs | DataflowRunner | 49599.3 | 54017.56 | 8.91 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_batch | RuntimeMs | DirectRunner | 1789.18 | 1784.78 | -0.25 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_sql_batch | RuntimeMs | SparkRunner | 336.11 | 341.72 | 1.67 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_1_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 428.04 |
420.72 | -1.71 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_1_sql_streaming | RuntimeMs | DataflowRunner | 18314.85 | 18806.33 |
2.68 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_streaming | RuntimeMs | DirectRunner | 3312.32 | 3370.61 | 1.76
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_streaming | RuntimeMs | FlinkRunner | 690.36 | 697.89 | 1.09 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_streaming | RuntimeMs | DataflowRunner | 16387.11 | 16939.56 | 3.37
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_streaming | RuntimeMs | DirectRunner | 3151.61 | 3083.56 | -2.16 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_streaming | RuntimeMs | FlinkRunner | 742.57 | 742.94 | 0.05 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_batch | RuntimeMs | DataflowRunner | 36219.25 | 36619.44 | 1.1 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_batch | RuntimeMs | DirectRunner | 1039.5 | 1031.05 | -0.81 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_batch | RuntimeMs | FlinkRunner | 129.86 | 118.56 | -8.7 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_batch | RuntimeMs | SparkRunner | 114.68 | 111.78 | -2.53 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_batch | RuntimeMs | SparkStructuredStreamingRunner | 137.89 | 147.11
| 6.69 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_sql_batch | RuntimeMs | DataflowRunner | 38693.78 | 39969.61 | 3.3 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_sql_batch | RuntimeMs | DirectRunner | 961.04 | 952.89 | -0.85 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_sql_batch | RuntimeMs | SparkRunner | 170.29 | 179.61 | 5.48 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 214.5 |
221.72 | 3.37 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_sql_streaming | RuntimeMs | DataflowRunner | 12103.19 | 11466.39 |
-5.26 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_streaming | RuntimeMs | DirectRunner | 1730.11 | 1716.78 | -0.77
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_streaming | RuntimeMs | FlinkRunner | 499.39 | 529.56 | 6.04 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_streaming | RuntimeMs | DataflowRunner | 10759.89 | 11529.17 | 7.15
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_streaming | RuntimeMs | DirectRunner | 1500.96 | 1531.28 | 2.02 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_streaming | RuntimeMs | FlinkRunner | 361.25 | 352.56 | -2.41 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_batch | RuntimeMs | DataflowRunner | 99938.3 | 99100.72 |
-0.84 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_batch | RuntimeMs | DirectRunner | 1817.0 | 1820.06 | 0.17 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_zetasql_streaming | RuntimeMs | DataflowRunner | 41059.22 | 39751.67
| -3.18 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_streaming | RuntimeMs | DirectRunner | 3032.18 | 3004.5 |
-0.91 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_streaming | RuntimeMs | FlinkRunner | 1143.64 | 1178.06 |
3.01 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_batch | RuntimeMs | DataflowRunner | 43981.64 | 39996.39 | -9.06 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_batch | RuntimeMs | DirectRunner | 2081.71 | 2129.79 | 2.31 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_batch | RuntimeMs | FlinkRunner | 1045.82 | 1094.17 | 4.62 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_3_batch | RuntimeMs | SparkRunner | 819.61 | 807.94 | -1.42 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_sql_batch | RuntimeMs | DataflowRunner | 46501.59 | 41573.28 | -10.6
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_batch | RuntimeMs | DirectRunner | 2344.04 | 2336.61 | -0.32 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_3_sql_batch | RuntimeMs | SparkRunner | 1054.32 | 1015.22 | -3.71 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_3_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 579.96 |
585.0 | 0.87 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_streaming | RuntimeMs | DataflowRunner | 33060.15 | 32405.17 |
-1.98 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_streaming | RuntimeMs | DirectRunner | 3374.64 | 3319.06 | -1.65
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_streaming | RuntimeMs | FlinkRunner | 892.32 | 889.17 | -0.35 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_streaming | RuntimeMs | DataflowRunner | 18880.32 | 20054.22 | 6.22
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_streaming | RuntimeMs | DirectRunner | 2982.89 | 2932.11 | -1.7 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_streaming | RuntimeMs | FlinkRunner | 511.11 | 497.78 | -2.61 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_batch | RuntimeMs | DataflowRunner | 107281.3 | 99876.33 |
-6.9 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_zetasql_batch | RuntimeMs | DirectRunner | 2452.68 | 2458.94 | 0.26
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_streaming | RuntimeMs | DataflowRunner | 44829.44 | 44151.33
| -1.51 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_streaming | RuntimeMs | DirectRunner | 3626.57 | 3721.33 |
2.61 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_streaming | RuntimeMs | FlinkRunner | 1143.68 | 1159.28 |
1.36 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_batch | RuntimeMs | DataflowRunner | 51405.43 | 49066.94 | -4.55 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_4_batch | RuntimeMs | DirectRunner | 1554.82 | 1534.26 | -1.32 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_4_batch | RuntimeMs | FlinkRunner | 832.64 | 845.17 | 1.5 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_4_batch | RuntimeMs | SparkRunner | 550.18 | 552.89 | 0.49 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_4_batch | RuntimeMs | SparkStructuredStreamingRunner | 1033.68 |
1006.72 | -2.61 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_4_streaming | RuntimeMs | DataflowRunner | 51374.21 | 51219.06 | -0.3
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_streaming | RuntimeMs | DirectRunner | 1297.43 | 1252.83 | -3.44 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_streaming | RuntimeMs | FlinkRunner | 1197.18 | 1210.5 | 1.11 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_batch | RuntimeMs | DataflowRunner | 61751.93 | 60464.83 | -2.08 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_5_batch | RuntimeMs | DirectRunner | 6480.64 | 6514.11 | 0.52 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_batch | RuntimeMs | FlinkRunner | 705.68 | 733.61 | 3.96 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_batch | RuntimeMs | SparkRunner | 599.54 | 588.22 | -1.89 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_5_batch | RuntimeMs | SparkStructuredStreamingRunner | 1222.11 |
1145.28 | -6.29 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_5_streaming | RuntimeMs | DataflowRunner | 126195.64 | 124276.39 |
-1.52 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_streaming | RuntimeMs | DirectRunner | 7147.43 | 7186.78 | 0.55 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_streaming | RuntimeMs | FlinkRunner | 1335.46 | 1368.0 | 2.44 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_batch | RuntimeMs | DataflowRunner | 53447.93 | 46124.28 | -13.7 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_6_batch | RuntimeMs | DirectRunner | 1074.89 | 1081.84 | 0.65 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_6_batch | RuntimeMs | FlinkRunner | 467.57 | 457.06 | -2.25 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_6_batch | RuntimeMs | SparkRunner | 309.57 | 317.06 | 2.42 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_batch | RuntimeMs | SparkStructuredStreamingRunner | 289.68 | 295.5
| 2.01 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_6_streaming | RuntimeMs | DataflowRunner | 42667.04 | 45459.11 | 6.54
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_streaming | RuntimeMs | DirectRunner | 950.93 | 956.5 | 0.59 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_streaming | RuntimeMs | FlinkRunner | 617.82 | 653.78 | 5.82 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_batch | RuntimeMs | DataflowRunner | 84587.39 | 79215.72 | -6.35 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_batch | RuntimeMs | DirectRunner | 3263.75 | 3339.47 | 2.32 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_batch | RuntimeMs | FlinkRunner | 540.5 | 539.72 | -0.14 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_batch | RuntimeMs | SparkRunner | 416.25 | 421.39 | 1.23 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_batch | RuntimeMs | SparkStructuredStreamingRunner | 1558.39 |
1471.56 | -5.57 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_sql_batch | RuntimeMs | DataflowRunner | 130222.96 | 126147.33 |
-3.13 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_sql_batch | RuntimeMs | DirectRunner | 89286.82 | 89640.56 | 0.4 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_batch | RuntimeMs | SparkRunner | 2382.82 | 2389.61 | 0.28 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 2794.18 |
2824.72 | 1.09 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_sql_streaming | RuntimeMs | DataflowRunner | 1088375.85 | 1093456.17
| 0.47 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_streaming | RuntimeMs | DirectRunner | 103909.86 | 103620.67 |
-0.28 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_streaming | RuntimeMs | FlinkRunner | 3889.61 | 3914.11 | 0.63 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_streaming | RuntimeMs | DataflowRunner | 105814.29 | 107285.33 |
1.39 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_streaming | RuntimeMs | DirectRunner | 7658.18 | 7633.39 | -0.32 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_streaming | RuntimeMs | FlinkRunner | 9679.0 | 7208.78 | -25.52 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_batch | RuntimeMs | DataflowRunner | 48650.14 | 42405.22 | -12.84 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_8_batch | RuntimeMs | DirectRunner | 1500.07 | 1504.42 | 0.29 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_8_batch | RuntimeMs | FlinkRunner | 468.32 | 485.17 | 3.6 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_batch | RuntimeMs | SparkRunner | 389.36 | 386.5 | -0.73 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_batch | RuntimeMs | SparkStructuredStreamingRunner | 356.11 | 354.89
| -0.34 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_8_streaming | RuntimeMs | DataflowRunner | 45140.43 | 46662.11 | 3.37
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_streaming | RuntimeMs | DirectRunner | 2447.82 | 2441.67 | -0.25 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_streaming | RuntimeMs | FlinkRunner | 432.18 | 444.11 | 2.76 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_batch | RuntimeMs | DataflowRunner | 46934.75 | 46189.5 | -1.59 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_9_batch | RuntimeMs | DirectRunner | 691.79 | 693.21 | 0.21 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_9_batch | RuntimeMs | FlinkRunner | 317.57 | 309.11 | -2.66 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_9_batch | RuntimeMs | SparkRunner | 196.79 | 199.67 | 1.46 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_batch | RuntimeMs | SparkStructuredStreamingRunner | 178.0 | 169.11
| -4.99 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_9_streaming | RuntimeMs | DataflowRunner | 32820.18 | 34595.39 | 5.41
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_streaming | RuntimeMs | DirectRunner | 652.89 | 653.11 | 0.03 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_streaming | RuntimeMs | FlinkRunner | 398.5 | 396.78 | -0.43 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)