You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/11/02 12:01:14 UTC
Beam Metrics Report (2020-11-02)
# Beam Metrics Report
Color legend: >= 20 | >= 10 | <= -10 | <= -20
---|---|---|---
## Possible regression
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
java_batch_cogbk_1 | dataflow_runtime_sec | - | 74.91 | 86.09 | 14.92 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | dataflow_runtime_sec | - | 29.07 | 44.02 | 51.47 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | dataflow_runtime_sec | - | 29.93 | 34.42 | 15.01 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_gbk_2 | dataflow_runtime_sec | - | 59.48 | 68.81 | 15.68 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_runtime_sec | - | 31.17 | 35.54 | 14.02 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | dataflow_runtime_sec | - | 32.82 | 39.68 | 20.87 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | dataflow_runtime_sec | - | 32.0 | 36.65 | 14.51 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | dataflow_runtime_sec | - | 104.52 | 118.2 | 13.08 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_pardo_1 | dataflow_runtime_sec | - | 27.39 | 30.43 | 11.1 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_1 | sparkstructuredstreaming_runtime_sec | - | 57.51 | 64.83
| 12.73 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | dataflow_runtime_sec | - | 21.86 | 24.13 | 10.39 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
mongodbioit_results | read_time | - | 31.17 | 34.68 | 11.28 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
python_batch_cogbk_2 | python_dataflow_batch_cogbk_2_runtime | - | 310.43 |
434.0 | 39.81 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_3 | python_dataflow_batch_cogbk_3_runtime | - | 288.43 |
342.75 | 18.83 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_combine_4 | python_dataflow_batch_combine_4_runtime | - | 37.86 |
45.0 | 18.87 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_5 | python_dataflow_batch_combine_5_runtime | - | 31.43 |
36.75 | 16.93 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_sideinput_8 | python_dataflow_batch_sideinput_8_runtime | - |
221.57 | 246.0 | 11.03 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_psio_2GB_results | pubsub_io_perf_read_runtime | - | 94.43 | 181.67 |
92.39 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_psio_2GB_results | pubsub_io_perf_write_runtime | - | 79.0 | 112.33 |
42.19 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_streaming_cogbk_2 | python_dataflow_streaming_cogbk_2_runtime | - |
399.29 | 459.0 | 14.96 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_gbk_7 | python_dataflow_streaming_gbk_7_runtime | - | 477.57
| 554.0 | 16.0 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
tfrecordioit_results | read_time | - | 25.06 | 27.69 | 10.46 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
wordcount_py37_results | runtime | - | 798.95 | 898.24 | 12.43 |
[[1]](http://metrics.beam.apache.org/d/1cnwVDkGk)
xmlioit_results | write_time | - | 38.76 | 44.59 | 15.04 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
nexmark_0_batch | RuntimeMs | DataflowRunner | 61393.0 | 72098.72 | 17.44 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_sql_batch | RuntimeMs | DataflowRunner | 60917.75 | 70525.44 | 15.77
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_batch | RuntimeMs | DataflowRunner | 86770.36 | 97603.28 | 12.48 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_batch | RuntimeMs | DataflowRunner | 58579.89 | 72442.72 | 23.66 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_batch | RuntimeMs | DataflowRunner | 41991.29 | 50554.11 | 20.39 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_batch | RuntimeMs | DataflowRunner | 50947.21 | 56536.72 | 10.97 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_1_batch | RuntimeMs | DataflowRunner | 52126.21 | 62015.83 | 18.97 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_sql_batch | RuntimeMs | DataflowRunner | 56501.61 | 65332.67 | 15.63
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_batch | RuntimeMs | DataflowRunner | 36837.96 | 46857.89 | 27.2 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_sql_batch | RuntimeMs | DataflowRunner | 39811.46 | 48502.11 | 21.83
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_batch | RuntimeMs | DataflowRunner | 47179.32 | 56850.61 | 20.5 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_3_sql_batch | RuntimeMs | DataflowRunner | 43027.04 | 52122.17 | 21.14
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_batch | RuntimeMs | DataflowRunner | 50450.36 | 60878.89 | 20.67 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_4_batch | RuntimeMs | SparkStructuredStreamingRunner | 1100.29 |
1238.94 | 12.6 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_batch | RuntimeMs | DataflowRunner | 66469.0 | 74471.56 | 12.04 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_6_batch | RuntimeMs | DataflowRunner | 46770.14 | 59438.44 | 27.09 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_batch | RuntimeMs | DataflowRunner | 85371.86 | 100994.11 | 18.3 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_batch | RuntimeMs | DataflowRunner | 46607.46 | 59573.5 | 27.82 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_9_batch | RuntimeMs | DataflowRunner | 47333.54 | 56532.17 | 19.43 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
## Possible improvement
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
java_batch_gbk_2 | sparkstructuredstreaming_runtime_sec | - | 140.35 | 118.39
| -15.65 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | sparkstructuredstreaming_runtime_sec | - | 73.46 | 63.93 |
-12.97 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_sideinput_2 | python_dataflow_batch_sideinput_2_runtime | - |
3.43 | 3.0 | -12.5 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_streaming_cogbk_1 | python_dataflow_streaming_cogbk_1_runtime | - |
826.71 | 630.5 | -23.73 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_3 | python_dataflow_streaming_cogbk_3_runtime | - |
1161.0 | 754.67 | -35.0 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_4 | python_dataflow_streaming_cogbk_4_runtime | - |
349.29 | 265.0 | -24.13 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_pardo_6 | python_flink_streaming_pardo_6_runtime | - | 114.8
| 83.5 | -27.26 |
nexmark_0_streaming | RuntimeMs | DataflowRunner | 36884.75 | 23598.06 |
-36.02 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_batch | RuntimeMs | DataflowRunner | 1279082.18 | 606199.47
| -52.61 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_zetasql_batch | RuntimeMs | DirectRunner | 16111.86 | 11331.61 |
-29.67 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_streaming | RuntimeMs | DataflowRunner | 558314.22 |
268959.0 | -51.83 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_streaming | RuntimeMs | DirectRunner | 18138.82 | 12949.33 |
-28.61 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_streaming | RuntimeMs | FlinkRunner | 15775.96 | 9830.67 |
-37.69 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_batch | RuntimeMs | FlinkRunner | 324.46 | 271.22 | -16.41 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_streaming | RuntimeMs | DataflowRunner | 109037.86 | 97859.5 |
-10.25 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_streaming | RuntimeMs | DataflowRunner | 52580.89 | 42311.71 |
-19.53 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_streaming | RuntimeMs | DataflowRunner | 41108.86 | 29335.94 |
-28.64 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_batch | RuntimeMs | DataflowRunner | 3237579.21 | 1285232.0
| -60.3 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_batch | RuntimeMs | DirectRunner | 33380.5 | 20623.83 |
-38.22 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_zetasql_streaming | RuntimeMs | DataflowRunner | 1134108.11 |
511929.71 | -54.86 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_streaming | RuntimeMs | DirectRunner | 27437.61 | 17437.67
| -36.45 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_streaming | RuntimeMs | FlinkRunner | 25820.96 | 16731.22 |
-35.2 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_streaming | RuntimeMs | DataflowRunner | 35281.0 | 23413.88 |
-33.64 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_batch | RuntimeMs | FlinkRunner | 140.18 | 110.39 | -21.25 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_batch | RuntimeMs | SparkStructuredStreamingRunner | 208.39 | 185.89
| -10.8 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_sql_streaming | RuntimeMs | DataflowRunner | 26574.75 | 14098.65 |
-46.95 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_batch | RuntimeMs | DataflowRunner | 1127186.54 | 487373.59
| -56.76 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_zetasql_batch | RuntimeMs | DirectRunner | 12980.89 | 7946.5 |
-38.78 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_zetasql_streaming | RuntimeMs | DataflowRunner | 494264.11 |
210465.82 | -57.42 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_streaming | RuntimeMs | DirectRunner | 13245.04 | 8644.39 |
-34.73 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_streaming | RuntimeMs | FlinkRunner | 13352.21 | 7842.33 |
-41.27 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_streaming | RuntimeMs | DataflowRunner | 52341.18 | 39434.59 |
-24.66 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_batch | RuntimeMs | DataflowRunner | 186295.5 | 124852.76 |
-32.98 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_batch | RuntimeMs | DirectRunner | 3838.32 | 3095.28 |
-19.36 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_streaming | RuntimeMs | DataflowRunner | 108015.93 |
60701.06 | -43.8 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_streaming | RuntimeMs | DirectRunner | 5061.86 | 4437.78 |
-12.33 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_streaming | RuntimeMs | FlinkRunner | 2404.21 | 1709.06 |
-28.91 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_streaming | RuntimeMs | DataflowRunner | 128671.14 | 112902.06 |
-12.26 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_streaming | RuntimeMs | DataflowRunner | 52034.39 | 39731.89 |
-23.64 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
## All metrics
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
avroioit_hdfs_results | read_time | - | 123.02 | 122.03 | -0.8 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_hdfs_results | write_time | - | 177.85 | 181.29 | 1.93 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_results | read_time | - | 118.98 | 121.76 | 2.34 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_results | write_time | - | 166.14 | 171.62 | 3.3 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_avro | avro_write_time | - | 55.33 | 55.06 |
-0.48 | [[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_avro | read_time | - | 76.35 | 70.64 | -7.48 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_json | read_time | - | 61.74 | 65.65 | 6.34 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_json | write_time | - | 104.41 | 100.68 | -3.58 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_stream | read_time | - | 0.0 | 0.0 | 0.0 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_stream | write_time | - | 120.09 | 121.08 | 0.82 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_hdfs_results | read_time | - | 217.3 | 215.35 | -0.9 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_hdfs_results | write_time | - | 300.61 | 310.79 | 3.39 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_results | read_time | - | 201.97 | 210.94 | 4.44 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_results | write_time | - | 285.27 | 286.27 | 0.35 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
java_batch_cogbk_1 | dataflow_runtime_sec | - | 74.91 | 86.09 | 14.92 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_1 | sparkstructuredstreaming_runtime_sec | - | 145.47 |
140.92 | -3.13 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | dataflow_runtime_sec | - | 74.54 | 75.81 | 1.7 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | sparkstructuredstreaming_runtime_sec | - | 135.35 |
133.66 | -1.25 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | dataflow_runtime_sec | - | 29.07 | 44.02 | 51.47 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | sparkstructuredstreaming_runtime_sec | - | 21.32 | 20.65
| -3.15 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | dataflow_runtime_sec | - | 29.93 | 34.42 | 15.01 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | sparkstructuredstreaming_runtime_sec | - | 22.2 | 20.91 |
-5.8 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_combine_1 | dataflow_runtime_sec | - | 86.36 | 91.91 | 6.43 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_1 | sparkstructuredstreaming_runtime_sec | - | 768.99 |
811.38 | 5.51 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_4 | dataflow_runtime_sec | - | 37.25 | 40.97 | 9.99 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_4 | sparkstructuredstreaming_runtime_sec | - | 156.48 |
146.81 | -6.18 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_5 | dataflow_runtime_sec | - | 37.25 | 40.67 | 9.17 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_5 | sparkstructuredstreaming_runtime_sec | - | 155.86 |
152.64 | -2.07 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_gbk_1 | dataflow_runtime_sec | - | 255.09 | 267.13 | 4.72 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_1 | sparkstructuredstreaming_runtime_sec | - | 752.38 | 762.48
| 1.34 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | dataflow_runtime_sec | - | 59.48 | 68.81 | 15.68 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | sparkstructuredstreaming_runtime_sec | - | 140.35 | 118.39
| -15.65 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_runtime_sec | - | 31.17 | 35.54 | 14.02 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | sparkstructuredstreaming_runtime_sec | - | 9.53 | 9.44 |
-1.0 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | dataflow_runtime_sec | - | 32.82 | 39.68 | 20.87 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | sparkstructuredstreaming_runtime_sec | - | 120.5 | 119.25 |
-1.04 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | dataflow_runtime_sec | - | 32.0 | 36.65 | 14.51 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | sparkstructuredstreaming_runtime_sec | - | 119.04 | 114.76
| -3.6 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | dataflow_runtime_sec | - | 77.55 | 70.14 | -9.55 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | sparkstructuredstreaming_runtime_sec | - | 73.46 | 63.93 |
-12.97 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | dataflow_runtime_sec | - | 104.52 | 118.2 | 13.08 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | sparkstructuredstreaming_runtime_sec | - | 109.84 | 109.39
| -0.41 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_pardo_1 | dataflow_runtime_sec | - | 27.39 | 30.43 | 11.1 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_1 | sparkstructuredstreaming_runtime_sec | - | 57.51 | 64.83
| 12.73 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_2 | dataflow_runtime_sec | - | 188.23 | 192.31 | 2.17 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | dataflow_runtime_sec | - | 21.86 | 24.13 | 10.39 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_4 | dataflow_runtime_sec | - | 33.16 | 35.21 | 6.2 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_cogbk_1 | dataflow_runtime_sec | - | 1018.97 | 1017.92 | -0.1 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_2 | dataflow_runtime_sec | - | 993.38 | 1038.89 | 4.58 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_3 | dataflow_runtime_sec | - | 135.93 | 149.04 | 9.65 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_4 | dataflow_runtime_sec | - | 137.13 | 133.63 | -2.55 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_combine_1 | dataflow_runtime_sec | - | 572.05 | 601.15 | 5.09 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_combine_4 | dataflow_runtime_sec | - | 324.29 | 332.52 | 2.54 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_combine_5 | dataflow_runtime_sec | - | 341.04 | 333.82 | -2.12
| [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_gbk_1 | dataflow_runtime_sec | - | 943.28 | 881.56 | -6.54 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_2 | dataflow_runtime_sec | - | 923.02 | 946.47 | 2.54 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_3 | dataflow_runtime_sec | - | 27.34 | 26.28 | -3.87 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_4 | dataflow_runtime_sec | - | 318.29 | 331.16 | 4.04 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_5 | dataflow_runtime_sec | - | 317.36 | 329.29 | 3.76 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_6 | dataflow_runtime_sec | - | 86.76 | 88.14 | 1.6 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_7 | dataflow_runtime_sec | - | 153.76 | 143.79 | -6.48 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_pardo_1 | dataflow_runtime_sec | - | 19.95 | 19.19 | -3.81 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_2 | dataflow_runtime_sec | - | 214.02 | 221.19 | 3.35 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_3 | dataflow_runtime_sec | - | 12.62 | 13.01 | 3.07 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_4 | dataflow_runtime_sec | - | 31.4 | 30.74 | -2.11 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
jdbcioit_results | read_time | - | 36.53 | 36.09 | -1.22 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
jdbcioit_results | write_time | - | 56.72 | 57.99 | 2.24 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results | read_time | - | 800.27 | 756.98 | -5.41 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results | write_time | - | 180.72 | 180.57 | -0.09 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_hdfs_results | read_time | - | 22.32 | 24.26 | 8.68 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_hdfs_results | write_time | - | 110.64 | 112.64 | 1.81 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_results | read_time | - | 55.86 | 55.65 | -0.38 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_results | write_time | - | 122.37 | 122.12 | -0.2 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
mongodbioit_results | read_time | - | 31.17 | 34.68 | 11.28 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
mongodbioit_results | write_time | - | 73.12 | 73.65 | 0.72 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_hdfs_results | read_time | - | 121.05 | 112.48 | -7.08 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_hdfs_results | write_time | - | 195.63 | 197.32 | 0.87 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_results | read_time | - | 118.41 | 121.29 | 2.43 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_results | write_time | - | 192.02 | 193.95 | 1.01 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
python_batch_cogbk_1 | python_dataflow_batch_cogbk_1_runtime | - | 470.86 |
477.5 | 1.41 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_2 | python_dataflow_batch_cogbk_2_runtime | - | 310.43 |
434.0 | 39.81 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_3 | python_dataflow_batch_cogbk_3_runtime | - | 288.43 |
342.75 | 18.83 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_4 | python_dataflow_batch_cogbk_4_runtime | - | 299.29 |
302.75 | 1.16 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_combine_1 | python_dataflow_batch_combine_1_runtime | - | 918.57
| 918.5 | -0.01 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_1 | python_flink_batch_combine_1_runtime | - | 4870.29 |
5164.75 | 6.05 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_4 | python_dataflow_batch_combine_4_runtime | - | 37.86 |
45.0 | 18.87 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_4 | python_flink_batch_combine_4_runtime | - | 184.4 |
171.0 | -7.27 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_5 | python_dataflow_batch_combine_5_runtime | - | 31.43 |
36.75 | 16.93 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_5 | python_flink_batch_combine_5_runtime | - | 144.0 |
147.67 | 2.55 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_gbk_1 | python_dataflow_batch_gbk_1_runtime | - | 1946.57 |
1960.0 | 0.69 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_2 | python_dataflow_batch_gbk_2_runtime | - | 346.0 | 356.5 |
3.03 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_3 | python_dataflow_batch_gbk_3_runtime | - | 31.0 | 31.25 |
0.81 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_4 | python_dataflow_batch_gbk_4_runtime | - | 105.14 | 104.75
| -0.37 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_5 | python_dataflow_batch_gbk_5_runtime | - | 101.14 | 111.25
| 9.99 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_6 | python_dataflow_batch_gbk_6_runtime | - | 394.14 | 403.75
| 2.44 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_7 | python_dataflow_batch_gbk_7_runtime | - | 362.43 | 383.0
| 5.68 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_pardo_1 | python_dataflow_batch_pardo_1_runtime | - | 164.43 |
159.25 | -3.15 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_1 | python_flink_batch_pardo_1_runtime | - | 799.29 | 769.5
| -3.73 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_2 | python_dataflow_batch_pardo_2_runtime | - | 1366.14 |
1367.5 | 0.1 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_3 | python_dataflow_batch_pardo_3_runtime | - | 137.71 |
142.25 | 3.29 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_3 | python_flink_batch_pardo_3_runtime | - | 697.0 | 665.0
| -4.59 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_4 | python_dataflow_batch_pardo_4_runtime | - | 334.14 |
351.75 | 5.27 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_4 | python_flink_batch_pardo_4_runtime | - | 2362.86 |
2322.5 | -1.71 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_sideinput_1 | python_dataflow_batch_sideinput_1_runtime | - |
3.43 | 3.2 | -6.67 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_10 | python_dataflow_batch_sideinput_10_runtime | - |
1506.71 | 1422.75 | -5.57 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_2 | python_dataflow_batch_sideinput_2_runtime | - |
3.43 | 3.0 | -12.5 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_3 | python_dataflow_batch_sideinput_3_runtime | - |
25.0 | 23.2 | -7.2 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_4 | python_dataflow_batch_sideinput_4_runtime | - |
25.14 | 23.75 | -5.54 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_5 | python_dataflow_batch_sideinput_5_runtime | - |
3.14 | 3.0 | -4.55 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_6 | python_dataflow_batch_sideinput_6_runtime | - |
3.29 | 3.25 | -1.09 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_7 | python_dataflow_batch_sideinput_7_runtime | - |
211.0 | 225.5 | 6.87 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_8 | python_dataflow_batch_sideinput_8_runtime | - |
221.57 | 246.0 | 11.03 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_9 | python_dataflow_batch_sideinput_9_runtime | - |
1253.57 | 1299.0 | 3.62 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_bqio_read_10GB_results | bqio_read_10GB_results_runtime | - | 164.43 |
172.75 | 5.06 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_bqio_write_10GB_results | bqio_write_10GB_results_runtime | - | 264.29
| 277.5 | 5.0 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_psio_2GB_results | pubsub_io_perf_read_runtime | - | 94.43 | 181.67 |
92.39 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_psio_2GB_results | pubsub_io_perf_write_runtime | - | 79.0 | 112.33 |
42.19 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_streaming_cogbk_1 | python_dataflow_streaming_cogbk_1_runtime | - |
826.71 | 630.5 | -23.73 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_2 | python_dataflow_streaming_cogbk_2_runtime | - |
399.29 | 459.0 | 14.96 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_3 | python_dataflow_streaming_cogbk_3_runtime | - |
1161.0 | 754.67 | -35.0 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_4 | python_dataflow_streaming_cogbk_4_runtime | - |
349.29 | 265.0 | -24.13 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_combine_4 | python_flink_streaming_combine_4_runtime | - |
243.0 | 230.75 | -5.04 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_streaming_combine_5 | python_flink_streaming_combine_5_runtime | - |
221.25 | 220.5 | -0.34 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_streaming_gbk_3 | python_dataflow_streaming_gbk_3_runtime | - | 159.43
| 174.5 | 9.45 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_gbk_6 | python_dataflow_streaming_gbk_6_runtime | - | 495.14
| 505.0 | 1.99 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_gbk_7 | python_dataflow_streaming_gbk_7_runtime | - | 477.57
| 554.0 | 16.0 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_pardo_1 | python_dataflow_streaming_pardo_1_runtime | - |
242.86 | 246.75 | 1.6 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_1 | python_flink_streaming_pardo_5_runtime | - | 153.33
| 162.0 | 5.65 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_2 | python_dataflow_streaming_pardo_2_runtime | - |
3277.0 | 3149.75 | -3.88 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_2 | python_flink_streaming_pardo_2_runtime | - | 4180.4
| 4423.25 | 5.81 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_3 | python_dataflow_streaming_pardo_3_runtime | - |
191.83 | 197.5 | 2.95 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_3 | python_flink_streaming_pardo_3_runtime | - | 270.8
| 260.0 | -3.99 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_4 | python_dataflow_streaming_pardo_4_runtime | - |
631.33 | 659.67 | 4.49 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_4 | python_flink_streaming_pardo_4_runtime | - | 692.8
| 649.75 | -6.21 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_6 | python_flink_streaming_pardo_6_runtime | - | 114.8
| 83.5 | -27.26 |
textioit_hdfs_results | read_time | - | 27.59 | 27.15 | -1.59 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_hdfs_results | write_time | - | 50.11 | 53.26 | 6.29 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_results | read_time | - | 25.35 | 27.62 | 8.92 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_results | write_time | - | 47.07 | 47.23 | 0.35 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
tfrecordioit_results | read_time | - | 25.06 | 27.69 | 10.46 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
tfrecordioit_results | write_time | - | 34.05 | 32.39 | -4.9 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
wordcount_py37_results | runtime | - | 798.95 | 898.24 | 12.43 |
[[1]](http://metrics.beam.apache.org/d/1cnwVDkGk)
xmlioit_hdfs_results | read_time | - | 26.2 | 26.66 | 1.74 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_hdfs_results | write_time | - | 41.41 | 43.9 | 6.0 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_results | read_time | - | 28.34 | 28.22 | -0.39 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_results | write_time | - | 38.76 | 44.59 | 15.04 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
nexmark_0_batch | RuntimeMs | DataflowRunner | 61393.0 | 72098.72 | 17.44 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_batch | RuntimeMs | DirectRunner | 2611.29 | 2617.56 | 0.24 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_batch | RuntimeMs | FlinkRunner | 1147.82 | 1135.33 | -1.09 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_batch | RuntimeMs | SparkRunner | 1254.36 | 1246.61 | -0.62 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_batch | RuntimeMs | SparkStructuredStreamingRunner | 1102.54 |
1105.11 | 0.23 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_sql_batch | RuntimeMs | DataflowRunner | 60917.75 | 70525.44 | 15.77
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_sql_batch | RuntimeMs | DirectRunner | 3858.32 | 3745.78 | -2.92 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_sql_batch | RuntimeMs | SparkRunner | 1102.75 | 1105.22 | 0.22 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1146.5 |
1129.94 | -1.44 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_sql_streaming | RuntimeMs | DataflowRunner | 25178.04 | 26174.12 |
3.96 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_sql_streaming | RuntimeMs | DirectRunner | 6660.04 | 6528.33 | -1.98
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_sql_streaming | RuntimeMs | FlinkRunner | 1761.57 | 1750.5 | -0.63 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_streaming | RuntimeMs | DataflowRunner | 36884.75 | 23598.06 |
-36.02 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_streaming | RuntimeMs | DirectRunner | 5125.79 | 5067.11 | -1.14 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_streaming | RuntimeMs | FlinkRunner | 1596.64 | 1575.39 | -1.33 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_batch | RuntimeMs | DataflowRunner | 1279082.18 | 606199.47
| -52.61 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_zetasql_batch | RuntimeMs | DirectRunner | 16111.86 | 11331.61 |
-29.67 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_streaming | RuntimeMs | DataflowRunner | 558314.22 |
268959.0 | -51.83 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_streaming | RuntimeMs | DirectRunner | 18138.82 | 12949.33 |
-28.61 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_streaming | RuntimeMs | FlinkRunner | 15775.96 | 9830.67 |
-37.69 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_batch | RuntimeMs | DataflowRunner | 86770.36 | 97603.28 | 12.48 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_batch | RuntimeMs | DirectRunner | 2866.5 | 2888.44 | 0.77 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_10_batch | RuntimeMs | FlinkRunner | 629.0 | 596.67 | -5.14 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_10_batch | RuntimeMs | SparkRunner | 619.29 | 621.78 | 0.4 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_batch | RuntimeMs | SparkStructuredStreamingRunner | 903.64 |
929.06 | 2.81 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_streaming | RuntimeMs | DataflowRunner | 101228.89 | 99558.94 |
-1.65 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_streaming | RuntimeMs | DirectRunner | 15078.86 | 14946.72 | -0.88
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_streaming | RuntimeMs | FlinkRunner | 1372.82 | 1355.61 | -1.25 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_batch | RuntimeMs | DataflowRunner | 58579.89 | 72442.72 | 23.66 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_batch | RuntimeMs | DirectRunner | 2615.04 | 2616.06 | 0.04 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_11_batch | RuntimeMs | FlinkRunner | 324.46 | 271.22 | -16.41 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_batch | RuntimeMs | SparkRunner | 529.39 | 513.44 | -3.01 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_11_batch | RuntimeMs | SparkStructuredStreamingRunner | 623.75 |
616.83 | -1.11 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_streaming | RuntimeMs | DataflowRunner | 205441.68 | 208039.72 |
1.26 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_streaming | RuntimeMs | DirectRunner | 3412.54 | 3307.28 | -3.08 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_streaming | RuntimeMs | FlinkRunner | 1453.68 | 1416.11 | -2.58 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_batch | RuntimeMs | DataflowRunner | 41991.29 | 50554.11 | 20.39 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_12_batch | RuntimeMs | DirectRunner | 1764.93 | 1753.39 | -0.65 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_12_batch | RuntimeMs | FlinkRunner | 199.29 | 202.06 | 1.39 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_12_batch | RuntimeMs | SparkRunner | 207.64 | 211.28 | 1.75 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_batch | RuntimeMs | SparkStructuredStreamingRunner | 354.61 |
378.17 | 6.64 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_12_streaming | RuntimeMs | DataflowRunner | 109037.86 | 97859.5 |
-10.25 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_streaming | RuntimeMs | DirectRunner | 2291.14 | 2244.5 | -2.04 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_streaming | RuntimeMs | FlinkRunner | 646.29 | 635.5 | -1.67 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_batch | RuntimeMs | DataflowRunner | 50947.21 | 56536.72 | 10.97 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_batch | RuntimeMs | DirectRunner | 1664.61 | 1679.61 | 0.9 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_batch | RuntimeMs | FlinkRunner | 356.96 | 348.28 | -2.43 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_batch | RuntimeMs | SparkRunner | 294.11 | 290.39 | -1.26 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_batch | RuntimeMs | SparkStructuredStreamingRunner | 411.36 |
433.17 | 5.3 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_batch | RuntimeMs | DataflowRunner | 118455.96 | 116452.44 |
-1.69 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_sql_batch | RuntimeMs | DirectRunner | 4781.46 | 4808.11 | 0.56 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_sql_batch | RuntimeMs | SparkRunner | 1136.07 | 1138.94 | 0.25 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1003.46 |
991.78 | -1.16 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_streaming | RuntimeMs | DataflowRunner | 52580.89 | 42311.71 |
-19.53 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_streaming | RuntimeMs | DirectRunner | 5642.79 | 5509.83 |
-2.36 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_streaming | RuntimeMs | FlinkRunner | 2862.0 | 2842.0 | -0.7 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_streaming | RuntimeMs | DataflowRunner | 41108.86 | 29335.94 |
-28.64 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_streaming | RuntimeMs | DirectRunner | 2683.32 | 2651.89 | -1.17 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_streaming | RuntimeMs | FlinkRunner | 1337.04 | 1334.61 | -0.18 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_batch | RuntimeMs | DataflowRunner | 3237579.21 | 1285232.0
| -60.3 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_batch | RuntimeMs | DirectRunner | 33380.5 | 20623.83 |
-38.22 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_zetasql_streaming | RuntimeMs | DataflowRunner | 1134108.11 |
511929.71 | -54.86 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_streaming | RuntimeMs | DirectRunner | 27437.61 | 17437.67
| -36.45 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_streaming | RuntimeMs | FlinkRunner | 25820.96 | 16731.22 |
-35.2 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_batch | RuntimeMs | DataflowRunner | 112388.18 | 122254.5 | 8.78 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_14_batch | RuntimeMs | DirectRunner | 2739.61 | 2797.89 | 2.13 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_14_batch | RuntimeMs | FlinkRunner | 556.18 | 518.78 | -6.72 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_14_batch | RuntimeMs | SparkRunner | 842.18 | 836.78 | -0.64 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_batch | RuntimeMs | SparkStructuredStreamingRunner | 843.21 |
869.67 | 3.14 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_streaming | RuntimeMs | DataflowRunner | 166905.5 | 158995.89 |
-4.74 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_streaming | RuntimeMs | DirectRunner | 3544.82 | 3500.17 | -1.26 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_streaming | RuntimeMs | FlinkRunner | 1194.07 | 1195.0 | 0.08 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_batch | RuntimeMs | DataflowRunner | 52126.21 | 62015.83 | 18.97 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_batch | RuntimeMs | DirectRunner | 1716.07 | 1625.33 | -5.29 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_batch | RuntimeMs | FlinkRunner | 300.82 | 289.17 | -3.87 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_batch | RuntimeMs | SparkRunner | 314.64 | 318.83 | 1.33 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_batch | RuntimeMs | SparkStructuredStreamingRunner | 401.18 | 384.89
| -4.06 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_sql_batch | RuntimeMs | DataflowRunner | 56501.61 | 65332.67 | 15.63
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_batch | RuntimeMs | DirectRunner | 2433.04 | 2340.56 | -3.8 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_sql_batch | RuntimeMs | SparkRunner | 446.18 | 439.5 | -1.5 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 540.79 |
521.17 | -3.63 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_sql_streaming | RuntimeMs | DataflowRunner | 35281.0 | 23413.88 |
-33.64 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_streaming | RuntimeMs | DirectRunner | 3999.57 | 3816.44 | -4.58
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_streaming | RuntimeMs | FlinkRunner | 792.14 | 802.28 | 1.28 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_streaming | RuntimeMs | DataflowRunner | 18987.79 | 19840.11 | 4.49
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_streaming | RuntimeMs | DirectRunner | 3554.93 | 3413.39 | -3.98 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_streaming | RuntimeMs | FlinkRunner | 695.68 | 692.5 | -0.46 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_batch | RuntimeMs | DataflowRunner | 36837.96 | 46857.89 | 27.2 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_batch | RuntimeMs | DirectRunner | 1101.86 | 1143.72 | 3.8 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_batch | RuntimeMs | FlinkRunner | 140.18 | 110.39 | -21.25 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_batch | RuntimeMs | SparkRunner | 133.07 | 140.72 | 5.75 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_batch | RuntimeMs | SparkStructuredStreamingRunner | 208.39 | 185.89
| -10.8 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_sql_batch | RuntimeMs | DataflowRunner | 39811.46 | 48502.11 | 21.83
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_batch | RuntimeMs | DirectRunner | 1346.61 | 1360.61 | 1.04 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_batch | RuntimeMs | SparkRunner | 197.86 | 196.72 | -0.57 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 269.36 |
271.83 | 0.92 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_sql_streaming | RuntimeMs | DataflowRunner | 26574.75 | 14098.65 |
-46.95 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_streaming | RuntimeMs | DirectRunner | 2069.71 | 2070.11 | 0.02
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_streaming | RuntimeMs | FlinkRunner | 454.43 | 470.11 | 3.45 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_streaming | RuntimeMs | DataflowRunner | 11685.07 | 11337.5 | -2.97
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_streaming | RuntimeMs | DirectRunner | 1634.0 | 1582.94 | -3.12 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_streaming | RuntimeMs | FlinkRunner | 381.93 | 369.17 | -3.34 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_batch | RuntimeMs | DataflowRunner | 1127186.54 | 487373.59
| -56.76 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_zetasql_batch | RuntimeMs | DirectRunner | 12980.89 | 7946.5 |
-38.78 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_zetasql_streaming | RuntimeMs | DataflowRunner | 494264.11 |
210465.82 | -57.42 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_streaming | RuntimeMs | DirectRunner | 13245.04 | 8644.39 |
-34.73 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_streaming | RuntimeMs | FlinkRunner | 13352.21 | 7842.33 |
-41.27 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_batch | RuntimeMs | DataflowRunner | 47179.32 | 56850.61 | 20.5 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_3_batch | RuntimeMs | DirectRunner | 3075.61 | 3009.33 | -2.15 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_batch | RuntimeMs | FlinkRunner | 1219.79 | 1194.67 | -2.06 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_batch | RuntimeMs | SparkRunner | 1027.71 | 1021.11 | -0.64 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_batch | RuntimeMs | DataflowRunner | 43027.04 | 52122.17 | 21.14
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_batch | RuntimeMs | DirectRunner | 2510.89 | 2468.39 | -1.69 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_3_sql_batch | RuntimeMs | SparkRunner | 1101.46 | 1078.94 | -2.04 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 661.89 |
663.5 | 0.24 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_sql_streaming | RuntimeMs | DataflowRunner | 52341.18 | 39434.59 |
-24.66 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_streaming | RuntimeMs | DirectRunner | 3855.86 | 3759.89 | -2.49
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_streaming | RuntimeMs | FlinkRunner | 1139.89 | 1069.0 | -6.22 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_streaming | RuntimeMs | DataflowRunner | 46543.29 | 45355.06 | -2.55
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_streaming | RuntimeMs | DirectRunner | 3873.68 | 3794.56 | -2.04 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_streaming | RuntimeMs | FlinkRunner | 766.29 | 735.39 | -4.03 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_batch | RuntimeMs | DataflowRunner | 186295.5 | 124852.76 |
-32.98 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_batch | RuntimeMs | DirectRunner | 3838.32 | 3095.28 |
-19.36 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_streaming | RuntimeMs | DataflowRunner | 108015.93 |
60701.06 | -43.8 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_streaming | RuntimeMs | DirectRunner | 5061.86 | 4437.78 |
-12.33 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_streaming | RuntimeMs | FlinkRunner | 2404.21 | 1709.06 |
-28.91 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_batch | RuntimeMs | DataflowRunner | 50450.36 | 60878.89 | 20.67 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_4_batch | RuntimeMs | DirectRunner | 1583.32 | 1554.33 | -1.83 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_batch | RuntimeMs | FlinkRunner | 876.04 | 845.5 | -3.49 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_4_batch | RuntimeMs | SparkRunner | 561.64 | 546.11 | -2.77 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_4_batch | RuntimeMs | SparkStructuredStreamingRunner | 1100.29 |
1238.94 | 12.6 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_streaming | RuntimeMs | DataflowRunner | 58274.82 | 57103.22 | -2.01
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_streaming | RuntimeMs | DirectRunner | 1359.25 | 1306.28 | -3.9 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_streaming | RuntimeMs | FlinkRunner | 1106.79 | 1073.72 | -2.99 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_batch | RuntimeMs | DataflowRunner | 66469.0 | 74471.56 | 12.04 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_5_batch | RuntimeMs | DirectRunner | 5458.39 | 5526.0 | 1.24 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_5_batch | RuntimeMs | FlinkRunner | 726.25 | 725.5 | -0.1 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_5_batch | RuntimeMs | SparkRunner | 560.89 | 597.11 | 6.46 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_5_batch | RuntimeMs | SparkStructuredStreamingRunner | 1329.46 |
1340.0 | 0.79 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_5_streaming | RuntimeMs | DataflowRunner | 165787.54 | 150833.22 |
-9.02 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_streaming | RuntimeMs | DirectRunner | 6439.89 | 6267.72 | -2.67 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_streaming | RuntimeMs | FlinkRunner | 1465.68 | 1437.5 | -1.92 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_batch | RuntimeMs | DataflowRunner | 46770.14 | 59438.44 | 27.09 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_batch | RuntimeMs | DirectRunner | 1080.79 | 1120.67 | 3.69 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_6_batch | RuntimeMs | FlinkRunner | 418.57 | 457.89 | 9.39 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_6_batch | RuntimeMs | SparkRunner | 268.32 | 263.44 | -1.82 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_batch | RuntimeMs | SparkStructuredStreamingRunner | 305.36 | 296.56
| -2.88 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_6_streaming | RuntimeMs | DataflowRunner | 50203.36 | 45790.72 | -8.79
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_streaming | RuntimeMs | DirectRunner | 1000.71 | 964.22 | -3.65 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_streaming | RuntimeMs | FlinkRunner | 527.07 | 513.33 | -2.61 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_batch | RuntimeMs | DataflowRunner | 85371.86 | 100994.11 | 18.3 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_batch | RuntimeMs | DirectRunner | 3535.0 | 3594.67 | 1.69 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_batch | RuntimeMs | FlinkRunner | 611.0 | 582.39 | -4.68 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_batch | RuntimeMs | SparkRunner | 464.36 | 482.56 | 3.92 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_batch | RuntimeMs | SparkStructuredStreamingRunner | 1601.21 |
1645.61 | 2.77 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_sql_batch | RuntimeMs | DataflowRunner | 137099.0 | 145272.17 | 5.96
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_sql_batch | RuntimeMs | DirectRunner | 95728.5 | 94109.06 | -1.69 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_batch | RuntimeMs | SparkRunner | 2585.25 | 2519.28 | -2.55 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 3047.07 |
2995.33 | -1.7 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_sql_streaming | RuntimeMs | DataflowRunner | 1197707.75 | 1175715.59
| -1.84 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_streaming | RuntimeMs | DirectRunner | 108836.75 | 107340.39 |
-1.37 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_streaming | RuntimeMs | FlinkRunner | 4097.46 | 3948.44 | -3.64
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_streaming | RuntimeMs | DataflowRunner | 128671.14 | 112902.06 |
-12.26 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_streaming | RuntimeMs | DirectRunner | 8200.36 | 8036.28 | -2.0 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_streaming | RuntimeMs | FlinkRunner | 1251.93 | 1182.17 | -5.57 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_batch | RuntimeMs | DataflowRunner | 46607.46 | 59573.5 | 27.82 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_8_batch | RuntimeMs | DirectRunner | 1575.11 | 1586.39 | 0.72 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_8_batch | RuntimeMs | FlinkRunner | 491.0 | 482.61 | -1.71 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_8_batch | RuntimeMs | SparkRunner | 384.46 | 385.94 | 0.38 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_8_batch | RuntimeMs | SparkStructuredStreamingRunner | 389.25 | 397.61
| 2.15 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_streaming | RuntimeMs | DataflowRunner | 52132.11 | 51179.83 | -1.83
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_streaming | RuntimeMs | DirectRunner | 2597.75 | 2521.0 | -2.95 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_streaming | RuntimeMs | FlinkRunner | 529.89 | 522.33 | -1.43 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_batch | RuntimeMs | DataflowRunner | 47333.54 | 56532.17 | 19.43 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_9_batch | RuntimeMs | DirectRunner | 737.14 | 741.78 | 0.63 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_9_batch | RuntimeMs | FlinkRunner | 304.29 | 278.33 | -8.53 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_9_batch | RuntimeMs | SparkRunner | 213.93 | 215.0 | 0.5 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_batch | RuntimeMs | SparkStructuredStreamingRunner | 176.36 | 177.44
| 0.62 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_9_streaming | RuntimeMs | DataflowRunner | 52034.39 | 39731.89 |
-23.64 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_streaming | RuntimeMs | DirectRunner | 712.93 | 695.28 | -2.48 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_streaming | RuntimeMs | FlinkRunner | 345.54 | 357.17 | 3.37 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)