You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/12/21 12:01:59 UTC
Beam Metrics Report (2020-12-21)
# Beam Metrics Report
Color legend: >= 20 | >= 10 | <= -10 | <= -20
---|---|---|---
## Possible regression
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
java_batch_combine_1 | sparkstructuredstreaming_runtime_sec | - | 623.25 |
723.42 | 16.07 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_4 | dataflow_runtime_sec | - | 37.67 | 84.45 | 124.22 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_gbk_2 | sparkstructuredstreaming_runtime_sec | - | 127.75 | 160.72
| 25.81 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | sparkstructuredstreaming_runtime_sec | - | 121.65 | 170.74
| 40.36 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | sparkstructuredstreaming_runtime_sec | - | 126.72 | 158.22
| 24.85 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | sparkstructuredstreaming_runtime_sec | - | 61.5 | 68.49 |
11.36 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | sparkstructuredstreaming_runtime_sec | - | 88.97 | 98.09 |
10.25 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_sideinput_2 | python_dataflow_batch_sideinput_2_runtime | - |
2.14 | 2.6 | 21.33 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_streaming_cogbk_2 | python_dataflow_streaming_cogbk_2_runtime | - |
383.43 | 433.25 | 12.99 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_3 | python_dataflow_streaming_cogbk_3_runtime | - |
703.0 | 824.5 | 17.28 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_gbk_3 | python_dataflow_streaming_gbk_3_runtime | - | 147.0 |
193.5 | 31.63 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_pardo_6 | python_flink_streaming_pardo_6_runtime | - | 51.5 |
75.25 | 46.12 |
xmlioit_hdfs_results | write_time | - | 42.48 | 64.11 | 50.91 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
nexmark_0_sql_streaming | RuntimeMs | DataflowRunner | 20398.04 | 23813.67 |
16.74 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_streaming | RuntimeMs | DataflowRunner | 19972.82 | 23437.94 | 17.35
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_batch | RuntimeMs | SparkStructuredStreamingRunner | 327.7 | 362.89
| 10.74 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_sql_batch | RuntimeMs | DataflowRunner | 125857.29 | 146904.56 |
16.72 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_batch | RuntimeMs | DataflowRunner | 65143.14 | 80744.56 | 23.95 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_batch | RuntimeMs | FlinkRunner | 252.44 | 283.78 | 12.41 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_batch | RuntimeMs | DataflowRunner | 64585.64 | 75569.28 | 17.01
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_sql_streaming | RuntimeMs | DataflowRunner | 19055.41 | 21368.5 |
12.14 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_streaming | RuntimeMs | DataflowRunner | 16517.39 | 18341.5 | 11.04
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_batch | RuntimeMs | DataflowRunner | 50375.86 | 57908.78 | 14.95 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_batch | RuntimeMs | FlinkRunner | 106.81 | 134.78 | 26.18 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_sql_batch | RuntimeMs | DataflowRunner | 49918.93 | 60839.44 | 21.88
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_sql_streaming | RuntimeMs | DataflowRunner | 10467.96 | 12450.78 |
18.94 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_batch | RuntimeMs | DataflowRunner | 62786.43 | 75800.67 | 20.73 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_4_batch | RuntimeMs | DataflowRunner | 58110.32 | 82610.0 | 42.16 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_5_batch | RuntimeMs | DirectRunner | 5055.04 | 6491.21 | 28.41 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_streaming | RuntimeMs | DirectRunner | 5977.85 | 7077.83 | 18.4 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_streaming | RuntimeMs | FlinkRunner | 1272.33 | 1413.61 | 11.1 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_batch | RuntimeMs | DirectRunner | 968.67 | 1106.26 | 14.2 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_batch | RuntimeMs | FlinkRunner | 394.85 | 455.61 | 15.39 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_6_batch | RuntimeMs | SparkRunner | 259.78 | 300.11 | 15.53 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_streaming | RuntimeMs | FlinkRunner | 468.04 | 590.17 | 26.09 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_batch | RuntimeMs | DataflowRunner | 95743.46 | 112992.61 | 18.02 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_8_batch | RuntimeMs | DataflowRunner | 62164.39 | 77507.94 | 24.68 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_9_batch | RuntimeMs | DataflowRunner | 56061.29 | 67809.33 | 20.96 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_9_streaming | RuntimeMs | FlinkRunner | 377.96 | 419.5 | 10.99 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
## Possible improvement
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
bqio_10GB_results_java_batch_avro | avro_write_time | - | 64.91 | 57.24 |
-11.81 | [[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
java_streaming_cogbk_1 | dataflow_runtime_sec | - | 1472.61 | 899.87 | -38.89
| [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_2 | dataflow_runtime_sec | - | 1782.19 | 959.05 | -46.19
| [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_3 | dataflow_runtime_sec | - | 181.05 | 122.41 | -32.39 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_4 | dataflow_runtime_sec | - | 159.66 | 116.95 | -26.75 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_combine_4 | dataflow_runtime_sec | - | 491.58 | 336.88 | -31.47
| [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_combine_5 | dataflow_runtime_sec | - | 466.12 | 293.42 | -37.05
| [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_gbk_2 | dataflow_runtime_sec | - | 1358.11 | 910.93 | -32.93 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_4 | dataflow_runtime_sec | - | 448.04 | 297.47 | -33.61 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_5 | dataflow_runtime_sec | - | 445.77 | 309.85 | -30.49 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_sideinput_10 | python_dataflow_batch_sideinput_10_runtime | - |
2374.71 | 1969.25 | -17.07 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_3 | python_dataflow_batch_sideinput_3_runtime | - |
21.14 | 18.6 | -12.03 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_5 | python_dataflow_batch_sideinput_5_runtime | - |
2.86 | 2.5 | -12.5 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_7 | python_dataflow_batch_sideinput_7_runtime | - |
270.71 | 240.75 | -11.07 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_psio_2GB_results | pubsub_io_perf_read_runtime | - | 185.86 | 136.25 |
-26.69 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_streaming_pardo_2 | python_dataflow_streaming_pardo_2_runtime | - |
2667.67 | 2334.75 | -12.48 | [[1]](http://metrics.beam.apache.org/d/MOi-
kf3Zk)
nexmark_0_zetasql_streaming | RuntimeMs | DataflowRunner | 221899.42 |
173831.28 | -21.66 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_streaming | RuntimeMs | DataflowRunner | 217911.75 | 156622.33 |
-28.13 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_streaming | RuntimeMs | DataflowRunner | 438242.65 |
350588.44 | -20.0 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_streaming | RuntimeMs | DataflowRunner | 139231.39 | 119548.83 |
-14.14 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_streaming | RuntimeMs | DataflowRunner | 167539.77 |
124735.17 | -25.55 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_batch | RuntimeMs | DirectRunner | 2880.93 | 2320.89 | -19.44 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_batch | RuntimeMs | SparkRunner | 999.89 | 896.83 | -10.31 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_streaming | RuntimeMs | DataflowRunner | 41095.04 | 25363.11 |
-38.28 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_streaming | RuntimeMs | FlinkRunner | 705.41 | 549.44 | -22.11 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_streaming | RuntimeMs | DataflowRunner | 62269.77 | 55003.33
| -11.67 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_batch | RuntimeMs | DataflowRunner | 87739.61 | 77868.72 | -11.25 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_streaming | RuntimeMs | DataflowRunner | 137121.79 | 122330.5 |
-10.79 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_streaming | RuntimeMs | DataflowRunner | 1632173.26 | 1125483.17
| -31.04 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_streaming | RuntimeMs | DataflowRunner | 53939.5 | 45267.33 | -16.08
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
## All metrics
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
avroioit_hdfs_results | read_time | - | 124.97 | 137.22 | 9.8 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_hdfs_results | write_time | - | 171.81 | 174.13 | 1.35 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_results | read_time | - | 121.51 | 121.6 | 0.08 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_results | write_time | - | 160.37 | 162.78 | 1.5 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_avro | avro_write_time | - | 64.91 | 57.24 |
-11.81 | [[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_avro | read_time | - | 74.48 | 77.26 | 3.73 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_json | read_time | - | 65.76 | 67.81 | 3.11 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_json | write_time | - | 95.02 | 90.34 | -4.93 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_stream | read_time | - | 0.0 | 0.0 | 0.0 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_stream | write_time | - | 113.49 | 105.92 | -6.67 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_hdfs_results | read_time | - | 226.89 | 220.83 | -2.67 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_hdfs_results | write_time | - | 299.46 | 297.73 | -0.58 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_results | read_time | - | 201.63 | 201.47 | -0.08 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_results | write_time | - | 275.3 | 277.64 | 0.85 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
go_batch_cogbk_1 | dataflow_runtime | - | 338.23 | 334.75 | -1.03 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_cogbk_2 | dataflow_runtime | - | 212.9 | 214.17 | 0.59 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_cogbk_2 | flink_runtime | - | 639.19 | 637.76 | -0.22 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_cogbk_3 | dataflow_runtime | - | 189.93 | 194.65 | 2.48 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_cogbk_3 | flink_runtime | - | 678.59 | 693.04 | 2.13 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_cogbk_4 | dataflow_runtime | - | 188.46 | 190.01 | 0.82 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_cogbk_4 | flink_runtime | - | 653.19 | 656.43 | 0.5 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_combine_1 | dataflow_runtime | - | 1492.82 | 1521.81 | 1.94 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
go_batch_combine_1 | flink_runtime | - | 3957.55 | 3970.05 | 0.32 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
go_batch_combine_4 | dataflow_runtime | - | 96.73 | 98.17 | 1.49 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
go_batch_combine_4 | flink_runtime | - | 147.03 | 144.4 | -1.79 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
go_batch_combine_5 | dataflow_runtime | - | 93.34 | 96.12 | 2.98 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
go_batch_combine_5 | flink_runtime | - | 106.59 | 106.83 | 0.23 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
go_batch_gbk_1 | dataflow_runtime | - | 747.38 | 745.51 | -0.25 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_1 | flink_runtime | - | 3263.18 | 3185.21 | -2.39 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_2 | dataflow_runtime | - | 161.57 | 165.86 | 2.65 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_2 | flink_runtime | - | 490.77 | 498.76 | 1.63 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_3 | dataflow_runtime | - | 40.41 | 40.54 | 0.34 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_3 | flink_runtime | - | 21.71 | 21.45 | -1.23 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_4 | dataflow_runtime | - | 72.86 | 72.21 | -0.89 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_4 | flink_runtime | - | 143.02 | 143.74 | 0.5 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_5 | dataflow_runtime | - | 65.55 | 65.87 | 0.48 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_5 | flink_runtime | - | 104.92 | 106.44 | 1.45 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_6 | dataflow_runtime | - | 168.04 | 170.28 | 1.34 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_6 | flink_runtime | - | 589.61 | 597.09 | 1.27 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_7 | dataflow_runtime | - | 166.37 | 169.45 | 1.85 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_pardo_1 | dataflow_runtime | - | 177.26 | 162.47 | -8.35 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_1 | flink_runtime | - | 589.97 | 591.93 | 0.33 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_2 | dataflow_runtime | - | 1695.39 | 1674.07 | -1.26 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_2 | flink_runtime | - | 6941.2 | 6909.84 | -0.45 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_3 | dataflow_runtime | - | 94.47 | 93.73 | -0.78 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_3 | flink_runtime | - | 304.03 | 305.4 | 0.45 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_4 | dataflow_runtime | - | 106.72 | 101.81 | -4.61 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_4 | flink_runtime | - | 344.01 | 344.11 | 0.03 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_sideinput_3 | dataflow_runtime | - | 262.04 | 262.37 | 0.13 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
go_batch_sideinput_3 | flink_runtime | - | 13.44 | 13.88 | 3.23 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
go_batch_sideinput_4 | dataflow_runtime | - | 275.69 | 262.68 | -4.72 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
go_batch_sideinput_4 | flink_runtime | - | 14.59 | 14.81 | 1.47 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
hadoopformatioit_results | read_time | - | 8.18 | 8.67 | 5.93 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
hadoopformatioit_results | write_time | - | 12.99 | 12.45 | -4.17 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
java_batch_cogbk_1 | dataflow_runtime_sec | - | 73.85 | 72.86 | -1.33 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_1 | sparkstructuredstreaming_runtime_sec | - | 143.0 | 143.69
| 0.49 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | dataflow_runtime_sec | - | 73.58 | 74.47 | 1.21 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | sparkstructuredstreaming_runtime_sec | - | 133.82 |
136.12 | 1.72 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | dataflow_runtime_sec | - | 30.21 | 30.06 | -0.51 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | sparkstructuredstreaming_runtime_sec | - | 20.72 | 21.19
| 2.29 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | dataflow_runtime_sec | - | 30.22 | 28.09 | -7.05 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | sparkstructuredstreaming_runtime_sec | - | 21.28 | 21.87
| 2.79 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_combine_1 | dataflow_runtime_sec | - | 88.22 | 84.72 | -3.97 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_1 | sparkstructuredstreaming_runtime_sec | - | 623.25 |
723.42 | 16.07 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_4 | dataflow_runtime_sec | - | 37.67 | 84.45 | 124.22 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_4 | sparkstructuredstreaming_runtime_sec | - | 135.79 |
144.69 | 6.56 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_5 | dataflow_runtime_sec | - | 38.78 | 39.2 | 1.09 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_5 | sparkstructuredstreaming_runtime_sec | - | 142.07 |
142.81 | 0.52 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_gbk_1 | dataflow_runtime_sec | - | 254.25 | 258.06 | 1.5 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_1 | sparkstructuredstreaming_runtime_sec | - | 690.51 | 699.94
| 1.37 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | dataflow_runtime_sec | - | 62.27 | 62.34 | 0.11 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | sparkstructuredstreaming_runtime_sec | - | 127.75 | 160.72
| 25.81 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_runtime_sec | - | 28.6 | 27.4 | -4.19 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | sparkstructuredstreaming_runtime_sec | - | 9.66 | 10.06 |
4.08 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | dataflow_runtime_sec | - | 31.26 | 32.91 | 5.26 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | sparkstructuredstreaming_runtime_sec | - | 121.65 | 170.74
| 40.36 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | dataflow_runtime_sec | - | 34.66 | 35.0 | 0.99 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | sparkstructuredstreaming_runtime_sec | - | 126.72 | 158.22
| 24.85 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | dataflow_runtime_sec | - | 73.38 | 71.74 | -2.23 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | sparkstructuredstreaming_runtime_sec | - | 61.5 | 68.49 |
11.36 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | dataflow_runtime_sec | - | 105.77 | 104.54 | -1.17 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | sparkstructuredstreaming_runtime_sec | - | 88.97 | 98.09 |
10.25 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_pardo_1 | dataflow_runtime_sec | - | 30.26 | 28.37 | -6.25 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_1 | sparkstructuredstreaming_runtime_sec | - | 51.59 | 52.17
| 1.12 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_2 | dataflow_runtime_sec | - | 186.79 | 189.53 | 1.47 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | dataflow_runtime_sec | - | 19.76 | 20.13 | 1.86 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_4 | dataflow_runtime_sec | - | 33.04 | 35.85 | 8.52 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_cogbk_1 | dataflow_runtime_sec | - | 1472.61 | 899.87 | -38.89
| [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_2 | dataflow_runtime_sec | - | 1782.19 | 959.05 | -46.19
| [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_3 | dataflow_runtime_sec | - | 181.05 | 122.41 | -32.39 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_4 | dataflow_runtime_sec | - | 159.66 | 116.95 | -26.75 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_combine_1 | dataflow_runtime_sec | - | 535.92 | 535.33 | -0.11
| [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_combine_4 | dataflow_runtime_sec | - | 491.58 | 336.88 | -31.47
| [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_combine_5 | dataflow_runtime_sec | - | 466.12 | 293.42 | -37.05
| [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_gbk_1 | dataflow_runtime_sec | - | 712.03 | 686.14 | -3.64 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_2 | dataflow_runtime_sec | - | 1358.11 | 910.93 | -32.93 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_3 | dataflow_runtime_sec | - | 23.79 | 23.78 | -0.05 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_4 | dataflow_runtime_sec | - | 448.04 | 297.47 | -33.61 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_5 | dataflow_runtime_sec | - | 445.77 | 309.85 | -30.49 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_6 | dataflow_runtime_sec | - | 78.16 | 77.76 | -0.52 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_7 | dataflow_runtime_sec | - | 141.6 | 131.68 | -7.0 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_pardo_1 | dataflow_runtime_sec | - | 19.59 | 18.3 | -6.57 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_2 | dataflow_runtime_sec | - | 214.77 | 212.56 | -1.03 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_3 | dataflow_runtime_sec | - | 12.4 | 12.4 | -0.0 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_4 | dataflow_runtime_sec | - | 30.93 | 31.46 | 1.71 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
jdbcioit_results | read_time | - | 37.54 | 37.05 | -1.3 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
jdbcioit_results | write_time | - | 54.7 | 49.82 | -8.92 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results | read_time | - | 794.29 | 800.17 | 0.74 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results | write_time | - | 173.78 | 174.6 | 0.47 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_hdfs_results | read_time | - | 26.26 | 26.38 | 0.46 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_hdfs_results | write_time | - | 105.71 | 102.67 | -2.88 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_results | read_time | - | 47.0 | 51.56 | 9.7 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_results | write_time | - | 114.14 | 123.83 | 8.49 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
mongodbioit_results | read_time | - | 30.83 | 31.08 | 0.79 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
mongodbioit_results | write_time | - | 79.11 | 72.81 | -7.96 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_hdfs_results | read_time | - | 128.87 | 120.51 | -6.48 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_hdfs_results | write_time | - | 196.49 | 193.31 | -1.62 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_results | read_time | - | 120.69 | 122.71 | 1.67 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_results | write_time | - | 188.13 | 192.21 | 2.17 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
python_batch_cogbk_1 | python_dataflow_batch_cogbk_1_runtime | - | 452.43 |
450.5 | -0.43 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_2 | python_dataflow_batch_cogbk_2_runtime | - | 310.14 |
318.5 | 2.69 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_3 | python_dataflow_batch_cogbk_3_runtime | - | 295.57 |
306.5 | 3.7 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_4 | python_dataflow_batch_cogbk_4_runtime | - | 300.71 |
305.0 | 1.43 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_combine_1 | python_dataflow_batch_combine_1_runtime | - | 917.86
| 930.75 | 1.4 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_1 | python_flink_batch_combine_1_runtime | - | 5225.29 |
5433.0 | 3.98 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_4 | python_dataflow_batch_combine_4_runtime | - | 38.71 |
37.5 | -3.14 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_4 | python_flink_batch_combine_4_runtime | - | 191.8 |
196.0 | 2.19 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_5 | python_dataflow_batch_combine_5_runtime | - | 36.71 |
38.5 | 4.86 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_5 | python_flink_batch_combine_5_runtime | - | 141.0 |
144.0 | 2.13 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_gbk_1 | python_dataflow_batch_gbk_1_runtime | - | 1938.43 |
1920.0 | -0.95 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_2 | python_dataflow_batch_gbk_2_runtime | - | 348.0 | 353.0 |
1.44 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_3 | python_dataflow_batch_gbk_3_runtime | - | 35.43 | 35.75 |
0.91 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_4 | python_dataflow_batch_gbk_4_runtime | - | 105.43 | 110.75
| 5.05 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_5 | python_dataflow_batch_gbk_5_runtime | - | 105.33 | 102.5
| -2.69 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_6 | python_dataflow_batch_gbk_6_runtime | - | 363.57 | 371.5
| 2.18 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_7 | python_dataflow_batch_gbk_7_runtime | - | 358.71 | 365.25
| 1.82 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_pardo_1 | python_dataflow_batch_pardo_1_runtime | - | 163.0 |
158.25 | -2.91 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_1 | python_flink_batch_pardo_1_runtime | - | 798.29 |
773.75 | -3.07 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_2 | python_dataflow_batch_pardo_2_runtime | - | 1369.86 |
1384.75 | 1.09 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_3 | python_dataflow_batch_pardo_3_runtime | - | 136.71 |
134.75 | -1.44 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_3 | python_flink_batch_pardo_3_runtime | - | 705.0 | 695.0
| -1.42 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_4 | python_dataflow_batch_pardo_4_runtime | - | 324.57 |
327.5 | 0.9 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_4 | python_flink_batch_pardo_4_runtime | - | 2401.0 |
2377.5 | -0.98 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_sideinput_1 | python_dataflow_batch_sideinput_1_runtime | - |
2.71 | 2.6 | -4.21 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_10 | python_dataflow_batch_sideinput_10_runtime | - |
2374.71 | 1969.25 | -17.07 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_2 | python_dataflow_batch_sideinput_2_runtime | - |
2.14 | 2.6 | 21.33 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_3 | python_dataflow_batch_sideinput_3_runtime | - |
21.14 | 18.6 | -12.03 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_4 | python_dataflow_batch_sideinput_4_runtime | - |
20.0 | 19.25 | -3.75 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_5 | python_dataflow_batch_sideinput_5_runtime | - |
2.86 | 2.5 | -12.5 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_6 | python_dataflow_batch_sideinput_6_runtime | - |
2.29 | 2.5 | 9.38 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_7 | python_dataflow_batch_sideinput_7_runtime | - |
270.71 | 240.75 | -11.07 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_8 | python_dataflow_batch_sideinput_8_runtime | - |
277.14 | 277.0 | -0.05 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_9 | python_dataflow_batch_sideinput_9_runtime | - |
1832.14 | 1846.25 | 0.77 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_bqio_read_10GB_results | bqio_read_10GB_results_runtime | - | 166.0 |
161.0 | -3.01 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_bqio_write_10GB_results | bqio_write_10GB_results_runtime | - | 258.0 |
255.5 | -0.97 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_psio_2GB_results | pubsub_io_perf_read_runtime | - | 185.86 | 136.25 |
-26.69 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_psio_2GB_results | pubsub_io_perf_write_runtime | - | 97.0 | 98.75 |
1.8 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_streaming_cogbk_1 | python_dataflow_streaming_cogbk_1_runtime | - |
606.71 | 590.0 | -2.75 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_2 | python_dataflow_streaming_cogbk_2_runtime | - |
383.43 | 433.25 | 12.99 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_3 | python_dataflow_streaming_cogbk_3_runtime | - |
703.0 | 824.5 | 17.28 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_4 | python_dataflow_streaming_cogbk_4_runtime | - |
256.57 | 259.5 | 1.14 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_combine_4 | python_flink_streaming_combine_4_runtime | - |
239.67 | 230.25 | -3.93 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_streaming_combine_5 | python_flink_streaming_combine_5_runtime | - |
225.2 | 225.33 | 0.06 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_streaming_gbk_3 | python_dataflow_streaming_gbk_3_runtime | - | 147.0 |
193.5 | 31.63 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_gbk_6 | python_dataflow_streaming_gbk_6_runtime | - | 453.0 |
479.5 | 5.85 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_gbk_7 | python_dataflow_streaming_gbk_7_runtime | - | 483.43
| 523.25 | 8.24 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_pardo_1 | python_dataflow_streaming_pardo_1_runtime | - |
186.86 | 169.5 | -9.29 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_1 | python_flink_streaming_pardo_5_runtime | - | 167.67
| 171.75 | 2.44 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_2 | python_dataflow_streaming_pardo_2_runtime | - |
2667.67 | 2334.75 | -12.48 | [[1]](http://metrics.beam.apache.org/d/MOi-
kf3Zk)
python_streaming_pardo_2 | python_flink_streaming_pardo_2_runtime | - |
4362.33 | 3978.0 | -8.81 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_3 | python_dataflow_streaming_pardo_3_runtime | - |
161.17 | 154.5 | -4.14 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_3 | python_flink_streaming_pardo_3_runtime | - | 268.17
| 271.25 | 1.15 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_4 | python_dataflow_streaming_pardo_4_runtime | - |
479.83 | 455.0 | -5.18 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_4 | python_flink_streaming_pardo_4_runtime | - | 710.5
| 714.25 | 0.53 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_6 | python_flink_streaming_pardo_6_runtime | - | 51.5 |
75.25 | 46.12 |
textioit_hdfs_results | read_time | - | 28.22 | 28.26 | 0.15 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_hdfs_results | write_time | - | 47.41 | 48.06 | 1.37 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_results | read_time | - | 28.93 | 30.4 | 5.09 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_results | write_time | - | 46.54 | 45.4 | -2.44 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
tfrecordioit_results | read_time | - | 23.91 | 25.55 | 6.84 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
tfrecordioit_results | write_time | - | 33.24 | 31.71 | -4.61 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
wordcount_py37_results | runtime | - | 817.37 | 808.99 | -1.03 |
[[1]](http://metrics.beam.apache.org/d/1cnwVDkGk)
xmlioit_hdfs_results | read_time | - | 26.88 | 28.07 | 4.42 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_hdfs_results | write_time | - | 42.48 | 64.11 | 50.91 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_results | read_time | - | 30.23 | 31.16 | 3.08 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_results | write_time | - | 41.89 | 41.17 | -1.74 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
nexmark_0_batch | RuntimeMs | DataflowRunner | 70950.32 | 75087.61 | 5.83 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_batch | RuntimeMs | DirectRunner | 2393.07 | 2417.47 | 1.02 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_batch | RuntimeMs | FlinkRunner | 1042.59 | 1080.28 | 3.61 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_batch | RuntimeMs | SparkRunner | 1153.81 | 1181.67 | 2.41 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_batch | RuntimeMs | SparkStructuredStreamingRunner | 1039.96 |
1046.67 | 0.64 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_sql_batch | RuntimeMs | DataflowRunner | 69888.36 | 72331.5 | 3.5 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_sql_batch | RuntimeMs | DirectRunner | 3568.33 | 3677.11 | 3.05 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_sql_batch | RuntimeMs | SparkRunner | 1019.37 | 1076.72 | 5.63 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1072.59 |
1089.67 | 1.59 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_sql_streaming | RuntimeMs | DataflowRunner | 20398.04 | 23813.67 |
16.74 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_sql_streaming | RuntimeMs | DirectRunner | 6190.56 | 6290.39 | 1.61
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_sql_streaming | RuntimeMs | FlinkRunner | 1641.26 | 1703.61 | 3.8 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_streaming | RuntimeMs | DataflowRunner | 19972.82 | 23437.94 | 17.35
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_streaming | RuntimeMs | DirectRunner | 4692.48 | 4894.11 | 4.3 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_streaming | RuntimeMs | FlinkRunner | 1481.81 | 1544.94 | 4.26 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_batch | RuntimeMs | DataflowRunner | 421355.96 | 426838.78 |
1.3 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_batch | RuntimeMs | DirectRunner | 7042.26 | 7369.06 | 4.64
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_zetasql_streaming | RuntimeMs | DataflowRunner | 221899.42 |
173831.28 | -21.66 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_streaming | RuntimeMs | DirectRunner | 9544.7 | 9788.67 |
2.56 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_streaming | RuntimeMs | FlinkRunner | 6230.33 | 6752.17 |
8.38 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_batch | RuntimeMs | DataflowRunner | 91674.21 | 95852.56 | 4.56 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_10_batch | RuntimeMs | DirectRunner | 2620.81 | 2717.53 | 3.69 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_batch | RuntimeMs | FlinkRunner | 582.15 | 541.89 | -6.92 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_10_batch | RuntimeMs | SparkRunner | 592.26 | 582.78 | -1.6 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_10_batch | RuntimeMs | SparkStructuredStreamingRunner | 867.56 |
883.39 | 1.83 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_10_streaming | RuntimeMs | DataflowRunner | 87497.79 | 91559.44 | 4.64
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_streaming | RuntimeMs | DirectRunner | 14077.81 | 15023.89 | 6.72 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_streaming | RuntimeMs | FlinkRunner | 1382.63 | 1484.28 | 7.35 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_batch | RuntimeMs | DataflowRunner | 73773.14 | 71458.56 | -3.14 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_11_batch | RuntimeMs | DirectRunner | 2344.33 | 2440.47 | 4.1 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_batch | RuntimeMs | FlinkRunner | 265.44 | 260.06 | -2.03 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_batch | RuntimeMs | SparkRunner | 476.33 | 502.06 | 5.4 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_batch | RuntimeMs | SparkStructuredStreamingRunner | 566.33 |
579.61 | 2.34 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_11_streaming | RuntimeMs | DataflowRunner | 217911.75 | 156622.33 |
-28.13 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_streaming | RuntimeMs | DirectRunner | 3144.56 | 3284.72 | 4.46 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_streaming | RuntimeMs | FlinkRunner | 1479.63 | 1574.94 | 6.44 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_batch | RuntimeMs | DataflowRunner | 59493.36 | 62606.56 | 5.23 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_12_batch | RuntimeMs | DirectRunner | 1611.19 | 1655.0 | 2.72 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_12_batch | RuntimeMs | FlinkRunner | 190.19 | 202.56 | 6.5 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_12_batch | RuntimeMs | SparkRunner | 204.74 | 208.22 | 1.7 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_12_batch | RuntimeMs | SparkStructuredStreamingRunner | 327.7 | 362.89
| 10.74 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_12_streaming | RuntimeMs | DataflowRunner | 80891.04 | 78698.56 |
-2.71 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_streaming | RuntimeMs | DirectRunner | 2118.52 | 2182.11 | 3.0 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_streaming | RuntimeMs | FlinkRunner | 703.41 | 729.22 | 3.67 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_batch | RuntimeMs | DataflowRunner | 57925.36 | 61568.17 | 6.29 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_batch | RuntimeMs | DirectRunner | 1559.78 | 1616.95 | 3.67 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_batch | RuntimeMs | FlinkRunner | 326.96 | 341.89 | 4.57 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_batch | RuntimeMs | SparkRunner | 278.52 | 281.94 | 1.23 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_batch | RuntimeMs | SparkStructuredStreamingRunner | 357.52 |
360.78 | 0.91 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_sql_batch | RuntimeMs | DataflowRunner | 125857.29 | 146904.56 |
16.72 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_batch | RuntimeMs | DirectRunner | 4564.48 | 4696.78 | 2.9 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_sql_batch | RuntimeMs | SparkRunner | 1063.41 | 1110.83 | 4.46 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 923.89 |
956.56 | 3.54 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_streaming | RuntimeMs | DataflowRunner | 37063.78 | 37826.78 |
2.06 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_streaming | RuntimeMs | DirectRunner | 5371.74 | 5416.56 | 0.83
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_streaming | RuntimeMs | FlinkRunner | 30428.48 | 29968.61 |
-1.51 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_streaming | RuntimeMs | DataflowRunner | 31236.39 | 28760.56 |
-7.93 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_streaming | RuntimeMs | DirectRunner | 2532.85 | 2630.61 | 3.86 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_streaming | RuntimeMs | FlinkRunner | 28023.33 | 29437.11 | 5.05 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_batch | RuntimeMs | DataflowRunner | 876724.23 | 896118.17
| 2.21 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_zetasql_batch | RuntimeMs | DirectRunner | 12324.48 | 12783.33 |
3.72 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_zetasql_streaming | RuntimeMs | DataflowRunner | 438242.65 |
350588.44 | -20.0 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_streaming | RuntimeMs | DirectRunner | 10133.22 | 10313.5 |
1.78 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_streaming | RuntimeMs | FlinkRunner | 38805.26 | 39469.89 |
1.71 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_batch | RuntimeMs | DataflowRunner | 130959.68 | 133941.06 | 2.28 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_14_batch | RuntimeMs | DirectRunner | 2514.11 | 2604.74 | 3.6 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_14_batch | RuntimeMs | FlinkRunner | 523.11 | 559.33 | 6.92 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_14_batch | RuntimeMs | SparkRunner | 768.44 | 813.11 | 5.81 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_14_batch | RuntimeMs | SparkStructuredStreamingRunner | 844.3 | 848.44
| 0.49 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_streaming | RuntimeMs | DataflowRunner | 139231.39 | 119548.83 |
-14.14 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_streaming | RuntimeMs | DirectRunner | 3301.93 | 3351.56 | 1.5 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_streaming | RuntimeMs | FlinkRunner | 1663.81 | 1573.78 | -5.41 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_batch | RuntimeMs | DataflowRunner | 65143.14 | 80744.56 | 23.95 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_batch | RuntimeMs | DirectRunner | 1493.04 | 1553.74 | 4.07 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_batch | RuntimeMs | FlinkRunner | 252.44 | 283.78 | 12.41 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_batch | RuntimeMs | SparkRunner | 306.22 | 320.17 | 4.55 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_1_batch | RuntimeMs | SparkStructuredStreamingRunner | 385.93 | 367.94
| -4.66 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_sql_batch | RuntimeMs | DataflowRunner | 64585.64 | 75569.28 | 17.01
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_sql_batch | RuntimeMs | DirectRunner | 2128.89 | 2174.61 | 2.15 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_sql_batch | RuntimeMs | SparkRunner | 428.15 | 447.06 | 4.42 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 502.59 |
495.0 | -1.51 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_streaming | RuntimeMs | DataflowRunner | 19055.41 | 21368.5 |
12.14 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_streaming | RuntimeMs | DirectRunner | 3647.67 | 3719.67 | 1.97
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_streaming | RuntimeMs | FlinkRunner | 745.56 | 780.28 | 4.66 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_streaming | RuntimeMs | DataflowRunner | 16517.39 | 18341.5 | 11.04
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_streaming | RuntimeMs | DirectRunner | 3126.19 | 3277.89 | 4.85 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_streaming | RuntimeMs | FlinkRunner | 699.37 | 685.94 | -1.92 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_batch | RuntimeMs | DataflowRunner | 50375.86 | 57908.78 | 14.95 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_batch | RuntimeMs | DirectRunner | 933.89 | 949.11 | 1.63 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_batch | RuntimeMs | FlinkRunner | 106.81 | 134.78 | 26.18 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_batch | RuntimeMs | SparkRunner | 142.26 | 142.39 | 0.09 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_batch | RuntimeMs | SparkStructuredStreamingRunner | 204.67 | 194.5
| -4.97 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_batch | RuntimeMs | DataflowRunner | 49918.93 | 60839.44 | 21.88
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_sql_batch | RuntimeMs | DirectRunner | 1256.19 | 1264.61 | 0.67 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_sql_batch | RuntimeMs | SparkRunner | 187.74 | 188.72 | 0.52 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 247.96 |
270.61 | 9.13 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_streaming | RuntimeMs | DataflowRunner | 10467.96 | 12450.78 |
18.94 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_streaming | RuntimeMs | DirectRunner | 1941.48 | 1974.67 | 1.71
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_streaming | RuntimeMs | FlinkRunner | 461.59 | 431.44 | -6.53 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_streaming | RuntimeMs | DataflowRunner | 9768.04 | 10578.78 | 8.3 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_streaming | RuntimeMs | DirectRunner | 1543.67 | 1576.44 | 2.12 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_streaming | RuntimeMs | FlinkRunner | 343.63 | 359.83 | 4.72 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_batch | RuntimeMs | DataflowRunner | 286844.46 | 290708.11 |
1.35 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_zetasql_batch | RuntimeMs | DirectRunner | 3792.59 | 3968.06 | 4.63
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_streaming | RuntimeMs | DataflowRunner | 167539.77 |
124735.17 | -25.55 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_streaming | RuntimeMs | DirectRunner | 4752.0 | 4864.56 |
2.37 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_streaming | RuntimeMs | FlinkRunner | 3556.19 | 3734.83 |
5.02 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_batch | RuntimeMs | DataflowRunner | 62786.43 | 75800.67 | 20.73 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_batch | RuntimeMs | DirectRunner | 2880.93 | 2320.89 | -19.44 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_batch | RuntimeMs | FlinkRunner | 1112.0 | 1055.11 | -5.12 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_batch | RuntimeMs | SparkRunner | 999.89 | 896.83 | -10.31 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_sql_batch | RuntimeMs | DataflowRunner | 68122.5 | 66209.72 | -2.81
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_3_sql_batch | RuntimeMs | DirectRunner | 2362.0 | 2384.72 | 0.96 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_3_sql_batch | RuntimeMs | SparkRunner | 1036.22 | 1084.44 | 4.65 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 610.04 |
635.83 | 4.23 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_3_sql_streaming | RuntimeMs | DataflowRunner | 35894.22 | 32669.72 |
-8.98 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_streaming | RuntimeMs | DirectRunner | 3549.7 | 3736.0 | 5.25 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_streaming | RuntimeMs | FlinkRunner | 921.56 | 969.83 | 5.24 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_streaming | RuntimeMs | DataflowRunner | 41095.04 | 25363.11 |
-38.28 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_streaming | RuntimeMs | DirectRunner | 3586.33 | 3250.5 | -9.36 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_streaming | RuntimeMs | FlinkRunner | 705.41 | 549.44 | -22.11 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_batch | RuntimeMs | DataflowRunner | 113989.23 | 115942.94 |
1.71 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_batch | RuntimeMs | DirectRunner | 2757.04 | 2863.56 | 3.86
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_streaming | RuntimeMs | DataflowRunner | 62269.77 | 55003.33
| -11.67 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_streaming | RuntimeMs | DirectRunner | 4054.85 | 4201.83 |
3.62 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_streaming | RuntimeMs | FlinkRunner | 1450.33 | 1560.5 | 7.6
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_batch | RuntimeMs | DataflowRunner | 58110.32 | 82610.0 | 42.16 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_4_batch | RuntimeMs | DirectRunner | 1479.96 | 1551.74 | 4.85 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_4_batch | RuntimeMs | FlinkRunner | 826.37 | 870.5 | 5.34 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_4_batch | RuntimeMs | SparkRunner | 501.93 | 549.33 | 9.45 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_4_batch | RuntimeMs | SparkStructuredStreamingRunner | 1101.59 |
1180.22 | 7.14 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_4_streaming | RuntimeMs | DataflowRunner | 53154.11 | 48927.5 | -7.95
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_streaming | RuntimeMs | DirectRunner | 1237.44 | 1267.83 | 2.46 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_streaming | RuntimeMs | FlinkRunner | 1129.89 | 1183.5 | 4.74 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_batch | RuntimeMs | DataflowRunner | 87739.61 | 77868.72 | -11.25 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_batch | RuntimeMs | DirectRunner | 5055.04 | 6491.21 | 28.41 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_batch | RuntimeMs | FlinkRunner | 675.85 | 708.94 | 4.9 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_5_batch | RuntimeMs | SparkRunner | 559.52 | 583.06 | 4.21 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_5_batch | RuntimeMs | SparkStructuredStreamingRunner | 1201.63 |
1242.11 | 3.37 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_5_streaming | RuntimeMs | DataflowRunner | 137121.79 | 122330.5 |
-10.79 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_streaming | RuntimeMs | DirectRunner | 5977.85 | 7077.83 | 18.4 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_streaming | RuntimeMs | FlinkRunner | 1272.33 | 1413.61 | 11.1 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_batch | RuntimeMs | DataflowRunner | 56564.14 | 60132.11 | 6.31 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_batch | RuntimeMs | DirectRunner | 968.67 | 1106.26 | 14.2 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_batch | RuntimeMs | FlinkRunner | 394.85 | 455.61 | 15.39 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_6_batch | RuntimeMs | SparkRunner | 259.78 | 300.11 | 15.53 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_batch | RuntimeMs | SparkStructuredStreamingRunner | 275.33 | 294.78
| 7.06 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_6_streaming | RuntimeMs | DataflowRunner | 42937.32 | 42628.56 | -0.72
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_streaming | RuntimeMs | DirectRunner | 920.22 | 979.5 | 6.44 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_streaming | RuntimeMs | FlinkRunner | 468.04 | 590.17 | 26.09 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_batch | RuntimeMs | DataflowRunner | 95743.46 | 112992.61 | 18.02 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_batch | RuntimeMs | DirectRunner | 3263.56 | 3470.05 | 6.33 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_batch | RuntimeMs | FlinkRunner | 547.26 | 539.17 | -1.48 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_batch | RuntimeMs | SparkRunner | 454.44 | 474.0 | 4.3 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_batch | RuntimeMs | SparkStructuredStreamingRunner | 1543.04 |
1571.11 | 1.82 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_batch | RuntimeMs | DataflowRunner | 146532.07 | 147984.0 | 0.99
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_batch | RuntimeMs | DirectRunner | 89934.85 | 93018.94 | 3.43 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_batch | RuntimeMs | SparkRunner | 2355.48 | 2384.56 | 1.23 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 2812.3 |
2873.61 | 2.18 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_sql_streaming | RuntimeMs | DataflowRunner | 1632173.26 | 1125483.17
| -31.04 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_streaming | RuntimeMs | DirectRunner | 104163.89 | 108043.44 |
3.72 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_streaming | RuntimeMs | FlinkRunner | 3844.96 | 4119.78 | 7.15 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_streaming | RuntimeMs | DataflowRunner | 106941.96 | 110174.33 |
3.02 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_streaming | RuntimeMs | DirectRunner | 7682.22 | 8053.44 | 4.83 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_streaming | RuntimeMs | FlinkRunner | 9507.19 | 9507.56 | 0.0 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_batch | RuntimeMs | DataflowRunner | 62164.39 | 77507.94 | 24.68 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_8_batch | RuntimeMs | DirectRunner | 1488.0 | 1568.79 | 5.43 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_batch | RuntimeMs | FlinkRunner | 472.59 | 497.89 | 5.35 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_8_batch | RuntimeMs | SparkRunner | 359.33 | 389.44 | 8.38 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_8_batch | RuntimeMs | SparkStructuredStreamingRunner | 363.56 | 376.89
| 3.67 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_8_streaming | RuntimeMs | DataflowRunner | 53939.5 | 45267.33 | -16.08
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_streaming | RuntimeMs | DirectRunner | 2478.37 | 2553.56 | 3.03 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_streaming | RuntimeMs | FlinkRunner | 438.37 | 446.67 | 1.89 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_batch | RuntimeMs | DataflowRunner | 56061.29 | 67809.33 | 20.96 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_9_batch | RuntimeMs | DirectRunner | 682.3 | 703.89 | 3.17 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_batch | RuntimeMs | FlinkRunner | 315.19 | 340.72 | 8.1 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_9_batch | RuntimeMs | SparkRunner | 196.0 | 206.67 | 5.44 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_9_batch | RuntimeMs | SparkStructuredStreamingRunner | 171.59 | 168.72
| -1.67 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_9_streaming | RuntimeMs | DataflowRunner | 34381.86 | 31319.67 | -8.91
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_streaming | RuntimeMs | DirectRunner | 648.85 | 672.06 | 3.58 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_streaming | RuntimeMs | FlinkRunner | 377.96 | 419.5 | 10.99 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)