You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/02/21 11:56:32 UTC
Beam Metrics Report (2023-02-21)
# Beam Metrics Report
Color legend: >= 20 | >= 10 | <= -10 | <= -20
---|---|---|---
## Possible regression
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
cdapioit_results | read_time | - | 15.03 | 16.87 | 12.26 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
go_batch_gbk_7 | dataflow_runtime | - | 115.41 | 134.93 | 16.92 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_cogbk_1 | sparkstructuredstreaming_runtime_sec | - | 70.17 | 81.0 |
15.43 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | sparkstructuredstreaming_runtime_sec | - | 75.09 | 89.63
| 19.36 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | dataflow_runtime_sec | - | 14.18 | 15.81 | 11.45 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | dataflow_v2_java17_runtime_sec | - | 12.12 | 13.57 |
11.98 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | dataflow_v2_java17_runtime_sec | - | 12.22 | 15.16 |
24.03 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_combine_5 | dataflow_runtime_sec | - | 25.52 | 30.13 | 18.1 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_gbk_2 | sparkstructuredstreaming_runtime_sec | - | 54.69 | 62.48 |
14.25 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_runtime_sec | - | 11.65 | 12.92 | 10.94 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | dataflow_runtime_sec | - | 18.89 | 20.78 | 10.01 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | dataflow_v2_java17_runtime_sec | - | 19.89 | 22.9 | 15.1 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | dataflow_v2_java11_runtime_sec | - | 26.89 | 29.65 | 10.27
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_pardo_1 | dataflow_v2_java11_runtime_sec | - | 13.54 | 17.28 |
27.59 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_1 | dataflow_v2_java17_runtime_sec | - | 12.86 | 15.14 |
17.72 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_1 | sparkstructuredstreaming_runtime_sec | - | 24.93 | 32.52
| 30.43 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_cogbk_4 | dataflow_v2_java17_runtime_sec | - | 297.61 | 348.85
| 17.22 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_gbk_3 | dataflow_v2_java17_runtime_sec | - | 62.77 | 69.7 |
11.04 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_5 | dataflow_v2_java11_runtime_sec | - | 594.04 | 697.93 |
17.49 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_6 | dataflow_v2_java11_runtime_sec | - | 150.07 | 169.36 |
12.86 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_7 | dataflow_v2_java17_runtime_sec | - | 222.54 | 291.74 |
31.1 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
kafkaioit_results | read_time | - | 890.4 | 1011.3 | 13.58 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
mongodbioit_results | read_time | - | 25.86 | 29.19 | 12.87 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_results | read_time | - | 83.18 | 93.38 | 12.26 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
python_batch_cogbk_2 | python_dataflow_batch_cogbk_2_runtime | - | 238.0 |
272.4 | 14.45 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_combine_5 | python_dataflow_batch_combine_5_runtime | - | 29.29 |
34.0 | 16.1 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_gbk_3 | python_dataflow_batch_gbk_3_runtime | - | 24.14 | 30.8 |
27.57 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_pardo_3 | python_dataflow_batch_pardo_3_runtime | - | 121.14 |
155.4 | 28.28 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_sideinput_2 | python_dataflow_batch_sideinput_2_runtime | - |
2.29 | 3.0 | 31.25 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_psio_2GB_results | pubsub_io_perf_write_runtime | - | 120.86 | 163.5 |
35.28 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_streaming_gbk_3 | python_dataflow_streaming_gbk_3_runtime | - | 74.71 |
99.4 | 33.04 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
nexmark_0_batch | RuntimeMs | DirectRunner | 1783.16 | 2123.67 | 19.1 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_batch | RuntimeMs | SparkRunner | 3510.0 | 4836.57 | 37.79 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_streaming | RuntimeMs | FlinkRunner | 3218.12 | 3754.05 |
16.65 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_10_batch | RuntimeMs | DirectRunner | 5602.62 | 7773.67 | 38.75 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_10_streaming | RuntimeMs | DataflowRunner | 99964.25 | 333912.78 |
234.03 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_streaming | RuntimeMs | DirectRunner | 52614.96 | 69076.81 | 31.29
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_batch | RuntimeMs | DirectRunner | 1417.68 | 1563.1 | 10.26 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_batch | RuntimeMs | FlinkRunner | 252.0 | 287.19 | 13.96 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_batch | RuntimeMs | DirectRunner | 3460.84 | 4111.76 | 18.81 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_sql_batch | RuntimeMs | DirectRunner | 10088.68 | 12178.38 | 20.71
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_zetasql_batch | RuntimeMs | DirectRunner | 11242.48 | 13471.24 |
19.82 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_zetasql_batch | RuntimeMs | SparkRunner | 3870.84 | 5379.33 | 38.97
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_14_batch | RuntimeMs | DirectRunner | 4249.16 | 4675.76 | 10.04 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_15_batch | RuntimeMs | FlinkRunner | 435.12 | 486.67 | 11.85 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_15_batch | RuntimeMs | SparkStructuredStreamingRunner | 1029.52 |
1148.95 | 11.6 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_16_streaming | RuntimeMs | DirectRunner | 134645.96 | 164238.14 |
21.98 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_batch | RuntimeMs | DirectRunner | 3732.0 | 4228.81 | 13.31 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_streaming | RuntimeMs | FlinkRunner | 823.72 | 943.67 | 14.56 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_batch | RuntimeMs | DirectRunner | 159.14 | 279.67 | 75.74 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_sql_batch | RuntimeMs | DirectRunner | 1623.28 | 1787.86 | 10.14 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_batch | RuntimeMs | DirectRunner | 2947.56 | 3249.0 | 10.23
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_zetasql_batch | RuntimeMs | SparkRunner | 1106.56 | 1221.9 | 10.42 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_batch | RuntimeMs | DirectRunner | 1005.18 | 1205.86 | 19.96 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_streaming | RuntimeMs | DataflowRunner | 32310.48 | 36064.45 |
11.62 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_streaming | RuntimeMs | FlinkRunner | 635.28 | 700.86 | 10.32 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_batch | RuntimeMs | SparkRunner | 3472.32 | 3932.9 | 13.26 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_streaming | RuntimeMs | DataflowRunner | 49916.22 | 57631.27
| 15.46 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_streaming | RuntimeMs | FlinkRunner | 1493.36 | 1745.71 |
16.9 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_batch | RuntimeMs | DirectRunner | 4450.86 | 5175.48 | 16.28 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_streaming | RuntimeMs | DirectRunner | 23362.84 | 30660.67 | 31.24 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_5_streaming | RuntimeMs | FlinkRunner | 1411.04 | 1556.1 | 10.28 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_7_batch | RuntimeMs | DirectRunner | 8956.08 | 10210.69 | 14.01 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_7_sql_batch | RuntimeMs | DataflowRunner | 77045.7 | 90994.27 | 18.1 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_sql_batch | RuntimeMs | DirectRunner | 236395.64 | 1310318.14 |
454.29 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_streaming | RuntimeMs | DirectRunner | 910056.04 | 2902227.88 |
218.91 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_8_batch | RuntimeMs | DirectRunner | 697.58 | 791.6 | 13.48 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_batch | RuntimeMs | SparkRunner | 567.28 | 626.67 | 10.47 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_streaming | RuntimeMs | FlinkRunner | 403.56 | 461.9 | 14.46 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
tpcds_query10_Calcite_1GB | RuntimeMs | FlinkRunner | 35767.81 | 40759.19 |
13.95 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query25_Calcite_1GB | RuntimeMs | FlinkRunner | 42126.5 | 48054.19 |
14.07 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query29_Calcite_1GB | RuntimeMs | FlinkRunner | 40771.38 | 46696.76 |
14.53 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query35_Calcite_1GB | RuntimeMs | FlinkRunner | 30409.77 | 35191.71 |
15.73 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query38_Calcite_1GB | RuntimeMs | FlinkRunner | 22935.69 | 26735.9 |
16.57 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query3_Calcite_1GB | RuntimeMs | FlinkRunner | 36080.88 | 40976.29 |
13.57 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query3_Calcite_1GB | RuntimeMs | SparkRunner | 34050.72 | 38213.9 |
12.23 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query40_Calcite_1GB | RuntimeMs | FlinkRunner | 30245.31 | 34842.9 |
15.2 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query42_Calcite_1GB | RuntimeMs | FlinkRunner | 23395.85 | 25856.81 |
10.52 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query43_Calcite_1GB | RuntimeMs | FlinkRunner | 23571.0 | 26048.9 |
10.51 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query52_Calcite_1GB | RuntimeMs | FlinkRunner | 23458.88 | 25862.38 |
10.25 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query55_Calcite_1GB | RuntimeMs | FlinkRunner | 22976.0 | 25435.86 |
10.71 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query69_Calcite_1GB | RuntimeMs | FlinkRunner | 31436.54 | 35748.38 |
13.72 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query7_Calcite_1GB | RuntimeMs | FlinkRunner | 38729.31 | 43235.1 |
11.63 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query84_Calcite_1GB | RuntimeMs | FlinkRunner | 20584.27 | 23509.19 |
14.21 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query87_Calcite_1GB | RuntimeMs | FlinkRunner | 23672.85 | 27336.67 |
15.48 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query93_Calcite_1GB | RuntimeMs | FlinkRunner | 48908.42 | 55821.43 |
14.13 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query96_Calcite_1GB | RuntimeMs | FlinkRunner | 20025.15 | 22467.62 |
12.2 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
## Possible improvement
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
avroioit_hdfs_results | read_time | - | 90.2 | 79.41 | -11.96 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_avro | avro_write_time | - | 35.08 | 30.94 |
-11.8 | [[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
java_batch_combine_4 | dataflow_runtime_sec | - | 31.62 | 26.92 | -14.85 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_gbk_3 | dataflow_v2_java11_runtime_sec | - | 18.73 | 11.62 | -37.96
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_v2_java17_runtime_sec | - | 14.52 | 11.9 | -18.06
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | dataflow_v2_java11_runtime_sec | - | 54.03 | 36.19 | -33.02
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | dataflow_v2_java17_runtime_sec | - | 93.02 | 34.26 | -63.17
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_pardo_2 | dataflow_v2_java17_runtime_sec | - | 60.55 | 53.35 |
-11.89 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | dataflow_v2_java11_runtime_sec | - | 12.51 | 10.19 |
-18.53 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | dataflow_v2_java17_runtime_sec | - | 13.9 | 10.71 |
-22.91 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_cogbk_1 | dataflow_v2_java17_runtime_sec | - | 2606.43 |
2175.14 | -16.55 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_gbk_1 | dataflow_v2_java11_runtime_sec | - | 1016.6 | 854.76 |
-15.92 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_2 | dataflow_v2_java11_runtime_sec | - | 2958.46 | 2606.28
| -11.9 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_2 | dataflow_v2_java17_runtime_sec | - | 3516.87 | 2831.8 |
-19.48 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_4 | dataflow_v2_java17_runtime_sec | - | 620.74 | 550.37 |
-11.34 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_6 | dataflow_v2_java17_runtime_sec | - | 177.15 | 145.73 |
-17.74 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_pardo_1 | dataflow_v2_java11_runtime_sec | - | 26.56 | 23.19 |
-12.7 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_2 | dataflow_v2_java11_runtime_sec | - | 97.93 | 87.64 |
-10.51 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_2 | dataflow_v2_java17_runtime_sec | - | 100.95 | 88.91 |
-11.93 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_combine_4 | python_dataflow_batch_combine_4_runtime | - | 43.86 |
29.8 | -32.05 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_gbk_4 | python_dataflow_batch_gbk_4_runtime | - | 102.57 | 62.4 |
-39.16 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_pardo_1 | python_dataflow_batch_pardo_1_runtime | - | 159.14 |
135.8 | -14.67 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_sideinput_10 | python_dataflow_batch_sideinput_10_runtime | - |
918.86 | 711.0 | -22.62 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_8 | python_dataflow_batch_sideinput_8_runtime | - |
167.71 | 134.2 | -19.98 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_bqio_read_10GB_results | bqio_read_10GB_results_runtime | - | 106.0 |
89.0 | -16.04 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_streaming_pardo_3 | python_dataflow_streaming_pardo_3_runtime | - |
231.43 | 169.0 | -26.98 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
xmlioit_hdfs_results | read_time | - | 23.63 | 20.56 | -13.01 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_hdfs_results | write_time | - | 26.16 | 21.77 | -16.78 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
nexmark_0_batch | RuntimeMs | DataflowRunner | 26749.75 | 18435.75 | -31.08 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_streaming | RuntimeMs | DataflowRunner | 38980.02 | 34901.86 |
-10.46 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_batch | RuntimeMs | DataflowRunner | 47515.68 | 30172.77 | -36.5 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_11_batch | RuntimeMs | DataflowRunner | 37386.57 | 22295.25 | -40.37 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_12_batch | RuntimeMs | DataflowRunner | 18674.81 | 11713.24 | -37.28 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_15_batch | RuntimeMs | DataflowRunner | 50806.66 | 31683.81 | -37.64 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_16_batch | RuntimeMs | DataflowRunner | 50817.24 | 32292.63 | -36.45 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_1_batch | RuntimeMs | DataflowRunner | 21164.16 | 14173.39 | -33.03 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_streaming | RuntimeMs | DataflowRunner | 29989.31 | 26805.65 |
-10.62 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_batch | RuntimeMs | DataflowRunner | 14706.32 | 9432.42 | -35.86 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_streaming | RuntimeMs | DataflowRunner | 19786.89 | 17303.69 |
-12.55 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_streaming | RuntimeMs | DataflowRunner | 46899.26 | 41710.78 |
-11.06 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_5_batch | RuntimeMs | DataflowRunner | 31070.26 | 20118.37 | -35.25 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_streaming | RuntimeMs | DataflowRunner | 123598.91 | 108149.55 |
-12.5 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_8_batch | RuntimeMs | DataflowRunner | 21435.32 | 13300.63 | -37.95 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
## All metrics
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
avroioit_hdfs_results | read_time | - | 90.2 | 79.41 | -11.96 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_hdfs_results | write_time | - | 121.4 | 122.86 | 1.2 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_results | read_time | - | 90.01 | 87.44 | -2.85 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_results | write_time | - | 121.12 | 121.44 | 0.26 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_avro | avro_write_time | - | 35.08 | 30.94 |
-11.8 | [[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_avro | read_time | - | 41.76 | 43.1 | 3.21 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_json | read_time | - | 41.54 | 40.29 | -3.01 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_json | write_time | - | 53.73 | 52.08 | -3.06 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_stream | read_time | - | 43.23 | 44.57 | 3.1 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_stream | write_time | - | 205.89 | 208.99 | 1.51 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
cdapioit_results | read_time | - | 15.03 | 16.87 | 12.26 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
cdapioit_results | write_time | - | 26.0 | 26.02 | 0.09 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_hdfs_results | read_time | - | 136.44 | 126.91 | -6.99 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_hdfs_results | write_time | - | 215.44 | 214.35 | -0.51 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_results | read_time | - | 134.75 | 128.13 | -4.91 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_results | write_time | - | 209.2 | 212.07 | 1.37 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
go_batch_cogbk_1 | dataflow_runtime | - | 258.35 | 257.64 | -0.28 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_cogbk_2 | dataflow_runtime | - | 147.85 | 146.38 | -0.99 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_cogbk_3 | dataflow_runtime | - | 114.16 | 113.28 | -0.77 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_cogbk_4 | dataflow_runtime | - | 110.72 | 109.17 | -1.4 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_combine_1 | dataflow_runtime | - | 432.84 | 428.33 | -1.04 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
go_batch_combine_4 | dataflow_runtime | - | 75.94 | 75.12 | -1.08 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
go_batch_combine_5 | dataflow_runtime | - | 70.6 | 69.56 | -1.46 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
go_batch_gbk_1 | dataflow_runtime | - | 389.3 | 397.02 | 1.99 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_2 | dataflow_runtime | - | 100.74 | 102.16 | 1.41 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_3 | dataflow_runtime | - | 24.93 | 25.47 | 2.18 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_4 | dataflow_runtime | - | 55.41 | 54.48 | -1.66 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_5 | dataflow_runtime | - | 42.87 | 44.57 | 3.95 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_6 | dataflow_runtime | - | 102.95 | 103.29 | 0.32 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_7 | dataflow_runtime | - | 115.41 | 134.93 | 16.92 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_pardo_1 | dataflow_runtime | - | 84.39 | 84.11 | -0.33 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_2 | dataflow_runtime | - | 619.82 | 601.88 | -2.9 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_3 | dataflow_runtime | - | 67.66 | 65.39 | -3.35 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_4 | dataflow_runtime | - | 69.59 | 71.59 | 2.88 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_sideinput_3 | dataflow_runtime | - | 2.65 | 2.43 | -8.13 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
go_batch_sideinput_4 | dataflow_runtime | - | 243.33 | 227.18 | -6.64 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
hadoopformatioit_results | read_time | - | 14.78 | 14.6 | -1.23 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
hadoopformatioit_results | write_time | - | 26.36 | 26.75 | 1.48 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
java_batch_cogbk_1 | dataflow_runtime_sec | - | 39.96 | 40.27 | 0.77 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_1 | dataflow_v2_java11_runtime_sec | - | 47.15 | 47.6 | 0.97
| [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_1 | dataflow_v2_java17_runtime_sec | - | 49.39 | 46.1 | -6.65
| [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_1 | sparkstructuredstreaming_runtime_sec | - | 70.17 | 81.0 |
15.43 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | dataflow_runtime_sec | - | 41.59 | 43.01 | 3.43 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | dataflow_v2_java11_runtime_sec | - | 48.49 | 46.33 |
-4.46 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | dataflow_v2_java17_runtime_sec | - | 46.36 | 43.67 | -5.8
| [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | sparkstructuredstreaming_runtime_sec | - | 75.09 | 89.63
| 19.36 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | dataflow_runtime_sec | - | 14.18 | 15.81 | 11.45 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | dataflow_v2_java11_runtime_sec | - | 12.92 | 13.36 | 3.4
| [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | dataflow_v2_java17_runtime_sec | - | 12.12 | 13.57 |
11.98 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | sparkstructuredstreaming_runtime_sec | - | 14.95 | 14.21
| -5.0 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | dataflow_runtime_sec | - | 15.78 | 14.4 | -8.8 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | dataflow_v2_java11_runtime_sec | - | 13.63 | 12.89 |
-5.48 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | dataflow_v2_java17_runtime_sec | - | 12.22 | 15.16 |
24.03 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | sparkstructuredstreaming_runtime_sec | - | 15.07 | 14.35
| -4.76 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_combine_1 | dataflow_runtime_sec | - | 65.12 | 66.78 | 2.53 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_1 | sparkstructuredstreaming_runtime_sec | - | 269.45 |
270.97 | 0.56 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_4 | dataflow_runtime_sec | - | 31.62 | 26.92 | -14.85 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_4 | sparkstructuredstreaming_runtime_sec | - | 56.19 |
53.73 | -4.38 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_5 | dataflow_runtime_sec | - | 25.52 | 30.13 | 18.1 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_5 | sparkstructuredstreaming_runtime_sec | - | 50.92 |
52.57 | 3.24 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_gbk_1 | dataflow_runtime_sec | - | 120.59 | 117.76 | -2.34 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_1 | dataflow_v2_java11_runtime_sec | - | 89.36 | 89.96 | 0.67 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_1 | dataflow_v2_java17_runtime_sec | - | 85.72 | 87.75 | 2.37 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_1 | sparkstructuredstreaming_runtime_sec | - | 259.78 | 253.76
| -2.31 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | dataflow_runtime_sec | - | 33.36 | 36.39 | 9.06 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | dataflow_v2_java11_runtime_sec | - | 42.96 | 41.28 | -3.9 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | dataflow_v2_java17_runtime_sec | - | 42.59 | 40.42 | -5.09
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | sparkstructuredstreaming_runtime_sec | - | 54.69 | 62.48 |
14.25 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_runtime_sec | - | 11.65 | 12.92 | 10.94 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_v2_java11_runtime_sec | - | 18.73 | 11.62 | -37.96
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_v2_java17_runtime_sec | - | 14.52 | 11.9 | -18.06
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | sparkstructuredstreaming_runtime_sec | - | 8.68 | 8.33 |
-4.1 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | dataflow_runtime_sec | - | 18.79 | 19.03 | 1.29 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | dataflow_v2_java11_runtime_sec | - | 21.42 | 21.62 | 0.95 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | dataflow_v2_java17_runtime_sec | - | 20.32 | 22.14 | 8.97 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | sparkstructuredstreaming_runtime_sec | - | 52.12 | 49.35 |
-5.31 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | dataflow_runtime_sec | - | 18.89 | 20.78 | 10.01 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | dataflow_v2_java11_runtime_sec | - | 19.76 | 19.72 | -0.19
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | dataflow_v2_java17_runtime_sec | - | 19.89 | 22.9 | 15.1 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | sparkstructuredstreaming_runtime_sec | - | 49.75 | 48.08 |
-3.37 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | dataflow_runtime_sec | - | 38.27 | 39.49 | 3.18 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | dataflow_v2_java11_runtime_sec | - | 26.89 | 29.65 | 10.27
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | dataflow_v2_java17_runtime_sec | - | 31.26 | 32.19 | 2.96 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | sparkstructuredstreaming_runtime_sec | - | 32.45 | 32.39 |
-0.2 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | dataflow_runtime_sec | - | 44.19 | 45.66 | 3.34 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | dataflow_v2_java11_runtime_sec | - | 54.03 | 36.19 | -33.02
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | dataflow_v2_java17_runtime_sec | - | 93.02 | 34.26 | -63.17
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | sparkstructuredstreaming_runtime_sec | - | 37.13 | 36.68 |
-1.21 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_pardo_1 | dataflow_runtime_sec | - | 20.61 | 19.9 | -3.41 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_1 | dataflow_v2_java11_runtime_sec | - | 13.54 | 17.28 |
27.59 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_1 | dataflow_v2_java17_runtime_sec | - | 12.86 | 15.14 |
17.72 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_1 | sparkstructuredstreaming_runtime_sec | - | 24.93 | 32.52
| 30.43 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_2 | dataflow_runtime_sec | - | 209.32 | 208.57 | -0.36 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_2 | dataflow_v2_java11_runtime_sec | - | 59.05 | 54.05 |
-8.47 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_2 | dataflow_v2_java17_runtime_sec | - | 60.55 | 53.35 |
-11.89 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | dataflow_runtime_sec | - | 13.9 | 15.02 | 8.09 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | dataflow_v2_java11_runtime_sec | - | 12.51 | 10.19 |
-18.53 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | dataflow_v2_java17_runtime_sec | - | 13.9 | 10.71 |
-22.91 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_4 | dataflow_runtime_sec | - | 28.13 | 28.74 | 2.18 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_4 | dataflow_v2_java11_runtime_sec | - | 26.32 | 27.75 | 5.42
| [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_4 | dataflow_v2_java17_runtime_sec | - | 24.51 | 22.69 |
-7.44 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_cogbk_1 | dataflow_runtime_sec | - | 872.6 | 789.84 | -9.48 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_1 | dataflow_v2_java11_runtime_sec | - | 3005.89 |
2851.74 | -5.13 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_1 | dataflow_v2_java17_runtime_sec | - | 2606.43 |
2175.14 | -16.55 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_2 | dataflow_runtime_sec | - | 917.57 | 924.82 | 0.79 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_2 | dataflow_v2_java11_runtime_sec | - | 3115.11 |
2941.95 | -5.56 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_2 | dataflow_v2_java17_runtime_sec | - | 2960.86 |
2987.15 | 0.89 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_3 | dataflow_runtime_sec | - | 121.41 | 109.31 | -9.96 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_3 | dataflow_v2_java11_runtime_sec | - | 378.28 | 366.57
| -3.1 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_3 | dataflow_v2_java17_runtime_sec | - | 348.02 | 314.68
| -9.58 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_4 | dataflow_runtime_sec | - | 125.13 | 114.87 | -8.2 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_4 | dataflow_v2_java11_runtime_sec | - | 363.26 | 332.86
| -8.37 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_4 | dataflow_v2_java17_runtime_sec | - | 297.61 | 348.85
| 17.22 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_combine_1 | dataflow_runtime_sec | - | 482.69 | 474.54 | -1.69
| [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_combine_4 | dataflow_runtime_sec | - | 313.08 | 306.95 | -1.96
| [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_combine_5 | dataflow_runtime_sec | - | 317.67 | 306.83 | -3.41
| [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_gbk_1 | dataflow_runtime_sec | - | 640.71 | 644.58 | 0.6 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_1 | dataflow_v2_java11_runtime_sec | - | 1016.6 | 854.76 |
-15.92 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_1 | dataflow_v2_java17_runtime_sec | - | 859.19 | 832.88 |
-3.06 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_2 | dataflow_runtime_sec | - | 844.31 | 815.67 | -3.39 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_2 | dataflow_v2_java11_runtime_sec | - | 2958.46 | 2606.28
| -11.9 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_2 | dataflow_v2_java17_runtime_sec | - | 3516.87 | 2831.8 |
-19.48 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_3 | dataflow_runtime_sec | - | 23.72 | 25.1 | 5.79 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_3 | dataflow_v2_java11_runtime_sec | - | 56.71 | 57.05 |
0.6 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_3 | dataflow_v2_java17_runtime_sec | - | 62.77 | 69.7 |
11.04 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_4 | dataflow_runtime_sec | - | 303.31 | 289.43 | -4.58 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_4 | dataflow_v2_java11_runtime_sec | - | 600.82 | 631.36 |
5.08 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_4 | dataflow_v2_java17_runtime_sec | - | 620.74 | 550.37 |
-11.34 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_5 | dataflow_runtime_sec | - | 282.59 | 301.15 | 6.57 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_5 | dataflow_v2_java11_runtime_sec | - | 594.04 | 697.93 |
17.49 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_5 | dataflow_v2_java17_runtime_sec | - | 585.53 | 550.22 |
-6.03 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_6 | dataflow_runtime_sec | - | 76.16 | 74.96 | -1.58 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_6 | dataflow_v2_java11_runtime_sec | - | 150.07 | 169.36 |
12.86 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_6 | dataflow_v2_java17_runtime_sec | - | 177.15 | 145.73 |
-17.74 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_7 | dataflow_runtime_sec | - | 136.32 | 127.69 | -6.33 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_7 | dataflow_v2_java11_runtime_sec | - | 231.51 | 221.07 |
-4.51 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_7 | dataflow_v2_java17_runtime_sec | - | 222.54 | 291.74 |
31.1 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_pardo_1 | dataflow_runtime_sec | - | 18.86 | 20.11 | 6.61 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_1 | dataflow_v2_java11_runtime_sec | - | 26.56 | 23.19 |
-12.7 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_1 | dataflow_v2_java17_runtime_sec | - | 24.28 | 23.01 |
-5.22 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_2 | dataflow_runtime_sec | - | 208.74 | 217.9 | 4.39 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_2 | dataflow_v2_java11_runtime_sec | - | 97.93 | 87.64 |
-10.51 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_2 | dataflow_v2_java17_runtime_sec | - | 100.95 | 88.91 |
-11.93 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_3 | dataflow_runtime_sec | - | 12.44 | 11.89 | -4.41 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_3 | dataflow_v2_java11_runtime_sec | - | 23.73 | 22.6 |
-4.78 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_3 | dataflow_v2_java17_runtime_sec | - | 20.97 | 20.5 |
-2.25 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_4 | dataflow_runtime_sec | - | 31.84 | 31.15 | -2.15 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_4 | dataflow_v2_java11_runtime_sec | - | 37.88 | 39.89 |
5.31 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_4 | dataflow_v2_java17_runtime_sec | - | 37.65 | 36.3 |
-3.59 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
jdbcioit_results | read_time | - | 26.24 | 25.71 | -1.99 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
jdbcioit_results | write_time | - | 39.42 | 40.3 | 2.24 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results | read_time | - | 890.4 | 1011.3 | 13.58 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results | write_time | - | 163.97 | 165.39 | 0.87 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results_runner_v2 | read_time | - | 956.27 | 937.09 | -2.01 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results_runner_v2 | write_time | - | 170.63 | 172.99 | 1.38 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_hdfs_results | read_time | - | 16.18 | 15.89 | -1.76 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_hdfs_results | write_time | - | 68.97 | 67.37 | -2.32 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_results | read_time | - | 23.0 | 25.17 | 9.42 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_results | write_time | - | 61.46 | 64.25 | 4.55 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
mongodbioit_results | read_time | - | 25.86 | 29.19 | 12.87 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
mongodbioit_results | write_time | - | 50.08 | 49.41 | -1.34 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_hdfs_results | read_time | - | 87.82 | 79.32 | -9.68 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_hdfs_results | write_time | - | 144.68 | 132.66 | -8.31 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_results | read_time | - | 83.18 | 93.38 | 12.26 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_results | write_time | - | 139.99 | 146.1 | 4.37 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
python_batch_cogbk_1 | python_dataflow_batch_cogbk_1_runtime | - | 385.14 |
389.4 | 1.11 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_2 | python_dataflow_batch_cogbk_2_runtime | - | 238.0 |
272.4 | 14.45 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_3 | python_dataflow_batch_cogbk_3_runtime | - | 216.29 |
208.8 | -3.46 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_4 | python_dataflow_batch_cogbk_4_runtime | - | 208.14 |
203.4 | -2.28 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_combine_1 | python_dataflow_batch_combine_1_runtime | - | 767.14
| 751.0 | -2.1 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_4 | python_dataflow_batch_combine_4_runtime | - | 43.86 |
29.8 | -32.05 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_5 | python_dataflow_batch_combine_5_runtime | - | 29.29 |
34.0 | 16.1 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_gbk_1 | python_dataflow_batch_gbk_1_runtime | - | 1316.86 |
1336.0 | 1.45 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_2 | python_dataflow_batch_gbk_2_runtime | - | 241.43 | 264.8
| 9.68 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_3 | python_dataflow_batch_gbk_3_runtime | - | 24.14 | 30.8 |
27.57 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_4 | python_dataflow_batch_gbk_4_runtime | - | 102.57 | 62.4 |
-39.16 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_5 | python_dataflow_batch_gbk_5_runtime | - | 102.29 | 97.4 |
-4.78 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_6 | python_dataflow_batch_gbk_6_runtime | - | 245.5 | 226.2 |
-7.86 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_7 | python_dataflow_batch_gbk_7_runtime | - | 244.83 | 231.6
| -5.41 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_pardo_1 | python_dataflow_batch_pardo_1_runtime | - | 159.14 |
135.8 | -14.67 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_2 | python_dataflow_batch_pardo_2_runtime | - | 1365.57 |
1358.0 | -0.55 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_3 | python_dataflow_batch_pardo_3_runtime | - | 121.14 |
155.4 | 28.28 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_4 | python_dataflow_batch_pardo_4_runtime | - | 319.71 |
322.0 | 0.71 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_sideinput_1 | python_dataflow_batch_sideinput_1_runtime | - |
2.14 | 2.17 | 1.11 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_10 | python_dataflow_batch_sideinput_10_runtime | - |
918.86 | 711.0 | -22.62 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_2 | python_dataflow_batch_sideinput_2_runtime | - |
2.29 | 3.0 | 31.25 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_3 | python_dataflow_batch_sideinput_3_runtime | - | 3.0
| 2.8 | -6.67 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_4 | python_dataflow_batch_sideinput_4_runtime | - |
28.86 | 27.4 | -5.05 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_5 | python_dataflow_batch_sideinput_5_runtime | - |
2.57 | 2.6 | 1.11 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_6 | python_dataflow_batch_sideinput_6_runtime | - |
2.43 | 2.4 | -1.18 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_7 | python_dataflow_batch_sideinput_7_runtime | - |
131.86 | 122.2 | -7.32 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_8 | python_dataflow_batch_sideinput_8_runtime | - |
167.71 | 134.2 | -19.98 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_9 | python_dataflow_batch_sideinput_9_runtime | - |
768.14 | 796.8 | 3.73 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_bqio_read_10GB_results | bqio_read_10GB_results_runtime | - | 106.0 |
89.0 | -16.04 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_bqio_write_10GB_results | bqio_write_10GB_results_runtime | - | 274.71
| 252.4 | -8.12 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_direct_microbenchmarks | fn_api_runner_microbenchmark_runtime_sec | - |
584.93 | 603.05 | 3.1 |
python_direct_microbenchmarks | teststream_microbenchmark_runtime_sec | - |
357.42 | 388.56 | 8.71 |
python_kafkaio_results | read_runtime | - | 234.57 | 230.4 | -1.78 |
[[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_kafkaio_results | write_runtime | - | 357.0 | 373.6 | 4.65 |
[[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_psio_2GB_results | pubsub_io_perf_read_runtime | - | 374.5 | 340.17 |
-9.17 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_psio_2GB_results | pubsub_io_perf_write_runtime | - | 120.86 | 163.5 |
35.28 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_spanner_write_2GB_results | pyspanner_write_2GB_results_runtime | - |
1839.86 | 1789.2 | -2.75 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_spannerio_read_2GB_results | pyspanner_read_2GB_results_runtime | - |
23.33 | 23.67 | 1.43 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_streaming_cogbk_1 | python_dataflow_streaming_cogbk_1_runtime | - |
612.0 | 563.2 | -7.97 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_2 | python_dataflow_streaming_cogbk_2_runtime | - |
319.17 | 348.2 | 9.1 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_3 | python_dataflow_streaming_cogbk_3_runtime | - |
375.33 | 368.0 | -1.95 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_4 | python_dataflow_streaming_cogbk_4_runtime | - |
319.67 | 325.0 | 1.67 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_gbk_3 | python_dataflow_streaming_gbk_3_runtime | - | 74.71 |
99.4 | 33.04 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_gbk_6 | python_dataflow_streaming_gbk_6_runtime | - | 453.0 |
446.0 | -1.55 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_gbk_7 | python_dataflow_streaming_gbk_7_runtime | - | 501.5 |
486.6 | -2.97 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_pardo_1 | python_dataflow_streaming_pardo_1_runtime | - |
193.0 | 203.6 | 5.49 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_2 | python_dataflow_streaming_pardo_2_runtime | - |
2411.71 | 2264.4 | -6.11 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_3 | python_dataflow_streaming_pardo_3_runtime | - |
231.43 | 169.0 | -26.98 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_4 | python_dataflow_streaming_pardo_4_runtime | - |
428.33 | 428.2 | -0.03 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_textio_1GB_results | read_runtime | - | 97.43 | 99.67 | 2.3 |
[[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_textio_1GB_results | write_runtime | - | 192.71 | 189.5 | -1.67 |
[[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
singlestoreioit_results | read_time | - | 90.19 | 85.79 | -4.88 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
singlestoreioit_results | write_time | - | 25.66 | 26.42 | 2.97 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
sparkreceiverioit_results | read_time | - | 765.18 | 792.2 | 3.53 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_hdfs_results | read_time | - | 17.96 | 18.6 | 3.57 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_hdfs_results | write_time | - | 37.67 | 35.26 | -6.4 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_results | read_time | - | 19.66 | 19.29 | -1.88 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_results | write_time | - | 34.96 | 31.8 | -9.03 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
tfrecordioit_results | read_time | - | 17.68 | 16.56 | -6.32 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
tfrecordioit_results | write_time | - | 22.29 | 23.09 | 3.58 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
wordcount_py37_results | runtime | - | 810.17 | 866.31 | 6.93 |
[[1]](http://metrics.beam.apache.org/d/1cnwVDkGk)
xmlioit_hdfs_results | read_time | - | 23.63 | 20.56 | -13.01 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_hdfs_results | write_time | - | 26.16 | 21.77 | -16.78 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_results | read_time | - | 25.69 | 26.58 | 3.45 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_results | write_time | - | 25.76 | 26.67 | 3.54 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
nexmark_0_batch | RuntimeMs | DataflowRunner | 26749.75 | 18435.75 | -31.08 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_batch | RuntimeMs | DirectRunner | 1783.16 | 2123.67 | 19.1 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_batch | RuntimeMs | FlinkRunner | 1064.56 | 1138.29 | 6.93 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_batch | RuntimeMs | SparkRunner | 1303.4 | 1400.62 | 7.46 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_batch | RuntimeMs | SparkStructuredStreamingRunner | 1310.64 |
1396.67 | 6.56 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_python_batch | RuntimeMs | DirectRunner | 12252.27 | 12309.52 | 0.47
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_sql_batch | RuntimeMs | DataflowRunner | 33071.81 | 33724.5 | 1.97 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_sql_batch | RuntimeMs | DirectRunner | 5879.64 | 6351.9 | 8.03 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_sql_batch | RuntimeMs | FlinkRunner | 1137.92 | 1213.14 | 6.61 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_sql_batch | RuntimeMs | SparkRunner | 3269.36 | 3369.38 | 3.06 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1535.52 |
1618.95 | 5.43 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_sql_streaming | RuntimeMs | DataflowRunner | 23607.74 | 24395.64 |
3.34 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_sql_streaming | RuntimeMs | DirectRunner | 15789.0 | 16131.12 | 2.17
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_sql_streaming | RuntimeMs | FlinkRunner | 1787.6 | 1937.62 | 8.39 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_streaming | RuntimeMs | DataflowRunner | 38980.02 | 34901.86 |
-10.46 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_streaming | RuntimeMs | DirectRunner | 12676.12 | 12695.05 | 0.15 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_streaming | RuntimeMs | FlinkRunner | 1530.0 | 1646.0 | 7.58 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_batch | RuntimeMs | DataflowRunner | 118581.48 | 125235.77 |
5.61 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_zetasql_batch | RuntimeMs | DirectRunner | 7108.56 | 7757.12 | 9.12
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_batch | RuntimeMs | FlinkRunner | 2266.08 | 2488.71 | 9.82 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_batch | RuntimeMs | SparkRunner | 3510.0 | 4836.57 | 37.79 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_batch | RuntimeMs | SparkStructuredStreamingRunner | 2866.56
| 3025.0 | 5.53 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_zetasql_streaming | RuntimeMs | DataflowRunner | 68752.07 | 70194.32
| 2.1 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_streaming | RuntimeMs | DirectRunner | 17661.8 | 18539.88 |
4.97 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_streaming | RuntimeMs | FlinkRunner | 3218.12 | 3754.05 |
16.65 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_10_batch | RuntimeMs | DataflowRunner | 47515.68 | 30172.77 | -36.5 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_10_batch | RuntimeMs | DirectRunner | 5602.62 | 7773.67 | 38.75 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_10_batch | RuntimeMs | FlinkRunner | 645.52 | 692.29 | 7.24 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_10_batch | RuntimeMs | SparkRunner | 681.4 | 722.67 | 6.06 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_10_batch | RuntimeMs | SparkStructuredStreamingRunner | 1003.32 |
1039.67 | 3.62 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_python_batch | RuntimeMs | DirectRunner | 25711.96 | 25954.14 |
0.94 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_streaming | RuntimeMs | DataflowRunner | 99964.25 | 333912.78 |
234.03 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_streaming | RuntimeMs | DirectRunner | 52614.96 | 69076.81 | 31.29
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_streaming | RuntimeMs | FlinkRunner | 1553.84 | 1598.24 | 2.86 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_11_batch | RuntimeMs | DataflowRunner | 37386.57 | 22295.25 | -40.37 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_11_batch | RuntimeMs | DirectRunner | 1417.68 | 1563.1 | 10.26 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_batch | RuntimeMs | FlinkRunner | 252.0 | 287.19 | 13.96 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_11_batch | RuntimeMs | SparkRunner | 1484.72 | 1526.33 | 2.8 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_11_batch | RuntimeMs | SparkStructuredStreamingRunner | 1269.96 |
1371.0 | 7.96 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_11_python_batch | RuntimeMs | DirectRunner | 20136.84 | 20394.38 |
1.28 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_11_streaming | RuntimeMs | DataflowRunner | 173412.48 | 171423.47 |
-1.15 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_11_streaming | RuntimeMs | DirectRunner | 10803.88 | 10796.62 | -0.07
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_streaming | RuntimeMs | FlinkRunner | 1524.64 | 1542.43 | 1.17 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_batch | RuntimeMs | DataflowRunner | 18674.81 | 11713.24 | -37.28 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_12_batch | RuntimeMs | DirectRunner | 2720.6 | 2936.52 | 7.94 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_12_batch | RuntimeMs | FlinkRunner | 175.08 | 177.24 | 1.23 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_12_batch | RuntimeMs | SparkRunner | 892.88 | 926.0 | 3.71 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_12_batch | RuntimeMs | SparkStructuredStreamingRunner | 923.12 | 954.1
| 3.36 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_12_streaming | RuntimeMs | DataflowRunner | 91825.83 | 89753.43 |
-2.26 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_streaming | RuntimeMs | DirectRunner | 9359.56 | 9369.95 | 0.11 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_streaming | RuntimeMs | FlinkRunner | 600.0 | 646.19 | 7.7 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_batch | RuntimeMs | DataflowRunner | 33043.33 | 31355.0 | -5.11 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_batch | RuntimeMs | DirectRunner | 3460.84 | 4111.76 | 18.81 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_batch | RuntimeMs | FlinkRunner | 450.36 | 466.62 | 3.61 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_batch | RuntimeMs | SparkRunner | 331.28 | 343.9 | 3.81 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_batch | RuntimeMs | SparkStructuredStreamingRunner | 1059.16 |
1072.9 | 1.3 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_sql_batch | RuntimeMs | DataflowRunner | 56831.67 | 58858.09 | 3.57
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_sql_batch | RuntimeMs | DirectRunner | 10088.68 | 12178.38 | 20.71
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_sql_batch | RuntimeMs | FlinkRunner | 1072.8 | 1149.38 | 7.14 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_sql_batch | RuntimeMs | SparkRunner | 3357.64 | 3500.24 | 4.25 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1755.32 |
1838.48 | 4.74 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_sql_streaming | RuntimeMs | DataflowRunner | 34625.22 | 34634.14 |
0.03 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_sql_streaming | RuntimeMs | DirectRunner | 19339.6 | 19400.82 |
0.32 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_streaming | RuntimeMs | FlinkRunner | 2470.52 | 2611.33 | 5.7 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_streaming | RuntimeMs | DataflowRunner | 26192.48 | 24892.95 |
-4.96 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_streaming | RuntimeMs | DirectRunner | 10120.2 | 10259.43 | 1.38 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_streaming | RuntimeMs | FlinkRunner | 1476.08 | 1573.57 | 6.6 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_zetasql_batch | RuntimeMs | DataflowRunner | 264852.07 | 276071.91
| 4.24 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_zetasql_batch | RuntimeMs | DirectRunner | 11242.48 | 13471.24 |
19.82 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_zetasql_batch | RuntimeMs | FlinkRunner | 2869.56 | 2901.38 | 1.11
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_zetasql_batch | RuntimeMs | SparkRunner | 3870.84 | 5379.33 | 38.97
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_zetasql_batch | RuntimeMs | SparkStructuredStreamingRunner |
4227.68 | 4368.33 | 3.33 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_zetasql_streaming | RuntimeMs | DataflowRunner | 115395.81 |
114891.95 | -0.44 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_zetasql_streaming | RuntimeMs | DirectRunner | 21540.6 | 23144.0 |
7.44 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_streaming | RuntimeMs | FlinkRunner | 4066.96 | 4326.1 |
6.37 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_14_batch | RuntimeMs | DataflowRunner | 61537.81 | 60080.32 | -2.37 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_14_batch | RuntimeMs | DirectRunner | 4249.16 | 4675.76 | 10.04 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_14_batch | RuntimeMs | FlinkRunner | 482.32 | 511.33 | 6.02 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_14_batch | RuntimeMs | SparkRunner | 846.88 | 914.43 | 7.98 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_14_batch | RuntimeMs | SparkStructuredStreamingRunner | 1066.24 |
1059.81 | -0.6 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_14_streaming | RuntimeMs | DataflowRunner | 129612.15 | 129600.91 |
-0.01 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_14_streaming | RuntimeMs | DirectRunner | 12800.28 | 13415.29 | 4.8 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_streaming | RuntimeMs | FlinkRunner | 1264.36 | 1314.1 | 3.93 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_15_batch | RuntimeMs | DataflowRunner | 50806.66 | 31683.81 | -37.64 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_15_batch | RuntimeMs | DirectRunner | 15621.12 | 16396.0 | 4.96 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_15_batch | RuntimeMs | FlinkRunner | 435.12 | 486.67 | 11.85 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_15_batch | RuntimeMs | SparkRunner | 1597.8 | 1653.24 | 3.47 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_15_batch | RuntimeMs | SparkStructuredStreamingRunner | 1029.52 |
1148.95 | 11.6 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_16_batch | RuntimeMs | DataflowRunner | 50817.24 | 32292.63 | -36.45 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_16_batch | RuntimeMs | DirectRunner | 84968.52 | 87346.48 | 2.8 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_16_batch | RuntimeMs | FlinkRunner | 215.52 | 228.71 | 6.12 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_16_batch | RuntimeMs | SparkRunner | 1365.32 | 1383.57 | 1.34 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_16_batch | RuntimeMs | SparkStructuredStreamingRunner | 639.04 |
653.81 | 2.31 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_16_streaming | RuntimeMs | DataflowRunner | 97653.77 | 93735.35 |
-4.01 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_16_streaming | RuntimeMs | DirectRunner | 134645.96 | 164238.14 |
21.98 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_16_streaming | RuntimeMs | FlinkRunner | 497.56 | 519.71 | 4.45 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_batch | RuntimeMs | DataflowRunner | 21164.16 | 14173.39 | -33.03 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_batch | RuntimeMs | DirectRunner | 3223.6 | 3481.1 | 7.99 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_batch | RuntimeMs | FlinkRunner | 312.48 | 332.48 | 6.4 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_batch | RuntimeMs | SparkRunner | 430.92 | 440.43 | 2.21 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_batch | RuntimeMs | SparkStructuredStreamingRunner | 421.32 | 425.38
| 0.96 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_sql_batch | RuntimeMs | DataflowRunner | 29694.04 | 29599.73 | -0.32
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_1_sql_batch | RuntimeMs | DirectRunner | 3732.0 | 4228.81 | 13.31 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_batch | RuntimeMs | FlinkRunner | 589.96 | 627.52 | 6.37 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_sql_batch | RuntimeMs | SparkRunner | 2376.08 | 2433.62 | 2.42 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 681.72 |
730.67 | 7.18 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_sql_streaming | RuntimeMs | DataflowRunner | 21010.93 | 21094.32 |
0.4 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_sql_streaming | RuntimeMs | DirectRunner | 11578.4 | 11795.88 | 1.88
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_streaming | RuntimeMs | FlinkRunner | 823.72 | 943.67 | 14.56 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_streaming | RuntimeMs | DataflowRunner | 29989.31 | 26805.65 |
-10.62 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_streaming | RuntimeMs | DirectRunner | 8239.24 | 8465.57 | 2.75 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_streaming | RuntimeMs | FlinkRunner | 675.8 | 719.81 | 6.51 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_batch | RuntimeMs | DataflowRunner | 14706.32 | 9432.42 | -35.86 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_batch | RuntimeMs | DirectRunner | 159.14 | 279.67 | 75.74 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_batch | RuntimeMs | FlinkRunner | 181.24 | 170.95 | -5.68 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_batch | RuntimeMs | SparkRunner | 276.56 | 292.52 | 5.77 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_batch | RuntimeMs | SparkStructuredStreamingRunner | 272.12 | 281.14
| 3.32 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_python_batch | RuntimeMs | DirectRunner | 7829.65 | 8468.19 | 8.16 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_sql_batch | RuntimeMs | DataflowRunner | 21686.93 | 20245.05 | -6.65
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_batch | RuntimeMs | DirectRunner | 1623.28 | 1787.86 | 10.14 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_batch | RuntimeMs | FlinkRunner | 379.0 | 392.9 | 3.67 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_sql_batch | RuntimeMs | SparkRunner | 748.4 | 796.19 | 6.39 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 597.16 |
634.86 | 6.31 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_streaming | RuntimeMs | DataflowRunner | 13997.85 | 13959.77 |
-0.27 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_sql_streaming | RuntimeMs | DirectRunner | 6869.4 | 6924.18 | 0.8 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_streaming | RuntimeMs | FlinkRunner | 425.56 | 413.14 | -2.92 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_streaming | RuntimeMs | DataflowRunner | 19786.89 | 17303.69 |
-12.55 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_streaming | RuntimeMs | DirectRunner | 5211.16 | 5357.95 | 2.82 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_streaming | RuntimeMs | FlinkRunner | 294.36 | 316.1 | 7.38 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_zetasql_batch | RuntimeMs | DataflowRunner | 74348.78 | 73878.45 |
-0.63 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_batch | RuntimeMs | DirectRunner | 2947.56 | 3249.0 | 10.23
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_zetasql_batch | RuntimeMs | FlinkRunner | 910.76 | 979.14 | 7.51 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_batch | RuntimeMs | SparkRunner | 1106.56 | 1221.9 | 10.42 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1080.48
| 1084.9 | 0.41 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_zetasql_streaming | RuntimeMs | DataflowRunner | 42780.04 | 41825.14
| -2.23 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_zetasql_streaming | RuntimeMs | DirectRunner | 8384.56 | 8746.76 |
4.32 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_zetasql_streaming | RuntimeMs | FlinkRunner | 1236.52 | 1326.29 |
7.26 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_batch | RuntimeMs | DataflowRunner | 23433.0 | 21672.36 | -7.51 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_batch | RuntimeMs | DirectRunner | 1005.18 | 1205.86 | 19.96 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_batch | RuntimeMs | FlinkRunner | 1221.2 | 1278.52 | 4.69 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_batch | RuntimeMs | SparkRunner | 2119.48 | 2167.52 | 2.27 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_python_batch | RuntimeMs | DirectRunner | 10760.73 | 10776.0 | 0.14
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_batch | RuntimeMs | DataflowRunner | 25223.3 | 24443.09 | -3.09
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_batch | RuntimeMs | DirectRunner | 3386.16 | 3555.57 | 5.0 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_sql_batch | RuntimeMs | FlinkRunner | 1452.68 | 1512.86 | 4.14 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_sql_batch | RuntimeMs | SparkRunner | 3620.8 | 3729.76 | 3.01 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_sql_streaming | RuntimeMs | DataflowRunner | 32310.48 | 36064.45 |
11.62 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_streaming | RuntimeMs | DirectRunner | 8541.28 | 8803.35 | 3.07
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_streaming | RuntimeMs | FlinkRunner | 1038.2 | 1129.62 | 8.81 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_streaming | RuntimeMs | DataflowRunner | 46899.26 | 41710.78 |
-11.06 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_streaming | RuntimeMs | DirectRunner | 7867.28 | 8257.0 | 4.95 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_streaming | RuntimeMs | FlinkRunner | 635.28 | 700.86 | 10.32 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_batch | RuntimeMs | DataflowRunner | 59496.74 | 60512.82 |
1.71 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_zetasql_batch | RuntimeMs | DirectRunner | 3818.12 | 4015.59 | 5.17
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_batch | RuntimeMs | FlinkRunner | 1800.8 | 1953.57 | 8.48 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_batch | RuntimeMs | SparkRunner | 3472.32 | 3932.9 | 13.26 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_streaming | RuntimeMs | DataflowRunner | 49916.22 | 57631.27
| 15.46 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_streaming | RuntimeMs | DirectRunner | 9091.72 | 9318.88 |
2.5 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_streaming | RuntimeMs | FlinkRunner | 1493.36 | 1745.71 |
16.9 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_batch | RuntimeMs | DataflowRunner | 29181.48 | 28042.59 | -3.9 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_batch | RuntimeMs | DirectRunner | 2466.04 | 2665.1 | 8.07 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_batch | RuntimeMs | FlinkRunner | 959.92 | 966.05 | 0.64 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_batch | RuntimeMs | SparkRunner | 1191.84 | 1252.38 | 5.08 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_batch | RuntimeMs | SparkStructuredStreamingRunner | 2729.44 |
2851.24 | 4.46 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_4_streaming | RuntimeMs | DataflowRunner | 51110.81 | 50696.95 | -0.81
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_4_streaming | RuntimeMs | DirectRunner | 2939.64 | 3139.14 | 6.79 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_4_streaming | RuntimeMs | FlinkRunner | 1092.36 | 1041.95 | -4.61 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_batch | RuntimeMs | DataflowRunner | 31070.26 | 20118.37 | -35.25 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_5_batch | RuntimeMs | DirectRunner | 4450.86 | 5175.48 | 16.28 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_batch | RuntimeMs | FlinkRunner | 876.92 | 897.48 | 2.34 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_5_batch | RuntimeMs | SparkRunner | 1508.48 | 1552.33 | 2.91 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_5_batch | RuntimeMs | SparkStructuredStreamingRunner | 1692.48 |
1717.81 | 1.5 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_5_python_batch | RuntimeMs | DirectRunner | 16819.96 | 16953.9 | 0.8 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_streaming | RuntimeMs | DataflowRunner | 196748.05 | 188710.43 |
-4.09 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_streaming | RuntimeMs | DirectRunner | 23362.84 | 30660.67 | 31.24 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_5_streaming | RuntimeMs | FlinkRunner | 1411.04 | 1556.1 | 10.28 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_6_batch | RuntimeMs | DataflowRunner | 26962.3 | 26104.91 | -3.18 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_batch | RuntimeMs | DirectRunner | 1846.28 | 1974.14 | 6.93 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_6_batch | RuntimeMs | FlinkRunner | 612.52 | 607.0 | -0.9 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_batch | RuntimeMs | SparkRunner | 709.2 | 749.57 | 5.69 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_batch | RuntimeMs | SparkStructuredStreamingRunner | 1200.4 |
1232.57 | 2.68 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_6_streaming | RuntimeMs | DataflowRunner | 39862.63 | 41376.27 | 3.8 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_streaming | RuntimeMs | DirectRunner | 2169.32 | 2254.29 | 3.92 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_streaming | RuntimeMs | FlinkRunner | 554.12 | 573.52 | 3.5 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_batch | RuntimeMs | DataflowRunner | 51271.63 | 47392.09 | -7.57 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_batch | RuntimeMs | DirectRunner | 8956.08 | 10210.69 | 14.01 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_7_batch | RuntimeMs | FlinkRunner | 700.8 | 729.57 | 4.11 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_7_batch | RuntimeMs | SparkRunner | 1468.92 | 1525.29 | 3.84 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_batch | RuntimeMs | SparkStructuredStreamingRunner | 3655.12 |
3724.33 | 1.89 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_7_python_batch | RuntimeMs | DirectRunner | 19817.08 | 19831.76 | 0.07
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_batch | RuntimeMs | DataflowRunner | 77045.7 | 90994.27 | 18.1 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_sql_batch | RuntimeMs | DirectRunner | 236395.64 | 1310318.14 |
454.29 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_batch | RuntimeMs | FlinkRunner | 2795.8 | 2994.48 | 7.11 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_7_sql_batch | RuntimeMs | SparkRunner | 7066.36 | 7333.19 | 3.78 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 6052.24 |
6245.52 | 3.19 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_sql_streaming | RuntimeMs | DataflowRunner | 1010451.11 | 1034446.23
| 2.37 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_streaming | RuntimeMs | DirectRunner | 910056.04 | 2902227.88 |
218.91 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_7_sql_streaming | RuntimeMs | FlinkRunner | 3621.72 | 3855.14 | 6.45 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_streaming | RuntimeMs | DataflowRunner | 123598.91 | 108149.55 |
-12.5 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_7_streaming | RuntimeMs | DirectRunner | 864197.84 | 861347.19 | -0.33
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_streaming | RuntimeMs | FlinkRunner | 1412.8 | 1403.57 | -0.65 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_batch | RuntimeMs | DataflowRunner | 21435.32 | 13300.63 | -37.95 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_8_batch | RuntimeMs | DirectRunner | 697.58 | 791.6 | 13.48 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_batch | RuntimeMs | FlinkRunner | 507.92 | 535.86 | 5.5 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_8_batch | RuntimeMs | SparkRunner | 1460.64 | 1535.81 | 5.15 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_batch | RuntimeMs | SparkStructuredStreamingRunner | 1982.28 |
2029.29 | 2.37 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_8_python_batch | RuntimeMs | DirectRunner | 10450.8 | 10465.81 | 0.14
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_8_streaming | RuntimeMs | DataflowRunner | 66471.26 | 61236.96 | -7.87
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_streaming | RuntimeMs | DirectRunner | 7442.64 | 7425.19 | -0.23 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_8_streaming | RuntimeMs | FlinkRunner | 581.04 | 577.57 | -0.6 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_9_batch | RuntimeMs | DataflowRunner | 25639.93 | 24353.5 | -5.02 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_batch | RuntimeMs | DirectRunner | 1466.0 | 1515.1 | 3.35 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_9_batch | RuntimeMs | FlinkRunner | 365.6 | 382.48 | 4.62 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_batch | RuntimeMs | SparkRunner | 567.28 | 626.67 | 10.47 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_batch | RuntimeMs | SparkStructuredStreamingRunner | 879.12 | 928.71
| 5.64 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_streaming | RuntimeMs | DataflowRunner | 32973.07 | 31714.59 | -3.82
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_streaming | RuntimeMs | DirectRunner | 1860.12 | 1891.14 | 1.67 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_streaming | RuntimeMs | FlinkRunner | 403.56 | 461.9 | 14.46 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
tpcds_query10_Calcite_1GB | RuntimeMs | DataflowRunner | 362315.07 | 371314.33
| 2.48 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query10_Calcite_1GB | RuntimeMs | FlinkRunner | 35767.81 | 40759.19 |
13.95 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query10_Calcite_1GB | RuntimeMs | SparkRunner | 57245.84 | 59869.95 |
4.58 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query10_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
51403.04 | 55012.81 | 7.02 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query25_Calcite_1GB | RuntimeMs | DataflowRunner | 378603.52 | 361011.86
| -4.65 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query25_Calcite_1GB | RuntimeMs | FlinkRunner | 42126.5 | 48054.19 |
14.07 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query25_Calcite_1GB | RuntimeMs | SparkRunner | 56661.92 | 59266.33 |
4.6 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query25_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
54411.04 | 57595.9 | 5.85 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query26_Calcite_1GB | RuntimeMs | DataflowRunner | 343585.19 | 325966.48
| -5.13 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query26_Calcite_1GB | RuntimeMs | FlinkRunner | 21425.23 | 23446.1 |
9.43 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query26_Calcite_1GB | RuntimeMs | SparkRunner | 22959.2 | 24112.29 |
5.02 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query26_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
21961.56 | 23247.52 | 5.86 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query29_Calcite_1GB | RuntimeMs | DataflowRunner | 368648.96 | 372150.48
| 0.95 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query29_Calcite_1GB | RuntimeMs | FlinkRunner | 40771.38 | 46696.76 |
14.53 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query29_Calcite_1GB | RuntimeMs | SparkRunner | 54244.72 | 57659.67 |
6.3 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query29_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
54272.8 | 56879.33 | 4.8 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query35_Calcite_1GB | RuntimeMs | DataflowRunner | 367656.78 | 361673.0
| -1.63 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query35_Calcite_1GB | RuntimeMs | FlinkRunner | 30409.77 | 35191.71 |
15.73 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query35_Calcite_1GB | RuntimeMs | SparkRunner | 52025.6 | 55407.1 | 6.5
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query35_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
44919.6 | 47794.43 | 6.4 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query38_Calcite_1GB | RuntimeMs | DataflowRunner | 343623.78 | 341860.67
| -0.51 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query38_Calcite_1GB | RuntimeMs | FlinkRunner | 22935.69 | 26735.9 |
16.57 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query38_Calcite_1GB | RuntimeMs | SparkRunner | 21119.2 | 22849.14 |
8.19 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query38_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner | 0.0 |
0.0 | 0.0 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query3_Calcite_1GB | RuntimeMs | DataflowRunner | 324788.56 | 325751.62
| 0.3 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query3_Calcite_1GB | RuntimeMs | FlinkRunner | 36080.88 | 40976.29 |
13.57 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query3_Calcite_1GB | RuntimeMs | SparkRunner | 34050.72 | 38213.9 |
12.23 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query3_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
39084.2 | 41950.9 | 7.33 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query40_Calcite_1GB | RuntimeMs | DataflowRunner | 339566.11 | 343633.71
| 1.2 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query40_Calcite_1GB | RuntimeMs | FlinkRunner | 30245.31 | 34842.9 |
15.2 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query40_Calcite_1GB | RuntimeMs | SparkRunner | 25379.52 | 26950.24 |
6.19 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query40_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
24706.72 | 26927.62 | 8.99 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query42_Calcite_1GB | RuntimeMs | DataflowRunner | 319514.19 | 319511.43
| -0.0 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query42_Calcite_1GB | RuntimeMs | FlinkRunner | 23395.85 | 25856.81 |
10.52 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query42_Calcite_1GB | RuntimeMs | SparkRunner | 21582.4 | 22969.86 |
6.43 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query42_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
20935.88 | 22345.71 | 6.73 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query43_Calcite_1GB | RuntimeMs | DataflowRunner | 313394.04 | 318909.52
| 1.76 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query43_Calcite_1GB | RuntimeMs | FlinkRunner | 23571.0 | 26048.9 |
10.51 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query43_Calcite_1GB | RuntimeMs | SparkRunner | 22088.12 | 23457.0 | 6.2
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query43_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
22004.52 | 23119.9 | 5.07 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query52_Calcite_1GB | RuntimeMs | DataflowRunner | 318206.63 | 327957.71
| 3.06 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query52_Calcite_1GB | RuntimeMs | FlinkRunner | 23458.88 | 25862.38 |
10.25 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query52_Calcite_1GB | RuntimeMs | SparkRunner | 21666.4 | 22942.38 |
5.89 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query52_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
21652.16 | 23114.52 | 6.75 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query55_Calcite_1GB | RuntimeMs | DataflowRunner | 318602.89 | 315638.0
| -0.93 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query55_Calcite_1GB | RuntimeMs | FlinkRunner | 22976.0 | 25435.86 |
10.71 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query55_Calcite_1GB | RuntimeMs | SparkRunner | 21973.72 | 23055.76 |
4.92 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query55_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
19978.24 | 21915.05 | 9.69 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query69_Calcite_1GB | RuntimeMs | DataflowRunner | 351148.37 | 354442.05
| 0.94 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query69_Calcite_1GB | RuntimeMs | FlinkRunner | 31436.54 | 35748.38 |
13.72 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query69_Calcite_1GB | RuntimeMs | SparkRunner | 50124.24 | 53213.86 |
6.16 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query69_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
44159.44 | 46946.81 | 6.31 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query79_Calcite_1GB | RuntimeMs | DataflowRunner | 347981.3 | 347125.76
| -0.25 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query79_Calcite_1GB | RuntimeMs | FlinkRunner | 36015.88 | 39348.43 |
9.25 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query79_Calcite_1GB | RuntimeMs | SparkRunner | 39837.6 | 42056.9 | 5.57
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query79_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
37740.0 | 39057.24 | 3.49 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query7_Calcite_1GB | RuntimeMs | DataflowRunner | 343937.07 | 344542.1 |
0.18 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query7_Calcite_1GB | RuntimeMs | FlinkRunner | 38729.31 | 43235.1 |
11.63 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query7_Calcite_1GB | RuntimeMs | SparkRunner | 40251.4 | 43268.9 | 7.5 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query7_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
39953.8 | 42229.43 | 5.7 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query83_Calcite_1GB | RuntimeMs | DataflowRunner | 350585.33 | 353801.1
| 0.92 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query83_Calcite_1GB | RuntimeMs | FlinkRunner | 9781.73 | 10692.71 |
9.31 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query83_Calcite_1GB | RuntimeMs | SparkRunner | 9829.92 | 10407.38 |
5.87 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query83_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
14143.08 | 14614.24 | 3.33 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query84_Calcite_1GB | RuntimeMs | DataflowRunner | 318936.56 | 322566.57
| 1.14 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query84_Calcite_1GB | RuntimeMs | FlinkRunner | 20584.27 | 23509.19 |
14.21 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query84_Calcite_1GB | RuntimeMs | SparkRunner | 17810.88 | 18656.67 |
4.75 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query84_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
17019.32 | 17893.43 | 5.14 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query87_Calcite_1GB | RuntimeMs | DataflowRunner | 349046.52 | 333596.95
| -4.43 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query87_Calcite_1GB | RuntimeMs | FlinkRunner | 23672.85 | 27336.67 |
15.48 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query87_Calcite_1GB | RuntimeMs | SparkRunner | 20632.72 | 22672.67 |
9.89 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query87_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
22861.48 | 24574.29 | 7.49 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query93_Calcite_1GB | RuntimeMs | DataflowRunner | 356997.11 | 347957.19
| -2.53 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query93_Calcite_1GB | RuntimeMs | FlinkRunner | 48908.42 | 55821.43 |
14.13 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query93_Calcite_1GB | RuntimeMs | SparkRunner | 44754.76 | 47089.76 |
5.22 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query93_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
38964.72 | 41755.1 | 7.16 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query96_Calcite_1GB | RuntimeMs | DataflowRunner | 328956.93 | 329416.29
| 0.14 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query96_Calcite_1GB | RuntimeMs | FlinkRunner | 20025.15 | 22467.62 |
12.2 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query96_Calcite_1GB | RuntimeMs | SparkRunner | 19627.92 | 20990.1 |
6.94 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query96_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
22169.36 | 23801.0 | 7.36 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
Re: Beam Metrics Report (2023-02-21)
Posted by Anand Inguva via dev <de...@beam.apache.org>.
Yes, in the past I was checking the dashboard and it wasn't much helpful.
To tackle this issue and provide better visibility on the regressions
that are caught on perf/benchmark/load tests, we added a change point
analysis[1][2] tool based on the E-Divisive algorithm. You can find more
information at [1].
1. The tool can file GitHub issues if a regression is found. It adds the
label `perf-alert` to the issues to filter the regressions easily.
2. We plan to use this tool on a python benchmark tests this quarter and
improve based on the initial feedback we get from those tests and
eventually add all the perf/load/benchmark tests to use this tool.
[1]
https://github.com/apache/beam/tree/master/sdks/python/apache_beam/testing/analyzers
[2] https://github.com/apache/beam/pull/23931
Thanks,
Anand
On Tue, Feb 21, 2023 at 2:05 PM Valentyn Tymofieiev <va...@google.com>
wrote:
> The single 'mean' metric is not very meaningful as it is prone to skew by
> outliers.
>
> +Anand Inguva <an...@google.com> recently added infrastructure for
> regression detection that relies on the E-Divisive algorithm for change
> point analysis. We plan to switch Python SDK benchmarks to use that
> infrastructure and potentially other benchmarks can follow if that works
> out well.
>
>
>
>
> On Tue, Feb 21, 2023 at 10:42 AM Kenneth Knowles <ke...@apache.org> wrote:
>
>> I have not kept a careful eye on these. Are they still useful? Are they
>> stable enough to be accurate or meaningful? This particular report (chosen
>> at random) looks like small and large regressions across the board.
>>
>> I would not automatically assume that this is meaningful. I would
>> honestly like to reduce the amount of automated content going to dev@
>>
>> Kenn
>>
>> On Tue, Feb 21, 2023 at 3:56 AM Apache Jenkins Server <
>> jenkins@builds.apache.org> wrote:
>>
>>> Beam Metrics Report Color legend:
>>> >= 20 >= 10 <= -10 <= -20 Possible regression
>>> *Measurement* *Metric* *Runner* *Mean previous week* *Mean last week* *Diff
>>> %* *Dashboard*
>>> cdapioit_results read_time - 15.03 16.87 12.26 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> go_batch_gbk_7 dataflow_runtime - 115.41 134.93 16.92 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_cogbk_1 sparkstructuredstreaming_runtime_sec - 70.17 81.0
>>> 15.43 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_batch_cogbk_2 sparkstructuredstreaming_runtime_sec - 75.09 89.63
>>> 19.36 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_batch_cogbk_3 dataflow_runtime_sec - 14.18 15.81 11.45 [1]
>>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_batch_cogbk_3 dataflow_v2_java17_runtime_sec - 12.12 13.57 11.98
>>> [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_batch_cogbk_4 dataflow_v2_java17_runtime_sec - 12.22 15.16 24.03
>>> [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_batch_combine_5 dataflow_runtime_sec - 25.52 30.13 18.1 [1]
>>> <http://metrics.beam.apache.org/d/WNzYt13Zk>
>>> java_batch_gbk_2 sparkstructuredstreaming_runtime_sec - 54.69 62.48
>>> 14.25 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_3 dataflow_runtime_sec - 11.65 12.92 10.94 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_5 dataflow_runtime_sec - 18.89 20.78 10.01 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_5 dataflow_v2_java17_runtime_sec - 19.89 22.9 15.1 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_6 dataflow_v2_java11_runtime_sec - 26.89 29.65 10.27 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_pardo_1 dataflow_v2_java11_runtime_sec - 13.54 17.28 27.59
>>> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> java_batch_pardo_1 dataflow_v2_java17_runtime_sec - 12.86 15.14 17.72
>>> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> java_batch_pardo_1 sparkstructuredstreaming_runtime_sec - 24.93 32.52
>>> 30.43 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> java_streaming_cogbk_4 dataflow_v2_java17_runtime_sec - 297.61 348.85
>>> 17.22 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_streaming_gbk_3 dataflow_v2_java17_runtime_sec - 62.77 69.7 11.04
>>> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_streaming_gbk_5 dataflow_v2_java11_runtime_sec - 594.04 697.93
>>> 17.49 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_streaming_gbk_6 dataflow_v2_java11_runtime_sec - 150.07 169.36
>>> 12.86 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_streaming_gbk_7 dataflow_v2_java17_runtime_sec - 222.54 291.74 31.1
>>> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> kafkaioit_results read_time - 890.4 1011.3 13.58 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> mongodbioit_results read_time - 25.86 29.19 12.87 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> parquetioit_results read_time - 83.18 93.38 12.26 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> python_batch_cogbk_2 python_dataflow_batch_cogbk_2_runtime - 238.0 272.4
>>> 14.45 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> python_batch_combine_5 python_dataflow_batch_combine_5_runtime - 29.29
>>> 34.0 16.1 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
>>> python_batch_gbk_3 python_dataflow_batch_gbk_3_runtime - 24.14 30.8
>>> 27.57 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> python_batch_pardo_3 python_dataflow_batch_pardo_3_runtime - 121.14
>>> 155.4 28.28 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> python_batch_sideinput_2 python_dataflow_batch_sideinput_2_runtime -
>>> 2.29 3.0 31.25 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
>>> python_psio_2GB_results pubsub_io_perf_write_runtime - 120.86 163.5
>>> 35.28 [1] <http://metrics.beam.apache.org/d/gP7vMPqZz>
>>> python_streaming_gbk_3 python_dataflow_streaming_gbk_3_runtime - 74.71
>>> 99.4 33.04 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> nexmark_0_batch RuntimeMs DirectRunner 1783.16 2123.67 19.1 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_0_zetasql_batch RuntimeMs SparkRunner 3510.0 4836.57 37.79 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_0_zetasql_streaming RuntimeMs FlinkRunner 3218.12 3754.05 16.65
>>> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_10_batch RuntimeMs DirectRunner 5602.62 7773.67 38.75 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_10_streaming RuntimeMs DataflowRunner 99964.25 333912.78 234.03
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_10_streaming RuntimeMs DirectRunner 52614.96 69076.81 31.29 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_11_batch RuntimeMs DirectRunner 1417.68 1563.1 10.26 [1]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_11_batch RuntimeMs FlinkRunner 252.0 287.19 13.96 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_13_batch RuntimeMs DirectRunner 3460.84 4111.76 18.81 [1]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_13_sql_batch RuntimeMs DirectRunner 10088.68 12178.38 20.71 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_13_zetasql_batch RuntimeMs DirectRunner 11242.48 13471.24 19.82
>>> [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_13_zetasql_batch RuntimeMs SparkRunner 3870.84 5379.33 38.97 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_14_batch RuntimeMs DirectRunner 4249.16 4675.76 10.04 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_15_batch RuntimeMs FlinkRunner 435.12 486.67 11.85 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_15_batch RuntimeMs SparkStructuredStreamingRunner 1029.52
>>> 1148.95 11.6 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_16_streaming RuntimeMs DirectRunner 134645.96 164238.14 21.98
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_1_sql_batch RuntimeMs DirectRunner 3732.0 4228.81 13.31 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_1_sql_streaming RuntimeMs FlinkRunner 823.72 943.67 14.56 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_2_batch RuntimeMs DirectRunner 159.14 279.67 75.74 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_2_sql_batch RuntimeMs DirectRunner 1623.28 1787.86 10.14 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_2_zetasql_batch RuntimeMs DirectRunner 2947.56 3249.0 10.23 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_2_zetasql_batch RuntimeMs SparkRunner 1106.56 1221.9 10.42 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_3_batch RuntimeMs DirectRunner 1005.18 1205.86 19.96 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_3_sql_streaming RuntimeMs DataflowRunner 32310.48 36064.45 11.62
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_3_streaming RuntimeMs FlinkRunner 635.28 700.86 10.32 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_3_zetasql_batch RuntimeMs SparkRunner 3472.32 3932.9 13.26 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_3_zetasql_streaming RuntimeMs DataflowRunner 49916.22 57631.27
>>> 15.46 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_3_zetasql_streaming RuntimeMs FlinkRunner 1493.36 1745.71 16.9
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_5_batch RuntimeMs DirectRunner 4450.86 5175.48 16.28 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_5_streaming RuntimeMs DirectRunner 23362.84 30660.67 31.24 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_5_streaming RuntimeMs FlinkRunner 1411.04 1556.1 10.28 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_7_batch RuntimeMs DirectRunner 8956.08 10210.69 14.01 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_7_sql_batch RuntimeMs DataflowRunner 77045.7 90994.27 18.1 [1]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
>>> nexmark_7_sql_batch RuntimeMs DirectRunner 236395.64 1310318.14 454.29
>>> [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_7_sql_streaming RuntimeMs DirectRunner 910056.04 2902227.88
>>> 218.91 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_8_batch RuntimeMs DirectRunner 697.58 791.6 13.48 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_9_batch RuntimeMs SparkRunner 567.28 626.67 10.47 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_9_streaming RuntimeMs FlinkRunner 403.56 461.9 14.46 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> tpcds_query10_Calcite_1GB RuntimeMs FlinkRunner 35767.81 40759.19 13.95
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> tpcds_query25_Calcite_1GB RuntimeMs FlinkRunner 42126.5 48054.19 14.07
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>>> tpcds_query29_Calcite_1GB RuntimeMs FlinkRunner 40771.38 46696.76 14.53
>>> [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> tpcds_query35_Calcite_1GB RuntimeMs FlinkRunner 30409.77 35191.71 15.73
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query38_Calcite_1GB RuntimeMs FlinkRunner 22935.69 26735.9 16.57
>>> [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query3_Calcite_1GB RuntimeMs FlinkRunner 36080.88 40976.29 13.57
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>>> tpcds_query3_Calcite_1GB RuntimeMs SparkRunner 34050.72 38213.9 12.23
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query40_Calcite_1GB RuntimeMs FlinkRunner 30245.31 34842.9 15.2
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> tpcds_query42_Calcite_1GB RuntimeMs FlinkRunner 23395.85 25856.81 10.52
>>> [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query43_Calcite_1GB RuntimeMs FlinkRunner 23571.0 26048.9 10.51
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> tpcds_query52_Calcite_1GB RuntimeMs FlinkRunner 23458.88 25862.38 10.25
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>>> tpcds_query55_Calcite_1GB RuntimeMs FlinkRunner 22976.0 25435.86 10.71
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> tpcds_query69_Calcite_1GB RuntimeMs FlinkRunner 31436.54 35748.38 13.72
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> tpcds_query7_Calcite_1GB RuntimeMs FlinkRunner 38729.31 43235.1 11.63
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>>> tpcds_query84_Calcite_1GB RuntimeMs FlinkRunner 20584.27 23509.19 14.21
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> tpcds_query87_Calcite_1GB RuntimeMs FlinkRunner 23672.85 27336.67 15.48
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> tpcds_query93_Calcite_1GB RuntimeMs FlinkRunner 48908.42 55821.43 14.13
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> tpcds_query96_Calcite_1GB RuntimeMs FlinkRunner 20025.15 22467.62 12.2
>>> [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq> Possible improvement
>>> *Measurement* *Metric* *Runner* *Mean previous week* *Mean last week* *Diff
>>> %* *Dashboard*
>>> avroioit_hdfs_results read_time - 90.2 79.41 -11.96 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> bqio_10GB_results_java_batch_avro avro_write_time - 35.08 30.94 -11.8
>>> [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> java_batch_combine_4 dataflow_runtime_sec - 31.62 26.92 -14.85 [1]
>>> <http://metrics.beam.apache.org/d/WNzYt13Zk>
>>> java_batch_gbk_3 dataflow_v2_java11_runtime_sec - 18.73 11.62 -37.96 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_3 dataflow_v2_java17_runtime_sec - 14.52 11.9 -18.06 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_7 dataflow_v2_java11_runtime_sec - 54.03 36.19 -33.02 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_7 dataflow_v2_java17_runtime_sec - 93.02 34.26 -63.17 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_pardo_2 dataflow_v2_java17_runtime_sec - 60.55 53.35 -11.89
>>> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> java_batch_pardo_3 dataflow_v2_java11_runtime_sec - 12.51 10.19 -18.53
>>> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> java_batch_pardo_3 dataflow_v2_java17_runtime_sec - 13.9 10.71 -22.91
>>> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> java_streaming_cogbk_1 dataflow_v2_java17_runtime_sec - 2606.43 2175.14
>>> -16.55 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_streaming_gbk_1 dataflow_v2_java11_runtime_sec - 1016.6 854.76
>>> -15.92 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_streaming_gbk_2 dataflow_v2_java11_runtime_sec - 2958.46 2606.28
>>> -11.9 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_streaming_gbk_2 dataflow_v2_java17_runtime_sec - 3516.87 2831.8
>>> -19.48 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_streaming_gbk_4 dataflow_v2_java17_runtime_sec - 620.74 550.37
>>> -11.34 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_streaming_gbk_6 dataflow_v2_java17_runtime_sec - 177.15 145.73
>>> -17.74 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_streaming_pardo_1 dataflow_v2_java11_runtime_sec - 26.56 23.19
>>> -12.7 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> java_streaming_pardo_2 dataflow_v2_java11_runtime_sec - 97.93 87.64
>>> -10.51 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> java_streaming_pardo_2 dataflow_v2_java17_runtime_sec - 100.95 88.91
>>> -11.93 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> python_batch_combine_4 python_dataflow_batch_combine_4_runtime - 43.86
>>> 29.8 -32.05 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
>>> python_batch_gbk_4 python_dataflow_batch_gbk_4_runtime - 102.57 62.4
>>> -39.16 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> python_batch_pardo_1 python_dataflow_batch_pardo_1_runtime - 159.14
>>> 135.8 -14.67 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> python_batch_sideinput_10 python_dataflow_batch_sideinput_10_runtime -
>>> 918.86 711.0 -22.62 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
>>> python_batch_sideinput_8 python_dataflow_batch_sideinput_8_runtime -
>>> 167.71 134.2 -19.98 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
>>> python_bqio_read_10GB_results bqio_read_10GB_results_runtime - 106.0
>>> 89.0 -16.04 [1] <http://metrics.beam.apache.org/d/gP7vMPqZz>
>>> python_streaming_pardo_3 python_dataflow_streaming_pardo_3_runtime -
>>> 231.43 169.0 -26.98 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> xmlioit_hdfs_results read_time - 23.63 20.56 -13.01 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> xmlioit_hdfs_results write_time - 26.16 21.77 -16.78 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> nexmark_0_batch RuntimeMs DataflowRunner 26749.75 18435.75 -31.08 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_0_streaming RuntimeMs DataflowRunner 38980.02 34901.86 -10.46
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_10_batch RuntimeMs DataflowRunner 47515.68 30172.77 -36.5 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_11_batch RuntimeMs DataflowRunner 37386.57 22295.25 -40.37 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_12_batch RuntimeMs DataflowRunner 18674.81 11713.24 -37.28 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_15_batch RuntimeMs DataflowRunner 50806.66 31683.81 -37.64 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_16_batch RuntimeMs DataflowRunner 50817.24 32292.63 -36.45 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
>>> nexmark_1_batch RuntimeMs DataflowRunner 21164.16 14173.39 -33.03 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_1_streaming RuntimeMs DataflowRunner 29989.31 26805.65 -10.62
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_2_batch RuntimeMs DataflowRunner 14706.32 9432.42 -35.86 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_2_streaming RuntimeMs DataflowRunner 19786.89 17303.69 -12.55
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_3_streaming RuntimeMs DataflowRunner 46899.26 41710.78 -11.06
>>> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_5_batch RuntimeMs DataflowRunner 31070.26 20118.37 -35.25 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_7_streaming RuntimeMs DataflowRunner 123598.91 108149.55 -12.5
>>> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_8_batch RuntimeMs DataflowRunner 21435.32 13300.63 -37.95 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> All metrics
>>> *Measurement* *Metric* *Runner* *Mean previous week* *Mean last week* *Diff
>>> %* *Dashboard*
>>> avroioit_hdfs_results read_time - 90.2 79.41 -11.96 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> avroioit_hdfs_results write_time - 121.4 122.86 1.2 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> avroioit_results read_time - 90.01 87.44 -2.85 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> avroioit_results write_time - 121.12 121.44 0.26 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> bqio_10GB_results_java_batch_avro avro_write_time - 35.08 30.94 -11.8
>>> [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> bqio_10GB_results_java_batch_avro read_time - 41.76 43.1 3.21 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> bqio_10GB_results_java_batch_json read_time - 41.54 40.29 -3.01 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> bqio_10GB_results_java_batch_json write_time - 53.73 52.08 -3.06 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> bqio_10GB_results_java_stream read_time - 43.23 44.57 3.1 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> bqio_10GB_results_java_stream write_time - 205.89 208.99 1.51 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> cdapioit_results read_time - 15.03 16.87 12.26 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> cdapioit_results write_time - 26.0 26.02 0.09 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> compressed_textioit_hdfs_results read_time - 136.44 126.91 -6.99 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> compressed_textioit_hdfs_results write_time - 215.44 214.35 -0.51 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> compressed_textioit_results read_time - 134.75 128.13 -4.91 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> compressed_textioit_results write_time - 209.2 212.07 1.37 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> go_batch_cogbk_1 dataflow_runtime - 258.35 257.64 -0.28 [1]
>>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> go_batch_cogbk_2 dataflow_runtime - 147.85 146.38 -0.99 [1]
>>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> go_batch_cogbk_3 dataflow_runtime - 114.16 113.28 -0.77 [1]
>>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> go_batch_cogbk_4 dataflow_runtime - 110.72 109.17 -1.4 [1]
>>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> go_batch_combine_1 dataflow_runtime - 432.84 428.33 -1.04 [1]
>>> <http://metrics.beam.apache.org/d/WNzYt13Zk>
>>> go_batch_combine_4 dataflow_runtime - 75.94 75.12 -1.08 [1]
>>> <http://metrics.beam.apache.org/d/WNzYt13Zk>
>>> go_batch_combine_5 dataflow_runtime - 70.6 69.56 -1.46 [1]
>>> <http://metrics.beam.apache.org/d/WNzYt13Zk>
>>> go_batch_gbk_1 dataflow_runtime - 389.3 397.02 1.99 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> go_batch_gbk_2 dataflow_runtime - 100.74 102.16 1.41 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> go_batch_gbk_3 dataflow_runtime - 24.93 25.47 2.18 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> go_batch_gbk_4 dataflow_runtime - 55.41 54.48 -1.66 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> go_batch_gbk_5 dataflow_runtime - 42.87 44.57 3.95 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> go_batch_gbk_6 dataflow_runtime - 102.95 103.29 0.32 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> go_batch_gbk_7 dataflow_runtime - 115.41 134.93 16.92 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> go_batch_pardo_1 dataflow_runtime - 84.39 84.11 -0.33 [1]
>>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> go_batch_pardo_2 dataflow_runtime - 619.82 601.88 -2.9 [1]
>>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> go_batch_pardo_3 dataflow_runtime - 67.66 65.39 -3.35 [1]
>>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> go_batch_pardo_4 dataflow_runtime - 69.59 71.59 2.88 [1]
>>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> go_batch_sideinput_3 dataflow_runtime - 2.65 2.43 -8.13 [1]
>>> <http://metrics.beam.apache.org/d/-E9aGlFGk>
>>> go_batch_sideinput_4 dataflow_runtime - 243.33 227.18 -6.64 [1]
>>> <http://metrics.beam.apache.org/d/-E9aGlFGk>
>>> hadoopformatioit_results read_time - 14.78 14.6 -1.23 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> hadoopformatioit_results write_time - 26.36 26.75 1.48 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> java_batch_cogbk_1 dataflow_runtime_sec - 39.96 40.27 0.77 [1]
>>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_batch_cogbk_1 dataflow_v2_java11_runtime_sec - 47.15 47.6 0.97 [1]
>>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_batch_cogbk_1 dataflow_v2_java17_runtime_sec - 49.39 46.1 -6.65 [1]
>>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_batch_cogbk_1 sparkstructuredstreaming_runtime_sec - 70.17 81.0
>>> 15.43 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_batch_cogbk_2 dataflow_runtime_sec - 41.59 43.01 3.43 [1]
>>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_batch_cogbk_2 dataflow_v2_java11_runtime_sec - 48.49 46.33 -4.46
>>> [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_batch_cogbk_2 dataflow_v2_java17_runtime_sec - 46.36 43.67 -5.8 [1]
>>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_batch_cogbk_2 sparkstructuredstreaming_runtime_sec - 75.09 89.63
>>> 19.36 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_batch_cogbk_3 dataflow_runtime_sec - 14.18 15.81 11.45 [1]
>>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_batch_cogbk_3 dataflow_v2_java11_runtime_sec - 12.92 13.36 3.4 [1]
>>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_batch_cogbk_3 dataflow_v2_java17_runtime_sec - 12.12 13.57 11.98
>>> [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_batch_cogbk_3 sparkstructuredstreaming_runtime_sec - 14.95 14.21
>>> -5.0 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_batch_cogbk_4 dataflow_runtime_sec - 15.78 14.4 -8.8 [1]
>>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_batch_cogbk_4 dataflow_v2_java11_runtime_sec - 13.63 12.89 -5.48
>>> [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_batch_cogbk_4 dataflow_v2_java17_runtime_sec - 12.22 15.16 24.03
>>> [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_batch_cogbk_4 sparkstructuredstreaming_runtime_sec - 15.07 14.35
>>> -4.76 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_batch_combine_1 dataflow_runtime_sec - 65.12 66.78 2.53 [1]
>>> <http://metrics.beam.apache.org/d/WNzYt13Zk>
>>> java_batch_combine_1 sparkstructuredstreaming_runtime_sec - 269.45
>>> 270.97 0.56 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
>>> java_batch_combine_4 dataflow_runtime_sec - 31.62 26.92 -14.85 [1]
>>> <http://metrics.beam.apache.org/d/WNzYt13Zk>
>>> java_batch_combine_4 sparkstructuredstreaming_runtime_sec - 56.19 53.73
>>> -4.38 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
>>> java_batch_combine_5 dataflow_runtime_sec - 25.52 30.13 18.1 [1]
>>> <http://metrics.beam.apache.org/d/WNzYt13Zk>
>>> java_batch_combine_5 sparkstructuredstreaming_runtime_sec - 50.92 52.57
>>> 3.24 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
>>> java_batch_gbk_1 dataflow_runtime_sec - 120.59 117.76 -2.34 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_1 dataflow_v2_java11_runtime_sec - 89.36 89.96 0.67 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_1 dataflow_v2_java17_runtime_sec - 85.72 87.75 2.37 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_1 sparkstructuredstreaming_runtime_sec - 259.78 253.76
>>> -2.31 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_2 dataflow_runtime_sec - 33.36 36.39 9.06 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_2 dataflow_v2_java11_runtime_sec - 42.96 41.28 -3.9 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_2 dataflow_v2_java17_runtime_sec - 42.59 40.42 -5.09 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_2 sparkstructuredstreaming_runtime_sec - 54.69 62.48
>>> 14.25 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_3 dataflow_runtime_sec - 11.65 12.92 10.94 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_3 dataflow_v2_java11_runtime_sec - 18.73 11.62 -37.96 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_3 dataflow_v2_java17_runtime_sec - 14.52 11.9 -18.06 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_3 sparkstructuredstreaming_runtime_sec - 8.68 8.33 -4.1
>>> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_4 dataflow_runtime_sec - 18.79 19.03 1.29 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_4 dataflow_v2_java11_runtime_sec - 21.42 21.62 0.95 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_4 dataflow_v2_java17_runtime_sec - 20.32 22.14 8.97 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_4 sparkstructuredstreaming_runtime_sec - 52.12 49.35
>>> -5.31 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_5 dataflow_runtime_sec - 18.89 20.78 10.01 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_5 dataflow_v2_java11_runtime_sec - 19.76 19.72 -0.19 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_5 dataflow_v2_java17_runtime_sec - 19.89 22.9 15.1 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_5 sparkstructuredstreaming_runtime_sec - 49.75 48.08
>>> -3.37 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_6 dataflow_runtime_sec - 38.27 39.49 3.18 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_6 dataflow_v2_java11_runtime_sec - 26.89 29.65 10.27 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_6 dataflow_v2_java17_runtime_sec - 31.26 32.19 2.96 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_6 sparkstructuredstreaming_runtime_sec - 32.45 32.39 -0.2
>>> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_7 dataflow_runtime_sec - 44.19 45.66 3.34 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_7 dataflow_v2_java11_runtime_sec - 54.03 36.19 -33.02 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_7 dataflow_v2_java17_runtime_sec - 93.02 34.26 -63.17 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_gbk_7 sparkstructuredstreaming_runtime_sec - 37.13 36.68
>>> -1.21 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_batch_pardo_1 dataflow_runtime_sec - 20.61 19.9 -3.41 [1]
>>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> java_batch_pardo_1 dataflow_v2_java11_runtime_sec - 13.54 17.28 27.59
>>> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> java_batch_pardo_1 dataflow_v2_java17_runtime_sec - 12.86 15.14 17.72
>>> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> java_batch_pardo_1 sparkstructuredstreaming_runtime_sec - 24.93 32.52
>>> 30.43 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> java_batch_pardo_2 dataflow_runtime_sec - 209.32 208.57 -0.36 [1]
>>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> java_batch_pardo_2 dataflow_v2_java11_runtime_sec - 59.05 54.05 -8.47
>>> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> java_batch_pardo_2 dataflow_v2_java17_runtime_sec - 60.55 53.35 -11.89
>>> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> java_batch_pardo_3 dataflow_runtime_sec - 13.9 15.02 8.09 [1]
>>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> java_batch_pardo_3 dataflow_v2_java11_runtime_sec - 12.51 10.19 -18.53
>>> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> java_batch_pardo_3 dataflow_v2_java17_runtime_sec - 13.9 10.71 -22.91
>>> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> java_batch_pardo_4 dataflow_runtime_sec - 28.13 28.74 2.18 [1]
>>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> java_batch_pardo_4 dataflow_v2_java11_runtime_sec - 26.32 27.75 5.42 [1]
>>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> java_batch_pardo_4 dataflow_v2_java17_runtime_sec - 24.51 22.69 -7.44
>>> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> java_streaming_cogbk_1 dataflow_runtime_sec - 872.6 789.84 -9.48 [1]
>>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_streaming_cogbk_1 dataflow_v2_java11_runtime_sec - 3005.89 2851.74
>>> -5.13 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_streaming_cogbk_1 dataflow_v2_java17_runtime_sec - 2606.43 2175.14
>>> -16.55 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_streaming_cogbk_2 dataflow_runtime_sec - 917.57 924.82 0.79 [1]
>>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_streaming_cogbk_2 dataflow_v2_java11_runtime_sec - 3115.11 2941.95
>>> -5.56 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_streaming_cogbk_2 dataflow_v2_java17_runtime_sec - 2960.86 2987.15
>>> 0.89 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_streaming_cogbk_3 dataflow_runtime_sec - 121.41 109.31 -9.96 [1]
>>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_streaming_cogbk_3 dataflow_v2_java11_runtime_sec - 378.28 366.57
>>> -3.1 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_streaming_cogbk_3 dataflow_v2_java17_runtime_sec - 348.02 314.68
>>> -9.58 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_streaming_cogbk_4 dataflow_runtime_sec - 125.13 114.87 -8.2 [1]
>>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_streaming_cogbk_4 dataflow_v2_java11_runtime_sec - 363.26 332.86
>>> -8.37 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_streaming_cogbk_4 dataflow_v2_java17_runtime_sec - 297.61 348.85
>>> 17.22 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> java_streaming_combine_1 dataflow_runtime_sec - 482.69 474.54 -1.69 [1]
>>> <http://metrics.beam.apache.org/d/WNzYt13Zk>
>>> java_streaming_combine_4 dataflow_runtime_sec - 313.08 306.95 -1.96 [1]
>>> <http://metrics.beam.apache.org/d/WNzYt13Zk>
>>> java_streaming_combine_5 dataflow_runtime_sec - 317.67 306.83 -3.41 [1]
>>> <http://metrics.beam.apache.org/d/WNzYt13Zk>
>>> java_streaming_gbk_1 dataflow_runtime_sec - 640.71 644.58 0.6 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_streaming_gbk_1 dataflow_v2_java11_runtime_sec - 1016.6 854.76
>>> -15.92 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_streaming_gbk_1 dataflow_v2_java17_runtime_sec - 859.19 832.88
>>> -3.06 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_streaming_gbk_2 dataflow_runtime_sec - 844.31 815.67 -3.39 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_streaming_gbk_2 dataflow_v2_java11_runtime_sec - 2958.46 2606.28
>>> -11.9 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_streaming_gbk_2 dataflow_v2_java17_runtime_sec - 3516.87 2831.8
>>> -19.48 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_streaming_gbk_3 dataflow_runtime_sec - 23.72 25.1 5.79 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_streaming_gbk_3 dataflow_v2_java11_runtime_sec - 56.71 57.05 0.6
>>> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_streaming_gbk_3 dataflow_v2_java17_runtime_sec - 62.77 69.7 11.04
>>> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_streaming_gbk_4 dataflow_runtime_sec - 303.31 289.43 -4.58 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_streaming_gbk_4 dataflow_v2_java11_runtime_sec - 600.82 631.36 5.08
>>> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_streaming_gbk_4 dataflow_v2_java17_runtime_sec - 620.74 550.37
>>> -11.34 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_streaming_gbk_5 dataflow_runtime_sec - 282.59 301.15 6.57 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_streaming_gbk_5 dataflow_v2_java11_runtime_sec - 594.04 697.93
>>> 17.49 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_streaming_gbk_5 dataflow_v2_java17_runtime_sec - 585.53 550.22
>>> -6.03 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_streaming_gbk_6 dataflow_runtime_sec - 76.16 74.96 -1.58 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_streaming_gbk_6 dataflow_v2_java11_runtime_sec - 150.07 169.36
>>> 12.86 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_streaming_gbk_6 dataflow_v2_java17_runtime_sec - 177.15 145.73
>>> -17.74 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_streaming_gbk_7 dataflow_runtime_sec - 136.32 127.69 -6.33 [1]
>>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_streaming_gbk_7 dataflow_v2_java11_runtime_sec - 231.51 221.07
>>> -4.51 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_streaming_gbk_7 dataflow_v2_java17_runtime_sec - 222.54 291.74 31.1
>>> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> java_streaming_pardo_1 dataflow_runtime_sec - 18.86 20.11 6.61 [1]
>>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> java_streaming_pardo_1 dataflow_v2_java11_runtime_sec - 26.56 23.19
>>> -12.7 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> java_streaming_pardo_1 dataflow_v2_java17_runtime_sec - 24.28 23.01
>>> -5.22 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> java_streaming_pardo_2 dataflow_runtime_sec - 208.74 217.9 4.39 [1]
>>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> java_streaming_pardo_2 dataflow_v2_java11_runtime_sec - 97.93 87.64
>>> -10.51 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> java_streaming_pardo_2 dataflow_v2_java17_runtime_sec - 100.95 88.91
>>> -11.93 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> java_streaming_pardo_3 dataflow_runtime_sec - 12.44 11.89 -4.41 [1]
>>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> java_streaming_pardo_3 dataflow_v2_java11_runtime_sec - 23.73 22.6 -4.78
>>> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> java_streaming_pardo_3 dataflow_v2_java17_runtime_sec - 20.97 20.5 -2.25
>>> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> java_streaming_pardo_4 dataflow_runtime_sec - 31.84 31.15 -2.15 [1]
>>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> java_streaming_pardo_4 dataflow_v2_java11_runtime_sec - 37.88 39.89 5.31
>>> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> java_streaming_pardo_4 dataflow_v2_java17_runtime_sec - 37.65 36.3 -3.59
>>> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> jdbcioit_results read_time - 26.24 25.71 -1.99 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> jdbcioit_results write_time - 39.42 40.3 2.24 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> kafkaioit_results read_time - 890.4 1011.3 13.58 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> kafkaioit_results write_time - 163.97 165.39 0.87 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> kafkaioit_results_runner_v2 read_time - 956.27 937.09 -2.01 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> kafkaioit_results_runner_v2 write_time - 170.63 172.99 1.38 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> many_files_textioit_hdfs_results read_time - 16.18 15.89 -1.76 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> many_files_textioit_hdfs_results write_time - 68.97 67.37 -2.32 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> many_files_textioit_results read_time - 23.0 25.17 9.42 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> many_files_textioit_results write_time - 61.46 64.25 4.55 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> mongodbioit_results read_time - 25.86 29.19 12.87 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> mongodbioit_results write_time - 50.08 49.41 -1.34 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> parquetioit_hdfs_results read_time - 87.82 79.32 -9.68 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> parquetioit_hdfs_results write_time - 144.68 132.66 -8.31 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> parquetioit_results read_time - 83.18 93.38 12.26 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> parquetioit_results write_time - 139.99 146.1 4.37 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> python_batch_cogbk_1 python_dataflow_batch_cogbk_1_runtime - 385.14
>>> 389.4 1.11 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> python_batch_cogbk_2 python_dataflow_batch_cogbk_2_runtime - 238.0 272.4
>>> 14.45 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> python_batch_cogbk_3 python_dataflow_batch_cogbk_3_runtime - 216.29
>>> 208.8 -3.46 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> python_batch_cogbk_4 python_dataflow_batch_cogbk_4_runtime - 208.14
>>> 203.4 -2.28 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> python_batch_combine_1 python_dataflow_batch_combine_1_runtime - 767.14
>>> 751.0 -2.1 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
>>> python_batch_combine_4 python_dataflow_batch_combine_4_runtime - 43.86
>>> 29.8 -32.05 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
>>> python_batch_combine_5 python_dataflow_batch_combine_5_runtime - 29.29
>>> 34.0 16.1 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
>>> python_batch_gbk_1 python_dataflow_batch_gbk_1_runtime - 1316.86 1336.0
>>> 1.45 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> python_batch_gbk_2 python_dataflow_batch_gbk_2_runtime - 241.43 264.8
>>> 9.68 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> python_batch_gbk_3 python_dataflow_batch_gbk_3_runtime - 24.14 30.8
>>> 27.57 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> python_batch_gbk_4 python_dataflow_batch_gbk_4_runtime - 102.57 62.4
>>> -39.16 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> python_batch_gbk_5 python_dataflow_batch_gbk_5_runtime - 102.29 97.4
>>> -4.78 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> python_batch_gbk_6 python_dataflow_batch_gbk_6_runtime - 245.5 226.2
>>> -7.86 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> python_batch_gbk_7 python_dataflow_batch_gbk_7_runtime - 244.83 231.6
>>> -5.41 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> python_batch_pardo_1 python_dataflow_batch_pardo_1_runtime - 159.14
>>> 135.8 -14.67 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> python_batch_pardo_2 python_dataflow_batch_pardo_2_runtime - 1365.57
>>> 1358.0 -0.55 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> python_batch_pardo_3 python_dataflow_batch_pardo_3_runtime - 121.14
>>> 155.4 28.28 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> python_batch_pardo_4 python_dataflow_batch_pardo_4_runtime - 319.71
>>> 322.0 0.71 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> python_batch_sideinput_1 python_dataflow_batch_sideinput_1_runtime -
>>> 2.14 2.17 1.11 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
>>> python_batch_sideinput_10 python_dataflow_batch_sideinput_10_runtime -
>>> 918.86 711.0 -22.62 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
>>> python_batch_sideinput_2 python_dataflow_batch_sideinput_2_runtime -
>>> 2.29 3.0 31.25 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
>>> python_batch_sideinput_3 python_dataflow_batch_sideinput_3_runtime - 3.0
>>> 2.8 -6.67 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
>>> python_batch_sideinput_4 python_dataflow_batch_sideinput_4_runtime -
>>> 28.86 27.4 -5.05 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
>>> python_batch_sideinput_5 python_dataflow_batch_sideinput_5_runtime -
>>> 2.57 2.6 1.11 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
>>> python_batch_sideinput_6 python_dataflow_batch_sideinput_6_runtime -
>>> 2.43 2.4 -1.18 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
>>> python_batch_sideinput_7 python_dataflow_batch_sideinput_7_runtime -
>>> 131.86 122.2 -7.32 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
>>> python_batch_sideinput_8 python_dataflow_batch_sideinput_8_runtime -
>>> 167.71 134.2 -19.98 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
>>> python_batch_sideinput_9 python_dataflow_batch_sideinput_9_runtime -
>>> 768.14 796.8 3.73 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
>>> python_bqio_read_10GB_results bqio_read_10GB_results_runtime - 106.0
>>> 89.0 -16.04 [1] <http://metrics.beam.apache.org/d/gP7vMPqZz>
>>> python_bqio_write_10GB_results bqio_write_10GB_results_runtime - 274.71
>>> 252.4 -8.12 [1] <http://metrics.beam.apache.org/d/gP7vMPqZz>
>>> python_direct_microbenchmarks fn_api_runner_microbenchmark_runtime_sec -
>>> 584.93 603.05 3.1
>>> python_direct_microbenchmarks teststream_microbenchmark_runtime_sec -
>>> 357.42 388.56 8.71
>>> python_kafkaio_results read_runtime - 234.57 230.4 -1.78 [1]
>>> <http://metrics.beam.apache.org/d/gP7vMPqZz>
>>> python_kafkaio_results write_runtime - 357.0 373.6 4.65 [1]
>>> <http://metrics.beam.apache.org/d/gP7vMPqZz>
>>> python_psio_2GB_results pubsub_io_perf_read_runtime - 374.5 340.17 -9.17
>>> [1] <http://metrics.beam.apache.org/d/gP7vMPqZz>
>>> python_psio_2GB_results pubsub_io_perf_write_runtime - 120.86 163.5
>>> 35.28 [1] <http://metrics.beam.apache.org/d/gP7vMPqZz>
>>> python_spanner_write_2GB_results pyspanner_write_2GB_results_runtime -
>>> 1839.86 1789.2 -2.75 [1] <http://metrics.beam.apache.org/d/gP7vMPqZz>
>>> python_spannerio_read_2GB_results pyspanner_read_2GB_results_runtime -
>>> 23.33 23.67 1.43 [1] <http://metrics.beam.apache.org/d/gP7vMPqZz>
>>> python_streaming_cogbk_1 python_dataflow_streaming_cogbk_1_runtime -
>>> 612.0 563.2 -7.97 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> python_streaming_cogbk_2 python_dataflow_streaming_cogbk_2_runtime -
>>> 319.17 348.2 9.1 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> python_streaming_cogbk_3 python_dataflow_streaming_cogbk_3_runtime -
>>> 375.33 368.0 -1.95 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> python_streaming_cogbk_4 python_dataflow_streaming_cogbk_4_runtime -
>>> 319.67 325.0 1.67 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>>> python_streaming_gbk_3 python_dataflow_streaming_gbk_3_runtime - 74.71
>>> 99.4 33.04 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> python_streaming_gbk_6 python_dataflow_streaming_gbk_6_runtime - 453.0
>>> 446.0 -1.55 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> python_streaming_gbk_7 python_dataflow_streaming_gbk_7_runtime - 501.5
>>> 486.6 -2.97 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>>> python_streaming_pardo_1 python_dataflow_streaming_pardo_1_runtime -
>>> 193.0 203.6 5.49 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> python_streaming_pardo_2 python_dataflow_streaming_pardo_2_runtime -
>>> 2411.71 2264.4 -6.11 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> python_streaming_pardo_3 python_dataflow_streaming_pardo_3_runtime -
>>> 231.43 169.0 -26.98 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> python_streaming_pardo_4 python_dataflow_streaming_pardo_4_runtime -
>>> 428.33 428.2 -0.03 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>>> python_textio_1GB_results read_runtime - 97.43 99.67 2.3 [1]
>>> <http://metrics.beam.apache.org/d/gP7vMPqZz>
>>> python_textio_1GB_results write_runtime - 192.71 189.5 -1.67 [1]
>>> <http://metrics.beam.apache.org/d/gP7vMPqZz>
>>> singlestoreioit_results read_time - 90.19 85.79 -4.88 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> singlestoreioit_results write_time - 25.66 26.42 2.97 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> sparkreceiverioit_results read_time - 765.18 792.2 3.53 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> textioit_hdfs_results read_time - 17.96 18.6 3.57 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> textioit_hdfs_results write_time - 37.67 35.26 -6.4 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> textioit_results read_time - 19.66 19.29 -1.88 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> textioit_results write_time - 34.96 31.8 -9.03 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> tfrecordioit_results read_time - 17.68 16.56 -6.32 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> tfrecordioit_results write_time - 22.29 23.09 3.58 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> wordcount_py37_results runtime - 810.17 866.31 6.93 [1]
>>> <http://metrics.beam.apache.org/d/1cnwVDkGk>
>>> xmlioit_hdfs_results read_time - 23.63 20.56 -13.01 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> xmlioit_hdfs_results write_time - 26.16 21.77 -16.78 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> xmlioit_results read_time - 25.69 26.58 3.45 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> xmlioit_results write_time - 25.76 26.67 3.54 [1]
>>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>>> nexmark_0_batch RuntimeMs DataflowRunner 26749.75 18435.75 -31.08 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_0_batch RuntimeMs DirectRunner 1783.16 2123.67 19.1 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_0_batch RuntimeMs FlinkRunner 1064.56 1138.29 6.93 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_0_batch RuntimeMs SparkRunner 1303.4 1400.62 7.46 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_0_batch RuntimeMs SparkStructuredStreamingRunner 1310.64 1396.67
>>> 6.56 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_0_python_batch RuntimeMs DirectRunner 12252.27 12309.52 0.47 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_0_sql_batch RuntimeMs DataflowRunner 33071.81 33724.5 1.97 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_0_sql_batch RuntimeMs DirectRunner 5879.64 6351.9 8.03 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_0_sql_batch RuntimeMs FlinkRunner 1137.92 1213.14 6.61 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_0_sql_batch RuntimeMs SparkRunner 3269.36 3369.38 3.06 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_0_sql_batch RuntimeMs SparkStructuredStreamingRunner 1535.52
>>> 1618.95 5.43 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_0_sql_streaming RuntimeMs DataflowRunner 23607.74 24395.64 3.34
>>> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_0_sql_streaming RuntimeMs DirectRunner 15789.0 16131.12 2.17 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_0_sql_streaming RuntimeMs FlinkRunner 1787.6 1937.62 8.39 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_0_streaming RuntimeMs DataflowRunner 38980.02 34901.86 -10.46
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_0_streaming RuntimeMs DirectRunner 12676.12 12695.05 0.15 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_0_streaming RuntimeMs FlinkRunner 1530.0 1646.0 7.58 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_0_zetasql_batch RuntimeMs DataflowRunner 118581.48 125235.77
>>> 5.61 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_0_zetasql_batch RuntimeMs DirectRunner 7108.56 7757.12 9.12 [1]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_0_zetasql_batch RuntimeMs FlinkRunner 2266.08 2488.71 9.82 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_0_zetasql_batch RuntimeMs SparkRunner 3510.0 4836.57 37.79 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_0_zetasql_batch RuntimeMs SparkStructuredStreamingRunner 2866.56
>>> 3025.0 5.53 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_0_zetasql_streaming RuntimeMs DataflowRunner 68752.07 70194.32
>>> 2.1 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_0_zetasql_streaming RuntimeMs DirectRunner 17661.8 18539.88 4.97
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_0_zetasql_streaming RuntimeMs FlinkRunner 3218.12 3754.05 16.65
>>> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_10_batch RuntimeMs DataflowRunner 47515.68 30172.77 -36.5 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_10_batch RuntimeMs DirectRunner 5602.62 7773.67 38.75 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_10_batch RuntimeMs FlinkRunner 645.52 692.29 7.24 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_10_batch RuntimeMs SparkRunner 681.4 722.67 6.06 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_10_batch RuntimeMs SparkStructuredStreamingRunner 1003.32
>>> 1039.67 3.62 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_10_python_batch RuntimeMs DirectRunner 25711.96 25954.14 0.94
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_10_streaming RuntimeMs DataflowRunner 99964.25 333912.78 234.03
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_10_streaming RuntimeMs DirectRunner 52614.96 69076.81 31.29 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_10_streaming RuntimeMs FlinkRunner 1553.84 1598.24 2.86 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_11_batch RuntimeMs DataflowRunner 37386.57 22295.25 -40.37 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_11_batch RuntimeMs DirectRunner 1417.68 1563.1 10.26 [1]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_11_batch RuntimeMs FlinkRunner 252.0 287.19 13.96 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_11_batch RuntimeMs SparkRunner 1484.72 1526.33 2.8 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_11_batch RuntimeMs SparkStructuredStreamingRunner 1269.96 1371.0
>>> 7.96 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_11_python_batch RuntimeMs DirectRunner 20136.84 20394.38 1.28
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_11_streaming RuntimeMs DataflowRunner 173412.48 171423.47 -1.15
>>> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_11_streaming RuntimeMs DirectRunner 10803.88 10796.62 -0.07 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_11_streaming RuntimeMs FlinkRunner 1524.64 1542.43 1.17 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_12_batch RuntimeMs DataflowRunner 18674.81 11713.24 -37.28 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_12_batch RuntimeMs DirectRunner 2720.6 2936.52 7.94 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_12_batch RuntimeMs FlinkRunner 175.08 177.24 1.23 [1]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_12_batch RuntimeMs SparkRunner 892.88 926.0 3.71 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_12_batch RuntimeMs SparkStructuredStreamingRunner 923.12 954.1
>>> 3.36 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_12_streaming RuntimeMs DataflowRunner 91825.83 89753.43 -2.26
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_12_streaming RuntimeMs DirectRunner 9359.56 9369.95 0.11 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_12_streaming RuntimeMs FlinkRunner 600.0 646.19 7.7 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_13_batch RuntimeMs DataflowRunner 33043.33 31355.0 -5.11 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_13_batch RuntimeMs DirectRunner 3460.84 4111.76 18.81 [1]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_13_batch RuntimeMs FlinkRunner 450.36 466.62 3.61 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_13_batch RuntimeMs SparkRunner 331.28 343.9 3.81 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_13_batch RuntimeMs SparkStructuredStreamingRunner 1059.16 1072.9
>>> 1.3 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_13_sql_batch RuntimeMs DataflowRunner 56831.67 58858.09 3.57 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_13_sql_batch RuntimeMs DirectRunner 10088.68 12178.38 20.71 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_13_sql_batch RuntimeMs FlinkRunner 1072.8 1149.38 7.14 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_13_sql_batch RuntimeMs SparkRunner 3357.64 3500.24 4.25 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_13_sql_batch RuntimeMs SparkStructuredStreamingRunner 1755.32
>>> 1838.48 4.74 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_13_sql_streaming RuntimeMs DataflowRunner 34625.22 34634.14 0.03
>>> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_13_sql_streaming RuntimeMs DirectRunner 19339.6 19400.82 0.32
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_13_sql_streaming RuntimeMs FlinkRunner 2470.52 2611.33 5.7 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_13_streaming RuntimeMs DataflowRunner 26192.48 24892.95 -4.96
>>> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_13_streaming RuntimeMs DirectRunner 10120.2 10259.43 1.38 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_13_streaming RuntimeMs FlinkRunner 1476.08 1573.57 6.6 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_13_zetasql_batch RuntimeMs DataflowRunner 264852.07 276071.91
>>> 4.24 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_13_zetasql_batch RuntimeMs DirectRunner 11242.48 13471.24 19.82
>>> [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_13_zetasql_batch RuntimeMs FlinkRunner 2869.56 2901.38 1.11 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_13_zetasql_batch RuntimeMs SparkRunner 3870.84 5379.33 38.97 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_13_zetasql_batch RuntimeMs SparkStructuredStreamingRunner
>>> 4227.68 4368.33 3.33 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_13_zetasql_streaming RuntimeMs DataflowRunner 115395.81
>>> 114891.95 -0.44 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_13_zetasql_streaming RuntimeMs DirectRunner 21540.6 23144.0 7.44
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_13_zetasql_streaming RuntimeMs FlinkRunner 4066.96 4326.1 6.37
>>> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_14_batch RuntimeMs DataflowRunner 61537.81 60080.32 -2.37 [1]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_14_batch RuntimeMs DirectRunner 4249.16 4675.76 10.04 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_14_batch RuntimeMs FlinkRunner 482.32 511.33 6.02 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_14_batch RuntimeMs SparkRunner 846.88 914.43 7.98 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_14_batch RuntimeMs SparkStructuredStreamingRunner 1066.24
>>> 1059.81 -0.6 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_14_streaming RuntimeMs DataflowRunner 129612.15 129600.91 -0.01
>>> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_14_streaming RuntimeMs DirectRunner 12800.28 13415.29 4.8 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_14_streaming RuntimeMs FlinkRunner 1264.36 1314.1 3.93 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_15_batch RuntimeMs DataflowRunner 50806.66 31683.81 -37.64 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_15_batch RuntimeMs DirectRunner 15621.12 16396.0 4.96 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_15_batch RuntimeMs FlinkRunner 435.12 486.67 11.85 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_15_batch RuntimeMs SparkRunner 1597.8 1653.24 3.47 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_15_batch RuntimeMs SparkStructuredStreamingRunner 1029.52
>>> 1148.95 11.6 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_16_batch RuntimeMs DataflowRunner 50817.24 32292.63 -36.45 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
>>> nexmark_16_batch RuntimeMs DirectRunner 84968.52 87346.48 2.8 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_16_batch RuntimeMs FlinkRunner 215.52 228.71 6.12 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_16_batch RuntimeMs SparkRunner 1365.32 1383.57 1.34 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_16_batch RuntimeMs SparkStructuredStreamingRunner 639.04 653.81
>>> 2.31 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_16_streaming RuntimeMs DataflowRunner 97653.77 93735.35 -4.01
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_16_streaming RuntimeMs DirectRunner 134645.96 164238.14 21.98
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_16_streaming RuntimeMs FlinkRunner 497.56 519.71 4.45 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_1_batch RuntimeMs DataflowRunner 21164.16 14173.39 -33.03 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_1_batch RuntimeMs DirectRunner 3223.6 3481.1 7.99 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_1_batch RuntimeMs FlinkRunner 312.48 332.48 6.4 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_1_batch RuntimeMs SparkRunner 430.92 440.43 2.21 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_1_batch RuntimeMs SparkStructuredStreamingRunner 421.32 425.38
>>> 0.96 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_1_sql_batch RuntimeMs DataflowRunner 29694.04 29599.73 -0.32 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
>>> nexmark_1_sql_batch RuntimeMs DirectRunner 3732.0 4228.81 13.31 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_1_sql_batch RuntimeMs FlinkRunner 589.96 627.52 6.37 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_1_sql_batch RuntimeMs SparkRunner 2376.08 2433.62 2.42 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_1_sql_batch RuntimeMs SparkStructuredStreamingRunner 681.72
>>> 730.67 7.18 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_1_sql_streaming RuntimeMs DataflowRunner 21010.93 21094.32 0.4
>>> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_1_sql_streaming RuntimeMs DirectRunner 11578.4 11795.88 1.88 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_1_sql_streaming RuntimeMs FlinkRunner 823.72 943.67 14.56 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_1_streaming RuntimeMs DataflowRunner 29989.31 26805.65 -10.62
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_1_streaming RuntimeMs DirectRunner 8239.24 8465.57 2.75 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_1_streaming RuntimeMs FlinkRunner 675.8 719.81 6.51 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_2_batch RuntimeMs DataflowRunner 14706.32 9432.42 -35.86 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_2_batch RuntimeMs DirectRunner 159.14 279.67 75.74 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_2_batch RuntimeMs FlinkRunner 181.24 170.95 -5.68 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_2_batch RuntimeMs SparkRunner 276.56 292.52 5.77 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_2_batch RuntimeMs SparkStructuredStreamingRunner 272.12 281.14
>>> 3.32 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_2_python_batch RuntimeMs DirectRunner 7829.65 8468.19 8.16 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_2_sql_batch RuntimeMs DataflowRunner 21686.93 20245.05 -6.65 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_2_sql_batch RuntimeMs DirectRunner 1623.28 1787.86 10.14 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_2_sql_batch RuntimeMs FlinkRunner 379.0 392.9 3.67 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_2_sql_batch RuntimeMs SparkRunner 748.4 796.19 6.39 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_2_sql_batch RuntimeMs SparkStructuredStreamingRunner 597.16
>>> 634.86 6.31 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_2_sql_streaming RuntimeMs DataflowRunner 13997.85 13959.77 -0.27
>>> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_2_sql_streaming RuntimeMs DirectRunner 6869.4 6924.18 0.8 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_2_sql_streaming RuntimeMs FlinkRunner 425.56 413.14 -2.92 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_2_streaming RuntimeMs DataflowRunner 19786.89 17303.69 -12.55
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_2_streaming RuntimeMs DirectRunner 5211.16 5357.95 2.82 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_2_streaming RuntimeMs FlinkRunner 294.36 316.1 7.38 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_2_zetasql_batch RuntimeMs DataflowRunner 74348.78 73878.45 -0.63
>>> [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_2_zetasql_batch RuntimeMs DirectRunner 2947.56 3249.0 10.23 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_2_zetasql_batch RuntimeMs FlinkRunner 910.76 979.14 7.51 [1]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_2_zetasql_batch RuntimeMs SparkRunner 1106.56 1221.9 10.42 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_2_zetasql_batch RuntimeMs SparkStructuredStreamingRunner 1080.48
>>> 1084.9 0.41 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_2_zetasql_streaming RuntimeMs DataflowRunner 42780.04 41825.14
>>> -2.23 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_2_zetasql_streaming RuntimeMs DirectRunner 8384.56 8746.76 4.32
>>> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_2_zetasql_streaming RuntimeMs FlinkRunner 1236.52 1326.29 7.26
>>> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_3_batch RuntimeMs DataflowRunner 23433.0 21672.36 -7.51 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_3_batch RuntimeMs DirectRunner 1005.18 1205.86 19.96 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_3_batch RuntimeMs FlinkRunner 1221.2 1278.52 4.69 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_3_batch RuntimeMs SparkRunner 2119.48 2167.52 2.27 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_3_python_batch RuntimeMs DirectRunner 10760.73 10776.0 0.14 [1]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_3_sql_batch RuntimeMs DataflowRunner 25223.3 24443.09 -3.09 [1]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_3_sql_batch RuntimeMs DirectRunner 3386.16 3555.57 5.0 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_3_sql_batch RuntimeMs FlinkRunner 1452.68 1512.86 4.14 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_3_sql_batch RuntimeMs SparkRunner 3620.8 3729.76 3.01 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_3_sql_streaming RuntimeMs DataflowRunner 32310.48 36064.45 11.62
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_3_sql_streaming RuntimeMs DirectRunner 8541.28 8803.35 3.07 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_3_sql_streaming RuntimeMs FlinkRunner 1038.2 1129.62 8.81 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_3_streaming RuntimeMs DataflowRunner 46899.26 41710.78 -11.06
>>> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_3_streaming RuntimeMs DirectRunner 7867.28 8257.0 4.95 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_3_streaming RuntimeMs FlinkRunner 635.28 700.86 10.32 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_3_zetasql_batch RuntimeMs DataflowRunner 59496.74 60512.82 1.71
>>> [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_3_zetasql_batch RuntimeMs DirectRunner 3818.12 4015.59 5.17 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_3_zetasql_batch RuntimeMs FlinkRunner 1800.8 1953.57 8.48 [1]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_3_zetasql_batch RuntimeMs SparkRunner 3472.32 3932.9 13.26 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_3_zetasql_streaming RuntimeMs DataflowRunner 49916.22 57631.27
>>> 15.46 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_3_zetasql_streaming RuntimeMs DirectRunner 9091.72 9318.88 2.5
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_3_zetasql_streaming RuntimeMs FlinkRunner 1493.36 1745.71 16.9
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_4_batch RuntimeMs DataflowRunner 29181.48 28042.59 -3.9 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_4_batch RuntimeMs DirectRunner 2466.04 2665.1 8.07 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_4_batch RuntimeMs FlinkRunner 959.92 966.05 0.64 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_4_batch RuntimeMs SparkRunner 1191.84 1252.38 5.08 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_4_batch RuntimeMs SparkStructuredStreamingRunner 2729.44 2851.24
>>> 4.46 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_4_streaming RuntimeMs DataflowRunner 51110.81 50696.95 -0.81 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_4_streaming RuntimeMs DirectRunner 2939.64 3139.14 6.79 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_4_streaming RuntimeMs FlinkRunner 1092.36 1041.95 -4.61 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_5_batch RuntimeMs DataflowRunner 31070.26 20118.37 -35.25 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_5_batch RuntimeMs DirectRunner 4450.86 5175.48 16.28 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_5_batch RuntimeMs FlinkRunner 876.92 897.48 2.34 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_5_batch RuntimeMs SparkRunner 1508.48 1552.33 2.91 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_5_batch RuntimeMs SparkStructuredStreamingRunner 1692.48 1717.81
>>> 1.5 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_5_python_batch RuntimeMs DirectRunner 16819.96 16953.9 0.8 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_5_streaming RuntimeMs DataflowRunner 196748.05 188710.43 -4.09
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_5_streaming RuntimeMs DirectRunner 23362.84 30660.67 31.24 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_5_streaming RuntimeMs FlinkRunner 1411.04 1556.1 10.28 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_6_batch RuntimeMs DataflowRunner 26962.3 26104.91 -3.18 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_6_batch RuntimeMs DirectRunner 1846.28 1974.14 6.93 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_6_batch RuntimeMs FlinkRunner 612.52 607.0 -0.9 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_6_batch RuntimeMs SparkRunner 709.2 749.57 5.69 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_6_batch RuntimeMs SparkStructuredStreamingRunner 1200.4 1232.57
>>> 2.68 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
>>> nexmark_6_streaming RuntimeMs DataflowRunner 39862.63 41376.27 3.8 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_6_streaming RuntimeMs DirectRunner 2169.32 2254.29 3.92 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_6_streaming RuntimeMs FlinkRunner 554.12 573.52 3.5 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_7_batch RuntimeMs DataflowRunner 51271.63 47392.09 -7.57 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_7_batch RuntimeMs DirectRunner 8956.08 10210.69 14.01 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_7_batch RuntimeMs FlinkRunner 700.8 729.57 4.11 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_7_batch RuntimeMs SparkRunner 1468.92 1525.29 3.84 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_7_batch RuntimeMs SparkStructuredStreamingRunner 3655.12 3724.33
>>> 1.89 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_7_python_batch RuntimeMs DirectRunner 19817.08 19831.76 0.07 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_7_sql_batch RuntimeMs DataflowRunner 77045.7 90994.27 18.1 [1]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
>>> nexmark_7_sql_batch RuntimeMs DirectRunner 236395.64 1310318.14 454.29
>>> [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_7_sql_batch RuntimeMs FlinkRunner 2795.8 2994.48 7.11 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_7_sql_batch RuntimeMs SparkRunner 7066.36 7333.19 3.78 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_7_sql_batch RuntimeMs SparkStructuredStreamingRunner 6052.24
>>> 6245.52 3.19 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_7_sql_streaming RuntimeMs DataflowRunner 1010451.11 1034446.23
>>> 2.37 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_7_sql_streaming RuntimeMs DirectRunner 910056.04 2902227.88
>>> 218.91 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_7_sql_streaming RuntimeMs FlinkRunner 3621.72 3855.14 6.45 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_7_streaming RuntimeMs DataflowRunner 123598.91 108149.55 -12.5
>>> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_7_streaming RuntimeMs DirectRunner 864197.84 861347.19 -0.33 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_7_streaming RuntimeMs FlinkRunner 1412.8 1403.57 -0.65 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_8_batch RuntimeMs DataflowRunner 21435.32 13300.63 -37.95 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_8_batch RuntimeMs DirectRunner 697.58 791.6 13.48 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_8_batch RuntimeMs FlinkRunner 507.92 535.86 5.5 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>>> nexmark_8_batch RuntimeMs SparkRunner 1460.64 1535.81 5.15 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_8_batch RuntimeMs SparkStructuredStreamingRunner 1982.28 2029.29
>>> 2.37 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_8_python_batch RuntimeMs DirectRunner 10450.8 10465.81 0.14 [1]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
>>> nexmark_8_streaming RuntimeMs DataflowRunner 66471.26 61236.96 -7.87 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_8_streaming RuntimeMs DirectRunner 7442.64 7425.19 -0.23 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_8_streaming RuntimeMs FlinkRunner 581.04 577.57 -0.6 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_9_batch RuntimeMs DataflowRunner 25639.93 24353.5 -5.02 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_9_batch RuntimeMs DirectRunner 1466.0 1515.1 3.35 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> nexmark_9_batch RuntimeMs FlinkRunner 365.6 382.48 4.62 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_9_batch RuntimeMs SparkRunner 567.28 626.67 10.47 [1]
>>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_9_batch RuntimeMs SparkStructuredStreamingRunner 879.12 928.71
>>> 5.64 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_9_streaming RuntimeMs DataflowRunner 32973.07 31714.59 -3.82 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_9_streaming RuntimeMs DirectRunner 1860.12 1891.14 1.67 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>>> nexmark_9_streaming RuntimeMs FlinkRunner 403.56 461.9 14.46 [1]
>>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>>> tpcds_query10_Calcite_1GB RuntimeMs DataflowRunner 362315.07 371314.33
>>> 2.48 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query10_Calcite_1GB RuntimeMs FlinkRunner 35767.81 40759.19 13.95
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> tpcds_query10_Calcite_1GB RuntimeMs SparkRunner 57245.84 59869.95 4.58
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> tpcds_query10_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>>> 51403.04 55012.81 7.02 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>>> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query25_Calcite_1GB RuntimeMs DataflowRunner 378603.52 361011.86
>>> -4.65 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> tpcds_query25_Calcite_1GB RuntimeMs FlinkRunner 42126.5 48054.19 14.07
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>>> tpcds_query25_Calcite_1GB RuntimeMs SparkRunner 56661.92 59266.33 4.6
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query25_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>>> 54411.04 57595.9 5.85 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>>> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query26_Calcite_1GB RuntimeMs DataflowRunner 343585.19 325966.48
>>> -5.13 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query26_Calcite_1GB RuntimeMs FlinkRunner 21425.23 23446.1 9.43
>>> [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> tpcds_query26_Calcite_1GB RuntimeMs SparkRunner 22959.2 24112.29 5.02
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> tpcds_query26_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>>> 21961.56 23247.52 5.86 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>>> tpcds_query29_Calcite_1GB RuntimeMs DataflowRunner 368648.96 372150.48
>>> 0.95 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query29_Calcite_1GB RuntimeMs FlinkRunner 40771.38 46696.76 14.53
>>> [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> tpcds_query29_Calcite_1GB RuntimeMs SparkRunner 54244.72 57659.67 6.3
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>>> tpcds_query29_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>>> 54272.8 56879.33 4.8 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query35_Calcite_1GB RuntimeMs DataflowRunner 367656.78 361673.0
>>> -1.63 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query35_Calcite_1GB RuntimeMs FlinkRunner 30409.77 35191.71 15.73
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query35_Calcite_1GB RuntimeMs SparkRunner 52025.6 55407.1 6.5 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>>> tpcds_query35_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>>> 44919.6 47794.43 6.4 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query38_Calcite_1GB RuntimeMs DataflowRunner 343623.78 341860.67
>>> -0.51 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>>> tpcds_query38_Calcite_1GB RuntimeMs FlinkRunner 22935.69 26735.9 16.57
>>> [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query38_Calcite_1GB RuntimeMs SparkRunner 21119.2 22849.14 8.19
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query38_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 0.0
>>> 0.0 0.0 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query3_Calcite_1GB RuntimeMs DataflowRunner 324788.56 325751.62
>>> 0.3 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>>> tpcds_query3_Calcite_1GB RuntimeMs FlinkRunner 36080.88 40976.29 13.57
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>>> tpcds_query3_Calcite_1GB RuntimeMs SparkRunner 34050.72 38213.9 12.23
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query3_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>>> 39084.2 41950.9 7.33 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query40_Calcite_1GB RuntimeMs DataflowRunner 339566.11 343633.71
>>> 1.2 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query40_Calcite_1GB RuntimeMs FlinkRunner 30245.31 34842.9 15.2
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> tpcds_query40_Calcite_1GB RuntimeMs SparkRunner 25379.52 26950.24 6.19
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query40_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>>> 24706.72 26927.62 8.99 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query42_Calcite_1GB RuntimeMs DataflowRunner 319514.19 319511.43
>>> -0.0 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query42_Calcite_1GB RuntimeMs FlinkRunner 23395.85 25856.81 10.52
>>> [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query42_Calcite_1GB RuntimeMs SparkRunner 21582.4 22969.86 6.43
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> tpcds_query42_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>>> 20935.88 22345.71 6.73 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>>> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> tpcds_query43_Calcite_1GB RuntimeMs DataflowRunner 313394.04 318909.52
>>> 1.76 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>>> tpcds_query43_Calcite_1GB RuntimeMs FlinkRunner 23571.0 26048.9 10.51
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> tpcds_query43_Calcite_1GB RuntimeMs SparkRunner 22088.12 23457.0 6.2 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query43_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>>> 22004.52 23119.9 5.07 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query52_Calcite_1GB RuntimeMs DataflowRunner 318206.63 327957.71
>>> 3.06 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query52_Calcite_1GB RuntimeMs FlinkRunner 23458.88 25862.38 10.25
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>>> tpcds_query52_Calcite_1GB RuntimeMs SparkRunner 21666.4 22942.38 5.89
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query52_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>>> 21652.16 23114.52 6.75 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>>> tpcds_query55_Calcite_1GB RuntimeMs DataflowRunner 318602.89 315638.0
>>> -0.93 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> tpcds_query55_Calcite_1GB RuntimeMs FlinkRunner 22976.0 25435.86 10.71
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> tpcds_query55_Calcite_1GB RuntimeMs SparkRunner 21973.72 23055.76 4.92
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query55_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>>> 19978.24 21915.05 9.69 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>>> tpcds_query69_Calcite_1GB RuntimeMs DataflowRunner 351148.37 354442.05
>>> 0.94 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query69_Calcite_1GB RuntimeMs FlinkRunner 31436.54 35748.38 13.72
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> tpcds_query69_Calcite_1GB RuntimeMs SparkRunner 50124.24 53213.86 6.16
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query69_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>>> 44159.44 46946.81 6.31 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query79_Calcite_1GB RuntimeMs DataflowRunner 347981.3 347125.76
>>> -0.25 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query79_Calcite_1GB RuntimeMs FlinkRunner 36015.88 39348.43 9.25
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> tpcds_query79_Calcite_1GB RuntimeMs SparkRunner 39837.6 42056.9 5.57 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query79_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>>> 37740.0 39057.24 3.49 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>>> tpcds_query7_Calcite_1GB RuntimeMs DataflowRunner 343937.07 344542.1
>>> 0.18 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> tpcds_query7_Calcite_1GB RuntimeMs FlinkRunner 38729.31 43235.1 11.63
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>>> tpcds_query7_Calcite_1GB RuntimeMs SparkRunner 40251.4 43268.9 7.5 [1]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query7_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>>> 39953.8 42229.43 5.7 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>>> tpcds_query83_Calcite_1GB RuntimeMs DataflowRunner 350585.33 353801.1
>>> 0.92 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>>> tpcds_query83_Calcite_1GB RuntimeMs FlinkRunner 9781.73 10692.71 9.31
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> tpcds_query83_Calcite_1GB RuntimeMs SparkRunner 9829.92 10407.38 5.87
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query83_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>>> 14143.08 14614.24 3.33 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query84_Calcite_1GB RuntimeMs DataflowRunner 318936.56 322566.57
>>> 1.14 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query84_Calcite_1GB RuntimeMs FlinkRunner 20584.27 23509.19 14.21
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> tpcds_query84_Calcite_1GB RuntimeMs SparkRunner 17810.88 18656.67 4.75
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query84_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>>> 17019.32 17893.43 5.14 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query87_Calcite_1GB RuntimeMs DataflowRunner 349046.52 333596.95
>>> -4.43 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>>> tpcds_query87_Calcite_1GB RuntimeMs FlinkRunner 23672.85 27336.67 15.48
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> tpcds_query87_Calcite_1GB RuntimeMs SparkRunner 20632.72 22672.67 9.89
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query87_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>>> 22861.48 24574.29 7.49 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query93_Calcite_1GB RuntimeMs DataflowRunner 356997.11 347957.19
>>> -2.53 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>>> tpcds_query93_Calcite_1GB RuntimeMs FlinkRunner 48908.42 55821.43 14.13
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> tpcds_query93_Calcite_1GB RuntimeMs SparkRunner 44754.76 47089.76 5.22
>>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query93_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>>> 38964.72 41755.1 7.16 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>>> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query96_Calcite_1GB RuntimeMs DataflowRunner 328956.93 329416.29
>>> 0.14 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>>> tpcds_query96_Calcite_1GB RuntimeMs FlinkRunner 20025.15 22467.62 12.2
>>> [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> tpcds_query96_Calcite_1GB RuntimeMs SparkRunner 19627.92 20990.1 6.94
>>> [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>>> tpcds_query96_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>>> 22169.36 23801.0 7.36 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
>>> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>>>
>>
Re: Beam Metrics Report (2023-02-21)
Posted by Valentyn Tymofieiev via dev <de...@beam.apache.org>.
The single 'mean' metric is not very meaningful as it is prone to skew by
outliers.
+Anand Inguva <an...@google.com> recently added infrastructure for
regression detection that relies on the E-Divisive algorithm for change
point analysis. We plan to switch Python SDK benchmarks to use that
infrastructure and potentially other benchmarks can follow if that works
out well.
On Tue, Feb 21, 2023 at 10:42 AM Kenneth Knowles <ke...@apache.org> wrote:
> I have not kept a careful eye on these. Are they still useful? Are they
> stable enough to be accurate or meaningful? This particular report (chosen
> at random) looks like small and large regressions across the board.
>
> I would not automatically assume that this is meaningful. I would honestly
> like to reduce the amount of automated content going to dev@
>
> Kenn
>
> On Tue, Feb 21, 2023 at 3:56 AM Apache Jenkins Server <
> jenkins@builds.apache.org> wrote:
>
>> Beam Metrics Report Color legend:
>> >= 20 >= 10 <= -10 <= -20 Possible regression
>> *Measurement* *Metric* *Runner* *Mean previous week* *Mean last week* *Diff
>> %* *Dashboard*
>> cdapioit_results read_time - 15.03 16.87 12.26 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> go_batch_gbk_7 dataflow_runtime - 115.41 134.93 16.92 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_cogbk_1 sparkstructuredstreaming_runtime_sec - 70.17 81.0
>> 15.43 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_batch_cogbk_2 sparkstructuredstreaming_runtime_sec - 75.09 89.63
>> 19.36 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_batch_cogbk_3 dataflow_runtime_sec - 14.18 15.81 11.45 [1]
>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_batch_cogbk_3 dataflow_v2_java17_runtime_sec - 12.12 13.57 11.98 [1]
>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_batch_cogbk_4 dataflow_v2_java17_runtime_sec - 12.22 15.16 24.03 [1]
>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_batch_combine_5 dataflow_runtime_sec - 25.52 30.13 18.1 [1]
>> <http://metrics.beam.apache.org/d/WNzYt13Zk>
>> java_batch_gbk_2 sparkstructuredstreaming_runtime_sec - 54.69 62.48 14.25
>> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_3 dataflow_runtime_sec - 11.65 12.92 10.94 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_5 dataflow_runtime_sec - 18.89 20.78 10.01 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_5 dataflow_v2_java17_runtime_sec - 19.89 22.9 15.1 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_6 dataflow_v2_java11_runtime_sec - 26.89 29.65 10.27 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_pardo_1 dataflow_v2_java11_runtime_sec - 13.54 17.28 27.59 [1]
>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> java_batch_pardo_1 dataflow_v2_java17_runtime_sec - 12.86 15.14 17.72 [1]
>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> java_batch_pardo_1 sparkstructuredstreaming_runtime_sec - 24.93 32.52
>> 30.43 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> java_streaming_cogbk_4 dataflow_v2_java17_runtime_sec - 297.61 348.85
>> 17.22 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_streaming_gbk_3 dataflow_v2_java17_runtime_sec - 62.77 69.7 11.04
>> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_streaming_gbk_5 dataflow_v2_java11_runtime_sec - 594.04 697.93 17.49
>> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_streaming_gbk_6 dataflow_v2_java11_runtime_sec - 150.07 169.36 12.86
>> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_streaming_gbk_7 dataflow_v2_java17_runtime_sec - 222.54 291.74 31.1
>> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> kafkaioit_results read_time - 890.4 1011.3 13.58 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> mongodbioit_results read_time - 25.86 29.19 12.87 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> parquetioit_results read_time - 83.18 93.38 12.26 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> python_batch_cogbk_2 python_dataflow_batch_cogbk_2_runtime - 238.0 272.4
>> 14.45 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> python_batch_combine_5 python_dataflow_batch_combine_5_runtime - 29.29
>> 34.0 16.1 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
>> python_batch_gbk_3 python_dataflow_batch_gbk_3_runtime - 24.14 30.8 27.57
>> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> python_batch_pardo_3 python_dataflow_batch_pardo_3_runtime - 121.14 155.4
>> 28.28 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> python_batch_sideinput_2 python_dataflow_batch_sideinput_2_runtime - 2.29
>> 3.0 31.25 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
>> python_psio_2GB_results pubsub_io_perf_write_runtime - 120.86 163.5 35.28
>> [1] <http://metrics.beam.apache.org/d/gP7vMPqZz>
>> python_streaming_gbk_3 python_dataflow_streaming_gbk_3_runtime - 74.71
>> 99.4 33.04 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> nexmark_0_batch RuntimeMs DirectRunner 1783.16 2123.67 19.1 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_0_zetasql_batch RuntimeMs SparkRunner 3510.0 4836.57 37.79 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_0_zetasql_streaming RuntimeMs FlinkRunner 3218.12 3754.05 16.65
>> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_10_batch RuntimeMs DirectRunner 5602.62 7773.67 38.75 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_10_streaming RuntimeMs DataflowRunner 99964.25 333912.78 234.03
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_10_streaming RuntimeMs DirectRunner 52614.96 69076.81 31.29 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_11_batch RuntimeMs DirectRunner 1417.68 1563.1 10.26 [1]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_11_batch RuntimeMs FlinkRunner 252.0 287.19 13.96 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_13_batch RuntimeMs DirectRunner 3460.84 4111.76 18.81 [1]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_13_sql_batch RuntimeMs DirectRunner 10088.68 12178.38 20.71 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_13_zetasql_batch RuntimeMs DirectRunner 11242.48 13471.24 19.82
>> [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_13_zetasql_batch RuntimeMs SparkRunner 3870.84 5379.33 38.97 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_14_batch RuntimeMs DirectRunner 4249.16 4675.76 10.04 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_15_batch RuntimeMs FlinkRunner 435.12 486.67 11.85 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_15_batch RuntimeMs SparkStructuredStreamingRunner 1029.52 1148.95
>> 11.6 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_16_streaming RuntimeMs DirectRunner 134645.96 164238.14 21.98 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_1_sql_batch RuntimeMs DirectRunner 3732.0 4228.81 13.31 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_1_sql_streaming RuntimeMs FlinkRunner 823.72 943.67 14.56 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_2_batch RuntimeMs DirectRunner 159.14 279.67 75.74 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_2_sql_batch RuntimeMs DirectRunner 1623.28 1787.86 10.14 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_2_zetasql_batch RuntimeMs DirectRunner 2947.56 3249.0 10.23 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_2_zetasql_batch RuntimeMs SparkRunner 1106.56 1221.9 10.42 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_3_batch RuntimeMs DirectRunner 1005.18 1205.86 19.96 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_3_sql_streaming RuntimeMs DataflowRunner 32310.48 36064.45 11.62
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_3_streaming RuntimeMs FlinkRunner 635.28 700.86 10.32 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_3_zetasql_batch RuntimeMs SparkRunner 3472.32 3932.9 13.26 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_3_zetasql_streaming RuntimeMs DataflowRunner 49916.22 57631.27
>> 15.46 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_3_zetasql_streaming RuntimeMs FlinkRunner 1493.36 1745.71 16.9
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_5_batch RuntimeMs DirectRunner 4450.86 5175.48 16.28 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_5_streaming RuntimeMs DirectRunner 23362.84 30660.67 31.24 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_5_streaming RuntimeMs FlinkRunner 1411.04 1556.1 10.28 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_7_batch RuntimeMs DirectRunner 8956.08 10210.69 14.01 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_7_sql_batch RuntimeMs DataflowRunner 77045.7 90994.27 18.1 [1]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
>> nexmark_7_sql_batch RuntimeMs DirectRunner 236395.64 1310318.14 454.29
>> [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_7_sql_streaming RuntimeMs DirectRunner 910056.04 2902227.88
>> 218.91 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_8_batch RuntimeMs DirectRunner 697.58 791.6 13.48 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_9_batch RuntimeMs SparkRunner 567.28 626.67 10.47 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_9_streaming RuntimeMs FlinkRunner 403.56 461.9 14.46 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> tpcds_query10_Calcite_1GB RuntimeMs FlinkRunner 35767.81 40759.19 13.95
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> tpcds_query25_Calcite_1GB RuntimeMs FlinkRunner 42126.5 48054.19 14.07
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>> tpcds_query29_Calcite_1GB RuntimeMs FlinkRunner 40771.38 46696.76 14.53
>> [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> tpcds_query35_Calcite_1GB RuntimeMs FlinkRunner 30409.77 35191.71 15.73
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query38_Calcite_1GB RuntimeMs FlinkRunner 22935.69 26735.9 16.57
>> [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query3_Calcite_1GB RuntimeMs FlinkRunner 36080.88 40976.29 13.57
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>> tpcds_query3_Calcite_1GB RuntimeMs SparkRunner 34050.72 38213.9 12.23 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query40_Calcite_1GB RuntimeMs FlinkRunner 30245.31 34842.9 15.2 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> tpcds_query42_Calcite_1GB RuntimeMs FlinkRunner 23395.85 25856.81 10.52
>> [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query43_Calcite_1GB RuntimeMs FlinkRunner 23571.0 26048.9 10.51 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> tpcds_query52_Calcite_1GB RuntimeMs FlinkRunner 23458.88 25862.38 10.25
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>> tpcds_query55_Calcite_1GB RuntimeMs FlinkRunner 22976.0 25435.86 10.71
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> tpcds_query69_Calcite_1GB RuntimeMs FlinkRunner 31436.54 35748.38 13.72
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> tpcds_query7_Calcite_1GB RuntimeMs FlinkRunner 38729.31 43235.1 11.63 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>> tpcds_query84_Calcite_1GB RuntimeMs FlinkRunner 20584.27 23509.19 14.21
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> tpcds_query87_Calcite_1GB RuntimeMs FlinkRunner 23672.85 27336.67 15.48
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> tpcds_query93_Calcite_1GB RuntimeMs FlinkRunner 48908.42 55821.43 14.13
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> tpcds_query96_Calcite_1GB RuntimeMs FlinkRunner 20025.15 22467.62 12.2
>> [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq> Possible improvement
>> *Measurement* *Metric* *Runner* *Mean previous week* *Mean last week* *Diff
>> %* *Dashboard*
>> avroioit_hdfs_results read_time - 90.2 79.41 -11.96 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> bqio_10GB_results_java_batch_avro avro_write_time - 35.08 30.94 -11.8 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> java_batch_combine_4 dataflow_runtime_sec - 31.62 26.92 -14.85 [1]
>> <http://metrics.beam.apache.org/d/WNzYt13Zk>
>> java_batch_gbk_3 dataflow_v2_java11_runtime_sec - 18.73 11.62 -37.96 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_3 dataflow_v2_java17_runtime_sec - 14.52 11.9 -18.06 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_7 dataflow_v2_java11_runtime_sec - 54.03 36.19 -33.02 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_7 dataflow_v2_java17_runtime_sec - 93.02 34.26 -63.17 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_pardo_2 dataflow_v2_java17_runtime_sec - 60.55 53.35 -11.89
>> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> java_batch_pardo_3 dataflow_v2_java11_runtime_sec - 12.51 10.19 -18.53
>> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> java_batch_pardo_3 dataflow_v2_java17_runtime_sec - 13.9 10.71 -22.91 [1]
>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> java_streaming_cogbk_1 dataflow_v2_java17_runtime_sec - 2606.43 2175.14
>> -16.55 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_streaming_gbk_1 dataflow_v2_java11_runtime_sec - 1016.6 854.76
>> -15.92 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_streaming_gbk_2 dataflow_v2_java11_runtime_sec - 2958.46 2606.28
>> -11.9 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_streaming_gbk_2 dataflow_v2_java17_runtime_sec - 3516.87 2831.8
>> -19.48 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_streaming_gbk_4 dataflow_v2_java17_runtime_sec - 620.74 550.37
>> -11.34 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_streaming_gbk_6 dataflow_v2_java17_runtime_sec - 177.15 145.73
>> -17.74 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_streaming_pardo_1 dataflow_v2_java11_runtime_sec - 26.56 23.19 -12.7
>> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> java_streaming_pardo_2 dataflow_v2_java11_runtime_sec - 97.93 87.64
>> -10.51 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> java_streaming_pardo_2 dataflow_v2_java17_runtime_sec - 100.95 88.91
>> -11.93 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> python_batch_combine_4 python_dataflow_batch_combine_4_runtime - 43.86
>> 29.8 -32.05 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
>> python_batch_gbk_4 python_dataflow_batch_gbk_4_runtime - 102.57 62.4
>> -39.16 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> python_batch_pardo_1 python_dataflow_batch_pardo_1_runtime - 159.14 135.8
>> -14.67 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> python_batch_sideinput_10 python_dataflow_batch_sideinput_10_runtime -
>> 918.86 711.0 -22.62 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
>> python_batch_sideinput_8 python_dataflow_batch_sideinput_8_runtime -
>> 167.71 134.2 -19.98 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
>> python_bqio_read_10GB_results bqio_read_10GB_results_runtime - 106.0 89.0
>> -16.04 [1] <http://metrics.beam.apache.org/d/gP7vMPqZz>
>> python_streaming_pardo_3 python_dataflow_streaming_pardo_3_runtime -
>> 231.43 169.0 -26.98 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> xmlioit_hdfs_results read_time - 23.63 20.56 -13.01 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> xmlioit_hdfs_results write_time - 26.16 21.77 -16.78 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> nexmark_0_batch RuntimeMs DataflowRunner 26749.75 18435.75 -31.08 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_0_streaming RuntimeMs DataflowRunner 38980.02 34901.86 -10.46 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_10_batch RuntimeMs DataflowRunner 47515.68 30172.77 -36.5 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_11_batch RuntimeMs DataflowRunner 37386.57 22295.25 -40.37 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_12_batch RuntimeMs DataflowRunner 18674.81 11713.24 -37.28 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_15_batch RuntimeMs DataflowRunner 50806.66 31683.81 -37.64 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_16_batch RuntimeMs DataflowRunner 50817.24 32292.63 -36.45 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
>> nexmark_1_batch RuntimeMs DataflowRunner 21164.16 14173.39 -33.03 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_1_streaming RuntimeMs DataflowRunner 29989.31 26805.65 -10.62 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_2_batch RuntimeMs DataflowRunner 14706.32 9432.42 -35.86 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_2_streaming RuntimeMs DataflowRunner 19786.89 17303.69 -12.55 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_3_streaming RuntimeMs DataflowRunner 46899.26 41710.78 -11.06 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_5_batch RuntimeMs DataflowRunner 31070.26 20118.37 -35.25 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_7_streaming RuntimeMs DataflowRunner 123598.91 108149.55 -12.5
>> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_8_batch RuntimeMs DataflowRunner 21435.32 13300.63 -37.95 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> All metrics
>> *Measurement* *Metric* *Runner* *Mean previous week* *Mean last week* *Diff
>> %* *Dashboard*
>> avroioit_hdfs_results read_time - 90.2 79.41 -11.96 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> avroioit_hdfs_results write_time - 121.4 122.86 1.2 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> avroioit_results read_time - 90.01 87.44 -2.85 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> avroioit_results write_time - 121.12 121.44 0.26 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> bqio_10GB_results_java_batch_avro avro_write_time - 35.08 30.94 -11.8 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> bqio_10GB_results_java_batch_avro read_time - 41.76 43.1 3.21 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> bqio_10GB_results_java_batch_json read_time - 41.54 40.29 -3.01 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> bqio_10GB_results_java_batch_json write_time - 53.73 52.08 -3.06 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> bqio_10GB_results_java_stream read_time - 43.23 44.57 3.1 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> bqio_10GB_results_java_stream write_time - 205.89 208.99 1.51 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> cdapioit_results read_time - 15.03 16.87 12.26 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> cdapioit_results write_time - 26.0 26.02 0.09 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> compressed_textioit_hdfs_results read_time - 136.44 126.91 -6.99 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> compressed_textioit_hdfs_results write_time - 215.44 214.35 -0.51 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> compressed_textioit_results read_time - 134.75 128.13 -4.91 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> compressed_textioit_results write_time - 209.2 212.07 1.37 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> go_batch_cogbk_1 dataflow_runtime - 258.35 257.64 -0.28 [1]
>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> go_batch_cogbk_2 dataflow_runtime - 147.85 146.38 -0.99 [1]
>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> go_batch_cogbk_3 dataflow_runtime - 114.16 113.28 -0.77 [1]
>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> go_batch_cogbk_4 dataflow_runtime - 110.72 109.17 -1.4 [1]
>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> go_batch_combine_1 dataflow_runtime - 432.84 428.33 -1.04 [1]
>> <http://metrics.beam.apache.org/d/WNzYt13Zk>
>> go_batch_combine_4 dataflow_runtime - 75.94 75.12 -1.08 [1]
>> <http://metrics.beam.apache.org/d/WNzYt13Zk>
>> go_batch_combine_5 dataflow_runtime - 70.6 69.56 -1.46 [1]
>> <http://metrics.beam.apache.org/d/WNzYt13Zk>
>> go_batch_gbk_1 dataflow_runtime - 389.3 397.02 1.99 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> go_batch_gbk_2 dataflow_runtime - 100.74 102.16 1.41 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> go_batch_gbk_3 dataflow_runtime - 24.93 25.47 2.18 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> go_batch_gbk_4 dataflow_runtime - 55.41 54.48 -1.66 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> go_batch_gbk_5 dataflow_runtime - 42.87 44.57 3.95 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> go_batch_gbk_6 dataflow_runtime - 102.95 103.29 0.32 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> go_batch_gbk_7 dataflow_runtime - 115.41 134.93 16.92 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> go_batch_pardo_1 dataflow_runtime - 84.39 84.11 -0.33 [1]
>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> go_batch_pardo_2 dataflow_runtime - 619.82 601.88 -2.9 [1]
>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> go_batch_pardo_3 dataflow_runtime - 67.66 65.39 -3.35 [1]
>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> go_batch_pardo_4 dataflow_runtime - 69.59 71.59 2.88 [1]
>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> go_batch_sideinput_3 dataflow_runtime - 2.65 2.43 -8.13 [1]
>> <http://metrics.beam.apache.org/d/-E9aGlFGk>
>> go_batch_sideinput_4 dataflow_runtime - 243.33 227.18 -6.64 [1]
>> <http://metrics.beam.apache.org/d/-E9aGlFGk>
>> hadoopformatioit_results read_time - 14.78 14.6 -1.23 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> hadoopformatioit_results write_time - 26.36 26.75 1.48 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> java_batch_cogbk_1 dataflow_runtime_sec - 39.96 40.27 0.77 [1]
>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_batch_cogbk_1 dataflow_v2_java11_runtime_sec - 47.15 47.6 0.97 [1]
>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_batch_cogbk_1 dataflow_v2_java17_runtime_sec - 49.39 46.1 -6.65 [1]
>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_batch_cogbk_1 sparkstructuredstreaming_runtime_sec - 70.17 81.0
>> 15.43 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_batch_cogbk_2 dataflow_runtime_sec - 41.59 43.01 3.43 [1]
>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_batch_cogbk_2 dataflow_v2_java11_runtime_sec - 48.49 46.33 -4.46 [1]
>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_batch_cogbk_2 dataflow_v2_java17_runtime_sec - 46.36 43.67 -5.8 [1]
>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_batch_cogbk_2 sparkstructuredstreaming_runtime_sec - 75.09 89.63
>> 19.36 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_batch_cogbk_3 dataflow_runtime_sec - 14.18 15.81 11.45 [1]
>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_batch_cogbk_3 dataflow_v2_java11_runtime_sec - 12.92 13.36 3.4 [1]
>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_batch_cogbk_3 dataflow_v2_java17_runtime_sec - 12.12 13.57 11.98 [1]
>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_batch_cogbk_3 sparkstructuredstreaming_runtime_sec - 14.95 14.21
>> -5.0 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_batch_cogbk_4 dataflow_runtime_sec - 15.78 14.4 -8.8 [1]
>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_batch_cogbk_4 dataflow_v2_java11_runtime_sec - 13.63 12.89 -5.48 [1]
>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_batch_cogbk_4 dataflow_v2_java17_runtime_sec - 12.22 15.16 24.03 [1]
>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_batch_cogbk_4 sparkstructuredstreaming_runtime_sec - 15.07 14.35
>> -4.76 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_batch_combine_1 dataflow_runtime_sec - 65.12 66.78 2.53 [1]
>> <http://metrics.beam.apache.org/d/WNzYt13Zk>
>> java_batch_combine_1 sparkstructuredstreaming_runtime_sec - 269.45 270.97
>> 0.56 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
>> java_batch_combine_4 dataflow_runtime_sec - 31.62 26.92 -14.85 [1]
>> <http://metrics.beam.apache.org/d/WNzYt13Zk>
>> java_batch_combine_4 sparkstructuredstreaming_runtime_sec - 56.19 53.73
>> -4.38 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
>> java_batch_combine_5 dataflow_runtime_sec - 25.52 30.13 18.1 [1]
>> <http://metrics.beam.apache.org/d/WNzYt13Zk>
>> java_batch_combine_5 sparkstructuredstreaming_runtime_sec - 50.92 52.57
>> 3.24 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
>> java_batch_gbk_1 dataflow_runtime_sec - 120.59 117.76 -2.34 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_1 dataflow_v2_java11_runtime_sec - 89.36 89.96 0.67 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_1 dataflow_v2_java17_runtime_sec - 85.72 87.75 2.37 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_1 sparkstructuredstreaming_runtime_sec - 259.78 253.76
>> -2.31 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_2 dataflow_runtime_sec - 33.36 36.39 9.06 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_2 dataflow_v2_java11_runtime_sec - 42.96 41.28 -3.9 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_2 dataflow_v2_java17_runtime_sec - 42.59 40.42 -5.09 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_2 sparkstructuredstreaming_runtime_sec - 54.69 62.48 14.25
>> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_3 dataflow_runtime_sec - 11.65 12.92 10.94 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_3 dataflow_v2_java11_runtime_sec - 18.73 11.62 -37.96 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_3 dataflow_v2_java17_runtime_sec - 14.52 11.9 -18.06 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_3 sparkstructuredstreaming_runtime_sec - 8.68 8.33 -4.1
>> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_4 dataflow_runtime_sec - 18.79 19.03 1.29 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_4 dataflow_v2_java11_runtime_sec - 21.42 21.62 0.95 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_4 dataflow_v2_java17_runtime_sec - 20.32 22.14 8.97 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_4 sparkstructuredstreaming_runtime_sec - 52.12 49.35 -5.31
>> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_5 dataflow_runtime_sec - 18.89 20.78 10.01 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_5 dataflow_v2_java11_runtime_sec - 19.76 19.72 -0.19 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_5 dataflow_v2_java17_runtime_sec - 19.89 22.9 15.1 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_5 sparkstructuredstreaming_runtime_sec - 49.75 48.08 -3.37
>> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_6 dataflow_runtime_sec - 38.27 39.49 3.18 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_6 dataflow_v2_java11_runtime_sec - 26.89 29.65 10.27 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_6 dataflow_v2_java17_runtime_sec - 31.26 32.19 2.96 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_6 sparkstructuredstreaming_runtime_sec - 32.45 32.39 -0.2
>> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_7 dataflow_runtime_sec - 44.19 45.66 3.34 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_7 dataflow_v2_java11_runtime_sec - 54.03 36.19 -33.02 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_7 dataflow_v2_java17_runtime_sec - 93.02 34.26 -63.17 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_gbk_7 sparkstructuredstreaming_runtime_sec - 37.13 36.68 -1.21
>> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_batch_pardo_1 dataflow_runtime_sec - 20.61 19.9 -3.41 [1]
>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> java_batch_pardo_1 dataflow_v2_java11_runtime_sec - 13.54 17.28 27.59 [1]
>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> java_batch_pardo_1 dataflow_v2_java17_runtime_sec - 12.86 15.14 17.72 [1]
>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> java_batch_pardo_1 sparkstructuredstreaming_runtime_sec - 24.93 32.52
>> 30.43 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> java_batch_pardo_2 dataflow_runtime_sec - 209.32 208.57 -0.36 [1]
>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> java_batch_pardo_2 dataflow_v2_java11_runtime_sec - 59.05 54.05 -8.47 [1]
>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> java_batch_pardo_2 dataflow_v2_java17_runtime_sec - 60.55 53.35 -11.89
>> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> java_batch_pardo_3 dataflow_runtime_sec - 13.9 15.02 8.09 [1]
>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> java_batch_pardo_3 dataflow_v2_java11_runtime_sec - 12.51 10.19 -18.53
>> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> java_batch_pardo_3 dataflow_v2_java17_runtime_sec - 13.9 10.71 -22.91 [1]
>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> java_batch_pardo_4 dataflow_runtime_sec - 28.13 28.74 2.18 [1]
>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> java_batch_pardo_4 dataflow_v2_java11_runtime_sec - 26.32 27.75 5.42 [1]
>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> java_batch_pardo_4 dataflow_v2_java17_runtime_sec - 24.51 22.69 -7.44 [1]
>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> java_streaming_cogbk_1 dataflow_runtime_sec - 872.6 789.84 -9.48 [1]
>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_streaming_cogbk_1 dataflow_v2_java11_runtime_sec - 3005.89 2851.74
>> -5.13 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_streaming_cogbk_1 dataflow_v2_java17_runtime_sec - 2606.43 2175.14
>> -16.55 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_streaming_cogbk_2 dataflow_runtime_sec - 917.57 924.82 0.79 [1]
>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_streaming_cogbk_2 dataflow_v2_java11_runtime_sec - 3115.11 2941.95
>> -5.56 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_streaming_cogbk_2 dataflow_v2_java17_runtime_sec - 2960.86 2987.15
>> 0.89 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_streaming_cogbk_3 dataflow_runtime_sec - 121.41 109.31 -9.96 [1]
>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_streaming_cogbk_3 dataflow_v2_java11_runtime_sec - 378.28 366.57
>> -3.1 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_streaming_cogbk_3 dataflow_v2_java17_runtime_sec - 348.02 314.68
>> -9.58 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_streaming_cogbk_4 dataflow_runtime_sec - 125.13 114.87 -8.2 [1]
>> <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_streaming_cogbk_4 dataflow_v2_java11_runtime_sec - 363.26 332.86
>> -8.37 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_streaming_cogbk_4 dataflow_v2_java17_runtime_sec - 297.61 348.85
>> 17.22 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> java_streaming_combine_1 dataflow_runtime_sec - 482.69 474.54 -1.69 [1]
>> <http://metrics.beam.apache.org/d/WNzYt13Zk>
>> java_streaming_combine_4 dataflow_runtime_sec - 313.08 306.95 -1.96 [1]
>> <http://metrics.beam.apache.org/d/WNzYt13Zk>
>> java_streaming_combine_5 dataflow_runtime_sec - 317.67 306.83 -3.41 [1]
>> <http://metrics.beam.apache.org/d/WNzYt13Zk>
>> java_streaming_gbk_1 dataflow_runtime_sec - 640.71 644.58 0.6 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_streaming_gbk_1 dataflow_v2_java11_runtime_sec - 1016.6 854.76
>> -15.92 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_streaming_gbk_1 dataflow_v2_java17_runtime_sec - 859.19 832.88 -3.06
>> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_streaming_gbk_2 dataflow_runtime_sec - 844.31 815.67 -3.39 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_streaming_gbk_2 dataflow_v2_java11_runtime_sec - 2958.46 2606.28
>> -11.9 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_streaming_gbk_2 dataflow_v2_java17_runtime_sec - 3516.87 2831.8
>> -19.48 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_streaming_gbk_3 dataflow_runtime_sec - 23.72 25.1 5.79 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_streaming_gbk_3 dataflow_v2_java11_runtime_sec - 56.71 57.05 0.6 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_streaming_gbk_3 dataflow_v2_java17_runtime_sec - 62.77 69.7 11.04
>> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_streaming_gbk_4 dataflow_runtime_sec - 303.31 289.43 -4.58 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_streaming_gbk_4 dataflow_v2_java11_runtime_sec - 600.82 631.36 5.08
>> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_streaming_gbk_4 dataflow_v2_java17_runtime_sec - 620.74 550.37
>> -11.34 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_streaming_gbk_5 dataflow_runtime_sec - 282.59 301.15 6.57 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_streaming_gbk_5 dataflow_v2_java11_runtime_sec - 594.04 697.93 17.49
>> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_streaming_gbk_5 dataflow_v2_java17_runtime_sec - 585.53 550.22 -6.03
>> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_streaming_gbk_6 dataflow_runtime_sec - 76.16 74.96 -1.58 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_streaming_gbk_6 dataflow_v2_java11_runtime_sec - 150.07 169.36 12.86
>> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_streaming_gbk_6 dataflow_v2_java17_runtime_sec - 177.15 145.73
>> -17.74 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_streaming_gbk_7 dataflow_runtime_sec - 136.32 127.69 -6.33 [1]
>> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_streaming_gbk_7 dataflow_v2_java11_runtime_sec - 231.51 221.07 -4.51
>> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_streaming_gbk_7 dataflow_v2_java17_runtime_sec - 222.54 291.74 31.1
>> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> java_streaming_pardo_1 dataflow_runtime_sec - 18.86 20.11 6.61 [1]
>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> java_streaming_pardo_1 dataflow_v2_java11_runtime_sec - 26.56 23.19 -12.7
>> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> java_streaming_pardo_1 dataflow_v2_java17_runtime_sec - 24.28 23.01 -5.22
>> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> java_streaming_pardo_2 dataflow_runtime_sec - 208.74 217.9 4.39 [1]
>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> java_streaming_pardo_2 dataflow_v2_java11_runtime_sec - 97.93 87.64
>> -10.51 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> java_streaming_pardo_2 dataflow_v2_java17_runtime_sec - 100.95 88.91
>> -11.93 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> java_streaming_pardo_3 dataflow_runtime_sec - 12.44 11.89 -4.41 [1]
>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> java_streaming_pardo_3 dataflow_v2_java11_runtime_sec - 23.73 22.6 -4.78
>> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> java_streaming_pardo_3 dataflow_v2_java17_runtime_sec - 20.97 20.5 -2.25
>> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> java_streaming_pardo_4 dataflow_runtime_sec - 31.84 31.15 -2.15 [1]
>> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> java_streaming_pardo_4 dataflow_v2_java11_runtime_sec - 37.88 39.89 5.31
>> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> java_streaming_pardo_4 dataflow_v2_java17_runtime_sec - 37.65 36.3 -3.59
>> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> jdbcioit_results read_time - 26.24 25.71 -1.99 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> jdbcioit_results write_time - 39.42 40.3 2.24 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> kafkaioit_results read_time - 890.4 1011.3 13.58 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> kafkaioit_results write_time - 163.97 165.39 0.87 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> kafkaioit_results_runner_v2 read_time - 956.27 937.09 -2.01 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> kafkaioit_results_runner_v2 write_time - 170.63 172.99 1.38 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> many_files_textioit_hdfs_results read_time - 16.18 15.89 -1.76 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> many_files_textioit_hdfs_results write_time - 68.97 67.37 -2.32 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> many_files_textioit_results read_time - 23.0 25.17 9.42 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> many_files_textioit_results write_time - 61.46 64.25 4.55 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> mongodbioit_results read_time - 25.86 29.19 12.87 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> mongodbioit_results write_time - 50.08 49.41 -1.34 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> parquetioit_hdfs_results read_time - 87.82 79.32 -9.68 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> parquetioit_hdfs_results write_time - 144.68 132.66 -8.31 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> parquetioit_results read_time - 83.18 93.38 12.26 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> parquetioit_results write_time - 139.99 146.1 4.37 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> python_batch_cogbk_1 python_dataflow_batch_cogbk_1_runtime - 385.14 389.4
>> 1.11 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> python_batch_cogbk_2 python_dataflow_batch_cogbk_2_runtime - 238.0 272.4
>> 14.45 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> python_batch_cogbk_3 python_dataflow_batch_cogbk_3_runtime - 216.29 208.8
>> -3.46 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> python_batch_cogbk_4 python_dataflow_batch_cogbk_4_runtime - 208.14 203.4
>> -2.28 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> python_batch_combine_1 python_dataflow_batch_combine_1_runtime - 767.14
>> 751.0 -2.1 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
>> python_batch_combine_4 python_dataflow_batch_combine_4_runtime - 43.86
>> 29.8 -32.05 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
>> python_batch_combine_5 python_dataflow_batch_combine_5_runtime - 29.29
>> 34.0 16.1 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
>> python_batch_gbk_1 python_dataflow_batch_gbk_1_runtime - 1316.86 1336.0
>> 1.45 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> python_batch_gbk_2 python_dataflow_batch_gbk_2_runtime - 241.43 264.8
>> 9.68 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> python_batch_gbk_3 python_dataflow_batch_gbk_3_runtime - 24.14 30.8 27.57
>> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> python_batch_gbk_4 python_dataflow_batch_gbk_4_runtime - 102.57 62.4
>> -39.16 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> python_batch_gbk_5 python_dataflow_batch_gbk_5_runtime - 102.29 97.4
>> -4.78 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> python_batch_gbk_6 python_dataflow_batch_gbk_6_runtime - 245.5 226.2
>> -7.86 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> python_batch_gbk_7 python_dataflow_batch_gbk_7_runtime - 244.83 231.6
>> -5.41 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> python_batch_pardo_1 python_dataflow_batch_pardo_1_runtime - 159.14 135.8
>> -14.67 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> python_batch_pardo_2 python_dataflow_batch_pardo_2_runtime - 1365.57
>> 1358.0 -0.55 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> python_batch_pardo_3 python_dataflow_batch_pardo_3_runtime - 121.14 155.4
>> 28.28 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> python_batch_pardo_4 python_dataflow_batch_pardo_4_runtime - 319.71 322.0
>> 0.71 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> python_batch_sideinput_1 python_dataflow_batch_sideinput_1_runtime - 2.14
>> 2.17 1.11 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
>> python_batch_sideinput_10 python_dataflow_batch_sideinput_10_runtime -
>> 918.86 711.0 -22.62 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
>> python_batch_sideinput_2 python_dataflow_batch_sideinput_2_runtime - 2.29
>> 3.0 31.25 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
>> python_batch_sideinput_3 python_dataflow_batch_sideinput_3_runtime - 3.0
>> 2.8 -6.67 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
>> python_batch_sideinput_4 python_dataflow_batch_sideinput_4_runtime -
>> 28.86 27.4 -5.05 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
>> python_batch_sideinput_5 python_dataflow_batch_sideinput_5_runtime - 2.57
>> 2.6 1.11 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
>> python_batch_sideinput_6 python_dataflow_batch_sideinput_6_runtime - 2.43
>> 2.4 -1.18 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
>> python_batch_sideinput_7 python_dataflow_batch_sideinput_7_runtime -
>> 131.86 122.2 -7.32 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
>> python_batch_sideinput_8 python_dataflow_batch_sideinput_8_runtime -
>> 167.71 134.2 -19.98 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
>> python_batch_sideinput_9 python_dataflow_batch_sideinput_9_runtime -
>> 768.14 796.8 3.73 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
>> python_bqio_read_10GB_results bqio_read_10GB_results_runtime - 106.0 89.0
>> -16.04 [1] <http://metrics.beam.apache.org/d/gP7vMPqZz>
>> python_bqio_write_10GB_results bqio_write_10GB_results_runtime - 274.71
>> 252.4 -8.12 [1] <http://metrics.beam.apache.org/d/gP7vMPqZz>
>> python_direct_microbenchmarks fn_api_runner_microbenchmark_runtime_sec -
>> 584.93 603.05 3.1
>> python_direct_microbenchmarks teststream_microbenchmark_runtime_sec -
>> 357.42 388.56 8.71
>> python_kafkaio_results read_runtime - 234.57 230.4 -1.78 [1]
>> <http://metrics.beam.apache.org/d/gP7vMPqZz>
>> python_kafkaio_results write_runtime - 357.0 373.6 4.65 [1]
>> <http://metrics.beam.apache.org/d/gP7vMPqZz>
>> python_psio_2GB_results pubsub_io_perf_read_runtime - 374.5 340.17 -9.17
>> [1] <http://metrics.beam.apache.org/d/gP7vMPqZz>
>> python_psio_2GB_results pubsub_io_perf_write_runtime - 120.86 163.5 35.28
>> [1] <http://metrics.beam.apache.org/d/gP7vMPqZz>
>> python_spanner_write_2GB_results pyspanner_write_2GB_results_runtime -
>> 1839.86 1789.2 -2.75 [1] <http://metrics.beam.apache.org/d/gP7vMPqZz>
>> python_spannerio_read_2GB_results pyspanner_read_2GB_results_runtime -
>> 23.33 23.67 1.43 [1] <http://metrics.beam.apache.org/d/gP7vMPqZz>
>> python_streaming_cogbk_1 python_dataflow_streaming_cogbk_1_runtime -
>> 612.0 563.2 -7.97 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> python_streaming_cogbk_2 python_dataflow_streaming_cogbk_2_runtime -
>> 319.17 348.2 9.1 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> python_streaming_cogbk_3 python_dataflow_streaming_cogbk_3_runtime -
>> 375.33 368.0 -1.95 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> python_streaming_cogbk_4 python_dataflow_streaming_cogbk_4_runtime -
>> 319.67 325.0 1.67 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
>> python_streaming_gbk_3 python_dataflow_streaming_gbk_3_runtime - 74.71
>> 99.4 33.04 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> python_streaming_gbk_6 python_dataflow_streaming_gbk_6_runtime - 453.0
>> 446.0 -1.55 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> python_streaming_gbk_7 python_dataflow_streaming_gbk_7_runtime - 501.5
>> 486.6 -2.97 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
>> python_streaming_pardo_1 python_dataflow_streaming_pardo_1_runtime -
>> 193.0 203.6 5.49 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> python_streaming_pardo_2 python_dataflow_streaming_pardo_2_runtime -
>> 2411.71 2264.4 -6.11 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> python_streaming_pardo_3 python_dataflow_streaming_pardo_3_runtime -
>> 231.43 169.0 -26.98 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> python_streaming_pardo_4 python_dataflow_streaming_pardo_4_runtime -
>> 428.33 428.2 -0.03 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
>> python_textio_1GB_results read_runtime - 97.43 99.67 2.3 [1]
>> <http://metrics.beam.apache.org/d/gP7vMPqZz>
>> python_textio_1GB_results write_runtime - 192.71 189.5 -1.67 [1]
>> <http://metrics.beam.apache.org/d/gP7vMPqZz>
>> singlestoreioit_results read_time - 90.19 85.79 -4.88 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> singlestoreioit_results write_time - 25.66 26.42 2.97 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> sparkreceiverioit_results read_time - 765.18 792.2 3.53 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> textioit_hdfs_results read_time - 17.96 18.6 3.57 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> textioit_hdfs_results write_time - 37.67 35.26 -6.4 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> textioit_results read_time - 19.66 19.29 -1.88 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> textioit_results write_time - 34.96 31.8 -9.03 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> tfrecordioit_results read_time - 17.68 16.56 -6.32 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> tfrecordioit_results write_time - 22.29 23.09 3.58 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> wordcount_py37_results runtime - 810.17 866.31 6.93 [1]
>> <http://metrics.beam.apache.org/d/1cnwVDkGk>
>> xmlioit_hdfs_results read_time - 23.63 20.56 -13.01 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> xmlioit_hdfs_results write_time - 26.16 21.77 -16.78 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> xmlioit_results read_time - 25.69 26.58 3.45 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> xmlioit_results write_time - 25.76 26.67 3.54 [1]
>> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
>> nexmark_0_batch RuntimeMs DataflowRunner 26749.75 18435.75 -31.08 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_0_batch RuntimeMs DirectRunner 1783.16 2123.67 19.1 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_0_batch RuntimeMs FlinkRunner 1064.56 1138.29 6.93 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_0_batch RuntimeMs SparkRunner 1303.4 1400.62 7.46 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_0_batch RuntimeMs SparkStructuredStreamingRunner 1310.64 1396.67
>> 6.56 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_0_python_batch RuntimeMs DirectRunner 12252.27 12309.52 0.47 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_0_sql_batch RuntimeMs DataflowRunner 33071.81 33724.5 1.97 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_0_sql_batch RuntimeMs DirectRunner 5879.64 6351.9 8.03 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_0_sql_batch RuntimeMs FlinkRunner 1137.92 1213.14 6.61 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_0_sql_batch RuntimeMs SparkRunner 3269.36 3369.38 3.06 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_0_sql_batch RuntimeMs SparkStructuredStreamingRunner 1535.52
>> 1618.95 5.43 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_0_sql_streaming RuntimeMs DataflowRunner 23607.74 24395.64 3.34
>> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_0_sql_streaming RuntimeMs DirectRunner 15789.0 16131.12 2.17 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_0_sql_streaming RuntimeMs FlinkRunner 1787.6 1937.62 8.39 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_0_streaming RuntimeMs DataflowRunner 38980.02 34901.86 -10.46 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_0_streaming RuntimeMs DirectRunner 12676.12 12695.05 0.15 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_0_streaming RuntimeMs FlinkRunner 1530.0 1646.0 7.58 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_0_zetasql_batch RuntimeMs DataflowRunner 118581.48 125235.77 5.61
>> [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_0_zetasql_batch RuntimeMs DirectRunner 7108.56 7757.12 9.12 [1]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_0_zetasql_batch RuntimeMs FlinkRunner 2266.08 2488.71 9.82 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_0_zetasql_batch RuntimeMs SparkRunner 3510.0 4836.57 37.79 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_0_zetasql_batch RuntimeMs SparkStructuredStreamingRunner 2866.56
>> 3025.0 5.53 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_0_zetasql_streaming RuntimeMs DataflowRunner 68752.07 70194.32
>> 2.1 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_0_zetasql_streaming RuntimeMs DirectRunner 17661.8 18539.88 4.97
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_0_zetasql_streaming RuntimeMs FlinkRunner 3218.12 3754.05 16.65
>> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_10_batch RuntimeMs DataflowRunner 47515.68 30172.77 -36.5 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_10_batch RuntimeMs DirectRunner 5602.62 7773.67 38.75 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_10_batch RuntimeMs FlinkRunner 645.52 692.29 7.24 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_10_batch RuntimeMs SparkRunner 681.4 722.67 6.06 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_10_batch RuntimeMs SparkStructuredStreamingRunner 1003.32 1039.67
>> 3.62 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_10_python_batch RuntimeMs DirectRunner 25711.96 25954.14 0.94 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_10_streaming RuntimeMs DataflowRunner 99964.25 333912.78 234.03
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_10_streaming RuntimeMs DirectRunner 52614.96 69076.81 31.29 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_10_streaming RuntimeMs FlinkRunner 1553.84 1598.24 2.86 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_11_batch RuntimeMs DataflowRunner 37386.57 22295.25 -40.37 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_11_batch RuntimeMs DirectRunner 1417.68 1563.1 10.26 [1]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_11_batch RuntimeMs FlinkRunner 252.0 287.19 13.96 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_11_batch RuntimeMs SparkRunner 1484.72 1526.33 2.8 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_11_batch RuntimeMs SparkStructuredStreamingRunner 1269.96 1371.0
>> 7.96 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_11_python_batch RuntimeMs DirectRunner 20136.84 20394.38 1.28 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_11_streaming RuntimeMs DataflowRunner 173412.48 171423.47 -1.15
>> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_11_streaming RuntimeMs DirectRunner 10803.88 10796.62 -0.07 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_11_streaming RuntimeMs FlinkRunner 1524.64 1542.43 1.17 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_12_batch RuntimeMs DataflowRunner 18674.81 11713.24 -37.28 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_12_batch RuntimeMs DirectRunner 2720.6 2936.52 7.94 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_12_batch RuntimeMs FlinkRunner 175.08 177.24 1.23 [1]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_12_batch RuntimeMs SparkRunner 892.88 926.0 3.71 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_12_batch RuntimeMs SparkStructuredStreamingRunner 923.12 954.1
>> 3.36 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_12_streaming RuntimeMs DataflowRunner 91825.83 89753.43 -2.26 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_12_streaming RuntimeMs DirectRunner 9359.56 9369.95 0.11 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_12_streaming RuntimeMs FlinkRunner 600.0 646.19 7.7 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_13_batch RuntimeMs DataflowRunner 33043.33 31355.0 -5.11 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_13_batch RuntimeMs DirectRunner 3460.84 4111.76 18.81 [1]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_13_batch RuntimeMs FlinkRunner 450.36 466.62 3.61 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_13_batch RuntimeMs SparkRunner 331.28 343.9 3.81 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_13_batch RuntimeMs SparkStructuredStreamingRunner 1059.16 1072.9
>> 1.3 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_13_sql_batch RuntimeMs DataflowRunner 56831.67 58858.09 3.57 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_13_sql_batch RuntimeMs DirectRunner 10088.68 12178.38 20.71 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_13_sql_batch RuntimeMs FlinkRunner 1072.8 1149.38 7.14 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_13_sql_batch RuntimeMs SparkRunner 3357.64 3500.24 4.25 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_13_sql_batch RuntimeMs SparkStructuredStreamingRunner 1755.32
>> 1838.48 4.74 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_13_sql_streaming RuntimeMs DataflowRunner 34625.22 34634.14 0.03
>> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_13_sql_streaming RuntimeMs DirectRunner 19339.6 19400.82 0.32 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_13_sql_streaming RuntimeMs FlinkRunner 2470.52 2611.33 5.7 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_13_streaming RuntimeMs DataflowRunner 26192.48 24892.95 -4.96 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_13_streaming RuntimeMs DirectRunner 10120.2 10259.43 1.38 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_13_streaming RuntimeMs FlinkRunner 1476.08 1573.57 6.6 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_13_zetasql_batch RuntimeMs DataflowRunner 264852.07 276071.91
>> 4.24 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_13_zetasql_batch RuntimeMs DirectRunner 11242.48 13471.24 19.82
>> [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_13_zetasql_batch RuntimeMs FlinkRunner 2869.56 2901.38 1.11 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_13_zetasql_batch RuntimeMs SparkRunner 3870.84 5379.33 38.97 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_13_zetasql_batch RuntimeMs SparkStructuredStreamingRunner 4227.68
>> 4368.33 3.33 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_13_zetasql_streaming RuntimeMs DataflowRunner 115395.81 114891.95
>> -0.44 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_13_zetasql_streaming RuntimeMs DirectRunner 21540.6 23144.0 7.44
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_13_zetasql_streaming RuntimeMs FlinkRunner 4066.96 4326.1 6.37
>> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_14_batch RuntimeMs DataflowRunner 61537.81 60080.32 -2.37 [1]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_14_batch RuntimeMs DirectRunner 4249.16 4675.76 10.04 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_14_batch RuntimeMs FlinkRunner 482.32 511.33 6.02 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_14_batch RuntimeMs SparkRunner 846.88 914.43 7.98 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_14_batch RuntimeMs SparkStructuredStreamingRunner 1066.24 1059.81
>> -0.6 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_14_streaming RuntimeMs DataflowRunner 129612.15 129600.91 -0.01
>> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_14_streaming RuntimeMs DirectRunner 12800.28 13415.29 4.8 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_14_streaming RuntimeMs FlinkRunner 1264.36 1314.1 3.93 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_15_batch RuntimeMs DataflowRunner 50806.66 31683.81 -37.64 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_15_batch RuntimeMs DirectRunner 15621.12 16396.0 4.96 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_15_batch RuntimeMs FlinkRunner 435.12 486.67 11.85 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_15_batch RuntimeMs SparkRunner 1597.8 1653.24 3.47 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_15_batch RuntimeMs SparkStructuredStreamingRunner 1029.52 1148.95
>> 11.6 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_16_batch RuntimeMs DataflowRunner 50817.24 32292.63 -36.45 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
>> nexmark_16_batch RuntimeMs DirectRunner 84968.52 87346.48 2.8 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_16_batch RuntimeMs FlinkRunner 215.52 228.71 6.12 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_16_batch RuntimeMs SparkRunner 1365.32 1383.57 1.34 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_16_batch RuntimeMs SparkStructuredStreamingRunner 639.04 653.81
>> 2.31 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_16_streaming RuntimeMs DataflowRunner 97653.77 93735.35 -4.01 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_16_streaming RuntimeMs DirectRunner 134645.96 164238.14 21.98 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_16_streaming RuntimeMs FlinkRunner 497.56 519.71 4.45 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_1_batch RuntimeMs DataflowRunner 21164.16 14173.39 -33.03 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_1_batch RuntimeMs DirectRunner 3223.6 3481.1 7.99 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_1_batch RuntimeMs FlinkRunner 312.48 332.48 6.4 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_1_batch RuntimeMs SparkRunner 430.92 440.43 2.21 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_1_batch RuntimeMs SparkStructuredStreamingRunner 421.32 425.38
>> 0.96 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_1_sql_batch RuntimeMs DataflowRunner 29694.04 29599.73 -0.32 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
>> nexmark_1_sql_batch RuntimeMs DirectRunner 3732.0 4228.81 13.31 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_1_sql_batch RuntimeMs FlinkRunner 589.96 627.52 6.37 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_1_sql_batch RuntimeMs SparkRunner 2376.08 2433.62 2.42 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_1_sql_batch RuntimeMs SparkStructuredStreamingRunner 681.72
>> 730.67 7.18 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_1_sql_streaming RuntimeMs DataflowRunner 21010.93 21094.32 0.4
>> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_1_sql_streaming RuntimeMs DirectRunner 11578.4 11795.88 1.88 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_1_sql_streaming RuntimeMs FlinkRunner 823.72 943.67 14.56 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_1_streaming RuntimeMs DataflowRunner 29989.31 26805.65 -10.62 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_1_streaming RuntimeMs DirectRunner 8239.24 8465.57 2.75 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_1_streaming RuntimeMs FlinkRunner 675.8 719.81 6.51 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_2_batch RuntimeMs DataflowRunner 14706.32 9432.42 -35.86 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_2_batch RuntimeMs DirectRunner 159.14 279.67 75.74 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_2_batch RuntimeMs FlinkRunner 181.24 170.95 -5.68 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_2_batch RuntimeMs SparkRunner 276.56 292.52 5.77 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_2_batch RuntimeMs SparkStructuredStreamingRunner 272.12 281.14
>> 3.32 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_2_python_batch RuntimeMs DirectRunner 7829.65 8468.19 8.16 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_2_sql_batch RuntimeMs DataflowRunner 21686.93 20245.05 -6.65 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_2_sql_batch RuntimeMs DirectRunner 1623.28 1787.86 10.14 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_2_sql_batch RuntimeMs FlinkRunner 379.0 392.9 3.67 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_2_sql_batch RuntimeMs SparkRunner 748.4 796.19 6.39 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_2_sql_batch RuntimeMs SparkStructuredStreamingRunner 597.16
>> 634.86 6.31 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_2_sql_streaming RuntimeMs DataflowRunner 13997.85 13959.77 -0.27
>> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_2_sql_streaming RuntimeMs DirectRunner 6869.4 6924.18 0.8 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_2_sql_streaming RuntimeMs FlinkRunner 425.56 413.14 -2.92 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_2_streaming RuntimeMs DataflowRunner 19786.89 17303.69 -12.55 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_2_streaming RuntimeMs DirectRunner 5211.16 5357.95 2.82 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_2_streaming RuntimeMs FlinkRunner 294.36 316.1 7.38 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_2_zetasql_batch RuntimeMs DataflowRunner 74348.78 73878.45 -0.63
>> [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_2_zetasql_batch RuntimeMs DirectRunner 2947.56 3249.0 10.23 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_2_zetasql_batch RuntimeMs FlinkRunner 910.76 979.14 7.51 [1]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_2_zetasql_batch RuntimeMs SparkRunner 1106.56 1221.9 10.42 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_2_zetasql_batch RuntimeMs SparkStructuredStreamingRunner 1080.48
>> 1084.9 0.41 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_2_zetasql_streaming RuntimeMs DataflowRunner 42780.04 41825.14
>> -2.23 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_2_zetasql_streaming RuntimeMs DirectRunner 8384.56 8746.76 4.32
>> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_2_zetasql_streaming RuntimeMs FlinkRunner 1236.52 1326.29 7.26
>> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_3_batch RuntimeMs DataflowRunner 23433.0 21672.36 -7.51 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_3_batch RuntimeMs DirectRunner 1005.18 1205.86 19.96 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_3_batch RuntimeMs FlinkRunner 1221.2 1278.52 4.69 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_3_batch RuntimeMs SparkRunner 2119.48 2167.52 2.27 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_3_python_batch RuntimeMs DirectRunner 10760.73 10776.0 0.14 [1]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_3_sql_batch RuntimeMs DataflowRunner 25223.3 24443.09 -3.09 [1]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_3_sql_batch RuntimeMs DirectRunner 3386.16 3555.57 5.0 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_3_sql_batch RuntimeMs FlinkRunner 1452.68 1512.86 4.14 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_3_sql_batch RuntimeMs SparkRunner 3620.8 3729.76 3.01 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_3_sql_streaming RuntimeMs DataflowRunner 32310.48 36064.45 11.62
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_3_sql_streaming RuntimeMs DirectRunner 8541.28 8803.35 3.07 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_3_sql_streaming RuntimeMs FlinkRunner 1038.2 1129.62 8.81 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_3_streaming RuntimeMs DataflowRunner 46899.26 41710.78 -11.06 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_3_streaming RuntimeMs DirectRunner 7867.28 8257.0 4.95 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_3_streaming RuntimeMs FlinkRunner 635.28 700.86 10.32 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_3_zetasql_batch RuntimeMs DataflowRunner 59496.74 60512.82 1.71
>> [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_3_zetasql_batch RuntimeMs DirectRunner 3818.12 4015.59 5.17 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_3_zetasql_batch RuntimeMs FlinkRunner 1800.8 1953.57 8.48 [1]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_3_zetasql_batch RuntimeMs SparkRunner 3472.32 3932.9 13.26 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_3_zetasql_streaming RuntimeMs DataflowRunner 49916.22 57631.27
>> 15.46 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_3_zetasql_streaming RuntimeMs DirectRunner 9091.72 9318.88 2.5
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_3_zetasql_streaming RuntimeMs FlinkRunner 1493.36 1745.71 16.9
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_4_batch RuntimeMs DataflowRunner 29181.48 28042.59 -3.9 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_4_batch RuntimeMs DirectRunner 2466.04 2665.1 8.07 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_4_batch RuntimeMs FlinkRunner 959.92 966.05 0.64 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_4_batch RuntimeMs SparkRunner 1191.84 1252.38 5.08 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_4_batch RuntimeMs SparkStructuredStreamingRunner 2729.44 2851.24
>> 4.46 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_4_streaming RuntimeMs DataflowRunner 51110.81 50696.95 -0.81 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_4_streaming RuntimeMs DirectRunner 2939.64 3139.14 6.79 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_4_streaming RuntimeMs FlinkRunner 1092.36 1041.95 -4.61 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_5_batch RuntimeMs DataflowRunner 31070.26 20118.37 -35.25 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_5_batch RuntimeMs DirectRunner 4450.86 5175.48 16.28 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_5_batch RuntimeMs FlinkRunner 876.92 897.48 2.34 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_5_batch RuntimeMs SparkRunner 1508.48 1552.33 2.91 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_5_batch RuntimeMs SparkStructuredStreamingRunner 1692.48 1717.81
>> 1.5 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_5_python_batch RuntimeMs DirectRunner 16819.96 16953.9 0.8 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_5_streaming RuntimeMs DataflowRunner 196748.05 188710.43 -4.09
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_5_streaming RuntimeMs DirectRunner 23362.84 30660.67 31.24 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_5_streaming RuntimeMs FlinkRunner 1411.04 1556.1 10.28 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_6_batch RuntimeMs DataflowRunner 26962.3 26104.91 -3.18 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_6_batch RuntimeMs DirectRunner 1846.28 1974.14 6.93 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_6_batch RuntimeMs FlinkRunner 612.52 607.0 -0.9 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_6_batch RuntimeMs SparkRunner 709.2 749.57 5.69 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_6_batch RuntimeMs SparkStructuredStreamingRunner 1200.4 1232.57
>> 2.68 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
>> nexmark_6_streaming RuntimeMs DataflowRunner 39862.63 41376.27 3.8 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_6_streaming RuntimeMs DirectRunner 2169.32 2254.29 3.92 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_6_streaming RuntimeMs FlinkRunner 554.12 573.52 3.5 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_7_batch RuntimeMs DataflowRunner 51271.63 47392.09 -7.57 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_7_batch RuntimeMs DirectRunner 8956.08 10210.69 14.01 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_7_batch RuntimeMs FlinkRunner 700.8 729.57 4.11 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_7_batch RuntimeMs SparkRunner 1468.92 1525.29 3.84 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_7_batch RuntimeMs SparkStructuredStreamingRunner 3655.12 3724.33
>> 1.89 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_7_python_batch RuntimeMs DirectRunner 19817.08 19831.76 0.07 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_7_sql_batch RuntimeMs DataflowRunner 77045.7 90994.27 18.1 [1]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
>> nexmark_7_sql_batch RuntimeMs DirectRunner 236395.64 1310318.14 454.29
>> [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_7_sql_batch RuntimeMs FlinkRunner 2795.8 2994.48 7.11 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_7_sql_batch RuntimeMs SparkRunner 7066.36 7333.19 3.78 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_7_sql_batch RuntimeMs SparkStructuredStreamingRunner 6052.24
>> 6245.52 3.19 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_7_sql_streaming RuntimeMs DataflowRunner 1010451.11 1034446.23
>> 2.37 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_7_sql_streaming RuntimeMs DirectRunner 910056.04 2902227.88
>> 218.91 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_7_sql_streaming RuntimeMs FlinkRunner 3621.72 3855.14 6.45 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_7_streaming RuntimeMs DataflowRunner 123598.91 108149.55 -12.5
>> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_7_streaming RuntimeMs DirectRunner 864197.84 861347.19 -0.33 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_7_streaming RuntimeMs FlinkRunner 1412.8 1403.57 -0.65 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_8_batch RuntimeMs DataflowRunner 21435.32 13300.63 -37.95 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_8_batch RuntimeMs DirectRunner 697.58 791.6 13.48 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_8_batch RuntimeMs FlinkRunner 507.92 535.86 5.5 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk>
>> nexmark_8_batch RuntimeMs SparkRunner 1460.64 1535.81 5.15 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_8_batch RuntimeMs SparkStructuredStreamingRunner 1982.28 2029.29
>> 2.37 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_8_python_batch RuntimeMs DirectRunner 10450.8 10465.81 0.14 [1]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
>> nexmark_8_streaming RuntimeMs DataflowRunner 66471.26 61236.96 -7.87 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_8_streaming RuntimeMs DirectRunner 7442.64 7425.19 -0.23 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_8_streaming RuntimeMs FlinkRunner 581.04 577.57 -0.6 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_9_batch RuntimeMs DataflowRunner 25639.93 24353.5 -5.02 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_9_batch RuntimeMs DirectRunner 1466.0 1515.1 3.35 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> nexmark_9_batch RuntimeMs FlinkRunner 365.6 382.48 4.62 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_9_batch RuntimeMs SparkRunner 567.28 626.67 10.47 [1]
>> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_9_batch RuntimeMs SparkStructuredStreamingRunner 879.12 928.71
>> 5.64 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_9_streaming RuntimeMs DataflowRunner 32973.07 31714.59 -3.82 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_9_streaming RuntimeMs DirectRunner 1860.12 1891.14 1.67 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
>> <http://metrics.beam.apache.org/d/ahudA_zGz>
>> nexmark_9_streaming RuntimeMs FlinkRunner 403.56 461.9 14.46 [1]
>> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mz>
>> tpcds_query10_Calcite_1GB RuntimeMs DataflowRunner 362315.07 371314.33
>> 2.48 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query10_Calcite_1GB RuntimeMs FlinkRunner 35767.81 40759.19 13.95
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> tpcds_query10_Calcite_1GB RuntimeMs SparkRunner 57245.84 59869.95 4.58
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> tpcds_query10_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>> 51403.04 55012.81 7.02 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query25_Calcite_1GB RuntimeMs DataflowRunner 378603.52 361011.86
>> -4.65 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> tpcds_query25_Calcite_1GB RuntimeMs FlinkRunner 42126.5 48054.19 14.07
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>> tpcds_query25_Calcite_1GB RuntimeMs SparkRunner 56661.92 59266.33 4.6 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query25_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>> 54411.04 57595.9 5.85 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query26_Calcite_1GB RuntimeMs DataflowRunner 343585.19 325966.48
>> -5.13 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query26_Calcite_1GB RuntimeMs FlinkRunner 21425.23 23446.1 9.43 [1]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> tpcds_query26_Calcite_1GB RuntimeMs SparkRunner 22959.2 24112.29 5.02 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> tpcds_query26_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>> 21961.56 23247.52 5.86 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>> tpcds_query29_Calcite_1GB RuntimeMs DataflowRunner 368648.96 372150.48
>> 0.95 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query29_Calcite_1GB RuntimeMs FlinkRunner 40771.38 46696.76 14.53
>> [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> tpcds_query29_Calcite_1GB RuntimeMs SparkRunner 54244.72 57659.67 6.3 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>> tpcds_query29_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>> 54272.8 56879.33 4.8 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query35_Calcite_1GB RuntimeMs DataflowRunner 367656.78 361673.0
>> -1.63 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query35_Calcite_1GB RuntimeMs FlinkRunner 30409.77 35191.71 15.73
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query35_Calcite_1GB RuntimeMs SparkRunner 52025.6 55407.1 6.5 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>> tpcds_query35_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>> 44919.6 47794.43 6.4 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query38_Calcite_1GB RuntimeMs DataflowRunner 343623.78 341860.67
>> -0.51 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>> tpcds_query38_Calcite_1GB RuntimeMs FlinkRunner 22935.69 26735.9 16.57
>> [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query38_Calcite_1GB RuntimeMs SparkRunner 21119.2 22849.14 8.19 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query38_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 0.0
>> 0.0 0.0 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query3_Calcite_1GB RuntimeMs DataflowRunner 324788.56 325751.62 0.3
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>> tpcds_query3_Calcite_1GB RuntimeMs FlinkRunner 36080.88 40976.29 13.57
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>> tpcds_query3_Calcite_1GB RuntimeMs SparkRunner 34050.72 38213.9 12.23 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query3_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 39084.2
>> 41950.9 7.33 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query40_Calcite_1GB RuntimeMs DataflowRunner 339566.11 343633.71
>> 1.2 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query40_Calcite_1GB RuntimeMs FlinkRunner 30245.31 34842.9 15.2 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> tpcds_query40_Calcite_1GB RuntimeMs SparkRunner 25379.52 26950.24 6.19
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query40_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>> 24706.72 26927.62 8.99 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query42_Calcite_1GB RuntimeMs DataflowRunner 319514.19 319511.43
>> -0.0 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query42_Calcite_1GB RuntimeMs FlinkRunner 23395.85 25856.81 10.52
>> [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query42_Calcite_1GB RuntimeMs SparkRunner 21582.4 22969.86 6.43 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> tpcds_query42_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>> 20935.88 22345.71 6.73 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> tpcds_query43_Calcite_1GB RuntimeMs DataflowRunner 313394.04 318909.52
>> 1.76 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>> tpcds_query43_Calcite_1GB RuntimeMs FlinkRunner 23571.0 26048.9 10.51 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> tpcds_query43_Calcite_1GB RuntimeMs SparkRunner 22088.12 23457.0 6.2 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query43_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>> 22004.52 23119.9 5.07 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query52_Calcite_1GB RuntimeMs DataflowRunner 318206.63 327957.71
>> 3.06 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query52_Calcite_1GB RuntimeMs FlinkRunner 23458.88 25862.38 10.25
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>> tpcds_query52_Calcite_1GB RuntimeMs SparkRunner 21666.4 22942.38 5.89 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query52_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>> 21652.16 23114.52 6.75 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>> tpcds_query55_Calcite_1GB RuntimeMs DataflowRunner 318602.89 315638.0
>> -0.93 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> tpcds_query55_Calcite_1GB RuntimeMs FlinkRunner 22976.0 25435.86 10.71
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> tpcds_query55_Calcite_1GB RuntimeMs SparkRunner 21973.72 23055.76 4.92
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query55_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>> 19978.24 21915.05 9.69 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>> tpcds_query69_Calcite_1GB RuntimeMs DataflowRunner 351148.37 354442.05
>> 0.94 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query69_Calcite_1GB RuntimeMs FlinkRunner 31436.54 35748.38 13.72
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> tpcds_query69_Calcite_1GB RuntimeMs SparkRunner 50124.24 53213.86 6.16
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query69_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>> 44159.44 46946.81 6.31 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query79_Calcite_1GB RuntimeMs DataflowRunner 347981.3 347125.76
>> -0.25 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query79_Calcite_1GB RuntimeMs FlinkRunner 36015.88 39348.43 9.25
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> tpcds_query79_Calcite_1GB RuntimeMs SparkRunner 39837.6 42056.9 5.57 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query79_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>> 37740.0 39057.24 3.49 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>> tpcds_query7_Calcite_1GB RuntimeMs DataflowRunner 343937.07 344542.1 0.18
>> [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> tpcds_query7_Calcite_1GB RuntimeMs FlinkRunner 38729.31 43235.1 11.63 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>> tpcds_query7_Calcite_1GB RuntimeMs SparkRunner 40251.4 43268.9 7.5 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query7_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 39953.8
>> 42229.43 5.7 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>> tpcds_query83_Calcite_1GB RuntimeMs DataflowRunner 350585.33 353801.1
>> 0.92 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>> tpcds_query83_Calcite_1GB RuntimeMs FlinkRunner 9781.73 10692.71 9.31 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> tpcds_query83_Calcite_1GB RuntimeMs SparkRunner 9829.92 10407.38 5.87 [1]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query83_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>> 14143.08 14614.24 3.33 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query84_Calcite_1GB RuntimeMs DataflowRunner 318936.56 322566.57
>> 1.14 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query84_Calcite_1GB RuntimeMs FlinkRunner 20584.27 23509.19 14.21
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> tpcds_query84_Calcite_1GB RuntimeMs SparkRunner 17810.88 18656.67 4.75
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query84_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>> 17019.32 17893.43 5.14 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query87_Calcite_1GB RuntimeMs DataflowRunner 349046.52 333596.95
>> -4.43 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>> tpcds_query87_Calcite_1GB RuntimeMs FlinkRunner 23672.85 27336.67 15.48
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> tpcds_query87_Calcite_1GB RuntimeMs SparkRunner 20632.72 22672.67 9.89
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query87_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>> 22861.48 24574.29 7.49 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query93_Calcite_1GB RuntimeMs DataflowRunner 356997.11 347957.19
>> -2.53 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>> tpcds_query93_Calcite_1GB RuntimeMs FlinkRunner 48908.42 55821.43 14.13
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> tpcds_query93_Calcite_1GB RuntimeMs SparkRunner 44754.76 47089.76 5.22
>> [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query93_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>> 38964.72 41755.1 7.16 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query96_Calcite_1GB RuntimeMs DataflowRunner 328956.93 329416.29
>> 0.14 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>> tpcds_query96_Calcite_1GB RuntimeMs FlinkRunner 20025.15 22467.62 12.2
>> [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> tpcds_query96_Calcite_1GB RuntimeMs SparkRunner 19627.92 20990.1 6.94 [1]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
>> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
>> <http://metrics.beam.apache.org/d/8INnSY9Mv>
>> tpcds_query96_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
>> 22169.36 23801.0 7.36 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
>> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
>> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>>
>
Re: Beam Metrics Report (2023-02-21)
Posted by Kenneth Knowles <ke...@apache.org>.
I have not kept a careful eye on these. Are they still useful? Are they
stable enough to be accurate or meaningful? This particular report (chosen
at random) looks like small and large regressions across the board.
I would not automatically assume that this is meaningful. I would honestly
like to reduce the amount of automated content going to dev@
Kenn
On Tue, Feb 21, 2023 at 3:56 AM Apache Jenkins Server <
jenkins@builds.apache.org> wrote:
> Beam Metrics Report Color legend:
> >= 20 >= 10 <= -10 <= -20 Possible regression
> *Measurement* *Metric* *Runner* *Mean previous week* *Mean last week* *Diff
> %* *Dashboard*
> cdapioit_results read_time - 15.03 16.87 12.26 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> go_batch_gbk_7 dataflow_runtime - 115.41 134.93 16.92 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_cogbk_1 sparkstructuredstreaming_runtime_sec - 70.17 81.0 15.43
> [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_2 sparkstructuredstreaming_runtime_sec - 75.09 89.63
> 19.36 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_3 dataflow_runtime_sec - 14.18 15.81 11.45 [1]
> <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_3 dataflow_v2_java17_runtime_sec - 12.12 13.57 11.98 [1]
> <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_4 dataflow_v2_java17_runtime_sec - 12.22 15.16 24.03 [1]
> <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_combine_5 dataflow_runtime_sec - 25.52 30.13 18.1 [1]
> <http://metrics.beam.apache.org/d/WNzYt13Zk>
> java_batch_gbk_2 sparkstructuredstreaming_runtime_sec - 54.69 62.48 14.25
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_3 dataflow_runtime_sec - 11.65 12.92 10.94 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_5 dataflow_runtime_sec - 18.89 20.78 10.01 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_5 dataflow_v2_java17_runtime_sec - 19.89 22.9 15.1 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_6 dataflow_v2_java11_runtime_sec - 26.89 29.65 10.27 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_pardo_1 dataflow_v2_java11_runtime_sec - 13.54 17.28 27.59 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_1 dataflow_v2_java17_runtime_sec - 12.86 15.14 17.72 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_1 sparkstructuredstreaming_runtime_sec - 24.93 32.52
> 30.43 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_cogbk_4 dataflow_v2_java17_runtime_sec - 297.61 348.85
> 17.22 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_streaming_gbk_3 dataflow_v2_java17_runtime_sec - 62.77 69.7 11.04 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_5 dataflow_v2_java11_runtime_sec - 594.04 697.93 17.49
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_6 dataflow_v2_java11_runtime_sec - 150.07 169.36 12.86
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_7 dataflow_v2_java17_runtime_sec - 222.54 291.74 31.1
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> kafkaioit_results read_time - 890.4 1011.3 13.58 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> mongodbioit_results read_time - 25.86 29.19 12.87 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> parquetioit_results read_time - 83.18 93.38 12.26 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> python_batch_cogbk_2 python_dataflow_batch_cogbk_2_runtime - 238.0 272.4
> 14.45 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> python_batch_combine_5 python_dataflow_batch_combine_5_runtime - 29.29
> 34.0 16.1 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> python_batch_gbk_3 python_dataflow_batch_gbk_3_runtime - 24.14 30.8 27.57
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_batch_pardo_3 python_dataflow_batch_pardo_3_runtime - 121.14 155.4
> 28.28 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_batch_sideinput_2 python_dataflow_batch_sideinput_2_runtime - 2.29
> 3.0 31.25 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
> python_psio_2GB_results pubsub_io_perf_write_runtime - 120.86 163.5 35.28
> [1] <http://metrics.beam.apache.org/d/gP7vMPqZz>
> python_streaming_gbk_3 python_dataflow_streaming_gbk_3_runtime - 74.71
> 99.4 33.04 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> nexmark_0_batch RuntimeMs DirectRunner 1783.16 2123.67 19.1 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_zetasql_batch RuntimeMs SparkRunner 3510.0 4836.57 37.79 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_zetasql_streaming RuntimeMs FlinkRunner 3218.12 3754.05 16.65
> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_10_batch RuntimeMs DirectRunner 5602.62 7773.67 38.75 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_10_streaming RuntimeMs DataflowRunner 99964.25 333912.78 234.03
> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_10_streaming RuntimeMs DirectRunner 52614.96 69076.81 31.29 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_11_batch RuntimeMs DirectRunner 1417.68 1563.1 10.26 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_11_batch RuntimeMs FlinkRunner 252.0 287.19 13.96 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_13_batch RuntimeMs DirectRunner 3460.84 4111.76 18.81 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_13_sql_batch RuntimeMs DirectRunner 10088.68 12178.38 20.71 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_13_zetasql_batch RuntimeMs DirectRunner 11242.48 13471.24 19.82
> [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_13_zetasql_batch RuntimeMs SparkRunner 3870.84 5379.33 38.97 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_14_batch RuntimeMs DirectRunner 4249.16 4675.76 10.04 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_15_batch RuntimeMs FlinkRunner 435.12 486.67 11.85 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_15_batch RuntimeMs SparkStructuredStreamingRunner 1029.52 1148.95
> 11.6 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_16_streaming RuntimeMs DirectRunner 134645.96 164238.14 21.98 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_1_sql_batch RuntimeMs DirectRunner 3732.0 4228.81 13.31 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_1_sql_streaming RuntimeMs FlinkRunner 823.72 943.67 14.56 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_2_batch RuntimeMs DirectRunner 159.14 279.67 75.74 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_2_sql_batch RuntimeMs DirectRunner 1623.28 1787.86 10.14 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_2_zetasql_batch RuntimeMs DirectRunner 2947.56 3249.0 10.23 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_2_zetasql_batch RuntimeMs SparkRunner 1106.56 1221.9 10.42 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_batch RuntimeMs DirectRunner 1005.18 1205.86 19.96 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_sql_streaming RuntimeMs DataflowRunner 32310.48 36064.45 11.62
> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_streaming RuntimeMs FlinkRunner 635.28 700.86 10.32 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_zetasql_batch RuntimeMs SparkRunner 3472.32 3932.9 13.26 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_zetasql_streaming RuntimeMs DataflowRunner 49916.22 57631.27
> 15.46 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_zetasql_streaming RuntimeMs FlinkRunner 1493.36 1745.71 16.9 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_5_batch RuntimeMs DirectRunner 4450.86 5175.48 16.28 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_5_streaming RuntimeMs DirectRunner 23362.84 30660.67 31.24 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_5_streaming RuntimeMs FlinkRunner 1411.04 1556.1 10.28 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_7_batch RuntimeMs DirectRunner 8956.08 10210.69 14.01 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_7_sql_batch RuntimeMs DataflowRunner 77045.7 90994.27 18.1 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_7_sql_batch RuntimeMs DirectRunner 236395.64 1310318.14 454.29 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_7_sql_streaming RuntimeMs DirectRunner 910056.04 2902227.88 218.91
> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_8_batch RuntimeMs DirectRunner 697.58 791.6 13.48 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_9_batch RuntimeMs SparkRunner 567.28 626.67 10.47 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_9_streaming RuntimeMs FlinkRunner 403.56 461.9 14.46 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> tpcds_query10_Calcite_1GB RuntimeMs FlinkRunner 35767.81 40759.19 13.95
> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query25_Calcite_1GB RuntimeMs FlinkRunner 42126.5 48054.19 14.07 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query29_Calcite_1GB RuntimeMs FlinkRunner 40771.38 46696.76 14.53
> [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query35_Calcite_1GB RuntimeMs FlinkRunner 30409.77 35191.71 15.73
> [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query38_Calcite_1GB RuntimeMs FlinkRunner 22935.69 26735.9 16.57 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query3_Calcite_1GB RuntimeMs FlinkRunner 36080.88 40976.29 13.57 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query3_Calcite_1GB RuntimeMs SparkRunner 34050.72 38213.9 12.23 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query40_Calcite_1GB RuntimeMs FlinkRunner 30245.31 34842.9 15.2 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query42_Calcite_1GB RuntimeMs FlinkRunner 23395.85 25856.81 10.52
> [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query43_Calcite_1GB RuntimeMs FlinkRunner 23571.0 26048.9 10.51 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query52_Calcite_1GB RuntimeMs FlinkRunner 23458.88 25862.38 10.25
> [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query55_Calcite_1GB RuntimeMs FlinkRunner 22976.0 25435.86 10.71 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query69_Calcite_1GB RuntimeMs FlinkRunner 31436.54 35748.38 13.72
> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query7_Calcite_1GB RuntimeMs FlinkRunner 38729.31 43235.1 11.63 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query84_Calcite_1GB RuntimeMs FlinkRunner 20584.27 23509.19 14.21
> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query87_Calcite_1GB RuntimeMs FlinkRunner 23672.85 27336.67 15.48
> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query93_Calcite_1GB RuntimeMs FlinkRunner 48908.42 55821.43 14.13
> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query96_Calcite_1GB RuntimeMs FlinkRunner 20025.15 22467.62 12.2 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> Possible improvement
> *Measurement* *Metric* *Runner* *Mean previous week* *Mean last week* *Diff
> %* *Dashboard*
> avroioit_hdfs_results read_time - 90.2 79.41 -11.96 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> bqio_10GB_results_java_batch_avro avro_write_time - 35.08 30.94 -11.8 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> java_batch_combine_4 dataflow_runtime_sec - 31.62 26.92 -14.85 [1]
> <http://metrics.beam.apache.org/d/WNzYt13Zk>
> java_batch_gbk_3 dataflow_v2_java11_runtime_sec - 18.73 11.62 -37.96 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_3 dataflow_v2_java17_runtime_sec - 14.52 11.9 -18.06 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_7 dataflow_v2_java11_runtime_sec - 54.03 36.19 -33.02 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_7 dataflow_v2_java17_runtime_sec - 93.02 34.26 -63.17 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_pardo_2 dataflow_v2_java17_runtime_sec - 60.55 53.35 -11.89 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_3 dataflow_v2_java11_runtime_sec - 12.51 10.19 -18.53 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_3 dataflow_v2_java17_runtime_sec - 13.9 10.71 -22.91 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_cogbk_1 dataflow_v2_java17_runtime_sec - 2606.43 2175.14
> -16.55 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_streaming_gbk_1 dataflow_v2_java11_runtime_sec - 1016.6 854.76 -15.92
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_2 dataflow_v2_java11_runtime_sec - 2958.46 2606.28
> -11.9 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_2 dataflow_v2_java17_runtime_sec - 3516.87 2831.8
> -19.48 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_4 dataflow_v2_java17_runtime_sec - 620.74 550.37 -11.34
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_6 dataflow_v2_java17_runtime_sec - 177.15 145.73 -17.74
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_pardo_1 dataflow_v2_java11_runtime_sec - 26.56 23.19 -12.7
> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_pardo_2 dataflow_v2_java11_runtime_sec - 97.93 87.64 -10.51
> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_pardo_2 dataflow_v2_java17_runtime_sec - 100.95 88.91
> -11.93 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_batch_combine_4 python_dataflow_batch_combine_4_runtime - 43.86
> 29.8 -32.05 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> python_batch_gbk_4 python_dataflow_batch_gbk_4_runtime - 102.57 62.4
> -39.16 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_batch_pardo_1 python_dataflow_batch_pardo_1_runtime - 159.14 135.8
> -14.67 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_batch_sideinput_10 python_dataflow_batch_sideinput_10_runtime -
> 918.86 711.0 -22.62 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
> python_batch_sideinput_8 python_dataflow_batch_sideinput_8_runtime -
> 167.71 134.2 -19.98 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
> python_bqio_read_10GB_results bqio_read_10GB_results_runtime - 106.0 89.0
> -16.04 [1] <http://metrics.beam.apache.org/d/gP7vMPqZz>
> python_streaming_pardo_3 python_dataflow_streaming_pardo_3_runtime -
> 231.43 169.0 -26.98 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> xmlioit_hdfs_results read_time - 23.63 20.56 -13.01 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> xmlioit_hdfs_results write_time - 26.16 21.77 -16.78 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> nexmark_0_batch RuntimeMs DataflowRunner 26749.75 18435.75 -31.08 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_0_streaming RuntimeMs DataflowRunner 38980.02 34901.86 -10.46 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_10_batch RuntimeMs DataflowRunner 47515.68 30172.77 -36.5 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_11_batch RuntimeMs DataflowRunner 37386.57 22295.25 -40.37 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_12_batch RuntimeMs DataflowRunner 18674.81 11713.24 -37.28 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_15_batch RuntimeMs DataflowRunner 50806.66 31683.81 -37.64 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_16_batch RuntimeMs DataflowRunner 50817.24 32292.63 -36.45 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_1_batch RuntimeMs DataflowRunner 21164.16 14173.39 -33.03 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_1_streaming RuntimeMs DataflowRunner 29989.31 26805.65 -10.62 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_2_batch RuntimeMs DataflowRunner 14706.32 9432.42 -35.86 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_2_streaming RuntimeMs DataflowRunner 19786.89 17303.69 -12.55 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_streaming RuntimeMs DataflowRunner 46899.26 41710.78 -11.06 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_5_batch RuntimeMs DataflowRunner 31070.26 20118.37 -35.25 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_7_streaming RuntimeMs DataflowRunner 123598.91 108149.55 -12.5 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_8_batch RuntimeMs DataflowRunner 21435.32 13300.63 -37.95 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> All metrics
> *Measurement* *Metric* *Runner* *Mean previous week* *Mean last week* *Diff
> %* *Dashboard*
> avroioit_hdfs_results read_time - 90.2 79.41 -11.96 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> avroioit_hdfs_results write_time - 121.4 122.86 1.2 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> avroioit_results read_time - 90.01 87.44 -2.85 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> avroioit_results write_time - 121.12 121.44 0.26 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> bqio_10GB_results_java_batch_avro avro_write_time - 35.08 30.94 -11.8 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> bqio_10GB_results_java_batch_avro read_time - 41.76 43.1 3.21 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> bqio_10GB_results_java_batch_json read_time - 41.54 40.29 -3.01 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> bqio_10GB_results_java_batch_json write_time - 53.73 52.08 -3.06 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> bqio_10GB_results_java_stream read_time - 43.23 44.57 3.1 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> bqio_10GB_results_java_stream write_time - 205.89 208.99 1.51 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> cdapioit_results read_time - 15.03 16.87 12.26 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> cdapioit_results write_time - 26.0 26.02 0.09 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> compressed_textioit_hdfs_results read_time - 136.44 126.91 -6.99 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> compressed_textioit_hdfs_results write_time - 215.44 214.35 -0.51 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> compressed_textioit_results read_time - 134.75 128.13 -4.91 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> compressed_textioit_results write_time - 209.2 212.07 1.37 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> go_batch_cogbk_1 dataflow_runtime - 258.35 257.64 -0.28 [1]
> <http://metrics.beam.apache.org/d/fK0U4JqWz>
> go_batch_cogbk_2 dataflow_runtime - 147.85 146.38 -0.99 [1]
> <http://metrics.beam.apache.org/d/fK0U4JqWz>
> go_batch_cogbk_3 dataflow_runtime - 114.16 113.28 -0.77 [1]
> <http://metrics.beam.apache.org/d/fK0U4JqWz>
> go_batch_cogbk_4 dataflow_runtime - 110.72 109.17 -1.4 [1]
> <http://metrics.beam.apache.org/d/fK0U4JqWz>
> go_batch_combine_1 dataflow_runtime - 432.84 428.33 -1.04 [1]
> <http://metrics.beam.apache.org/d/WNzYt13Zk>
> go_batch_combine_4 dataflow_runtime - 75.94 75.12 -1.08 [1]
> <http://metrics.beam.apache.org/d/WNzYt13Zk>
> go_batch_combine_5 dataflow_runtime - 70.6 69.56 -1.46 [1]
> <http://metrics.beam.apache.org/d/WNzYt13Zk>
> go_batch_gbk_1 dataflow_runtime - 389.3 397.02 1.99 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> go_batch_gbk_2 dataflow_runtime - 100.74 102.16 1.41 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> go_batch_gbk_3 dataflow_runtime - 24.93 25.47 2.18 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> go_batch_gbk_4 dataflow_runtime - 55.41 54.48 -1.66 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> go_batch_gbk_5 dataflow_runtime - 42.87 44.57 3.95 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> go_batch_gbk_6 dataflow_runtime - 102.95 103.29 0.32 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> go_batch_gbk_7 dataflow_runtime - 115.41 134.93 16.92 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> go_batch_pardo_1 dataflow_runtime - 84.39 84.11 -0.33 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> go_batch_pardo_2 dataflow_runtime - 619.82 601.88 -2.9 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> go_batch_pardo_3 dataflow_runtime - 67.66 65.39 -3.35 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> go_batch_pardo_4 dataflow_runtime - 69.59 71.59 2.88 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> go_batch_sideinput_3 dataflow_runtime - 2.65 2.43 -8.13 [1]
> <http://metrics.beam.apache.org/d/-E9aGlFGk>
> go_batch_sideinput_4 dataflow_runtime - 243.33 227.18 -6.64 [1]
> <http://metrics.beam.apache.org/d/-E9aGlFGk>
> hadoopformatioit_results read_time - 14.78 14.6 -1.23 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> hadoopformatioit_results write_time - 26.36 26.75 1.48 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> java_batch_cogbk_1 dataflow_runtime_sec - 39.96 40.27 0.77 [1]
> <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_1 dataflow_v2_java11_runtime_sec - 47.15 47.6 0.97 [1]
> <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_1 dataflow_v2_java17_runtime_sec - 49.39 46.1 -6.65 [1]
> <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_1 sparkstructuredstreaming_runtime_sec - 70.17 81.0 15.43
> [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_2 dataflow_runtime_sec - 41.59 43.01 3.43 [1]
> <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_2 dataflow_v2_java11_runtime_sec - 48.49 46.33 -4.46 [1]
> <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_2 dataflow_v2_java17_runtime_sec - 46.36 43.67 -5.8 [1]
> <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_2 sparkstructuredstreaming_runtime_sec - 75.09 89.63
> 19.36 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_3 dataflow_runtime_sec - 14.18 15.81 11.45 [1]
> <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_3 dataflow_v2_java11_runtime_sec - 12.92 13.36 3.4 [1]
> <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_3 dataflow_v2_java17_runtime_sec - 12.12 13.57 11.98 [1]
> <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_3 sparkstructuredstreaming_runtime_sec - 14.95 14.21 -5.0
> [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_4 dataflow_runtime_sec - 15.78 14.4 -8.8 [1]
> <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_4 dataflow_v2_java11_runtime_sec - 13.63 12.89 -5.48 [1]
> <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_4 dataflow_v2_java17_runtime_sec - 12.22 15.16 24.03 [1]
> <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_4 sparkstructuredstreaming_runtime_sec - 15.07 14.35
> -4.76 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_combine_1 dataflow_runtime_sec - 65.12 66.78 2.53 [1]
> <http://metrics.beam.apache.org/d/WNzYt13Zk>
> java_batch_combine_1 sparkstructuredstreaming_runtime_sec - 269.45 270.97
> 0.56 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> java_batch_combine_4 dataflow_runtime_sec - 31.62 26.92 -14.85 [1]
> <http://metrics.beam.apache.org/d/WNzYt13Zk>
> java_batch_combine_4 sparkstructuredstreaming_runtime_sec - 56.19 53.73
> -4.38 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> java_batch_combine_5 dataflow_runtime_sec - 25.52 30.13 18.1 [1]
> <http://metrics.beam.apache.org/d/WNzYt13Zk>
> java_batch_combine_5 sparkstructuredstreaming_runtime_sec - 50.92 52.57
> 3.24 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> java_batch_gbk_1 dataflow_runtime_sec - 120.59 117.76 -2.34 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_1 dataflow_v2_java11_runtime_sec - 89.36 89.96 0.67 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_1 dataflow_v2_java17_runtime_sec - 85.72 87.75 2.37 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_1 sparkstructuredstreaming_runtime_sec - 259.78 253.76
> -2.31 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_2 dataflow_runtime_sec - 33.36 36.39 9.06 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_2 dataflow_v2_java11_runtime_sec - 42.96 41.28 -3.9 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_2 dataflow_v2_java17_runtime_sec - 42.59 40.42 -5.09 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_2 sparkstructuredstreaming_runtime_sec - 54.69 62.48 14.25
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_3 dataflow_runtime_sec - 11.65 12.92 10.94 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_3 dataflow_v2_java11_runtime_sec - 18.73 11.62 -37.96 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_3 dataflow_v2_java17_runtime_sec - 14.52 11.9 -18.06 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_3 sparkstructuredstreaming_runtime_sec - 8.68 8.33 -4.1 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_4 dataflow_runtime_sec - 18.79 19.03 1.29 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_4 dataflow_v2_java11_runtime_sec - 21.42 21.62 0.95 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_4 dataflow_v2_java17_runtime_sec - 20.32 22.14 8.97 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_4 sparkstructuredstreaming_runtime_sec - 52.12 49.35 -5.31
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_5 dataflow_runtime_sec - 18.89 20.78 10.01 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_5 dataflow_v2_java11_runtime_sec - 19.76 19.72 -0.19 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_5 dataflow_v2_java17_runtime_sec - 19.89 22.9 15.1 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_5 sparkstructuredstreaming_runtime_sec - 49.75 48.08 -3.37
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_6 dataflow_runtime_sec - 38.27 39.49 3.18 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_6 dataflow_v2_java11_runtime_sec - 26.89 29.65 10.27 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_6 dataflow_v2_java17_runtime_sec - 31.26 32.19 2.96 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_6 sparkstructuredstreaming_runtime_sec - 32.45 32.39 -0.2
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_7 dataflow_runtime_sec - 44.19 45.66 3.34 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_7 dataflow_v2_java11_runtime_sec - 54.03 36.19 -33.02 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_7 dataflow_v2_java17_runtime_sec - 93.02 34.26 -63.17 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_7 sparkstructuredstreaming_runtime_sec - 37.13 36.68 -1.21
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_pardo_1 dataflow_runtime_sec - 20.61 19.9 -3.41 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_1 dataflow_v2_java11_runtime_sec - 13.54 17.28 27.59 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_1 dataflow_v2_java17_runtime_sec - 12.86 15.14 17.72 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_1 sparkstructuredstreaming_runtime_sec - 24.93 32.52
> 30.43 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_2 dataflow_runtime_sec - 209.32 208.57 -0.36 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_2 dataflow_v2_java11_runtime_sec - 59.05 54.05 -8.47 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_2 dataflow_v2_java17_runtime_sec - 60.55 53.35 -11.89 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_3 dataflow_runtime_sec - 13.9 15.02 8.09 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_3 dataflow_v2_java11_runtime_sec - 12.51 10.19 -18.53 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_3 dataflow_v2_java17_runtime_sec - 13.9 10.71 -22.91 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_4 dataflow_runtime_sec - 28.13 28.74 2.18 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_4 dataflow_v2_java11_runtime_sec - 26.32 27.75 5.42 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_4 dataflow_v2_java17_runtime_sec - 24.51 22.69 -7.44 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_cogbk_1 dataflow_runtime_sec - 872.6 789.84 -9.48 [1]
> <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_streaming_cogbk_1 dataflow_v2_java11_runtime_sec - 3005.89 2851.74
> -5.13 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_streaming_cogbk_1 dataflow_v2_java17_runtime_sec - 2606.43 2175.14
> -16.55 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_streaming_cogbk_2 dataflow_runtime_sec - 917.57 924.82 0.79 [1]
> <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_streaming_cogbk_2 dataflow_v2_java11_runtime_sec - 3115.11 2941.95
> -5.56 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_streaming_cogbk_2 dataflow_v2_java17_runtime_sec - 2960.86 2987.15
> 0.89 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_streaming_cogbk_3 dataflow_runtime_sec - 121.41 109.31 -9.96 [1]
> <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_streaming_cogbk_3 dataflow_v2_java11_runtime_sec - 378.28 366.57 -3.1
> [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_streaming_cogbk_3 dataflow_v2_java17_runtime_sec - 348.02 314.68
> -9.58 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_streaming_cogbk_4 dataflow_runtime_sec - 125.13 114.87 -8.2 [1]
> <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_streaming_cogbk_4 dataflow_v2_java11_runtime_sec - 363.26 332.86
> -8.37 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_streaming_cogbk_4 dataflow_v2_java17_runtime_sec - 297.61 348.85
> 17.22 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_streaming_combine_1 dataflow_runtime_sec - 482.69 474.54 -1.69 [1]
> <http://metrics.beam.apache.org/d/WNzYt13Zk>
> java_streaming_combine_4 dataflow_runtime_sec - 313.08 306.95 -1.96 [1]
> <http://metrics.beam.apache.org/d/WNzYt13Zk>
> java_streaming_combine_5 dataflow_runtime_sec - 317.67 306.83 -3.41 [1]
> <http://metrics.beam.apache.org/d/WNzYt13Zk>
> java_streaming_gbk_1 dataflow_runtime_sec - 640.71 644.58 0.6 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_1 dataflow_v2_java11_runtime_sec - 1016.6 854.76 -15.92
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_1 dataflow_v2_java17_runtime_sec - 859.19 832.88 -3.06
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_2 dataflow_runtime_sec - 844.31 815.67 -3.39 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_2 dataflow_v2_java11_runtime_sec - 2958.46 2606.28
> -11.9 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_2 dataflow_v2_java17_runtime_sec - 3516.87 2831.8
> -19.48 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_3 dataflow_runtime_sec - 23.72 25.1 5.79 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_3 dataflow_v2_java11_runtime_sec - 56.71 57.05 0.6 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_3 dataflow_v2_java17_runtime_sec - 62.77 69.7 11.04 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_4 dataflow_runtime_sec - 303.31 289.43 -4.58 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_4 dataflow_v2_java11_runtime_sec - 600.82 631.36 5.08
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_4 dataflow_v2_java17_runtime_sec - 620.74 550.37 -11.34
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_5 dataflow_runtime_sec - 282.59 301.15 6.57 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_5 dataflow_v2_java11_runtime_sec - 594.04 697.93 17.49
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_5 dataflow_v2_java17_runtime_sec - 585.53 550.22 -6.03
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_6 dataflow_runtime_sec - 76.16 74.96 -1.58 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_6 dataflow_v2_java11_runtime_sec - 150.07 169.36 12.86
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_6 dataflow_v2_java17_runtime_sec - 177.15 145.73 -17.74
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_7 dataflow_runtime_sec - 136.32 127.69 -6.33 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_7 dataflow_v2_java11_runtime_sec - 231.51 221.07 -4.51
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_7 dataflow_v2_java17_runtime_sec - 222.54 291.74 31.1
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_pardo_1 dataflow_runtime_sec - 18.86 20.11 6.61 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_pardo_1 dataflow_v2_java11_runtime_sec - 26.56 23.19 -12.7
> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_pardo_1 dataflow_v2_java17_runtime_sec - 24.28 23.01 -5.22
> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_pardo_2 dataflow_runtime_sec - 208.74 217.9 4.39 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_pardo_2 dataflow_v2_java11_runtime_sec - 97.93 87.64 -10.51
> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_pardo_2 dataflow_v2_java17_runtime_sec - 100.95 88.91
> -11.93 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_pardo_3 dataflow_runtime_sec - 12.44 11.89 -4.41 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_pardo_3 dataflow_v2_java11_runtime_sec - 23.73 22.6 -4.78
> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_pardo_3 dataflow_v2_java17_runtime_sec - 20.97 20.5 -2.25
> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_pardo_4 dataflow_runtime_sec - 31.84 31.15 -2.15 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_pardo_4 dataflow_v2_java11_runtime_sec - 37.88 39.89 5.31
> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_pardo_4 dataflow_v2_java17_runtime_sec - 37.65 36.3 -3.59
> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> jdbcioit_results read_time - 26.24 25.71 -1.99 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> jdbcioit_results write_time - 39.42 40.3 2.24 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> kafkaioit_results read_time - 890.4 1011.3 13.58 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> kafkaioit_results write_time - 163.97 165.39 0.87 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> kafkaioit_results_runner_v2 read_time - 956.27 937.09 -2.01 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> kafkaioit_results_runner_v2 write_time - 170.63 172.99 1.38 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> many_files_textioit_hdfs_results read_time - 16.18 15.89 -1.76 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> many_files_textioit_hdfs_results write_time - 68.97 67.37 -2.32 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> many_files_textioit_results read_time - 23.0 25.17 9.42 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> many_files_textioit_results write_time - 61.46 64.25 4.55 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> mongodbioit_results read_time - 25.86 29.19 12.87 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> mongodbioit_results write_time - 50.08 49.41 -1.34 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> parquetioit_hdfs_results read_time - 87.82 79.32 -9.68 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> parquetioit_hdfs_results write_time - 144.68 132.66 -8.31 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> parquetioit_results read_time - 83.18 93.38 12.26 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> parquetioit_results write_time - 139.99 146.1 4.37 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> python_batch_cogbk_1 python_dataflow_batch_cogbk_1_runtime - 385.14 389.4
> 1.11 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> python_batch_cogbk_2 python_dataflow_batch_cogbk_2_runtime - 238.0 272.4
> 14.45 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> python_batch_cogbk_3 python_dataflow_batch_cogbk_3_runtime - 216.29 208.8
> -3.46 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> python_batch_cogbk_4 python_dataflow_batch_cogbk_4_runtime - 208.14 203.4
> -2.28 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> python_batch_combine_1 python_dataflow_batch_combine_1_runtime - 767.14
> 751.0 -2.1 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> python_batch_combine_4 python_dataflow_batch_combine_4_runtime - 43.86
> 29.8 -32.05 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> python_batch_combine_5 python_dataflow_batch_combine_5_runtime - 29.29
> 34.0 16.1 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> python_batch_gbk_1 python_dataflow_batch_gbk_1_runtime - 1316.86 1336.0
> 1.45 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_batch_gbk_2 python_dataflow_batch_gbk_2_runtime - 241.43 264.8 9.68
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_batch_gbk_3 python_dataflow_batch_gbk_3_runtime - 24.14 30.8 27.57
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_batch_gbk_4 python_dataflow_batch_gbk_4_runtime - 102.57 62.4
> -39.16 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_batch_gbk_5 python_dataflow_batch_gbk_5_runtime - 102.29 97.4 -4.78
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_batch_gbk_6 python_dataflow_batch_gbk_6_runtime - 245.5 226.2 -7.86
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_batch_gbk_7 python_dataflow_batch_gbk_7_runtime - 244.83 231.6
> -5.41 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_batch_pardo_1 python_dataflow_batch_pardo_1_runtime - 159.14 135.8
> -14.67 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_batch_pardo_2 python_dataflow_batch_pardo_2_runtime - 1365.57
> 1358.0 -0.55 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_batch_pardo_3 python_dataflow_batch_pardo_3_runtime - 121.14 155.4
> 28.28 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_batch_pardo_4 python_dataflow_batch_pardo_4_runtime - 319.71 322.0
> 0.71 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_batch_sideinput_1 python_dataflow_batch_sideinput_1_runtime - 2.14
> 2.17 1.11 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
> python_batch_sideinput_10 python_dataflow_batch_sideinput_10_runtime -
> 918.86 711.0 -22.62 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
> python_batch_sideinput_2 python_dataflow_batch_sideinput_2_runtime - 2.29
> 3.0 31.25 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
> python_batch_sideinput_3 python_dataflow_batch_sideinput_3_runtime - 3.0
> 2.8 -6.67 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
> python_batch_sideinput_4 python_dataflow_batch_sideinput_4_runtime - 28.86
> 27.4 -5.05 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
> python_batch_sideinput_5 python_dataflow_batch_sideinput_5_runtime - 2.57
> 2.6 1.11 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
> python_batch_sideinput_6 python_dataflow_batch_sideinput_6_runtime - 2.43
> 2.4 -1.18 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
> python_batch_sideinput_7 python_dataflow_batch_sideinput_7_runtime -
> 131.86 122.2 -7.32 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
> python_batch_sideinput_8 python_dataflow_batch_sideinput_8_runtime -
> 167.71 134.2 -19.98 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
> python_batch_sideinput_9 python_dataflow_batch_sideinput_9_runtime -
> 768.14 796.8 3.73 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
> python_bqio_read_10GB_results bqio_read_10GB_results_runtime - 106.0 89.0
> -16.04 [1] <http://metrics.beam.apache.org/d/gP7vMPqZz>
> python_bqio_write_10GB_results bqio_write_10GB_results_runtime - 274.71
> 252.4 -8.12 [1] <http://metrics.beam.apache.org/d/gP7vMPqZz>
> python_direct_microbenchmarks fn_api_runner_microbenchmark_runtime_sec -
> 584.93 603.05 3.1
> python_direct_microbenchmarks teststream_microbenchmark_runtime_sec -
> 357.42 388.56 8.71
> python_kafkaio_results read_runtime - 234.57 230.4 -1.78 [1]
> <http://metrics.beam.apache.org/d/gP7vMPqZz>
> python_kafkaio_results write_runtime - 357.0 373.6 4.65 [1]
> <http://metrics.beam.apache.org/d/gP7vMPqZz>
> python_psio_2GB_results pubsub_io_perf_read_runtime - 374.5 340.17 -9.17
> [1] <http://metrics.beam.apache.org/d/gP7vMPqZz>
> python_psio_2GB_results pubsub_io_perf_write_runtime - 120.86 163.5 35.28
> [1] <http://metrics.beam.apache.org/d/gP7vMPqZz>
> python_spanner_write_2GB_results pyspanner_write_2GB_results_runtime -
> 1839.86 1789.2 -2.75 [1] <http://metrics.beam.apache.org/d/gP7vMPqZz>
> python_spannerio_read_2GB_results pyspanner_read_2GB_results_runtime -
> 23.33 23.67 1.43 [1] <http://metrics.beam.apache.org/d/gP7vMPqZz>
> python_streaming_cogbk_1 python_dataflow_streaming_cogbk_1_runtime - 612.0
> 563.2 -7.97 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> python_streaming_cogbk_2 python_dataflow_streaming_cogbk_2_runtime -
> 319.17 348.2 9.1 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> python_streaming_cogbk_3 python_dataflow_streaming_cogbk_3_runtime -
> 375.33 368.0 -1.95 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> python_streaming_cogbk_4 python_dataflow_streaming_cogbk_4_runtime -
> 319.67 325.0 1.67 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> python_streaming_gbk_3 python_dataflow_streaming_gbk_3_runtime - 74.71
> 99.4 33.04 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_streaming_gbk_6 python_dataflow_streaming_gbk_6_runtime - 453.0
> 446.0 -1.55 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_streaming_gbk_7 python_dataflow_streaming_gbk_7_runtime - 501.5
> 486.6 -2.97 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_streaming_pardo_1 python_dataflow_streaming_pardo_1_runtime - 193.0
> 203.6 5.49 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_streaming_pardo_2 python_dataflow_streaming_pardo_2_runtime -
> 2411.71 2264.4 -6.11 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_streaming_pardo_3 python_dataflow_streaming_pardo_3_runtime -
> 231.43 169.0 -26.98 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_streaming_pardo_4 python_dataflow_streaming_pardo_4_runtime -
> 428.33 428.2 -0.03 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_textio_1GB_results read_runtime - 97.43 99.67 2.3 [1]
> <http://metrics.beam.apache.org/d/gP7vMPqZz>
> python_textio_1GB_results write_runtime - 192.71 189.5 -1.67 [1]
> <http://metrics.beam.apache.org/d/gP7vMPqZz>
> singlestoreioit_results read_time - 90.19 85.79 -4.88 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> singlestoreioit_results write_time - 25.66 26.42 2.97 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> sparkreceiverioit_results read_time - 765.18 792.2 3.53 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> textioit_hdfs_results read_time - 17.96 18.6 3.57 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> textioit_hdfs_results write_time - 37.67 35.26 -6.4 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> textioit_results read_time - 19.66 19.29 -1.88 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> textioit_results write_time - 34.96 31.8 -9.03 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> tfrecordioit_results read_time - 17.68 16.56 -6.32 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> tfrecordioit_results write_time - 22.29 23.09 3.58 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> wordcount_py37_results runtime - 810.17 866.31 6.93 [1]
> <http://metrics.beam.apache.org/d/1cnwVDkGk>
> xmlioit_hdfs_results read_time - 23.63 20.56 -13.01 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> xmlioit_hdfs_results write_time - 26.16 21.77 -16.78 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> xmlioit_results read_time - 25.69 26.58 3.45 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> xmlioit_results write_time - 25.76 26.67 3.54 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> nexmark_0_batch RuntimeMs DataflowRunner 26749.75 18435.75 -31.08 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_0_batch RuntimeMs DirectRunner 1783.16 2123.67 19.1 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_batch RuntimeMs FlinkRunner 1064.56 1138.29 6.93 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_0_batch RuntimeMs SparkRunner 1303.4 1400.62 7.46 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_0_batch RuntimeMs SparkStructuredStreamingRunner 1310.64 1396.67
> 6.56 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_python_batch RuntimeMs DirectRunner 12252.27 12309.52 0.47 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_0_sql_batch RuntimeMs DataflowRunner 33071.81 33724.5 1.97 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_0_sql_batch RuntimeMs DirectRunner 5879.64 6351.9 8.03 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_0_sql_batch RuntimeMs FlinkRunner 1137.92 1213.14 6.61 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_0_sql_batch RuntimeMs SparkRunner 3269.36 3369.38 3.06 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_0_sql_batch RuntimeMs SparkStructuredStreamingRunner 1535.52
> 1618.95 5.43 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_0_sql_streaming RuntimeMs DataflowRunner 23607.74 24395.64 3.34
> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_0_sql_streaming RuntimeMs DirectRunner 15789.0 16131.12 2.17 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_sql_streaming RuntimeMs FlinkRunner 1787.6 1937.62 8.39 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_0_streaming RuntimeMs DataflowRunner 38980.02 34901.86 -10.46 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_streaming RuntimeMs DirectRunner 12676.12 12695.05 0.15 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_streaming RuntimeMs FlinkRunner 1530.0 1646.0 7.58 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_zetasql_batch RuntimeMs DataflowRunner 118581.48 125235.77 5.61
> [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_0_zetasql_batch RuntimeMs DirectRunner 7108.56 7757.12 9.12 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_zetasql_batch RuntimeMs FlinkRunner 2266.08 2488.71 9.82 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_zetasql_batch RuntimeMs SparkRunner 3510.0 4836.57 37.79 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_zetasql_batch RuntimeMs SparkStructuredStreamingRunner 2866.56
> 3025.0 5.53 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_0_zetasql_streaming RuntimeMs DataflowRunner 68752.07 70194.32 2.1
> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_zetasql_streaming RuntimeMs DirectRunner 17661.8 18539.88 4.97
> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_zetasql_streaming RuntimeMs FlinkRunner 3218.12 3754.05 16.65
> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_10_batch RuntimeMs DataflowRunner 47515.68 30172.77 -36.5 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_10_batch RuntimeMs DirectRunner 5602.62 7773.67 38.75 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_10_batch RuntimeMs FlinkRunner 645.52 692.29 7.24 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_10_batch RuntimeMs SparkRunner 681.4 722.67 6.06 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_10_batch RuntimeMs SparkStructuredStreamingRunner 1003.32 1039.67
> 3.62 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_10_python_batch RuntimeMs DirectRunner 25711.96 25954.14 0.94 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_10_streaming RuntimeMs DataflowRunner 99964.25 333912.78 234.03
> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_10_streaming RuntimeMs DirectRunner 52614.96 69076.81 31.29 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_10_streaming RuntimeMs FlinkRunner 1553.84 1598.24 2.86 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_11_batch RuntimeMs DataflowRunner 37386.57 22295.25 -40.37 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_11_batch RuntimeMs DirectRunner 1417.68 1563.1 10.26 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_11_batch RuntimeMs FlinkRunner 252.0 287.19 13.96 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_11_batch RuntimeMs SparkRunner 1484.72 1526.33 2.8 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_11_batch RuntimeMs SparkStructuredStreamingRunner 1269.96 1371.0
> 7.96 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_11_python_batch RuntimeMs DirectRunner 20136.84 20394.38 1.28 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_11_streaming RuntimeMs DataflowRunner 173412.48 171423.47 -1.15
> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_11_streaming RuntimeMs DirectRunner 10803.88 10796.62 -0.07 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_11_streaming RuntimeMs FlinkRunner 1524.64 1542.43 1.17 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_12_batch RuntimeMs DataflowRunner 18674.81 11713.24 -37.28 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_12_batch RuntimeMs DirectRunner 2720.6 2936.52 7.94 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_12_batch RuntimeMs FlinkRunner 175.08 177.24 1.23 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_12_batch RuntimeMs SparkRunner 892.88 926.0 3.71 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_12_batch RuntimeMs SparkStructuredStreamingRunner 923.12 954.1
> 3.36 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_12_streaming RuntimeMs DataflowRunner 91825.83 89753.43 -2.26 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_12_streaming RuntimeMs DirectRunner 9359.56 9369.95 0.11 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_12_streaming RuntimeMs FlinkRunner 600.0 646.19 7.7 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_13_batch RuntimeMs DataflowRunner 33043.33 31355.0 -5.11 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_13_batch RuntimeMs DirectRunner 3460.84 4111.76 18.81 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_13_batch RuntimeMs FlinkRunner 450.36 466.62 3.61 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_13_batch RuntimeMs SparkRunner 331.28 343.9 3.81 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_13_batch RuntimeMs SparkStructuredStreamingRunner 1059.16 1072.9
> 1.3 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_13_sql_batch RuntimeMs DataflowRunner 56831.67 58858.09 3.57 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_13_sql_batch RuntimeMs DirectRunner 10088.68 12178.38 20.71 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_13_sql_batch RuntimeMs FlinkRunner 1072.8 1149.38 7.14 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_13_sql_batch RuntimeMs SparkRunner 3357.64 3500.24 4.25 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_13_sql_batch RuntimeMs SparkStructuredStreamingRunner 1755.32
> 1838.48 4.74 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_13_sql_streaming RuntimeMs DataflowRunner 34625.22 34634.14 0.03
> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_13_sql_streaming RuntimeMs DirectRunner 19339.6 19400.82 0.32 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_13_sql_streaming RuntimeMs FlinkRunner 2470.52 2611.33 5.7 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_13_streaming RuntimeMs DataflowRunner 26192.48 24892.95 -4.96 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_13_streaming RuntimeMs DirectRunner 10120.2 10259.43 1.38 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_13_streaming RuntimeMs FlinkRunner 1476.08 1573.57 6.6 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_13_zetasql_batch RuntimeMs DataflowRunner 264852.07 276071.91 4.24
> [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_13_zetasql_batch RuntimeMs DirectRunner 11242.48 13471.24 19.82
> [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_13_zetasql_batch RuntimeMs FlinkRunner 2869.56 2901.38 1.11 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_13_zetasql_batch RuntimeMs SparkRunner 3870.84 5379.33 38.97 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_13_zetasql_batch RuntimeMs SparkStructuredStreamingRunner 4227.68
> 4368.33 3.33 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_13_zetasql_streaming RuntimeMs DataflowRunner 115395.81 114891.95
> -0.44 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_13_zetasql_streaming RuntimeMs DirectRunner 21540.6 23144.0 7.44
> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_13_zetasql_streaming RuntimeMs FlinkRunner 4066.96 4326.1 6.37 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_14_batch RuntimeMs DataflowRunner 61537.81 60080.32 -2.37 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_14_batch RuntimeMs DirectRunner 4249.16 4675.76 10.04 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_14_batch RuntimeMs FlinkRunner 482.32 511.33 6.02 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_14_batch RuntimeMs SparkRunner 846.88 914.43 7.98 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_14_batch RuntimeMs SparkStructuredStreamingRunner 1066.24 1059.81
> -0.6 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_14_streaming RuntimeMs DataflowRunner 129612.15 129600.91 -0.01
> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_14_streaming RuntimeMs DirectRunner 12800.28 13415.29 4.8 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_14_streaming RuntimeMs FlinkRunner 1264.36 1314.1 3.93 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_15_batch RuntimeMs DataflowRunner 50806.66 31683.81 -37.64 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_15_batch RuntimeMs DirectRunner 15621.12 16396.0 4.96 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_15_batch RuntimeMs FlinkRunner 435.12 486.67 11.85 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_15_batch RuntimeMs SparkRunner 1597.8 1653.24 3.47 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_15_batch RuntimeMs SparkStructuredStreamingRunner 1029.52 1148.95
> 11.6 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_16_batch RuntimeMs DataflowRunner 50817.24 32292.63 -36.45 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_16_batch RuntimeMs DirectRunner 84968.52 87346.48 2.8 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_16_batch RuntimeMs FlinkRunner 215.52 228.71 6.12 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_16_batch RuntimeMs SparkRunner 1365.32 1383.57 1.34 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_16_batch RuntimeMs SparkStructuredStreamingRunner 639.04 653.81
> 2.31 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_16_streaming RuntimeMs DataflowRunner 97653.77 93735.35 -4.01 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_16_streaming RuntimeMs DirectRunner 134645.96 164238.14 21.98 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_16_streaming RuntimeMs FlinkRunner 497.56 519.71 4.45 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_1_batch RuntimeMs DataflowRunner 21164.16 14173.39 -33.03 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_1_batch RuntimeMs DirectRunner 3223.6 3481.1 7.99 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_1_batch RuntimeMs FlinkRunner 312.48 332.48 6.4 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_1_batch RuntimeMs SparkRunner 430.92 440.43 2.21 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_1_batch RuntimeMs SparkStructuredStreamingRunner 421.32 425.38
> 0.96 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_1_sql_batch RuntimeMs DataflowRunner 29694.04 29599.73 -0.32 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_1_sql_batch RuntimeMs DirectRunner 3732.0 4228.81 13.31 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_1_sql_batch RuntimeMs FlinkRunner 589.96 627.52 6.37 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_1_sql_batch RuntimeMs SparkRunner 2376.08 2433.62 2.42 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_1_sql_batch RuntimeMs SparkStructuredStreamingRunner 681.72 730.67
> 7.18 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_1_sql_streaming RuntimeMs DataflowRunner 21010.93 21094.32 0.4 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_1_sql_streaming RuntimeMs DirectRunner 11578.4 11795.88 1.88 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_1_sql_streaming RuntimeMs FlinkRunner 823.72 943.67 14.56 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_1_streaming RuntimeMs DataflowRunner 29989.31 26805.65 -10.62 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_1_streaming RuntimeMs DirectRunner 8239.24 8465.57 2.75 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_1_streaming RuntimeMs FlinkRunner 675.8 719.81 6.51 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_2_batch RuntimeMs DataflowRunner 14706.32 9432.42 -35.86 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_2_batch RuntimeMs DirectRunner 159.14 279.67 75.74 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_2_batch RuntimeMs FlinkRunner 181.24 170.95 -5.68 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_2_batch RuntimeMs SparkRunner 276.56 292.52 5.77 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_2_batch RuntimeMs SparkStructuredStreamingRunner 272.12 281.14
> 3.32 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_2_python_batch RuntimeMs DirectRunner 7829.65 8468.19 8.16 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_2_sql_batch RuntimeMs DataflowRunner 21686.93 20245.05 -6.65 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_2_sql_batch RuntimeMs DirectRunner 1623.28 1787.86 10.14 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_2_sql_batch RuntimeMs FlinkRunner 379.0 392.9 3.67 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_2_sql_batch RuntimeMs SparkRunner 748.4 796.19 6.39 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_2_sql_batch RuntimeMs SparkStructuredStreamingRunner 597.16 634.86
> 6.31 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_2_sql_streaming RuntimeMs DataflowRunner 13997.85 13959.77 -0.27
> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_2_sql_streaming RuntimeMs DirectRunner 6869.4 6924.18 0.8 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_2_sql_streaming RuntimeMs FlinkRunner 425.56 413.14 -2.92 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_2_streaming RuntimeMs DataflowRunner 19786.89 17303.69 -12.55 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_2_streaming RuntimeMs DirectRunner 5211.16 5357.95 2.82 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_2_streaming RuntimeMs FlinkRunner 294.36 316.1 7.38 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_2_zetasql_batch RuntimeMs DataflowRunner 74348.78 73878.45 -0.63
> [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_2_zetasql_batch RuntimeMs DirectRunner 2947.56 3249.0 10.23 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_2_zetasql_batch RuntimeMs FlinkRunner 910.76 979.14 7.51 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_2_zetasql_batch RuntimeMs SparkRunner 1106.56 1221.9 10.42 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_2_zetasql_batch RuntimeMs SparkStructuredStreamingRunner 1080.48
> 1084.9 0.41 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_2_zetasql_streaming RuntimeMs DataflowRunner 42780.04 41825.14
> -2.23 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_2_zetasql_streaming RuntimeMs DirectRunner 8384.56 8746.76 4.32
> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_2_zetasql_streaming RuntimeMs FlinkRunner 1236.52 1326.29 7.26 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_3_batch RuntimeMs DataflowRunner 23433.0 21672.36 -7.51 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_3_batch RuntimeMs DirectRunner 1005.18 1205.86 19.96 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_batch RuntimeMs FlinkRunner 1221.2 1278.52 4.69 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_batch RuntimeMs SparkRunner 2119.48 2167.52 2.27 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_3_python_batch RuntimeMs DirectRunner 10760.73 10776.0 0.14 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_sql_batch RuntimeMs DataflowRunner 25223.3 24443.09 -3.09 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_sql_batch RuntimeMs DirectRunner 3386.16 3555.57 5.0 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_3_sql_batch RuntimeMs FlinkRunner 1452.68 1512.86 4.14 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_3_sql_batch RuntimeMs SparkRunner 3620.8 3729.76 3.01 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_3_sql_streaming RuntimeMs DataflowRunner 32310.48 36064.45 11.62
> [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_sql_streaming RuntimeMs DirectRunner 8541.28 8803.35 3.07 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_sql_streaming RuntimeMs FlinkRunner 1038.2 1129.62 8.81 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_streaming RuntimeMs DataflowRunner 46899.26 41710.78 -11.06 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_3_streaming RuntimeMs DirectRunner 7867.28 8257.0 4.95 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_streaming RuntimeMs FlinkRunner 635.28 700.86 10.32 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_zetasql_batch RuntimeMs DataflowRunner 59496.74 60512.82 1.71
> [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_3_zetasql_batch RuntimeMs DirectRunner 3818.12 4015.59 5.17 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_zetasql_batch RuntimeMs FlinkRunner 1800.8 1953.57 8.48 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_zetasql_batch RuntimeMs SparkRunner 3472.32 3932.9 13.26 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_zetasql_streaming RuntimeMs DataflowRunner 49916.22 57631.27
> 15.46 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_zetasql_streaming RuntimeMs DirectRunner 9091.72 9318.88 2.5 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_zetasql_streaming RuntimeMs FlinkRunner 1493.36 1745.71 16.9 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_4_batch RuntimeMs DataflowRunner 29181.48 28042.59 -3.9 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_4_batch RuntimeMs DirectRunner 2466.04 2665.1 8.07 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_4_batch RuntimeMs FlinkRunner 959.92 966.05 0.64 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_4_batch RuntimeMs SparkRunner 1191.84 1252.38 5.08 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_4_batch RuntimeMs SparkStructuredStreamingRunner 2729.44 2851.24
> 4.46 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_4_streaming RuntimeMs DataflowRunner 51110.81 50696.95 -0.81 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_4_streaming RuntimeMs DirectRunner 2939.64 3139.14 6.79 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_4_streaming RuntimeMs FlinkRunner 1092.36 1041.95 -4.61 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_5_batch RuntimeMs DataflowRunner 31070.26 20118.37 -35.25 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_5_batch RuntimeMs DirectRunner 4450.86 5175.48 16.28 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_5_batch RuntimeMs FlinkRunner 876.92 897.48 2.34 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_5_batch RuntimeMs SparkRunner 1508.48 1552.33 2.91 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_5_batch RuntimeMs SparkStructuredStreamingRunner 1692.48 1717.81
> 1.5 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_5_python_batch RuntimeMs DirectRunner 16819.96 16953.9 0.8 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_5_streaming RuntimeMs DataflowRunner 196748.05 188710.43 -4.09 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_5_streaming RuntimeMs DirectRunner 23362.84 30660.67 31.24 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_5_streaming RuntimeMs FlinkRunner 1411.04 1556.1 10.28 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_6_batch RuntimeMs DataflowRunner 26962.3 26104.91 -3.18 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_6_batch RuntimeMs DirectRunner 1846.28 1974.14 6.93 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_6_batch RuntimeMs FlinkRunner 612.52 607.0 -0.9 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_6_batch RuntimeMs SparkRunner 709.2 749.57 5.69 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_6_batch RuntimeMs SparkStructuredStreamingRunner 1200.4 1232.57
> 2.68 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_6_streaming RuntimeMs DataflowRunner 39862.63 41376.27 3.8 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_6_streaming RuntimeMs DirectRunner 2169.32 2254.29 3.92 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_6_streaming RuntimeMs FlinkRunner 554.12 573.52 3.5 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_7_batch RuntimeMs DataflowRunner 51271.63 47392.09 -7.57 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_7_batch RuntimeMs DirectRunner 8956.08 10210.69 14.01 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_7_batch RuntimeMs FlinkRunner 700.8 729.57 4.11 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_7_batch RuntimeMs SparkRunner 1468.92 1525.29 3.84 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_7_batch RuntimeMs SparkStructuredStreamingRunner 3655.12 3724.33
> 1.89 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_7_python_batch RuntimeMs DirectRunner 19817.08 19831.76 0.07 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_7_sql_batch RuntimeMs DataflowRunner 77045.7 90994.27 18.1 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_7_sql_batch RuntimeMs DirectRunner 236395.64 1310318.14 454.29 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_7_sql_batch RuntimeMs FlinkRunner 2795.8 2994.48 7.11 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_7_sql_batch RuntimeMs SparkRunner 7066.36 7333.19 3.78 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_7_sql_batch RuntimeMs SparkStructuredStreamingRunner 6052.24
> 6245.52 3.19 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_7_sql_streaming RuntimeMs DataflowRunner 1010451.11 1034446.23
> 2.37 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_7_sql_streaming RuntimeMs DirectRunner 910056.04 2902227.88 218.91
> [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_7_sql_streaming RuntimeMs FlinkRunner 3621.72 3855.14 6.45 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_7_streaming RuntimeMs DataflowRunner 123598.91 108149.55 -12.5 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_7_streaming RuntimeMs DirectRunner 864197.84 861347.19 -0.33 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_7_streaming RuntimeMs FlinkRunner 1412.8 1403.57 -0.65 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_8_batch RuntimeMs DataflowRunner 21435.32 13300.63 -37.95 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_8_batch RuntimeMs DirectRunner 697.58 791.6 13.48 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_8_batch RuntimeMs FlinkRunner 507.92 535.86 5.5 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_8_batch RuntimeMs SparkRunner 1460.64 1535.81 5.15 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_8_batch RuntimeMs SparkStructuredStreamingRunner 1982.28 2029.29
> 2.37 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_8_python_batch RuntimeMs DirectRunner 10450.8 10465.81 0.14 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_8_streaming RuntimeMs DataflowRunner 66471.26 61236.96 -7.87 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_8_streaming RuntimeMs DirectRunner 7442.64 7425.19 -0.23 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_8_streaming RuntimeMs FlinkRunner 581.04 577.57 -0.6 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_9_batch RuntimeMs DataflowRunner 25639.93 24353.5 -5.02 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_9_batch RuntimeMs DirectRunner 1466.0 1515.1 3.35 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [4]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_9_batch RuntimeMs FlinkRunner 365.6 382.48 4.62 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_9_batch RuntimeMs SparkRunner 567.28 626.67 10.47 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_9_batch RuntimeMs SparkStructuredStreamingRunner 879.12 928.71
> 5.64 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [4]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_9_streaming RuntimeMs DataflowRunner 32973.07 31714.59 -3.82 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_9_streaming RuntimeMs DirectRunner 1860.12 1891.14 1.67 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mz> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_9_streaming RuntimeMs FlinkRunner 403.56 461.9 14.46 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mz>
> tpcds_query10_Calcite_1GB RuntimeMs DataflowRunner 362315.07 371314.33
> 2.48 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query10_Calcite_1GB RuntimeMs FlinkRunner 35767.81 40759.19 13.95
> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query10_Calcite_1GB RuntimeMs SparkRunner 57245.84 59869.95 4.58 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query10_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
> 51403.04 55012.81 7.02 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query25_Calcite_1GB RuntimeMs DataflowRunner 378603.52 361011.86
> -4.65 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query25_Calcite_1GB RuntimeMs FlinkRunner 42126.5 48054.19 14.07 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query25_Calcite_1GB RuntimeMs SparkRunner 56661.92 59266.33 4.6 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query25_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
> 54411.04 57595.9 5.85 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query26_Calcite_1GB RuntimeMs DataflowRunner 343585.19 325966.48
> -5.13 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query26_Calcite_1GB RuntimeMs FlinkRunner 21425.23 23446.1 9.43 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query26_Calcite_1GB RuntimeMs SparkRunner 22959.2 24112.29 5.02 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query26_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
> 21961.56 23247.52 5.86 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query29_Calcite_1GB RuntimeMs DataflowRunner 368648.96 372150.48
> 0.95 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query29_Calcite_1GB RuntimeMs FlinkRunner 40771.38 46696.76 14.53
> [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query29_Calcite_1GB RuntimeMs SparkRunner 54244.72 57659.67 6.3 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query29_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 54272.8
> 56879.33 4.8 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query35_Calcite_1GB RuntimeMs DataflowRunner 367656.78 361673.0
> -1.63 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query35_Calcite_1GB RuntimeMs FlinkRunner 30409.77 35191.71 15.73
> [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query35_Calcite_1GB RuntimeMs SparkRunner 52025.6 55407.1 6.5 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query35_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 44919.6
> 47794.43 6.4 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query38_Calcite_1GB RuntimeMs DataflowRunner 343623.78 341860.67
> -0.51 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query38_Calcite_1GB RuntimeMs FlinkRunner 22935.69 26735.9 16.57 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query38_Calcite_1GB RuntimeMs SparkRunner 21119.2 22849.14 8.19 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query38_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 0.0 0.0
> 0.0 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query3_Calcite_1GB RuntimeMs DataflowRunner 324788.56 325751.62 0.3
> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query3_Calcite_1GB RuntimeMs FlinkRunner 36080.88 40976.29 13.57 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query3_Calcite_1GB RuntimeMs SparkRunner 34050.72 38213.9 12.23 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query3_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 39084.2
> 41950.9 7.33 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query40_Calcite_1GB RuntimeMs DataflowRunner 339566.11 343633.71 1.2
> [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query40_Calcite_1GB RuntimeMs FlinkRunner 30245.31 34842.9 15.2 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query40_Calcite_1GB RuntimeMs SparkRunner 25379.52 26950.24 6.19 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query40_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
> 24706.72 26927.62 8.99 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query42_Calcite_1GB RuntimeMs DataflowRunner 319514.19 319511.43
> -0.0 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query42_Calcite_1GB RuntimeMs FlinkRunner 23395.85 25856.81 10.52
> [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query42_Calcite_1GB RuntimeMs SparkRunner 21582.4 22969.86 6.43 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query42_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
> 20935.88 22345.71 6.73 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query43_Calcite_1GB RuntimeMs DataflowRunner 313394.04 318909.52
> 1.76 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query43_Calcite_1GB RuntimeMs FlinkRunner 23571.0 26048.9 10.51 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query43_Calcite_1GB RuntimeMs SparkRunner 22088.12 23457.0 6.2 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query43_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
> 22004.52 23119.9 5.07 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query52_Calcite_1GB RuntimeMs DataflowRunner 318206.63 327957.71
> 3.06 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query52_Calcite_1GB RuntimeMs FlinkRunner 23458.88 25862.38 10.25
> [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query52_Calcite_1GB RuntimeMs SparkRunner 21666.4 22942.38 5.89 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query52_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
> 21652.16 23114.52 6.75 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query55_Calcite_1GB RuntimeMs DataflowRunner 318602.89 315638.0
> -0.93 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query55_Calcite_1GB RuntimeMs FlinkRunner 22976.0 25435.86 10.71 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query55_Calcite_1GB RuntimeMs SparkRunner 21973.72 23055.76 4.92 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query55_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
> 19978.24 21915.05 9.69 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query69_Calcite_1GB RuntimeMs DataflowRunner 351148.37 354442.05
> 0.94 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query69_Calcite_1GB RuntimeMs FlinkRunner 31436.54 35748.38 13.72
> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query69_Calcite_1GB RuntimeMs SparkRunner 50124.24 53213.86 6.16 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query69_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
> 44159.44 46946.81 6.31 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query79_Calcite_1GB RuntimeMs DataflowRunner 347981.3 347125.76
> -0.25 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query79_Calcite_1GB RuntimeMs FlinkRunner 36015.88 39348.43 9.25 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query79_Calcite_1GB RuntimeMs SparkRunner 39837.6 42056.9 5.57 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query79_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 37740.0
> 39057.24 3.49 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query7_Calcite_1GB RuntimeMs DataflowRunner 343937.07 344542.1 0.18
> [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query7_Calcite_1GB RuntimeMs FlinkRunner 38729.31 43235.1 11.63 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query7_Calcite_1GB RuntimeMs SparkRunner 40251.4 43268.9 7.5 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query7_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 39953.8
> 42229.43 5.7 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query83_Calcite_1GB RuntimeMs DataflowRunner 350585.33 353801.1 0.92
> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query83_Calcite_1GB RuntimeMs FlinkRunner 9781.73 10692.71 9.31 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query83_Calcite_1GB RuntimeMs SparkRunner 9829.92 10407.38 5.87 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query83_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
> 14143.08 14614.24 3.33 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query84_Calcite_1GB RuntimeMs DataflowRunner 318936.56 322566.57
> 1.14 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query84_Calcite_1GB RuntimeMs FlinkRunner 20584.27 23509.19 14.21
> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query84_Calcite_1GB RuntimeMs SparkRunner 17810.88 18656.67 4.75 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query84_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
> 17019.32 17893.43 5.14 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query87_Calcite_1GB RuntimeMs DataflowRunner 349046.52 333596.95
> -4.43 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query87_Calcite_1GB RuntimeMs FlinkRunner 23672.85 27336.67 15.48
> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query87_Calcite_1GB RuntimeMs SparkRunner 20632.72 22672.67 9.89 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query87_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
> 22861.48 24574.29 7.49 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq>
> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query93_Calcite_1GB RuntimeMs DataflowRunner 356997.11 347957.19
> -2.53 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query93_Calcite_1GB RuntimeMs FlinkRunner 48908.42 55821.43 14.13
> [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query93_Calcite_1GB RuntimeMs SparkRunner 44754.76 47089.76 5.22 [1]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query93_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
> 38964.72 41755.1 7.16 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query96_Calcite_1GB RuntimeMs DataflowRunner 328956.93 329416.29
> 0.14 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query96_Calcite_1GB RuntimeMs FlinkRunner 20025.15 22467.62 12.2 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query96_Calcite_1GB RuntimeMs SparkRunner 19627.92 20990.1 6.94 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mq> [3]
> <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query96_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner
> 22169.36 23801.0 7.36 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2]
> <http://metrics.beam.apache.org/d/8INnSY9Mv> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk2>
>