You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/09/27 11:56:31 UTC
Beam Metrics Report (2022-09-27)
# Beam Metrics Report
Color legend: >= 20 | >= 10 | <= -10 | <= -20
---|---|---|---
## Possible regression
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
java_batch_cogbk_3 | dataflow_v2_java11_runtime_sec | - | 12.92 | 14.86 |
15.04 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_gbk_1 | sparkstructuredstreaming_runtime_sec | - | 507.33 | 624.47
| 23.09 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | sparkstructuredstreaming_runtime_sec | - | 106.26 | 138.08
| 29.94 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | sparkstructuredstreaming_runtime_sec | - | 8.79 | 10.48 |
19.26 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | dataflow_runtime_sec | - | 16.97 | 21.06 | 24.1 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | sparkstructuredstreaming_runtime_sec | - | 103.5 | 119.1 |
15.07 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | dataflow_v2_java17_runtime_sec | - | 22.95 | 27.8 | 21.13 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | dataflow_runtime_sec | - | 45.62 | 95.42 | 109.17 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_pardo_1 | sparkstructuredstreaming_runtime_sec | - | 52.59 | 66.8 |
27.01 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_2 | dataflow_runtime_sec | - | 180.16 | 208.46 | 15.71 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | dataflow_v2_java17_runtime_sec | - | 8.99 | 10.5 | 16.8 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_cogbk_3 | dataflow_v2_java17_runtime_sec | - | 323.67 | 403.29
| 24.6 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_4 | dataflow_v2_java11_runtime_sec | - | 325.26 | 397.32
| 22.15 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_gbk_5 | dataflow_v2_java17_runtime_sec | - | 608.13 | 671.4 |
10.4 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_7 | dataflow_v2_java11_runtime_sec | - | 227.32 | 266.6 |
17.28 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_pardo_1 | dataflow_v2_java17_runtime_sec | - | 23.88 | 26.29 |
10.08 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_cogbk_1 | python_dataflow_batch_cogbk_1_runtime | - | 393.0 |
433.0 | 10.18 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_gbk_1 | python_dataflow_batch_gbk_1_runtime | - | 1519.14 |
1703.8 | 12.16 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_pardo_3 | python_dataflow_batch_pardo_3_runtime | - | 138.14 |
173.0 | 25.23 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_sideinput_5 | python_dataflow_batch_sideinput_5_runtime | - |
2.71 | 3.0 | 10.53 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_6 | python_dataflow_batch_sideinput_6_runtime | - |
2.14 | 2.4 | 12.0 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_direct_microbenchmarks | teststream_microbenchmark_runtime_sec | - |
337.66 | 387.59 | 14.78 |
python_spannerio_read_2GB_results | pyspanner_read_2GB_results_runtime | - |
21.86 | 25.22 | 15.4 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_streaming_pardo_2 | python_dataflow_streaming_pardo_2_runtime | - |
2768.86 | 3053.2 | 10.27 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
textioit_hdfs_results | write_time | - | 30.96 | 46.31 | 49.6 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
wordcount_py37_results | runtime | - | 826.04 | 913.81 | 10.63 |
[[1]](http://metrics.beam.apache.org/d/1cnwVDkGk)
xmlioit_hdfs_results | write_time | - | 24.74 | 53.53 | 116.36 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
nexmark_11_batch | RuntimeMs | SparkStructuredStreamingRunner | 1032.05 |
1135.89 | 10.06 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_sql_batch | RuntimeMs | DataflowRunner | 56133.0 | 65246.0 | 16.23
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1674.04 |
2017.86 | 20.54 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_batch | RuntimeMs | FlinkRunner | 205.32 | 227.86 | 10.98 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
tpcds_query42_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
4172.39 | 4888.52 | 17.16 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query52_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
4178.14 | 4642.86 | 11.12 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
## Possible improvement
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
java_batch_combine_4 | dataflow_runtime_sec | - | 30.86 | 27.3 | -11.55 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_gbk_3 | dataflow_runtime_sec | - | 10.53 | 9.09 | -13.64 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | dataflow_v2_java11_runtime_sec | - | 28.14 | 24.16 | -14.16
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | dataflow_v2_java11_runtime_sec | - | 37.95 | 32.43 | -14.55
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_pardo_1 | dataflow_v2_java17_runtime_sec | - | 13.6 | 10.61 |
-21.98 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | dataflow_v2_java11_runtime_sec | - | 13.01 | 9.33 |
-28.26 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_4 | dataflow_v2_java11_runtime_sec | - | 25.54 | 22.05 |
-13.66 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_cogbk_3 | dataflow_v2_java11_runtime_sec | - | 368.06 | 323.64
| -12.07 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_gbk_1 | dataflow_v2_java11_runtime_sec | - | 966.89 | 798.17 |
-17.45 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_6 | dataflow_v2_java11_runtime_sec | - | 182.89 | 158.31 |
-13.44 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_pardo_1 | python_dataflow_streaming_pardo_1_runtime | - |
295.57 | 261.8 | -11.43 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
textioit_results | read_time | - | 21.47 | 18.6 | -13.34 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
nexmark_0_batch | RuntimeMs | SparkStructuredStreamingRunner | 1642.8 |
1440.82 | -12.3 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_15_batch | RuntimeMs | SparkStructuredStreamingRunner | 1364.27 |
1226.41 | -10.1 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_batch | RuntimeMs | SparkStructuredStreamingRunner | 471.3 | 379.66
| -19.44 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1075.14 |
949.09 | -11.72 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_7_batch | RuntimeMs | SparkStructuredStreamingRunner | 2213.05 |
1505.68 | -31.96 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_7_sql_streaming | RuntimeMs | DirectRunner | 4318496.25 | 2816075.77 |
-34.79 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
tpcds_query10_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
46696.14 | 40165.62 | -13.99 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query25_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
14181.25 | 11119.76 | -21.59 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query29_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
14232.5 | 10429.05 | -26.72 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query35_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
37213.36 | 32356.95 | -13.05 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query69_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
38034.25 | 32306.57 | -15.06 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query79_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
9261.36 | 8061.9 | -12.95 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query83_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
21832.79 | 19378.86 | -11.24 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query96_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
7188.68 | 5799.38 | -19.33 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
## All metrics
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
avroioit_hdfs_results | read_time | - | 91.9 | 90.13 | -1.93 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_hdfs_results | write_time | - | 119.52 | 121.27 | 1.46 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_results | read_time | - | 93.98 | 90.66 | -3.53 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_results | write_time | - | 120.51 | 119.19 | -1.09 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_avro | avro_write_time | - | 33.64 | 34.32 | 2.01
| [[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_avro | read_time | - | 41.67 | 39.59 | -5.0 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_json | read_time | - | 37.88 | 38.69 | 2.14 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_json | write_time | - | 52.32 | 53.1 | 1.48 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
cdapioit_results | read_time | - | 5.91 | 6.41 | 8.49 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
cdapioit_results | write_time | - | 7.81 | 7.78 | -0.4 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_hdfs_results | read_time | - | 135.52 | 131.15 | -3.23 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_hdfs_results | write_time | - | 213.54 | 208.17 | -2.51 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_results | read_time | - | 139.81 | 143.39 | 2.55 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_results | write_time | - | 209.06 | 214.22 | 2.47 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
go_batch_cogbk_1 | dataflow_runtime | - | 262.88 | 284.27 | 8.14 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_cogbk_2 | dataflow_runtime | - | 149.39 | 145.57 | -2.56 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_cogbk_3 | dataflow_runtime | - | 110.77 | 108.77 | -1.81 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_cogbk_4 | dataflow_runtime | - | 110.47 | 111.33 | 0.78 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_combine_1 | dataflow_runtime | - | 416.04 | 424.97 | 2.15 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
go_batch_combine_4 | dataflow_runtime | - | 74.53 | 74.44 | -0.12 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
go_batch_combine_5 | dataflow_runtime | - | 69.26 | 69.61 | 0.5 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
go_batch_gbk_1 | dataflow_runtime | - | 392.87 | 395.7 | 0.72 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_2 | dataflow_runtime | - | 101.45 | 104.35 | 2.86 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_3 | dataflow_runtime | - | 24.49 | 24.62 | 0.55 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_4 | dataflow_runtime | - | 53.41 | 54.35 | 1.78 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_5 | dataflow_runtime | - | 44.03 | 42.47 | -3.56 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_6 | dataflow_runtime | - | 104.28 | 103.84 | -0.43 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_7 | dataflow_runtime | - | 113.84 | 124.43 | 9.3 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_pardo_1 | dataflow_runtime | - | 80.92 | 79.9 | -1.26 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_2 | dataflow_runtime | - | 604.86 | 622.14 | 2.86 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_3 | dataflow_runtime | - | 65.91 | 67.58 | 2.53 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_4 | dataflow_runtime | - | 69.44 | 69.23 | -0.31 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_sideinput_3 | dataflow_runtime | - | 2.59 | 2.35 | -9.27 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
go_batch_sideinput_4 | dataflow_runtime | - | 216.23 | 231.06 | 6.86 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
hadoopformatioit_results | read_time | - | 6.36 | 6.64 | 4.3 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
hadoopformatioit_results | write_time | - | 7.71 | 7.83 | 1.49 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
java_batch_cogbk_1 | dataflow_runtime_sec | - | 40.64 | 40.83 | 0.46 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_1 | dataflow_v2_java11_runtime_sec | - | 47.22 | 44.64 |
-5.47 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_1 | dataflow_v2_java17_runtime_sec | - | 44.46 | 48.5 | 9.07
| [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_1 | sparkstructuredstreaming_runtime_sec | - | 127.15 |
130.14 | 2.35 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | dataflow_runtime_sec | - | 38.7 | 41.85 | 8.14 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | dataflow_v2_java11_runtime_sec | - | 43.15 | 45.38 | 5.15
| [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | dataflow_v2_java17_runtime_sec | - | 46.79 | 48.47 | 3.59
| [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | sparkstructuredstreaming_runtime_sec | - | 119.91 |
119.58 | -0.27 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | dataflow_runtime_sec | - | 14.18 | 14.32 | 1.04 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | dataflow_v2_java11_runtime_sec | - | 12.92 | 14.86 |
15.04 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | dataflow_v2_java17_runtime_sec | - | 11.36 | 11.84 | 4.28
| [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | sparkstructuredstreaming_runtime_sec | - | 21.63 | 20.15
| -6.83 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | dataflow_runtime_sec | - | 14.64 | 13.26 | -9.39 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | dataflow_v2_java11_runtime_sec | - | 11.75 | 12.2 | 3.84
| [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | dataflow_v2_java17_runtime_sec | - | 12.19 | 11.4 | -6.49
| [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | sparkstructuredstreaming_runtime_sec | - | 19.99 | 19.72
| -1.34 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_combine_1 | dataflow_runtime_sec | - | 60.89 | 62.98 | 3.44 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_1 | sparkstructuredstreaming_runtime_sec | - | 525.58 |
566.56 | 7.8 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_4 | dataflow_runtime_sec | - | 30.86 | 27.3 | -11.55 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_4 | sparkstructuredstreaming_runtime_sec | - | 128.9 |
137.08 | 6.35 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_5 | dataflow_runtime_sec | - | 27.01 | 26.56 | -1.64 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_5 | sparkstructuredstreaming_runtime_sec | - | 125.17 |
130.39 | 4.17 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_gbk_1 | dataflow_runtime_sec | - | 113.49 | 123.7 | 8.99 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_1 | dataflow_v2_java11_runtime_sec | - | 85.65 | 89.1 | 4.03 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_1 | dataflow_v2_java17_runtime_sec | - | 87.03 | 88.18 | 1.33 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_1 | sparkstructuredstreaming_runtime_sec | - | 507.33 | 624.47
| 23.09 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | dataflow_runtime_sec | - | 33.78 | 34.21 | 1.3 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | dataflow_v2_java11_runtime_sec | - | 44.0 | 41.95 | -4.65 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | dataflow_v2_java17_runtime_sec | - | 41.53 | 39.26 | -5.46
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | sparkstructuredstreaming_runtime_sec | - | 106.26 | 138.08
| 29.94 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_runtime_sec | - | 10.53 | 9.09 | -13.64 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_v2_java11_runtime_sec | - | 13.14 | 13.22 | 0.64 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_v2_java17_runtime_sec | - | 13.09 | 12.56 | -4.06
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | sparkstructuredstreaming_runtime_sec | - | 8.79 | 10.48 |
19.26 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | dataflow_runtime_sec | - | 16.97 | 21.06 | 24.1 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | dataflow_v2_java11_runtime_sec | - | 21.26 | 20.95 | -1.47
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | dataflow_v2_java17_runtime_sec | - | 18.72 | 18.96 | 1.27 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | sparkstructuredstreaming_runtime_sec | - | 103.5 | 119.1 |
15.07 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | dataflow_runtime_sec | - | 17.94 | 16.46 | -8.23 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | dataflow_v2_java11_runtime_sec | - | 18.79 | 17.99 | -4.27
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | dataflow_v2_java17_runtime_sec | - | 17.96 | 17.16 | -4.46
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | sparkstructuredstreaming_runtime_sec | - | 106.44 | 115.75
| 8.75 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | dataflow_runtime_sec | - | 34.42 | 34.72 | 0.86 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | dataflow_v2_java11_runtime_sec | - | 28.14 | 24.16 | -14.16
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | dataflow_v2_java17_runtime_sec | - | 22.95 | 27.8 | 21.13 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | sparkstructuredstreaming_runtime_sec | - | 60.8 | 65.71 |
8.08 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | dataflow_runtime_sec | - | 45.62 | 95.42 | 109.17 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | dataflow_v2_java11_runtime_sec | - | 37.95 | 32.43 | -14.55
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | dataflow_v2_java17_runtime_sec | - | 32.81 | 34.49 | 5.11 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | sparkstructuredstreaming_runtime_sec | - | 85.48 | 91.44 |
6.98 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_pardo_1 | dataflow_runtime_sec | - | 19.64 | 20.52 | 4.49 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_1 | dataflow_v2_java11_runtime_sec | - | 13.33 | 12.42 |
-6.83 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_1 | dataflow_v2_java17_runtime_sec | - | 13.6 | 10.61 |
-21.98 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_1 | sparkstructuredstreaming_runtime_sec | - | 52.59 | 66.8 |
27.01 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_2 | dataflow_runtime_sec | - | 180.16 | 208.46 | 15.71 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_2 | dataflow_v2_java11_runtime_sec | - | 60.95 | 60.77 | -0.3
| [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_2 | dataflow_v2_java17_runtime_sec | - | 57.96 | 58.89 | 1.61
| [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | dataflow_runtime_sec | - | 12.26 | 13.13 | 7.09 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | dataflow_v2_java11_runtime_sec | - | 13.01 | 9.33 |
-28.26 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | dataflow_v2_java17_runtime_sec | - | 8.99 | 10.5 | 16.8 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_4 | dataflow_runtime_sec | - | 25.29 | 25.09 | -0.83 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_4 | dataflow_v2_java11_runtime_sec | - | 25.54 | 22.05 |
-13.66 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_4 | dataflow_v2_java17_runtime_sec | - | 21.69 | 23.36 | 7.67
| [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_cogbk_1 | dataflow_runtime_sec | - | 839.95 | 842.82 | 0.34 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_1 | dataflow_v2_java11_runtime_sec | - | 3275.78 |
2991.61 | -8.67 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_1 | dataflow_v2_java17_runtime_sec | - | 2514.37 | 2589.0
| 2.97 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_2 | dataflow_runtime_sec | - | 882.07 | 839.48 | -4.83 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_2 | dataflow_v2_java11_runtime_sec | - | 3285.9 | 2961.88
| -9.86 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_2 | dataflow_v2_java17_runtime_sec | - | 3373.79 |
3244.96 | -3.82 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_3 | dataflow_runtime_sec | - | 112.14 | 116.11 | 3.54 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_3 | dataflow_v2_java11_runtime_sec | - | 368.06 | 323.64
| -12.07 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_3 | dataflow_v2_java17_runtime_sec | - | 323.67 | 403.29
| 24.6 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_4 | dataflow_runtime_sec | - | 111.16 | 115.64 | 4.03 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_4 | dataflow_v2_java11_runtime_sec | - | 325.26 | 397.32
| 22.15 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_4 | dataflow_v2_java17_runtime_sec | - | 323.49 | 338.45
| 4.62 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_combine_1 | dataflow_runtime_sec | - | 476.04 | 489.52 | 2.83 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_combine_4 | dataflow_runtime_sec | - | 308.52 | 313.61 | 1.65 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_combine_5 | dataflow_runtime_sec | - | 304.61 | 309.82 | 1.71 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_gbk_1 | dataflow_runtime_sec | - | 655.3 | 639.34 | -2.44 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_1 | dataflow_v2_java11_runtime_sec | - | 966.89 | 798.17 |
-17.45 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_1 | dataflow_v2_java17_runtime_sec | - | 1107.67 | 1062.23
| -4.1 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_2 | dataflow_runtime_sec | - | 783.91 | 791.93 | 1.02 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_2 | dataflow_v2_java11_runtime_sec | - | 2767.67 | 2874.03
| 3.84 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_2 | dataflow_v2_java17_runtime_sec | - | 3369.24 | 3176.43
| -5.72 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_3 | dataflow_runtime_sec | - | 23.41 | 23.32 | -0.39 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_3 | dataflow_v2_java11_runtime_sec | - | 75.84 | 72.65 |
-4.21 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_3 | dataflow_v2_java17_runtime_sec | - | 59.06 | 61.13 |
3.52 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_4 | dataflow_runtime_sec | - | 277.78 | 271.32 | -2.33 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_4 | dataflow_v2_java11_runtime_sec | - | 627.71 | 684.03 |
8.97 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_4 | dataflow_v2_java17_runtime_sec | - | 651.63 | 647.74 |
-0.6 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_5 | dataflow_runtime_sec | - | 284.96 | 268.82 | -5.66 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_5 | dataflow_v2_java11_runtime_sec | - | 639.15 | 613.17 |
-4.07 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_5 | dataflow_v2_java17_runtime_sec | - | 608.13 | 671.4 |
10.4 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_6 | dataflow_runtime_sec | - | 74.15 | 74.67 | 0.7 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_6 | dataflow_v2_java11_runtime_sec | - | 182.89 | 158.31 |
-13.44 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_6 | dataflow_v2_java17_runtime_sec | - | 174.21 | 182.96 |
5.02 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_7 | dataflow_runtime_sec | - | 133.83 | 131.36 | -1.84 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_7 | dataflow_v2_java11_runtime_sec | - | 227.32 | 266.6 |
17.28 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_7 | dataflow_v2_java17_runtime_sec | - | 229.08 | 209.52 |
-8.54 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_pardo_1 | dataflow_runtime_sec | - | 18.77 | 19.19 | 2.21 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_1 | dataflow_v2_java11_runtime_sec | - | 25.79 | 24.76 |
-3.99 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_1 | dataflow_v2_java17_runtime_sec | - | 23.88 | 26.29 |
10.08 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_2 | dataflow_runtime_sec | - | 214.97 | 209.19 | -2.69 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_2 | dataflow_v2_java11_runtime_sec | - | 114.35 | 107.53
| -5.96 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_2 | dataflow_v2_java17_runtime_sec | - | 112.33 | 104.39
| -7.06 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_3 | dataflow_runtime_sec | - | 11.75 | 12.16 | 3.41 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_3 | dataflow_v2_java11_runtime_sec | - | 23.63 | 21.67 |
-8.28 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_3 | dataflow_v2_java17_runtime_sec | - | 20.97 | 20.63 |
-1.62 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_4 | dataflow_runtime_sec | - | 30.88 | 31.26 | 1.23 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_4 | dataflow_v2_java11_runtime_sec | - | 35.69 | 37.95 |
6.31 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_4 | dataflow_v2_java17_runtime_sec | - | 34.87 | 35.39 |
1.5 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
jdbcioit_results | read_time | - | 23.73 | 24.66 | 3.96 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
jdbcioit_results | write_time | - | 38.77 | 36.14 | -6.78 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results | read_time | - | 917.37 | 924.0 | 0.72 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results | write_time | - | 180.42 | 179.03 | -0.77 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results_runner_v2 | read_time | - | 2.57 | 2.64 | 2.77 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results_runner_v2 | write_time | - | 3.66 | 4.0 | 9.39 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_hdfs_results | read_time | - | 17.27 | 17.96 | 4.01 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_hdfs_results | write_time | - | 63.57 | 62.76 | -1.28 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_results | read_time | - | 24.47 | 23.11 | -5.55 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_results | write_time | - | 62.7 | 61.76 | -1.49 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
mongodbioit_results | read_time | - | 33.62 | 34.56 | 2.8 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
mongodbioit_results | write_time | - | 58.28 | 55.0 | -5.62 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_hdfs_results | read_time | - | 88.72 | 92.88 | 4.69 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_hdfs_results | write_time | - | 146.54 | 152.89 | 4.34 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_results | read_time | - | 90.51 | 94.12 | 3.99 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_results | write_time | - | 144.56 | 145.67 | 0.77 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
python_batch_cogbk_1 | python_dataflow_batch_cogbk_1_runtime | - | 393.0 |
433.0 | 10.18 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_2 | python_dataflow_batch_cogbk_2_runtime | - | 274.86 |
276.4 | 0.56 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_3 | python_dataflow_batch_cogbk_3_runtime | - | 238.43 |
243.0 | 1.92 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_4 | python_dataflow_batch_cogbk_4_runtime | - | 241.0 |
251.2 | 4.23 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_combine_1 | python_dataflow_batch_combine_1_runtime | - | 947.14
| 944.6 | -0.27 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_4 | python_dataflow_batch_combine_4_runtime | - | 40.0 |
41.2 | 3.0 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_5 | python_dataflow_batch_combine_5_runtime | - | 28.86 |
29.8 | 3.27 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_gbk_1 | python_dataflow_batch_gbk_1_runtime | - | 1519.14 |
1703.8 | 12.16 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_2 | python_dataflow_batch_gbk_2_runtime | - | 272.43 | 294.0
| 7.92 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_3 | python_dataflow_batch_gbk_3_runtime | - | 17.71 | 17.6 |
-0.65 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_4 | python_dataflow_batch_gbk_4_runtime | - | 73.71 | 71.0 |
-3.68 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_5 | python_dataflow_batch_gbk_5_runtime | - | 70.0 | 66.0 |
-5.71 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_6 | python_dataflow_batch_gbk_6_runtime | - | 237.0 | 259.0 |
9.28 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_7 | python_dataflow_batch_gbk_7_runtime | - | 272.0 | 272.4 |
0.15 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_pardo_1 | python_dataflow_batch_pardo_1_runtime | - | 158.29 |
172.6 | 9.04 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_2 | python_dataflow_batch_pardo_2_runtime | - | 1612.43 |
1715.8 | 6.41 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_3 | python_dataflow_batch_pardo_3_runtime | - | 138.14 |
173.0 | 25.23 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_4 | python_dataflow_batch_pardo_4_runtime | - | 382.71 |
391.8 | 2.37 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_sideinput_1 | python_dataflow_batch_sideinput_1_runtime | - |
2.29 | 2.5 | 9.38 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_10 | python_dataflow_batch_sideinput_10_runtime | - |
762.29 | 738.2 | -3.16 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_2 | python_dataflow_batch_sideinput_2_runtime | - |
2.29 | 2.5 | 9.38 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_3 | python_dataflow_batch_sideinput_3_runtime | - |
3.14 | 3.4 | 8.18 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_4 | python_dataflow_batch_sideinput_4_runtime | - |
24.43 | 25.8 | 5.61 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_5 | python_dataflow_batch_sideinput_5_runtime | - |
2.71 | 3.0 | 10.53 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_6 | python_dataflow_batch_sideinput_6_runtime | - |
2.14 | 2.4 | 12.0 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_7 | python_dataflow_batch_sideinput_7_runtime | - |
145.43 | 154.8 | 6.44 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_8 | python_dataflow_batch_sideinput_8_runtime | - |
136.57 | 127.2 | -6.86 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_9 | python_dataflow_batch_sideinput_9_runtime | - |
766.0 | 781.0 | 1.96 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_bqio_read_10GB_results | bqio_read_10GB_results_runtime | - | 101.57 |
101.8 | 0.23 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_bqio_write_10GB_results | bqio_write_10GB_results_runtime | - | 285.57
| 292.0 | 2.25 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_direct_microbenchmarks | fn_api_runner_microbenchmark_runtime_sec | - |
94.1 | 103.27 | 9.75 |
python_direct_microbenchmarks | teststream_microbenchmark_runtime_sec | - |
337.66 | 387.59 | 14.78 |
python_spanner_write_2GB_results | pyspanner_write_2GB_results_runtime | - |
1712.86 | 1718.0 | 0.3 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_spannerio_read_2GB_results | pyspanner_read_2GB_results_runtime | - |
21.86 | 25.22 | 15.4 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_streaming_cogbk_1 | python_dataflow_streaming_cogbk_1_runtime | - |
665.71 | 665.2 | -0.08 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_2 | python_dataflow_streaming_cogbk_2_runtime | - |
448.29 | 467.2 | 4.22 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_3 | python_dataflow_streaming_cogbk_3_runtime | - |
531.71 | 515.8 | -2.99 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_4 | python_dataflow_streaming_cogbk_4_runtime | - |
447.57 | 422.6 | -5.58 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_gbk_3 | python_dataflow_streaming_gbk_3_runtime | - | 100.0 |
90.2 | -9.8 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_gbk_6 | python_dataflow_streaming_gbk_6_runtime | - | 552.14
| 585.8 | 6.1 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_gbk_7 | python_dataflow_streaming_gbk_7_runtime | - | 598.29
| 583.6 | -2.45 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_pardo_1 | python_dataflow_streaming_pardo_1_runtime | - |
295.57 | 261.8 | -11.43 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_2 | python_dataflow_streaming_pardo_2_runtime | - |
2768.86 | 3053.2 | 10.27 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_3 | python_dataflow_streaming_pardo_3_runtime | - |
213.29 | 212.0 | -0.6 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_4 | python_dataflow_streaming_pardo_4_runtime | - |
527.67 | 507.0 | -3.92 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
textioit_hdfs_results | read_time | - | 17.21 | 17.66 | 2.64 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_hdfs_results | write_time | - | 30.96 | 46.31 | 49.6 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_results | read_time | - | 21.47 | 18.6 | -13.34 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_results | write_time | - | 32.33 | 31.74 | -1.83 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
tfrecordioit_results | read_time | - | 16.49 | 16.3 | -1.16 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
tfrecordioit_results | write_time | - | 21.43 | 20.35 | -5.05 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
wordcount_py37_results | runtime | - | 826.04 | 913.81 | 10.63 |
[[1]](http://metrics.beam.apache.org/d/1cnwVDkGk)
xmlioit_hdfs_results | read_time | - | 21.5 | 22.24 | 3.47 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_hdfs_results | write_time | - | 24.74 | 53.53 | 116.36 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_results | read_time | - | 23.8 | 23.91 | 0.44 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_results | write_time | - | 25.07 | 23.5 | -6.28 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
nexmark_0_batch | RuntimeMs | DataflowRunner | 26037.05 | 25470.56 | -2.18 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_batch | RuntimeMs | DirectRunner | 4605.04 | 4580.09 | -0.54 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_batch | RuntimeMs | FlinkRunner | 1139.86 | 1143.59 | 0.33 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_batch | RuntimeMs | SparkRunner | 1307.43 | 1300.32 | -0.54 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_batch | RuntimeMs | SparkStructuredStreamingRunner | 1642.8 |
1440.82 | -12.3 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_sql_batch | RuntimeMs | DataflowRunner | 31466.46 | 30756.27 | -2.26
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_sql_batch | RuntimeMs | DirectRunner | 5723.71 | 5746.59 | 0.4 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_sql_batch | RuntimeMs | SparkRunner | 3265.54 | 3215.95 | -1.52 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 2964.32 |
2931.18 | -1.12 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_sql_streaming | RuntimeMs | DataflowRunner | 23026.5 | 23231.59 |
0.89 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_sql_streaming | RuntimeMs | DirectRunner | 16009.21 | 16034.95 |
0.16 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_sql_streaming | RuntimeMs | FlinkRunner | 1716.86 | 1684.73 | -1.87
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_streaming | RuntimeMs | DataflowRunner | 38433.8 | 38983.34 | 1.43 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_streaming | RuntimeMs | DirectRunner | 12303.89 | 12329.41 | 0.21 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_streaming | RuntimeMs | FlinkRunner | 1454.71 | 1453.18 | -0.11 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_batch | RuntimeMs | DataflowRunner | 114063.5 | 117451.45 |
2.97 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_zetasql_batch | RuntimeMs | DirectRunner | 7013.96 | 6895.64 | -1.69
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_zetasql_streaming | RuntimeMs | DataflowRunner | 66263.68 | 67964.36
| 2.57 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_zetasql_streaming | RuntimeMs | DirectRunner | 17668.64 | 17420.05 |
-1.41 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_zetasql_streaming | RuntimeMs | FlinkRunner | 3380.86 | 3358.91 |
-0.65 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_batch | RuntimeMs | DataflowRunner | 45302.54 | 44725.69 | -1.27 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_10_batch | RuntimeMs | DirectRunner | 10735.11 | 10713.27 | -0.2 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_10_batch | RuntimeMs | FlinkRunner | 580.21 | 584.59 | 0.75 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_10_batch | RuntimeMs | SparkRunner | 730.18 | 715.18 | -2.05 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_10_batch | RuntimeMs | SparkStructuredStreamingRunner | 1054.0 |
1026.95 | -2.57 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_10_streaming | RuntimeMs | DataflowRunner | 108528.73 | 107464.2 |
-0.98 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_10_streaming | RuntimeMs | DirectRunner | 44185.89 | 44429.5 | 0.55 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_streaming | RuntimeMs | FlinkRunner | 1375.14 | 1387.64 | 0.91 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_11_batch | RuntimeMs | DataflowRunner | 37764.11 | 36826.12 | -2.48 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_11_batch | RuntimeMs | DirectRunner | 3995.07 | 3990.32 | -0.12 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_11_batch | RuntimeMs | FlinkRunner | 278.71 | 267.45 | -4.04 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_11_batch | RuntimeMs | SparkRunner | 1411.45 | 1406.18 | -0.37 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_11_batch | RuntimeMs | SparkStructuredStreamingRunner | 1032.05 |
1135.89 | 10.06 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_11_streaming | RuntimeMs | DataflowRunner | 185461.97 | 184138.86 |
-0.71 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_streaming | RuntimeMs | DirectRunner | 10889.61 | 10946.23 | 0.52 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_streaming | RuntimeMs | FlinkRunner | 1354.36 | 1323.95 | -2.24 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_12_batch | RuntimeMs | DataflowRunner | 17932.41 | 16726.01 | -6.73 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_12_batch | RuntimeMs | DirectRunner | 2779.14 | 2825.86 | 1.68 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_12_batch | RuntimeMs | FlinkRunner | 169.11 | 177.36 | 4.88 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_12_batch | RuntimeMs | SparkRunner | 906.36 | 895.2 | -1.23 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_12_batch | RuntimeMs | SparkStructuredStreamingRunner | 848.93 |
840.48 | -1.0 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_12_streaming | RuntimeMs | DataflowRunner | 95582.01 | 96221.23 | 0.67
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_12_streaming | RuntimeMs | DirectRunner | 9387.71 | 9418.5 | 0.33 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_streaming | RuntimeMs | FlinkRunner | 619.68 | 616.77 | -0.47 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_batch | RuntimeMs | DataflowRunner | 31260.18 | 30456.05 | -2.57 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_batch | RuntimeMs | DirectRunner | 3243.82 | 3170.77 | -2.25 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_batch | RuntimeMs | FlinkRunner | 390.21 | 371.14 | -4.89 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_batch | RuntimeMs | SparkRunner | 353.45 | 349.41 | -1.14 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_batch | RuntimeMs | SparkStructuredStreamingRunner | 536.21 |
484.68 | -9.61 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_batch | RuntimeMs | DataflowRunner | 56133.0 | 65246.0 | 16.23
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_batch | RuntimeMs | DirectRunner | 9132.14 | 9094.82 | -0.41 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_sql_batch | RuntimeMs | SparkRunner | 3445.98 | 3406.2 | -1.15 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 3070.43 |
3200.43 | 4.23 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_streaming | RuntimeMs | DataflowRunner | 34032.14 | 35492.68 |
4.29 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_sql_streaming | RuntimeMs | DirectRunner | 19241.79 | 19065.95 |
-0.91 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_streaming | RuntimeMs | FlinkRunner | 34410.54 | 37459.77 |
8.86 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_streaming | RuntimeMs | DataflowRunner | 25115.86 | 25643.27 | 2.1
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_streaming | RuntimeMs | DirectRunner | 10145.32 | 10219.0 | 0.73 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_streaming | RuntimeMs | FlinkRunner | 35817.04 | 36109.5 | 0.82 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_zetasql_batch | RuntimeMs | DataflowRunner | 251775.96 | 269855.82
| 7.18 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_zetasql_batch | RuntimeMs | DirectRunner | 10359.04 | 10428.18 |
0.67 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_streaming | RuntimeMs | DataflowRunner | 109012.86 |
112655.91 | 3.34 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_zetasql_streaming | RuntimeMs | DirectRunner | 21346.71 | 21243.77
| -0.48 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_streaming | RuntimeMs | FlinkRunner | 39799.39 | 39602.32 |
-0.5 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_14_batch | RuntimeMs | DataflowRunner | 59111.86 | 57979.14 | -1.92 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_14_batch | RuntimeMs | DirectRunner | 4255.54 | 4220.59 | -0.82 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_14_batch | RuntimeMs | FlinkRunner | 457.07 | 473.18 | 3.52 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_14_batch | RuntimeMs | SparkRunner | 907.23 | 903.2 | -0.44 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_14_batch | RuntimeMs | SparkStructuredStreamingRunner | 924.68 |
996.34 | 7.75 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_14_streaming | RuntimeMs | DataflowRunner | 123986.39 | 122911.59 |
-0.87 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_14_streaming | RuntimeMs | DirectRunner | 12297.29 | 12418.18 | 0.98 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_14_streaming | RuntimeMs | FlinkRunner | 1846.71 | 1803.77 | -2.33 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_15_batch | RuntimeMs | DataflowRunner | 43370.77 | 43089.08 | -0.65 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_15_batch | RuntimeMs | DirectRunner | 16713.61 | 16446.05 | -1.6 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_15_batch | RuntimeMs | FlinkRunner | 430.32 | 417.64 | -2.95 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_15_batch | RuntimeMs | SparkRunner | 1600.59 | 1586.8 | -0.86 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_15_batch | RuntimeMs | SparkStructuredStreamingRunner | 1364.27 |
1226.41 | -10.1 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_16_batch | RuntimeMs | DataflowRunner | 49213.76 | 48617.6 | -1.21 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_16_batch | RuntimeMs | DirectRunner | 87897.07 | 87689.68 | -0.24 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_16_batch | RuntimeMs | FlinkRunner | 230.54 | 223.91 | -2.87 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_16_batch | RuntimeMs | SparkRunner | 1315.91 | 1287.09 | -2.19 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_16_batch | RuntimeMs | SparkStructuredStreamingRunner | 1216.73 |
1299.61 | 6.81 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_16_streaming | RuntimeMs | DataflowRunner | 92179.31 | 98360.98 | 6.71
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_16_streaming | RuntimeMs | DirectRunner | 146340.29 | 136424.0 | -6.78
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_16_streaming | RuntimeMs | FlinkRunner | 427.39 | 427.68 | 0.07 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_batch | RuntimeMs | DataflowRunner | 20543.86 | 19595.99 | -4.61 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_batch | RuntimeMs | DirectRunner | 3150.29 | 3246.95 | 3.07 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_batch | RuntimeMs | FlinkRunner | 330.43 | 334.09 | 1.11 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_batch | RuntimeMs | SparkRunner | 456.7 | 455.7 | -0.22 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_batch | RuntimeMs | SparkStructuredStreamingRunner | 609.43 | 553.14
| -9.24 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_sql_batch | RuntimeMs | DataflowRunner | 27980.5 | 27691.23 | -1.03
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_1_sql_batch | RuntimeMs | DirectRunner | 3632.14 | 3662.32 | 0.83 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_sql_batch | RuntimeMs | SparkRunner | 2449.09 | 2402.75 | -1.89 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_1_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1674.04 |
2017.86 | 20.54 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_sql_streaming | RuntimeMs | DataflowRunner | 20655.61 | 19520.23 |
-5.5 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_sql_streaming | RuntimeMs | DirectRunner | 11710.25 | 11656.09 |
-0.46 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_streaming | RuntimeMs | FlinkRunner | 714.07 | 692.27 | -3.05 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_streaming | RuntimeMs | DataflowRunner | 28455.91 | 28770.44 | 1.11
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_streaming | RuntimeMs | DirectRunner | 8298.36 | 8235.64 | -0.76 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_streaming | RuntimeMs | FlinkRunner | 657.14 | 655.77 | -0.21 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_batch | RuntimeMs | DataflowRunner | 14090.08 | 13071.39 | -7.23 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_batch | RuntimeMs | DirectRunner | 1350.04 | 1366.95 | 1.25 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_batch | RuntimeMs | FlinkRunner | 205.32 | 227.86 | 10.98 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_batch | RuntimeMs | SparkRunner | 312.12 | 306.39 | -1.84 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_batch | RuntimeMs | SparkStructuredStreamingRunner | 471.3 | 379.66
| -19.44 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_sql_batch | RuntimeMs | DataflowRunner | 20078.54 | 18795.27 | -6.39
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_sql_batch | RuntimeMs | DirectRunner | 1579.75 | 1569.5 | -0.65 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_sql_batch | RuntimeMs | SparkRunner | 774.7 | 775.93 | 0.16 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1075.14 |
949.09 | -11.72 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_sql_streaming | RuntimeMs | DataflowRunner | 13744.21 | 13478.09 |
-1.94 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_sql_streaming | RuntimeMs | DirectRunner | 6926.79 | 6941.36 | 0.21
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_streaming | RuntimeMs | FlinkRunner | 387.32 | 378.36 | -2.31 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_streaming | RuntimeMs | DataflowRunner | 19205.46 | 18862.59 | -1.79
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_streaming | RuntimeMs | DirectRunner | 5250.18 | 5247.64 | -0.05 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_streaming | RuntimeMs | FlinkRunner | 275.96 | 269.82 | -2.23 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_zetasql_batch | RuntimeMs | DataflowRunner | 70472.86 | 72753.59 |
3.24 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_batch | RuntimeMs | DirectRunner | 2905.64 | 2816.27 | -3.08
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_zetasql_streaming | RuntimeMs | DataflowRunner | 41062.64 | 40400.68
| -1.61 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_streaming | RuntimeMs | DirectRunner | 8446.25 | 8360.0 |
-1.02 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_streaming | RuntimeMs | FlinkRunner | 1213.86 | 1244.45 |
2.52 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_batch | RuntimeMs | DataflowRunner | 22184.43 | 20346.82 | -8.28 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_batch | RuntimeMs | DirectRunner | 3091.0 | 3034.32 | -1.83 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_batch | RuntimeMs | FlinkRunner | 1116.71 | 1112.5 | -0.38 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_batch | RuntimeMs | SparkRunner | 2154.55 | 2096.75 | -2.68 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_sql_batch | RuntimeMs | DataflowRunner | 23424.07 | 22119.73 | -5.57
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_batch | RuntimeMs | DirectRunner | 3405.64 | 3406.41 | 0.02 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_sql_batch | RuntimeMs | SparkRunner | 3626.71 | 3581.52 | -1.25 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 2985.98 |
3235.68 | 8.36 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_sql_streaming | RuntimeMs | DataflowRunner | 31299.57 | 30973.82 |
-1.04 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_streaming | RuntimeMs | DirectRunner | 8698.64 | 8632.09 | -0.77
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_sql_streaming | RuntimeMs | FlinkRunner | 945.64 | 950.05 | 0.47 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_streaming | RuntimeMs | DataflowRunner | 46397.4 | 45035.4 | -2.94 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_streaming | RuntimeMs | DirectRunner | 7893.29 | 7778.18 | -1.46 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_streaming | RuntimeMs | FlinkRunner | 513.86 | 513.09 | -0.15 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_batch | RuntimeMs | DataflowRunner | 56083.57 | 60340.32 |
7.59 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_zetasql_batch | RuntimeMs | DirectRunner | 3848.75 | 3775.45 | -1.9
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_streaming | RuntimeMs | DataflowRunner | 45510.32 | 44730.32
| -1.71 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_zetasql_streaming | RuntimeMs | DirectRunner | 9151.43 | 9122.95 |
-0.31 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_streaming | RuntimeMs | FlinkRunner | 1188.61 | 1178.5 |
-0.85 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_4_batch | RuntimeMs | DataflowRunner | 27955.29 | 27356.18 | -2.14 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_4_batch | RuntimeMs | DirectRunner | 2513.96 | 2506.36 | -0.3 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_4_batch | RuntimeMs | FlinkRunner | 1039.04 | 1049.95 | 1.05 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_4_batch | RuntimeMs | SparkRunner | 1067.82 | 1054.93 | -1.21 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_batch | RuntimeMs | SparkStructuredStreamingRunner | 2270.45 |
2463.52 | 8.5 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_4_streaming | RuntimeMs | DataflowRunner | 49918.79 | 51156.05 | 2.48
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_4_streaming | RuntimeMs | DirectRunner | 2937.79 | 2911.5 | -0.89 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_4_streaming | RuntimeMs | FlinkRunner | 933.64 | 920.18 | -1.44 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_5_batch | RuntimeMs | DataflowRunner | 33065.28 | 32243.36 | -2.49 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_5_batch | RuntimeMs | DirectRunner | 11189.64 | 10955.0 | -2.1 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_5_batch | RuntimeMs | FlinkRunner | 779.54 | 778.05 | -0.19 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_batch | RuntimeMs | SparkRunner | 1557.0 | 1542.93 | -0.9 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_5_batch | RuntimeMs | SparkStructuredStreamingRunner | 1742.04 |
1657.57 | -4.85 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_5_streaming | RuntimeMs | DataflowRunner | 211870.83 | 209246.59 |
-1.24 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_5_streaming | RuntimeMs | DirectRunner | 23745.43 | 24358.95 | 2.58 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_streaming | RuntimeMs | FlinkRunner | 1378.43 | 1387.14 | 0.63 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_batch | RuntimeMs | DataflowRunner | 26534.32 | 25201.59 | -5.02 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_6_batch | RuntimeMs | DirectRunner | 1857.82 | 1856.68 | -0.06 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_6_batch | RuntimeMs | FlinkRunner | 639.89 | 617.36 | -3.52 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_batch | RuntimeMs | SparkRunner | 717.21 | 693.23 | -3.34 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_6_batch | RuntimeMs | SparkStructuredStreamingRunner | 967.18 |
1024.64 | 5.94 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_6_streaming | RuntimeMs | DataflowRunner | 36577.32 | 35005.41 | -4.3
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_streaming | RuntimeMs | DirectRunner | 2207.54 | 2213.05 | 0.25 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_6_streaming | RuntimeMs | FlinkRunner | 585.0 | 577.09 | -1.35 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_batch | RuntimeMs | DataflowRunner | 48366.43 | 45561.91 | -5.8 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_batch | RuntimeMs | DirectRunner | 18929.57 | 18999.27 | 0.37 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_batch | RuntimeMs | FlinkRunner | 655.75 | 671.0 | 2.33 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_batch | RuntimeMs | SparkRunner | 1445.52 | 1434.2 | -0.78 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_batch | RuntimeMs | SparkStructuredStreamingRunner | 2213.05 |
1505.68 | -31.96 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_7_sql_batch | RuntimeMs | DataflowRunner | 72908.04 | 73562.91 | 0.9 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_sql_batch | RuntimeMs | DirectRunner | 773829.79 | 804809.14 | 4.0 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_batch | RuntimeMs | SparkRunner | 7207.11 | 7140.52 | -0.92 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_7_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 5932.3 |
6351.82 | 7.07 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_sql_streaming | RuntimeMs | DataflowRunner | 991782.14 | 1000105.45
| 0.84 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_7_sql_streaming | RuntimeMs | DirectRunner | 4318496.25 | 2816075.77 |
-34.79 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_streaming | RuntimeMs | FlinkRunner | 3553.57 | 3486.86 | -1.88
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_streaming | RuntimeMs | DataflowRunner | 126124.44 | 122137.77 |
-3.16 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_7_streaming | RuntimeMs | DirectRunner | 874804.54 | 872705.82 | -0.24
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_streaming | RuntimeMs | FlinkRunner | 14473.61 | 14509.41 | 0.25 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_batch | RuntimeMs | DataflowRunner | 19976.14 | 18696.91 | -6.4 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_8_batch | RuntimeMs | DirectRunner | 2336.32 | 2469.23 | 5.69 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_8_batch | RuntimeMs | FlinkRunner | 490.79 | 488.86 | -0.39 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_batch | RuntimeMs | SparkRunner | 1452.55 | 1418.84 | -2.32 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_8_batch | RuntimeMs | SparkStructuredStreamingRunner | 1092.21 |
1137.82 | 4.18 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_8_streaming | RuntimeMs | DataflowRunner | 62519.36 | 62711.77 | 0.31
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_8_streaming | RuntimeMs | DirectRunner | 7136.54 | 7275.73 | 1.95 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_streaming | RuntimeMs | FlinkRunner | 495.14 | 480.91 | -2.87 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_9_batch | RuntimeMs | DataflowRunner | 25284.32 | 23270.86 | -7.96 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_9_batch | RuntimeMs | DirectRunner | 1442.07 | 1467.77 | 1.78 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_9_batch | RuntimeMs | FlinkRunner | 363.93 | 353.82 | -2.78 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_9_batch | RuntimeMs | SparkRunner | 563.0 | 554.66 | -1.48 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_9_batch | RuntimeMs | SparkStructuredStreamingRunner | 751.39 | 751.3
| -0.01 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_9_streaming | RuntimeMs | DataflowRunner | 31989.11 | 31392.09 | -1.87
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_9_streaming | RuntimeMs | DirectRunner | 1801.82 | 1819.5 | 0.98 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_9_streaming | RuntimeMs | FlinkRunner | 369.0 | 355.09 | -3.77 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
tpcds_query10_Calcite_1GB | RuntimeMs | DataflowRunner | 346717.41 | 339961.86
| -1.95 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query10_Calcite_1GB | RuntimeMs | FlinkRunner | 32004.89 | 31744.0 |
-0.82 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query10_Calcite_1GB | RuntimeMs | SparkRunner | 36640.86 | 36713.52 |
0.2 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query10_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
46696.14 | 40165.62 | -13.99 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query25_Calcite_1GB | RuntimeMs | DataflowRunner | 319530.78 | 320837.05
| 0.41 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query25_Calcite_1GB | RuntimeMs | FlinkRunner | 5134.33 | 5013.18 |
-2.36 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query25_Calcite_1GB | RuntimeMs | SparkRunner | 4388.89 | 4310.43 |
-1.79 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query25_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
14181.25 | 11119.76 | -21.59 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query26_Calcite_1GB | RuntimeMs | DataflowRunner | 313918.41 | 320913.86
| 2.23 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query26_Calcite_1GB | RuntimeMs | FlinkRunner | 11630.59 | 11913.36 |
2.43 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query26_Calcite_1GB | RuntimeMs | SparkRunner | 13980.57 | 13683.71 |
-2.12 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query26_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
17224.86 | 16442.81 | -4.54 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query29_Calcite_1GB | RuntimeMs | DataflowRunner | 321195.89 | 322385.41
| 0.37 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query29_Calcite_1GB | RuntimeMs | FlinkRunner | 5134.15 | 4719.73 |
-8.07 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query29_Calcite_1GB | RuntimeMs | SparkRunner | 4156.39 | 4297.38 | 3.39
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query29_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
14232.5 | 10429.05 | -26.72 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query35_Calcite_1GB | RuntimeMs | DataflowRunner | 346183.52 | 347812.36
| 0.47 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query35_Calcite_1GB | RuntimeMs | FlinkRunner | 25475.3 | 25528.41 |
0.21 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query35_Calcite_1GB | RuntimeMs | SparkRunner | 28836.21 | 28900.14 |
0.22 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query35_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
37213.36 | 32356.95 | -13.05 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query38_Calcite_1GB | RuntimeMs | DataflowRunner | 327158.81 | 325186.68
| -0.6 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query38_Calcite_1GB | RuntimeMs | FlinkRunner | 6111.26 | 6075.55 |
-0.58 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query38_Calcite_1GB | RuntimeMs | SparkRunner | 6145.71 | 6144.76 |
-0.02 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query38_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner | 0.0 |
0.0 | 0.0 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query3_Calcite_1GB | RuntimeMs | DataflowRunner | 305054.81 | 306552.5 |
0.49 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query3_Calcite_1GB | RuntimeMs | FlinkRunner | 13377.93 | 13175.95 |
-1.51 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query3_Calcite_1GB | RuntimeMs | SparkRunner | 13525.14 | 13588.29 |
0.47 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query3_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
21988.71 | 23296.76 | 5.95 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query40_Calcite_1GB | RuntimeMs | DataflowRunner | 293579.33 | 303832.77
| 3.49 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query40_Calcite_1GB | RuntimeMs | FlinkRunner | 2944.37 | 2976.73 | 1.1
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query40_Calcite_1GB | RuntimeMs | SparkRunner | 3292.14 | 3296.95 | 0.15
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query40_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
6572.39 | 6879.43 | 4.67 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query42_Calcite_1GB | RuntimeMs | DataflowRunner | 296668.67 | 297952.5
| 0.43 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query42_Calcite_1GB | RuntimeMs | FlinkRunner | 2416.96 | 2426.82 | 0.41
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query42_Calcite_1GB | RuntimeMs | SparkRunner | 2707.89 | 2604.67 |
-3.81 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query42_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
4172.39 | 4888.52 | 17.16 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query43_Calcite_1GB | RuntimeMs | DataflowRunner | 300669.04 | 295313.23
| -1.78 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query43_Calcite_1GB | RuntimeMs | FlinkRunner | 2423.89 | 2504.73 | 3.34
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query43_Calcite_1GB | RuntimeMs | SparkRunner | 2497.89 | 2527.86 | 1.2
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query43_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
4127.82 | 4369.81 | 5.86 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query52_Calcite_1GB | RuntimeMs | DataflowRunner | 295043.81 | 300676.5
| 1.91 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query52_Calcite_1GB | RuntimeMs | FlinkRunner | 2507.19 | 2450.05 |
-2.28 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query52_Calcite_1GB | RuntimeMs | SparkRunner | 2603.46 | 2633.29 | 1.15
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query52_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
4178.14 | 4642.86 | 11.12 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query55_Calcite_1GB | RuntimeMs | DataflowRunner | 298537.81 | 300629.55
| 0.7 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query55_Calcite_1GB | RuntimeMs | FlinkRunner | 2583.93 | 2561.55 |
-0.87 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query55_Calcite_1GB | RuntimeMs | SparkRunner | 2318.36 | 2277.81 |
-1.75 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query55_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
4546.29 | 4674.1 | 2.81 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query69_Calcite_1GB | RuntimeMs | DataflowRunner | 350389.0 | 339636.23
| -3.07 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query69_Calcite_1GB | RuntimeMs | FlinkRunner | 26570.22 | 26444.41 |
-0.47 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query69_Calcite_1GB | RuntimeMs | SparkRunner | 30416.82 | 30309.24 |
-0.35 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query69_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
38034.25 | 32306.57 | -15.06 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query79_Calcite_1GB | RuntimeMs | DataflowRunner | 309606.48 | 309834.36
| 0.07 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query79_Calcite_1GB | RuntimeMs | FlinkRunner | 4080.07 | 4039.0 | -1.01
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query79_Calcite_1GB | RuntimeMs | SparkRunner | 4369.68 | 4315.52 |
-1.24 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query79_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
9261.36 | 8061.9 | -12.95 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query7_Calcite_1GB | RuntimeMs | DataflowRunner | 320628.52 | 322280.55
| 0.52 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query7_Calcite_1GB | RuntimeMs | FlinkRunner | 13603.0 | 13639.73 | 0.27
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query7_Calcite_1GB | RuntimeMs | SparkRunner | 17365.46 | 17220.14 |
-0.84 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query7_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
20636.21 | 18694.29 | -9.41 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query83_Calcite_1GB | RuntimeMs | DataflowRunner | 343174.85 | 346690.0
| 1.02 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query83_Calcite_1GB | RuntimeMs | FlinkRunner | 7311.11 | 7146.91 |
-2.25 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query83_Calcite_1GB | RuntimeMs | SparkRunner | 7422.32 | 7210.86 |
-2.85 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query83_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
21832.79 | 19378.86 | -11.24 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query84_Calcite_1GB | RuntimeMs | DataflowRunner | 314422.74 | 320228.0
| 1.85 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query84_Calcite_1GB | RuntimeMs | FlinkRunner | 17717.3 | 17671.27 |
-0.26 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query84_Calcite_1GB | RuntimeMs | SparkRunner | 16885.0 | 16735.86 |
-0.88 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query84_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
18705.54 | 18631.62 | -0.4 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query87_Calcite_1GB | RuntimeMs | DataflowRunner | 322277.93 | 327223.68
| 1.53 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query87_Calcite_1GB | RuntimeMs | FlinkRunner | 5559.89 | 5627.91 | 1.22
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query87_Calcite_1GB | RuntimeMs | SparkRunner | 5578.39 | 5511.81 |
-1.19 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query87_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
13565.82 | 12377.76 | -8.76 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query93_Calcite_1GB | RuntimeMs | DataflowRunner | 300496.0 | 299302.27
| -0.4 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query93_Calcite_1GB | RuntimeMs | FlinkRunner | 2026.85 | 2042.41 | 0.77
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query93_Calcite_1GB | RuntimeMs | SparkRunner | 1937.39 | 1952.62 | 0.79
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query93_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
3635.46 | 3964.95 | 9.06 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query96_Calcite_1GB | RuntimeMs | DataflowRunner | 311647.19 | 310237.95
| -0.45 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query96_Calcite_1GB | RuntimeMs | FlinkRunner | 3142.0 | 3050.59 | -2.91
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query96_Calcite_1GB | RuntimeMs | SparkRunner | 2701.96 | 2735.62 | 1.25
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query96_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
7188.68 | 5799.38 | -19.33 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
Re: Beam Metrics Report (2022-09-27)
Posted by Alexey Romanenko <ar...@gmail.com>.
Just wanted to point out that Nexmark/TPC-DS improvements for Spark Dataset Runner (aka SparkStructuredStreamingRunner), that we can observe here, are caused by the recent work on the runner optimisations [1] (thanks to Moritz Mack for working on this and to Etienne Chauchot for PR reviews).
Also, there are a couple of queries that have degradations in results, so it has to be investigated further.
—
Alexey
[1] https://github.com/apache/beam/issues/22445
> On 27 Sep 2022, at 13:56, Apache Jenkins Server <je...@builds.apache.org> wrote:
>
> Beam Metrics Report
>
> Color legend:
> >= 20 >= 10 <= -10 <= -20
> Possible regression
>
> Measurement Metric Runner Mean previous week Mean last week Diff % Dashboard
> java_batch_cogbk_3 dataflow_v2_java11_runtime_sec - 12.92 14.86 15.04 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_gbk_1 sparkstructuredstreaming_runtime_sec - 507.33 624.47 23.09 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_2 sparkstructuredstreaming_runtime_sec - 106.26 138.08 29.94 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_3 sparkstructuredstreaming_runtime_sec - 8.79 10.48 19.26 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_4 dataflow_runtime_sec - 16.97 21.06 24.1 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_4 sparkstructuredstreaming_runtime_sec - 103.5 119.1 15.07 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_6 dataflow_v2_java17_runtime_sec - 22.95 27.8 21.13 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_7 dataflow_runtime_sec - 45.62 95.42 109.17 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_pardo_1 sparkstructuredstreaming_runtime_sec - 52.59 66.8 27.01 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_2 dataflow_runtime_sec - 180.16 208.46 15.71 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_3 dataflow_v2_java17_runtime_sec - 8.99 10.5 16.8 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_cogbk_3 dataflow_v2_java17_runtime_sec - 323.67 403.29 24.6 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_streaming_cogbk_4 dataflow_v2_java11_runtime_sec - 325.26 397.32 22.15 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_streaming_gbk_5 dataflow_v2_java17_runtime_sec - 608.13 671.4 10.4 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_7 dataflow_v2_java11_runtime_sec - 227.32 266.6 17.28 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_pardo_1 dataflow_v2_java17_runtime_sec - 23.88 26.29 10.08 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_batch_cogbk_1 python_dataflow_batch_cogbk_1_runtime - 393.0 433.0 10.18 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> python_batch_gbk_1 python_dataflow_batch_gbk_1_runtime - 1519.14 1703.8 12.16 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_batch_pardo_3 python_dataflow_batch_pardo_3_runtime - 138.14 173.0 25.23 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_batch_sideinput_5 python_dataflow_batch_sideinput_5_runtime - 2.71 3.0 10.53 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
> python_batch_sideinput_6 python_dataflow_batch_sideinput_6_runtime - 2.14 2.4 12.0 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
> python_direct_microbenchmarks teststream_microbenchmark_runtime_sec - 337.66 387.59 14.78
> python_spannerio_read_2GB_results pyspanner_read_2GB_results_runtime - 21.86 25.22 15.4 [1] <http://metrics.beam.apache.org/d/gP7vMPqZz>
> python_streaming_pardo_2 python_dataflow_streaming_pardo_2_runtime - 2768.86 3053.2 10.27 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> textioit_hdfs_results write_time - 30.96 46.31 49.6 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> wordcount_py37_results runtime - 826.04 913.81 10.63 [1] <http://metrics.beam.apache.org/d/1cnwVDkGk>
> xmlioit_hdfs_results write_time - 24.74 53.53 116.36 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> nexmark_11_batch RuntimeMs SparkStructuredStreamingRunner 1032.05 1135.89 10.06 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_13_sql_batch RuntimeMs DataflowRunner 56133.0 65246.0 16.23 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/8INnSY9Mz>[4] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_1_sql_batch RuntimeMs SparkStructuredStreamingRunner 1674.04 2017.86 20.54 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/8INnSY9Mz>[4] <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_2_batch RuntimeMs FlinkRunner 205.32 227.86 10.98 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/ahudA_zGz>
> tpcds_query42_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 4172.39 4888.52 17.16 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query52_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 4178.14 4642.86 11.12 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> Possible improvement
>
> Measurement Metric Runner Mean previous week Mean last week Diff % Dashboard
> java_batch_combine_4 dataflow_runtime_sec - 30.86 27.3 -11.55 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> java_batch_gbk_3 dataflow_runtime_sec - 10.53 9.09 -13.64 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_6 dataflow_v2_java11_runtime_sec - 28.14 24.16 -14.16 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_7 dataflow_v2_java11_runtime_sec - 37.95 32.43 -14.55 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_pardo_1 dataflow_v2_java17_runtime_sec - 13.6 10.61 -21.98 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_3 dataflow_v2_java11_runtime_sec - 13.01 9.33 -28.26 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_4 dataflow_v2_java11_runtime_sec - 25.54 22.05 -13.66 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_cogbk_3 dataflow_v2_java11_runtime_sec - 368.06 323.64 -12.07 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_streaming_gbk_1 dataflow_v2_java11_runtime_sec - 966.89 798.17 -17.45 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_6 dataflow_v2_java11_runtime_sec - 182.89 158.31 -13.44 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_streaming_pardo_1 python_dataflow_streaming_pardo_1_runtime - 295.57 261.8 -11.43 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> textioit_results read_time - 21.47 18.6 -13.34 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> nexmark_0_batch RuntimeMs SparkStructuredStreamingRunner 1642.8 1440.82 -12.3 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_15_batch RuntimeMs SparkStructuredStreamingRunner 1364.27 1226.41 -10.1 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_2_batch RuntimeMs SparkStructuredStreamingRunner 471.3 379.66 -19.44 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_2_sql_batch RuntimeMs SparkStructuredStreamingRunner 1075.14 949.09 -11.72 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_7_batch RuntimeMs SparkStructuredStreamingRunner 2213.05 1505.68 -31.96 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/ahudA_zGz>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_7_sql_streaming RuntimeMs DirectRunner 4318496.25 2816075.77 -34.79 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> tpcds_query10_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 46696.14 40165.62 -13.99 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3] <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query25_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 14181.25 11119.76 -21.59 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query29_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 14232.5 10429.05 -26.72 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query35_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 37213.36 32356.95 -13.05 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3] <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query69_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 38034.25 32306.57 -15.06 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query79_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 9261.36 8061.9 -12.95 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3] <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query83_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 21832.79 19378.86 -11.24 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query96_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 7188.68 5799.38 -19.33 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3] <http://metrics.beam.apache.org/d/8INnSY9Mq>
> All metrics
>
> Measurement Metric Runner Mean previous week Mean last week Diff % Dashboard
> avroioit_hdfs_results read_time - 91.9 90.13 -1.93 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> avroioit_hdfs_results write_time - 119.52 121.27 1.46 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> avroioit_results read_time - 93.98 90.66 -3.53 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> avroioit_results write_time - 120.51 119.19 -1.09 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> bqio_10GB_results_java_batch_avro avro_write_time - 33.64 34.32 2.01 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> bqio_10GB_results_java_batch_avro read_time - 41.67 39.59 -5.0 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> bqio_10GB_results_java_batch_json read_time - 37.88 38.69 2.14 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> bqio_10GB_results_java_batch_json write_time - 52.32 53.1 1.48 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> cdapioit_results read_time - 5.91 6.41 8.49 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> cdapioit_results write_time - 7.81 7.78 -0.4 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> compressed_textioit_hdfs_results read_time - 135.52 131.15 -3.23 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> compressed_textioit_hdfs_results write_time - 213.54 208.17 -2.51 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> compressed_textioit_results read_time - 139.81 143.39 2.55 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> compressed_textioit_results write_time - 209.06 214.22 2.47 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> go_batch_cogbk_1 dataflow_runtime - 262.88 284.27 8.14 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> go_batch_cogbk_2 dataflow_runtime - 149.39 145.57 -2.56 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> go_batch_cogbk_3 dataflow_runtime - 110.77 108.77 -1.81 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> go_batch_cogbk_4 dataflow_runtime - 110.47 111.33 0.78 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> go_batch_combine_1 dataflow_runtime - 416.04 424.97 2.15 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> go_batch_combine_4 dataflow_runtime - 74.53 74.44 -0.12 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> go_batch_combine_5 dataflow_runtime - 69.26 69.61 0.5 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> go_batch_gbk_1 dataflow_runtime - 392.87 395.7 0.72 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> go_batch_gbk_2 dataflow_runtime - 101.45 104.35 2.86 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> go_batch_gbk_3 dataflow_runtime - 24.49 24.62 0.55 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> go_batch_gbk_4 dataflow_runtime - 53.41 54.35 1.78 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> go_batch_gbk_5 dataflow_runtime - 44.03 42.47 -3.56 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> go_batch_gbk_6 dataflow_runtime - 104.28 103.84 -0.43 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> go_batch_gbk_7 dataflow_runtime - 113.84 124.43 9.3 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> go_batch_pardo_1 dataflow_runtime - 80.92 79.9 -1.26 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> go_batch_pardo_2 dataflow_runtime - 604.86 622.14 2.86 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> go_batch_pardo_3 dataflow_runtime - 65.91 67.58 2.53 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> go_batch_pardo_4 dataflow_runtime - 69.44 69.23 -0.31 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> go_batch_sideinput_3 dataflow_runtime - 2.59 2.35 -9.27 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
> go_batch_sideinput_4 dataflow_runtime - 216.23 231.06 6.86 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
> hadoopformatioit_results read_time - 6.36 6.64 4.3 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> hadoopformatioit_results write_time - 7.71 7.83 1.49 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> java_batch_cogbk_1 dataflow_runtime_sec - 40.64 40.83 0.46 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_1 dataflow_v2_java11_runtime_sec - 47.22 44.64 -5.47 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_1 dataflow_v2_java17_runtime_sec - 44.46 48.5 9.07 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_1 sparkstructuredstreaming_runtime_sec - 127.15 130.14 2.35 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_2 dataflow_runtime_sec - 38.7 41.85 8.14 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_2 dataflow_v2_java11_runtime_sec - 43.15 45.38 5.15 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_2 dataflow_v2_java17_runtime_sec - 46.79 48.47 3.59 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_2 sparkstructuredstreaming_runtime_sec - 119.91 119.58 -0.27 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_3 dataflow_runtime_sec - 14.18 14.32 1.04 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_3 dataflow_v2_java11_runtime_sec - 12.92 14.86 15.04 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_3 dataflow_v2_java17_runtime_sec - 11.36 11.84 4.28 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_3 sparkstructuredstreaming_runtime_sec - 21.63 20.15 -6.83 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_4 dataflow_runtime_sec - 14.64 13.26 -9.39 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_4 dataflow_v2_java11_runtime_sec - 11.75 12.2 3.84 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_4 dataflow_v2_java17_runtime_sec - 12.19 11.4 -6.49 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_4 sparkstructuredstreaming_runtime_sec - 19.99 19.72 -1.34 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_combine_1 dataflow_runtime_sec - 60.89 62.98 3.44 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> java_batch_combine_1 sparkstructuredstreaming_runtime_sec - 525.58 566.56 7.8 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> java_batch_combine_4 dataflow_runtime_sec - 30.86 27.3 -11.55 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> java_batch_combine_4 sparkstructuredstreaming_runtime_sec - 128.9 137.08 6.35 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> java_batch_combine_5 dataflow_runtime_sec - 27.01 26.56 -1.64 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> java_batch_combine_5 sparkstructuredstreaming_runtime_sec - 125.17 130.39 4.17 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> java_batch_gbk_1 dataflow_runtime_sec - 113.49 123.7 8.99 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_1 dataflow_v2_java11_runtime_sec - 85.65 89.1 4.03 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_1 dataflow_v2_java17_runtime_sec - 87.03 88.18 1.33 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_1 sparkstructuredstreaming_runtime_sec - 507.33 624.47 23.09 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_2 dataflow_runtime_sec - 33.78 34.21 1.3 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_2 dataflow_v2_java11_runtime_sec - 44.0 41.95 -4.65 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_2 dataflow_v2_java17_runtime_sec - 41.53 39.26 -5.46 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_2 sparkstructuredstreaming_runtime_sec - 106.26 138.08 29.94 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_3 dataflow_runtime_sec - 10.53 9.09 -13.64 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_3 dataflow_v2_java11_runtime_sec - 13.14 13.22 0.64 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_3 dataflow_v2_java17_runtime_sec - 13.09 12.56 -4.06 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_3 sparkstructuredstreaming_runtime_sec - 8.79 10.48 19.26 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_4 dataflow_runtime_sec - 16.97 21.06 24.1 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_4 dataflow_v2_java11_runtime_sec - 21.26 20.95 -1.47 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_4 dataflow_v2_java17_runtime_sec - 18.72 18.96 1.27 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_4 sparkstructuredstreaming_runtime_sec - 103.5 119.1 15.07 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_5 dataflow_runtime_sec - 17.94 16.46 -8.23 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_5 dataflow_v2_java11_runtime_sec - 18.79 17.99 -4.27 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_5 dataflow_v2_java17_runtime_sec - 17.96 17.16 -4.46 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_5 sparkstructuredstreaming_runtime_sec - 106.44 115.75 8.75 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_6 dataflow_runtime_sec - 34.42 34.72 0.86 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_6 dataflow_v2_java11_runtime_sec - 28.14 24.16 -14.16 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_6 dataflow_v2_java17_runtime_sec - 22.95 27.8 21.13 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_6 sparkstructuredstreaming_runtime_sec - 60.8 65.71 8.08 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_7 dataflow_runtime_sec - 45.62 95.42 109.17 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_7 dataflow_v2_java11_runtime_sec - 37.95 32.43 -14.55 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_7 dataflow_v2_java17_runtime_sec - 32.81 34.49 5.11 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_7 sparkstructuredstreaming_runtime_sec - 85.48 91.44 6.98 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_pardo_1 dataflow_runtime_sec - 19.64 20.52 4.49 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_1 dataflow_v2_java11_runtime_sec - 13.33 12.42 -6.83 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_1 dataflow_v2_java17_runtime_sec - 13.6 10.61 -21.98 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_1 sparkstructuredstreaming_runtime_sec - 52.59 66.8 27.01 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_2 dataflow_runtime_sec - 180.16 208.46 15.71 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_2 dataflow_v2_java11_runtime_sec - 60.95 60.77 -0.3 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_2 dataflow_v2_java17_runtime_sec - 57.96 58.89 1.61 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_3 dataflow_runtime_sec - 12.26 13.13 7.09 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_3 dataflow_v2_java11_runtime_sec - 13.01 9.33 -28.26 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_3 dataflow_v2_java17_runtime_sec - 8.99 10.5 16.8 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_4 dataflow_runtime_sec - 25.29 25.09 -0.83 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_4 dataflow_v2_java11_runtime_sec - 25.54 22.05 -13.66 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_4 dataflow_v2_java17_runtime_sec - 21.69 23.36 7.67 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_cogbk_1 dataflow_runtime_sec - 839.95 842.82 0.34 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_streaming_cogbk_1 dataflow_v2_java11_runtime_sec - 3275.78 2991.61 -8.67 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_streaming_cogbk_1 dataflow_v2_java17_runtime_sec - 2514.37 2589.0 2.97 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_streaming_cogbk_2 dataflow_runtime_sec - 882.07 839.48 -4.83 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_streaming_cogbk_2 dataflow_v2_java11_runtime_sec - 3285.9 2961.88 -9.86 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_streaming_cogbk_2 dataflow_v2_java17_runtime_sec - 3373.79 3244.96 -3.82 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_streaming_cogbk_3 dataflow_runtime_sec - 112.14 116.11 3.54 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_streaming_cogbk_3 dataflow_v2_java11_runtime_sec - 368.06 323.64 -12.07 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_streaming_cogbk_3 dataflow_v2_java17_runtime_sec - 323.67 403.29 24.6 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_streaming_cogbk_4 dataflow_runtime_sec - 111.16 115.64 4.03 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_streaming_cogbk_4 dataflow_v2_java11_runtime_sec - 325.26 397.32 22.15 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_streaming_cogbk_4 dataflow_v2_java17_runtime_sec - 323.49 338.45 4.62 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_streaming_combine_1 dataflow_runtime_sec - 476.04 489.52 2.83 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> java_streaming_combine_4 dataflow_runtime_sec - 308.52 313.61 1.65 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> java_streaming_combine_5 dataflow_runtime_sec - 304.61 309.82 1.71 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> java_streaming_gbk_1 dataflow_runtime_sec - 655.3 639.34 -2.44 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_1 dataflow_v2_java11_runtime_sec - 966.89 798.17 -17.45 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_1 dataflow_v2_java17_runtime_sec - 1107.67 1062.23 -4.1 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_2 dataflow_runtime_sec - 783.91 791.93 1.02 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_2 dataflow_v2_java11_runtime_sec - 2767.67 2874.03 3.84 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_2 dataflow_v2_java17_runtime_sec - 3369.24 3176.43 -5.72 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_3 dataflow_runtime_sec - 23.41 23.32 -0.39 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_3 dataflow_v2_java11_runtime_sec - 75.84 72.65 -4.21 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_3 dataflow_v2_java17_runtime_sec - 59.06 61.13 3.52 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_4 dataflow_runtime_sec - 277.78 271.32 -2.33 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_4 dataflow_v2_java11_runtime_sec - 627.71 684.03 8.97 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_4 dataflow_v2_java17_runtime_sec - 651.63 647.74 -0.6 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_5 dataflow_runtime_sec - 284.96 268.82 -5.66 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_5 dataflow_v2_java11_runtime_sec - 639.15 613.17 -4.07 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_5 dataflow_v2_java17_runtime_sec - 608.13 671.4 10.4 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_6 dataflow_runtime_sec - 74.15 74.67 0.7 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_6 dataflow_v2_java11_runtime_sec - 182.89 158.31 -13.44 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_6 dataflow_v2_java17_runtime_sec - 174.21 182.96 5.02 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_7 dataflow_runtime_sec - 133.83 131.36 -1.84 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_7 dataflow_v2_java11_runtime_sec - 227.32 266.6 17.28 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_7 dataflow_v2_java17_runtime_sec - 229.08 209.52 -8.54 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_pardo_1 dataflow_runtime_sec - 18.77 19.19 2.21 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_pardo_1 dataflow_v2_java11_runtime_sec - 25.79 24.76 -3.99 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_pardo_1 dataflow_v2_java17_runtime_sec - 23.88 26.29 10.08 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_pardo_2 dataflow_runtime_sec - 214.97 209.19 -2.69 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_pardo_2 dataflow_v2_java11_runtime_sec - 114.35 107.53 -5.96 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_pardo_2 dataflow_v2_java17_runtime_sec - 112.33 104.39 -7.06 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_pardo_3 dataflow_runtime_sec - 11.75 12.16 3.41 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_pardo_3 dataflow_v2_java11_runtime_sec - 23.63 21.67 -8.28 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_pardo_3 dataflow_v2_java17_runtime_sec - 20.97 20.63 -1.62 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_pardo_4 dataflow_runtime_sec - 30.88 31.26 1.23 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_pardo_4 dataflow_v2_java11_runtime_sec - 35.69 37.95 6.31 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_pardo_4 dataflow_v2_java17_runtime_sec - 34.87 35.39 1.5 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> jdbcioit_results read_time - 23.73 24.66 3.96 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> jdbcioit_results write_time - 38.77 36.14 -6.78 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> kafkaioit_results read_time - 917.37 924.0 0.72 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> kafkaioit_results write_time - 180.42 179.03 -0.77 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> kafkaioit_results_runner_v2 read_time - 2.57 2.64 2.77 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> kafkaioit_results_runner_v2 write_time - 3.66 4.0 9.39 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> many_files_textioit_hdfs_results read_time - 17.27 17.96 4.01 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> many_files_textioit_hdfs_results write_time - 63.57 62.76 -1.28 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> many_files_textioit_results read_time - 24.47 23.11 -5.55 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> many_files_textioit_results write_time - 62.7 61.76 -1.49 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> mongodbioit_results read_time - 33.62 34.56 2.8 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> mongodbioit_results write_time - 58.28 55.0 -5.62 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> parquetioit_hdfs_results read_time - 88.72 92.88 4.69 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> parquetioit_hdfs_results write_time - 146.54 152.89 4.34 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> parquetioit_results read_time - 90.51 94.12 3.99 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> parquetioit_results write_time - 144.56 145.67 0.77 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> python_batch_cogbk_1 python_dataflow_batch_cogbk_1_runtime - 393.0 433.0 10.18 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> python_batch_cogbk_2 python_dataflow_batch_cogbk_2_runtime - 274.86 276.4 0.56 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> python_batch_cogbk_3 python_dataflow_batch_cogbk_3_runtime - 238.43 243.0 1.92 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> python_batch_cogbk_4 python_dataflow_batch_cogbk_4_runtime - 241.0 251.2 4.23 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> python_batch_combine_1 python_dataflow_batch_combine_1_runtime - 947.14 944.6 -0.27 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> python_batch_combine_4 python_dataflow_batch_combine_4_runtime - 40.0 41.2 3.0 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> python_batch_combine_5 python_dataflow_batch_combine_5_runtime - 28.86 29.8 3.27 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> python_batch_gbk_1 python_dataflow_batch_gbk_1_runtime - 1519.14 1703.8 12.16 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_batch_gbk_2 python_dataflow_batch_gbk_2_runtime - 272.43 294.0 7.92 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_batch_gbk_3 python_dataflow_batch_gbk_3_runtime - 17.71 17.6 -0.65 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_batch_gbk_4 python_dataflow_batch_gbk_4_runtime - 73.71 71.0 -3.68 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_batch_gbk_5 python_dataflow_batch_gbk_5_runtime - 70.0 66.0 -5.71 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_batch_gbk_6 python_dataflow_batch_gbk_6_runtime - 237.0 259.0 9.28 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_batch_gbk_7 python_dataflow_batch_gbk_7_runtime - 272.0 272.4 0.15 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_batch_pardo_1 python_dataflow_batch_pardo_1_runtime - 158.29 172.6 9.04 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_batch_pardo_2 python_dataflow_batch_pardo_2_runtime - 1612.43 1715.8 6.41 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_batch_pardo_3 python_dataflow_batch_pardo_3_runtime - 138.14 173.0 25.23 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_batch_pardo_4 python_dataflow_batch_pardo_4_runtime - 382.71 391.8 2.37 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_batch_sideinput_1 python_dataflow_batch_sideinput_1_runtime - 2.29 2.5 9.38 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
> python_batch_sideinput_10 python_dataflow_batch_sideinput_10_runtime - 762.29 738.2 -3.16 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
> python_batch_sideinput_2 python_dataflow_batch_sideinput_2_runtime - 2.29 2.5 9.38 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
> python_batch_sideinput_3 python_dataflow_batch_sideinput_3_runtime - 3.14 3.4 8.18 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
> python_batch_sideinput_4 python_dataflow_batch_sideinput_4_runtime - 24.43 25.8 5.61 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
> python_batch_sideinput_5 python_dataflow_batch_sideinput_5_runtime - 2.71 3.0 10.53 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
> python_batch_sideinput_6 python_dataflow_batch_sideinput_6_runtime - 2.14 2.4 12.0 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
> python_batch_sideinput_7 python_dataflow_batch_sideinput_7_runtime - 145.43 154.8 6.44 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
> python_batch_sideinput_8 python_dataflow_batch_sideinput_8_runtime - 136.57 127.2 -6.86 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
> python_batch_sideinput_9 python_dataflow_batch_sideinput_9_runtime - 766.0 781.0 1.96 [1] <http://metrics.beam.apache.org/d/-E9aGlFGk>
> python_bqio_read_10GB_results bqio_read_10GB_results_runtime - 101.57 101.8 0.23 [1] <http://metrics.beam.apache.org/d/gP7vMPqZz>
> python_bqio_write_10GB_results bqio_write_10GB_results_runtime - 285.57 292.0 2.25 [1] <http://metrics.beam.apache.org/d/gP7vMPqZz>
> python_direct_microbenchmarks fn_api_runner_microbenchmark_runtime_sec - 94.1 103.27 9.75
> python_direct_microbenchmarks teststream_microbenchmark_runtime_sec - 337.66 387.59 14.78
> python_spanner_write_2GB_results pyspanner_write_2GB_results_runtime - 1712.86 1718.0 0.3 [1] <http://metrics.beam.apache.org/d/gP7vMPqZz>
> python_spannerio_read_2GB_results pyspanner_read_2GB_results_runtime - 21.86 25.22 15.4 [1] <http://metrics.beam.apache.org/d/gP7vMPqZz>
> python_streaming_cogbk_1 python_dataflow_streaming_cogbk_1_runtime - 665.71 665.2 -0.08 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> python_streaming_cogbk_2 python_dataflow_streaming_cogbk_2_runtime - 448.29 467.2 4.22 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> python_streaming_cogbk_3 python_dataflow_streaming_cogbk_3_runtime - 531.71 515.8 -2.99 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> python_streaming_cogbk_4 python_dataflow_streaming_cogbk_4_runtime - 447.57 422.6 -5.58 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> python_streaming_gbk_3 python_dataflow_streaming_gbk_3_runtime - 100.0 90.2 -9.8 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_streaming_gbk_6 python_dataflow_streaming_gbk_6_runtime - 552.14 585.8 6.1 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_streaming_gbk_7 python_dataflow_streaming_gbk_7_runtime - 598.29 583.6 -2.45 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_streaming_pardo_1 python_dataflow_streaming_pardo_1_runtime - 295.57 261.8 -11.43 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_streaming_pardo_2 python_dataflow_streaming_pardo_2_runtime - 2768.86 3053.2 10.27 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_streaming_pardo_3 python_dataflow_streaming_pardo_3_runtime - 213.29 212.0 -0.6 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_streaming_pardo_4 python_dataflow_streaming_pardo_4_runtime - 527.67 507.0 -3.92 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> textioit_hdfs_results read_time - 17.21 17.66 2.64 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> textioit_hdfs_results write_time - 30.96 46.31 49.6 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> textioit_results read_time - 21.47 18.6 -13.34 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> textioit_results write_time - 32.33 31.74 -1.83 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> tfrecordioit_results read_time - 16.49 16.3 -1.16 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> tfrecordioit_results write_time - 21.43 20.35 -5.05 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> wordcount_py37_results runtime - 826.04 913.81 10.63 [1] <http://metrics.beam.apache.org/d/1cnwVDkGk>
> xmlioit_hdfs_results read_time - 21.5 22.24 3.47 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> xmlioit_hdfs_results write_time - 24.74 53.53 116.36 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> xmlioit_results read_time - 23.8 23.91 0.44 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> xmlioit_results write_time - 25.07 23.5 -6.28 [1] <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> nexmark_0_batch RuntimeMs DataflowRunner 26037.05 25470.56 -2.18 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_0_batch RuntimeMs DirectRunner 4605.04 4580.09 -0.54 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/ahudA_zGz>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_0_batch RuntimeMs FlinkRunner 1139.86 1143.59 0.33 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk> [3] <http://metrics.beam.apache.org/d/8INnSY9Mz>[4] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_batch RuntimeMs SparkRunner 1307.43 1300.32 -0.54 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_0_batch RuntimeMs SparkStructuredStreamingRunner 1642.8 1440.82 -12.3 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_0_sql_batch RuntimeMs DataflowRunner 31466.46 30756.27 -2.26 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/8INnSY9Mz>[4] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_sql_batch RuntimeMs DirectRunner 5723.71 5746.59 0.4 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_0_sql_batch RuntimeMs SparkRunner 3265.54 3215.95 -1.52 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_0_sql_batch RuntimeMs SparkStructuredStreamingRunner 2964.32 2931.18 -1.12 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/8INnSY9Mz>[4] <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_0_sql_streaming RuntimeMs DataflowRunner 23026.5 23231.59 0.89 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_0_sql_streaming RuntimeMs DirectRunner 16009.21 16034.95 0.16 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_sql_streaming RuntimeMs FlinkRunner 1716.86 1684.73 -1.87 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_streaming RuntimeMs DataflowRunner 38433.8 38983.34 1.43 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_0_streaming RuntimeMs DirectRunner 12303.89 12329.41 0.21 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_streaming RuntimeMs FlinkRunner 1454.71 1453.18 -0.11 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_zetasql_batch RuntimeMs DataflowRunner 114063.5 117451.45 2.97 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/ahudA_zGz>[4] <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_0_zetasql_batch RuntimeMs DirectRunner 7013.96 6895.64 -1.69 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz> [3] <http://metrics.beam.apache.org/d/ahudA_zGz>[4] <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_0_zetasql_streaming RuntimeMs DataflowRunner 66263.68 67964.36 2.57 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_0_zetasql_streaming RuntimeMs DirectRunner 17668.64 17420.05 -1.41 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_0_zetasql_streaming RuntimeMs FlinkRunner 3380.86 3358.91 -0.65 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_10_batch RuntimeMs DataflowRunner 45302.54 44725.69 -1.27 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/8INnSY9Mz>[4] <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_10_batch RuntimeMs DirectRunner 10735.11 10713.27 -0.2 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/8INnSY9Mz>[4] <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_10_batch RuntimeMs FlinkRunner 580.21 584.59 0.75 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/ahudA_zGz>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_10_batch RuntimeMs SparkRunner 730.18 715.18 -2.05 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk> [3] <http://metrics.beam.apache.org/d/ahudA_zGz>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_10_batch RuntimeMs SparkStructuredStreamingRunner 1054.0 1026.95 -2.57 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/8INnSY9Mz>[4] <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_10_streaming RuntimeMs DataflowRunner 108528.73 107464.2 -0.98 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_10_streaming RuntimeMs DirectRunner 44185.89 44429.5 0.55 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_10_streaming RuntimeMs FlinkRunner 1375.14 1387.64 0.91 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_11_batch RuntimeMs DataflowRunner 37764.11 36826.12 -2.48 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk>[4] <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_11_batch RuntimeMs DirectRunner 3995.07 3990.32 -0.12 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk>[4] <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_11_batch RuntimeMs FlinkRunner 278.71 267.45 -4.04 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/ahudA_zGz>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_11_batch RuntimeMs SparkRunner 1411.45 1406.18 -0.37 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/8INnSY9Mz>[4] <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_11_batch RuntimeMs SparkStructuredStreamingRunner 1032.05 1135.89 10.06 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_11_streaming RuntimeMs DataflowRunner 185461.97 184138.86 -0.71 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_11_streaming RuntimeMs DirectRunner 10889.61 10946.23 0.52 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_11_streaming RuntimeMs FlinkRunner 1354.36 1323.95 -2.24 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_12_batch RuntimeMs DataflowRunner 17932.41 16726.01 -6.73 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_12_batch RuntimeMs DirectRunner 2779.14 2825.86 1.68 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_12_batch RuntimeMs FlinkRunner 169.11 177.36 4.88 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz> [3] <http://metrics.beam.apache.org/d/ahudA_zGz>[4] <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_12_batch RuntimeMs SparkRunner 906.36 895.2 -1.23 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk> [3] <http://metrics.beam.apache.org/d/ahudA_zGz>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_12_batch RuntimeMs SparkStructuredStreamingRunner 848.93 840.48 -1.0 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_12_streaming RuntimeMs DataflowRunner 95582.01 96221.23 0.67 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_12_streaming RuntimeMs DirectRunner 9387.71 9418.5 0.33 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_12_streaming RuntimeMs FlinkRunner 619.68 616.77 -0.47 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_13_batch RuntimeMs DataflowRunner 31260.18 30456.05 -2.57 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_13_batch RuntimeMs DirectRunner 3243.82 3170.77 -2.25 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_13_batch RuntimeMs FlinkRunner 390.21 371.14 -4.89 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/8INnSY9Mz>[4] <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_13_batch RuntimeMs SparkRunner 353.45 349.41 -1.14 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_13_batch RuntimeMs SparkStructuredStreamingRunner 536.21 484.68 -9.61 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk>[4] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_13_sql_batch RuntimeMs DataflowRunner 56133.0 65246.0 16.23 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/8INnSY9Mz>[4] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_13_sql_batch RuntimeMs DirectRunner 9132.14 9094.82 -0.41 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz> [3] <http://metrics.beam.apache.org/d/ahudA_zGz>[4] <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_13_sql_batch RuntimeMs SparkRunner 3445.98 3406.2 -1.15 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_13_sql_batch RuntimeMs SparkStructuredStreamingRunner 3070.43 3200.43 4.23 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk>[4] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_13_sql_streaming RuntimeMs DataflowRunner 34032.14 35492.68 4.29 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_13_sql_streaming RuntimeMs DirectRunner 19241.79 19065.95 -0.91 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_13_sql_streaming RuntimeMs FlinkRunner 34410.54 37459.77 8.86 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_13_streaming RuntimeMs DataflowRunner 25115.86 25643.27 2.1 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_13_streaming RuntimeMs DirectRunner 10145.32 10219.0 0.73 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_13_streaming RuntimeMs FlinkRunner 35817.04 36109.5 0.82 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_13_zetasql_batch RuntimeMs DataflowRunner 251775.96 269855.82 7.18 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_13_zetasql_batch RuntimeMs DirectRunner 10359.04 10428.18 0.67 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_13_zetasql_streaming RuntimeMs DataflowRunner 109012.86 112655.91 3.34 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_13_zetasql_streaming RuntimeMs DirectRunner 21346.71 21243.77 -0.48 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_13_zetasql_streaming RuntimeMs FlinkRunner 39799.39 39602.32 -0.5 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_14_batch RuntimeMs DataflowRunner 59111.86 57979.14 -1.92 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk>[4] <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_14_batch RuntimeMs DirectRunner 4255.54 4220.59 -0.82 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk> [3] <http://metrics.beam.apache.org/d/ahudA_zGz>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_14_batch RuntimeMs FlinkRunner 457.07 473.18 3.52 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/8INnSY9Mz>[4] <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_14_batch RuntimeMs SparkRunner 907.23 903.2 -0.44 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_14_batch RuntimeMs SparkStructuredStreamingRunner 924.68 996.34 7.75 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_14_streaming RuntimeMs DataflowRunner 123986.39 122911.59 -0.87 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_14_streaming RuntimeMs DirectRunner 12297.29 12418.18 0.98 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_14_streaming RuntimeMs FlinkRunner 1846.71 1803.77 -2.33 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_15_batch RuntimeMs DataflowRunner 43370.77 43089.08 -0.65 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk> [3] <http://metrics.beam.apache.org/d/8INnSY9Mz>[4] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_15_batch RuntimeMs DirectRunner 16713.61 16446.05 -1.6 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_15_batch RuntimeMs FlinkRunner 430.32 417.64 -2.95 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz> [3] <http://metrics.beam.apache.org/d/ahudA_zGz>[4] <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_15_batch RuntimeMs SparkRunner 1600.59 1586.8 -0.86 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/ahudA_zGz>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_15_batch RuntimeMs SparkStructuredStreamingRunner 1364.27 1226.41 -10.1 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_16_batch RuntimeMs DataflowRunner 49213.76 48617.6 -1.21 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/8INnSY9Mz>[4] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_16_batch RuntimeMs DirectRunner 87897.07 87689.68 -0.24 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_16_batch RuntimeMs FlinkRunner 230.54 223.91 -2.87 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz> [3] <http://metrics.beam.apache.org/d/ahudA_zGz>[4] <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_16_batch RuntimeMs SparkRunner 1315.91 1287.09 -2.19 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_16_batch RuntimeMs SparkStructuredStreamingRunner 1216.73 1299.61 6.81 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk> [3] <http://metrics.beam.apache.org/d/ahudA_zGz>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_16_streaming RuntimeMs DataflowRunner 92179.31 98360.98 6.71 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_16_streaming RuntimeMs DirectRunner 146340.29 136424.0 -6.78 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_16_streaming RuntimeMs FlinkRunner 427.39 427.68 0.07 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_1_batch RuntimeMs DataflowRunner 20543.86 19595.99 -4.61 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk> [3] <http://metrics.beam.apache.org/d/ahudA_zGz>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_1_batch RuntimeMs DirectRunner 3150.29 3246.95 3.07 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_1_batch RuntimeMs FlinkRunner 330.43 334.09 1.11 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/8INnSY9Mz>[4] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_1_batch RuntimeMs SparkRunner 456.7 455.7 -0.22 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_1_batch RuntimeMs SparkStructuredStreamingRunner 609.43 553.14 -9.24 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk> [3] <http://metrics.beam.apache.org/d/ahudA_zGz>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_1_sql_batch RuntimeMs DataflowRunner 27980.5 27691.23 -1.03 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk>[4] <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_1_sql_batch RuntimeMs DirectRunner 3632.14 3662.32 0.83 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/ahudA_zGz>[4] <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_1_sql_batch RuntimeMs SparkRunner 2449.09 2402.75 -1.89 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk>[4] <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_1_sql_batch RuntimeMs SparkStructuredStreamingRunner 1674.04 2017.86 20.54 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/8INnSY9Mz>[4] <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_1_sql_streaming RuntimeMs DataflowRunner 20655.61 19520.23 -5.5 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_1_sql_streaming RuntimeMs DirectRunner 11710.25 11656.09 -0.46 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_1_sql_streaming RuntimeMs FlinkRunner 714.07 692.27 -3.05 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_1_streaming RuntimeMs DataflowRunner 28455.91 28770.44 1.11 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_1_streaming RuntimeMs DirectRunner 8298.36 8235.64 -0.76 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_1_streaming RuntimeMs FlinkRunner 657.14 655.77 -0.21 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_2_batch RuntimeMs DataflowRunner 14090.08 13071.39 -7.23 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_2_batch RuntimeMs DirectRunner 1350.04 1366.95 1.25 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/8INnSY9Mz>[4] <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_2_batch RuntimeMs FlinkRunner 205.32 227.86 10.98 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_2_batch RuntimeMs SparkRunner 312.12 306.39 -1.84 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk> [3] <http://metrics.beam.apache.org/d/8INnSY9Mz>[4] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_2_batch RuntimeMs SparkStructuredStreamingRunner 471.3 379.66 -19.44 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_2_sql_batch RuntimeMs DataflowRunner 20078.54 18795.27 -6.39 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_2_sql_batch RuntimeMs DirectRunner 1579.75 1569.5 -0.65 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/ahudA_zGz>[4] <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_2_sql_batch RuntimeMs SparkRunner 774.7 775.93 0.16 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk> [3] <http://metrics.beam.apache.org/d/ahudA_zGz>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_2_sql_batch RuntimeMs SparkStructuredStreamingRunner 1075.14 949.09 -11.72 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_2_sql_streaming RuntimeMs DataflowRunner 13744.21 13478.09 -1.94 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_2_sql_streaming RuntimeMs DirectRunner 6926.79 6941.36 0.21 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_2_sql_streaming RuntimeMs FlinkRunner 387.32 378.36 -2.31 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_2_streaming RuntimeMs DataflowRunner 19205.46 18862.59 -1.79 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_2_streaming RuntimeMs DirectRunner 5250.18 5247.64 -0.05 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_2_streaming RuntimeMs FlinkRunner 275.96 269.82 -2.23 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_2_zetasql_batch RuntimeMs DataflowRunner 70472.86 72753.59 3.24 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_2_zetasql_batch RuntimeMs DirectRunner 2905.64 2816.27 -3.08 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_2_zetasql_streaming RuntimeMs DataflowRunner 41062.64 40400.68 -1.61 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_2_zetasql_streaming RuntimeMs DirectRunner 8446.25 8360.0 -1.02 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_2_zetasql_streaming RuntimeMs FlinkRunner 1213.86 1244.45 2.52 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_batch RuntimeMs DataflowRunner 22184.43 20346.82 -8.28 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk> [3] <http://metrics.beam.apache.org/d/ahudA_zGz>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_3_batch RuntimeMs DirectRunner 3091.0 3034.32 -1.83 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_batch RuntimeMs FlinkRunner 1116.71 1112.5 -0.38 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_batch RuntimeMs SparkRunner 2154.55 2096.75 -2.68 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_3_sql_batch RuntimeMs DataflowRunner 23424.07 22119.73 -5.57 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk>[4] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_sql_batch RuntimeMs DirectRunner 3405.64 3406.41 0.02 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/ahudA_zGz>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_3_sql_batch RuntimeMs SparkRunner 3626.71 3581.52 -1.25 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_sql_batch RuntimeMs SparkStructuredStreamingRunner 2985.98 3235.68 8.36 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_3_sql_streaming RuntimeMs DataflowRunner 31299.57 30973.82 -1.04 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_sql_streaming RuntimeMs DirectRunner 8698.64 8632.09 -0.77 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_3_sql_streaming RuntimeMs FlinkRunner 945.64 950.05 0.47 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_streaming RuntimeMs DataflowRunner 46397.4 45035.4 -2.94 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_3_streaming RuntimeMs DirectRunner 7893.29 7778.18 -1.46 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_streaming RuntimeMs FlinkRunner 513.86 513.09 -0.15 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_zetasql_batch RuntimeMs DataflowRunner 56083.57 60340.32 7.59 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/8INnSY9Mz>[4] <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_3_zetasql_batch RuntimeMs DirectRunner 3848.75 3775.45 -1.9 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk>[4] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_zetasql_streaming RuntimeMs DataflowRunner 45510.32 44730.32 -1.71 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_3_zetasql_streaming RuntimeMs DirectRunner 9151.43 9122.95 -0.31 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_zetasql_streaming RuntimeMs FlinkRunner 1188.61 1178.5 -0.85 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_4_batch RuntimeMs DataflowRunner 27955.29 27356.18 -2.14 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk> [3] <http://metrics.beam.apache.org/d/ahudA_zGz>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_4_batch RuntimeMs DirectRunner 2513.96 2506.36 -0.3 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_4_batch RuntimeMs FlinkRunner 1039.04 1049.95 1.05 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/ahudA_zGz>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_4_batch RuntimeMs SparkRunner 1067.82 1054.93 -1.21 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk> [3] <http://metrics.beam.apache.org/d/8INnSY9Mz>[4] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_4_batch RuntimeMs SparkStructuredStreamingRunner 2270.45 2463.52 8.5 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_4_streaming RuntimeMs DataflowRunner 49918.79 51156.05 2.48 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_4_streaming RuntimeMs DirectRunner 2937.79 2911.5 -0.89 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_4_streaming RuntimeMs FlinkRunner 933.64 920.18 -1.44 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_5_batch RuntimeMs DataflowRunner 33065.28 32243.36 -2.49 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/8INnSY9Mz>[4] <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_5_batch RuntimeMs DirectRunner 11189.64 10955.0 -2.1 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_5_batch RuntimeMs FlinkRunner 779.54 778.05 -0.19 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/8INnSY9Mz>[4] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_5_batch RuntimeMs SparkRunner 1557.0 1542.93 -0.9 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/ahudA_zGz>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_5_batch RuntimeMs SparkStructuredStreamingRunner 1742.04 1657.57 -4.85 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/8INnSY9Mz>[4] <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_5_streaming RuntimeMs DataflowRunner 211870.83 209246.59 -1.24 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_5_streaming RuntimeMs DirectRunner 23745.43 24358.95 2.58 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_5_streaming RuntimeMs FlinkRunner 1378.43 1387.14 0.63 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_6_batch RuntimeMs DataflowRunner 26534.32 25201.59 -5.02 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/8INnSY9Mz>[4] <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_6_batch RuntimeMs DirectRunner 1857.82 1856.68 -0.06 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_6_batch RuntimeMs FlinkRunner 639.89 617.36 -3.52 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_6_batch RuntimeMs SparkRunner 717.21 693.23 -3.34 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_6_batch RuntimeMs SparkStructuredStreamingRunner 967.18 1024.64 5.94 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk> [3] <http://metrics.beam.apache.org/d/ahudA_zGz>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_6_streaming RuntimeMs DataflowRunner 36577.32 35005.41 -4.3 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_6_streaming RuntimeMs DirectRunner 2207.54 2213.05 0.25 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_6_streaming RuntimeMs FlinkRunner 585.0 577.09 -1.35 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_7_batch RuntimeMs DataflowRunner 48366.43 45561.91 -5.8 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/8INnSY9Mz>[4] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_7_batch RuntimeMs DirectRunner 18929.57 18999.27 0.37 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk>[4] <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_7_batch RuntimeMs FlinkRunner 655.75 671.0 2.33 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk> [3] <http://metrics.beam.apache.org/d/8INnSY9Mz>[4] <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_7_batch RuntimeMs SparkRunner 1445.52 1434.2 -0.78 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz> [3] <http://metrics.beam.apache.org/d/ahudA_zGz>[4] <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_7_batch RuntimeMs SparkStructuredStreamingRunner 2213.05 1505.68 -31.96 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/ahudA_zGz>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_7_sql_batch RuntimeMs DataflowRunner 72908.04 73562.91 0.9 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_7_sql_batch RuntimeMs DirectRunner 773829.79 804809.14 4.0 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_7_sql_batch RuntimeMs SparkRunner 7207.11 7140.52 -0.92 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/ahudA_zGz>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_7_sql_batch RuntimeMs SparkStructuredStreamingRunner 5932.3 6351.82 7.07 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/ahudA_zGz>[4] <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_7_sql_streaming RuntimeMs DataflowRunner 991782.14 1000105.45 0.84 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_7_sql_streaming RuntimeMs DirectRunner 4318496.25 2816075.77 -34.79 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_7_sql_streaming RuntimeMs FlinkRunner 3553.57 3486.86 -1.88 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_7_streaming RuntimeMs DataflowRunner 126124.44 122137.77 -3.16 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_7_streaming RuntimeMs DirectRunner 874804.54 872705.82 -0.24 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_7_streaming RuntimeMs FlinkRunner 14473.61 14509.41 0.25 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_8_batch RuntimeMs DataflowRunner 19976.14 18696.91 -6.4 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/ahudA_zGz>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_8_batch RuntimeMs DirectRunner 2336.32 2469.23 5.69 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_8_batch RuntimeMs FlinkRunner 490.79 488.86 -0.39 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk> [3] <http://metrics.beam.apache.org/d/8INnSY9Mz>[4] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_8_batch RuntimeMs SparkRunner 1452.55 1418.84 -2.32 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_8_batch RuntimeMs SparkStructuredStreamingRunner 1092.21 1137.82 4.18 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_8_streaming RuntimeMs DataflowRunner 62519.36 62711.77 0.31 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_8_streaming RuntimeMs DirectRunner 7136.54 7275.73 1.95 [1] <http://metrics.beam.apache.org/d/8INnSY9Mz> [2] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_8_streaming RuntimeMs FlinkRunner 495.14 480.91 -2.87 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_9_batch RuntimeMs DataflowRunner 25284.32 23270.86 -7.96 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/8INnSY9Mz>[4] <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_9_batch RuntimeMs DirectRunner 1442.07 1467.77 1.78 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2] <http://metrics.beam.apache.org/d/ahudA_zGz> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_9_batch RuntimeMs FlinkRunner 363.93 353.82 -2.78 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk>[4] <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_9_batch RuntimeMs SparkRunner 563.0 554.66 -1.48 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk> [3] <http://metrics.beam.apache.org/d/f0Q6T0dGk>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_9_batch RuntimeMs SparkStructuredStreamingRunner 751.39 751.3 -0.01 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk> [3] <http://metrics.beam.apache.org/d/ahudA_zGz>[4] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_9_streaming RuntimeMs DataflowRunner 31989.11 31392.09 -1.87 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_9_streaming RuntimeMs DirectRunner 1801.82 1819.5 0.98 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> nexmark_9_streaming RuntimeMs FlinkRunner 369.0 355.09 -3.77 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2] <http://metrics.beam.apache.org/d/8INnSY9Mz>
> tpcds_query10_Calcite_1GB RuntimeMs DataflowRunner 346717.41 339961.86 -1.95 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query10_Calcite_1GB RuntimeMs FlinkRunner 32004.89 31744.0 -0.82 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query10_Calcite_1GB RuntimeMs SparkRunner 36640.86 36713.52 0.2 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query10_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 46696.14 40165.62 -13.99 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3] <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query25_Calcite_1GB RuntimeMs DataflowRunner 319530.78 320837.05 0.41 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query25_Calcite_1GB RuntimeMs FlinkRunner 5134.33 5013.18 -2.36 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3] <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query25_Calcite_1GB RuntimeMs SparkRunner 4388.89 4310.43 -1.79 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query25_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 14181.25 11119.76 -21.59 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query26_Calcite_1GB RuntimeMs DataflowRunner 313918.41 320913.86 2.23 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query26_Calcite_1GB RuntimeMs FlinkRunner 11630.59 11913.36 2.43 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query26_Calcite_1GB RuntimeMs SparkRunner 13980.57 13683.71 -2.12 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query26_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 17224.86 16442.81 -4.54 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query29_Calcite_1GB RuntimeMs DataflowRunner 321195.89 322385.41 0.37 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3] <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query29_Calcite_1GB RuntimeMs FlinkRunner 5134.15 4719.73 -8.07 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query29_Calcite_1GB RuntimeMs SparkRunner 4156.39 4297.38 3.39 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query29_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 14232.5 10429.05 -26.72 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query35_Calcite_1GB RuntimeMs DataflowRunner 346183.52 347812.36 0.47 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query35_Calcite_1GB RuntimeMs FlinkRunner 25475.3 25528.41 0.21 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query35_Calcite_1GB RuntimeMs SparkRunner 28836.21 28900.14 0.22 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query35_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 37213.36 32356.95 -13.05 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3] <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query38_Calcite_1GB RuntimeMs DataflowRunner 327158.81 325186.68 -0.6 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query38_Calcite_1GB RuntimeMs FlinkRunner 6111.26 6075.55 -0.58 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query38_Calcite_1GB RuntimeMs SparkRunner 6145.71 6144.76 -0.02 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query38_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 0.0 0.0 0.0 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3] <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query3_Calcite_1GB RuntimeMs DataflowRunner 305054.81 306552.5 0.49 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3] <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query3_Calcite_1GB RuntimeMs FlinkRunner 13377.93 13175.95 -1.51 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query3_Calcite_1GB RuntimeMs SparkRunner 13525.14 13588.29 0.47 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query3_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 21988.71 23296.76 5.95 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query40_Calcite_1GB RuntimeMs DataflowRunner 293579.33 303832.77 3.49 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query40_Calcite_1GB RuntimeMs FlinkRunner 2944.37 2976.73 1.1 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query40_Calcite_1GB RuntimeMs SparkRunner 3292.14 3296.95 0.15 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query40_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 6572.39 6879.43 4.67 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3] <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query42_Calcite_1GB RuntimeMs DataflowRunner 296668.67 297952.5 0.43 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3] <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query42_Calcite_1GB RuntimeMs FlinkRunner 2416.96 2426.82 0.41 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query42_Calcite_1GB RuntimeMs SparkRunner 2707.89 2604.67 -3.81 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query42_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 4172.39 4888.52 17.16 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query43_Calcite_1GB RuntimeMs DataflowRunner 300669.04 295313.23 -1.78 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3] <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query43_Calcite_1GB RuntimeMs FlinkRunner 2423.89 2504.73 3.34 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query43_Calcite_1GB RuntimeMs SparkRunner 2497.89 2527.86 1.2 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query43_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 4127.82 4369.81 5.86 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query52_Calcite_1GB RuntimeMs DataflowRunner 295043.81 300676.5 1.91 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3] <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query52_Calcite_1GB RuntimeMs FlinkRunner 2507.19 2450.05 -2.28 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query52_Calcite_1GB RuntimeMs SparkRunner 2603.46 2633.29 1.15 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query52_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 4178.14 4642.86 11.12 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query55_Calcite_1GB RuntimeMs DataflowRunner 298537.81 300629.55 0.7 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query55_Calcite_1GB RuntimeMs FlinkRunner 2583.93 2561.55 -0.87 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query55_Calcite_1GB RuntimeMs SparkRunner 2318.36 2277.81 -1.75 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query55_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 4546.29 4674.1 2.81 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query69_Calcite_1GB RuntimeMs DataflowRunner 350389.0 339636.23 -3.07 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query69_Calcite_1GB RuntimeMs FlinkRunner 26570.22 26444.41 -0.47 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query69_Calcite_1GB RuntimeMs SparkRunner 30416.82 30309.24 -0.35 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query69_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 38034.25 32306.57 -15.06 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query79_Calcite_1GB RuntimeMs DataflowRunner 309606.48 309834.36 0.07 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query79_Calcite_1GB RuntimeMs FlinkRunner 4080.07 4039.0 -1.01 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query79_Calcite_1GB RuntimeMs SparkRunner 4369.68 4315.52 -1.24 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query79_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 9261.36 8061.9 -12.95 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3] <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query7_Calcite_1GB RuntimeMs DataflowRunner 320628.52 322280.55 0.52 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query7_Calcite_1GB RuntimeMs FlinkRunner 13603.0 13639.73 0.27 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query7_Calcite_1GB RuntimeMs SparkRunner 17365.46 17220.14 -0.84 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query7_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 20636.21 18694.29 -9.41 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query83_Calcite_1GB RuntimeMs DataflowRunner 343174.85 346690.0 1.02 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3] <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query83_Calcite_1GB RuntimeMs FlinkRunner 7311.11 7146.91 -2.25 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query83_Calcite_1GB RuntimeMs SparkRunner 7422.32 7210.86 -2.85 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query83_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 21832.79 19378.86 -11.24 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query84_Calcite_1GB RuntimeMs DataflowRunner 314422.74 320228.0 1.85 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query84_Calcite_1GB RuntimeMs FlinkRunner 17717.3 17671.27 -0.26 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query84_Calcite_1GB RuntimeMs SparkRunner 16885.0 16735.86 -0.88 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query84_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 18705.54 18631.62 -0.4 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query87_Calcite_1GB RuntimeMs DataflowRunner 322277.93 327223.68 1.53 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3] <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query87_Calcite_1GB RuntimeMs FlinkRunner 5559.89 5627.91 1.22 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query87_Calcite_1GB RuntimeMs SparkRunner 5578.39 5511.81 -1.19 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query87_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 13565.82 12377.76 -8.76 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query93_Calcite_1GB RuntimeMs DataflowRunner 300496.0 299302.27 -0.4 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3] <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query93_Calcite_1GB RuntimeMs FlinkRunner 2026.85 2042.41 0.77 [1] <http://metrics.beam.apache.org/d/8INnSY9Mq> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query93_Calcite_1GB RuntimeMs SparkRunner 1937.39 1952.62 0.79 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query93_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 3635.46 3964.95 9.06 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3] <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query96_Calcite_1GB RuntimeMs DataflowRunner 311647.19 310237.95 -0.45 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mv> [3] <http://metrics.beam.apache.org/d/8INnSY9Mq>
> tpcds_query96_Calcite_1GB RuntimeMs FlinkRunner 3142.0 3050.59 -2.91 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/tkqc0AdGk2>
> tpcds_query96_Calcite_1GB RuntimeMs SparkRunner 2701.96 2735.62 1.25 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [2] <http://metrics.beam.apache.org/d/8INnSY9Mq> [3] <http://metrics.beam.apache.org/d/8INnSY9Mv>
> tpcds_query96_Calcite_1GB RuntimeMs SparkStructuredStreamingRunner 7188.68 5799.38 -19.33 [1] <http://metrics.beam.apache.org/d/8INnSY9Mv> [2] <http://metrics.beam.apache.org/d/tkqc0AdGk2> [3] <http://metrics.beam.apache.org/d/8INnSY9Mq>