You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@beam.apache.org by be...@gmail.com on 2024/10/15 11:03:26 UTC
Beam Metrics Report 2024-10-15
# Beam Metrics Report
Color legend: >= 20 | >= 10 | <= -10 | <= -20
---|---|---|---
## Possible regression
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
bqio_10GB_results_java_stream | read_time | - | 41.71 | 53.42 | 28.08 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
cdapioit_results | read_time | - | 17.71 | 19.68 | 11.14 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
go_batch_cogbk_4 | dataflow_runtime | - | 106.56 | 118.07 | 10.81 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_gbk_3 | dataflow_runtime | - | 18.25 | 21.17 | 16.05 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_cogbk_2 | dataflow_v2_java11_runtime_sec | - | 50.91 | 62.4 | 22.57
| [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_gbk_2 | dataflow_v2_java11_runtime_sec | - | 31.92 | 42.58 | 33.42
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | dataflow_v2_java17_runtime_sec | - | 35.74 | 39.62 | 10.85
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_v2_java11_runtime_sec | - | 13.52 | 16.36 | 20.96
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_v2_java17_runtime_sec | - | 13.12 | 16.09 | 22.68
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | dataflow_v2_java17_runtime_sec | - | 22.32 | 31.05 | 39.16
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | dataflow_runtime_sec | - | 35.73 | 42.92 | 20.1 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | dataflow_v2_java11_runtime_sec | - | 23.66 | 30.84 | 30.33
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | sparkstructuredstreaming_runtime_sec | - | 38.25 | 42.61 |
11.41 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | dataflow_runtime_sec | - | 45.48 | 50.59 | 11.22 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_pardo_3 | dataflow_runtime_sec | - | 17.28 | 19.61 | 13.5 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | dataflow_v2_java11_runtime_sec | - | 11.49 | 16.39 |
42.68 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | dataflow_v2_java17_runtime_sec | - | 11.94 | 16.72 |
40.08 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_4 | dataflow_v2_java11_runtime_sec | - | 23.62 | 32.99 |
39.68 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_4 | dataflow_v2_java17_runtime_sec | - | 23.19 | 31.07 |
33.98 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_gbk_1 | dataflow_v2_java11_runtime_sec | - | 420.92 | 596.41 |
41.69 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_3 | dataflow_v2_java11_runtime_sec | - | 42.67 | 91.3 |
113.98 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_6 | dataflow_runtime_sec | - | 79.8 | 92.95 | 16.47 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_pardo_1 | dataflow_v2_java17_runtime_sec | - | 25.22 | 29.21 |
15.83 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_3 | dataflow_runtime_sec | - | 14.54 | 16.96 | 16.67 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_cogbk_1 | python_flink_batch_cogbk_1_runtime | - | 3532.57 |
4034.2 | 14.2 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_gbk_3 | python_dataflow_batch_gbk_3_runtime | - | 11.86 | 17.2 |
45.06 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_5 | python_dataflow_batch_gbk_5_runtime | - | 52.71 | 66.4 |
25.96 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_7 | python_dataflow_batch_gbk_7_runtime | - | 130.57 | 147.8
| 13.19 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_pardo_1 | python_dataflow_batch_pardo_1_runtime | - | 103.29 |
116.8 | 13.08 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_3 | python_dataflow_batch_pardo_3_runtime | - | 88.71 |
110.2 | 24.22 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_sideinput_1 | python_dataflow_batch_sideinput_1_runtime | - |
2.43 | 3.0 | 23.53 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_streaming_pardo_1 | python_dataflow_streaming_pardo_1_runtime | - |
128.71 | 183.0 | 42.18 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
textioit_hdfs_results | write_time | - | 31.37 | 35.7 | 13.8 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
tfrecordioit_results | write_time | - | 25.07 | 29.24 | 16.63 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
nexmark_0_sql_batch | RuntimeMs | FlinkRunner | 2092.93 | 2513.05 | 20.07 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_sql_streaming | RuntimeMs | FlinkRunner | 3880.07 | 4520.68 | 16.51
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_10_batch | RuntimeMs | SparkRunner | 1096.97 | 1233.23 | 12.42 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_11_batch | RuntimeMs | SparkRunner | 1656.9 | 1866.05 | 12.62 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_12_batch | RuntimeMs | SparkRunner | 1130.86 | 1245.36 | 10.13 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_12_streaming | RuntimeMs | FlinkRunner | 950.1 | 1181.05 | 24.31 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_batch | RuntimeMs | SparkRunner | 417.14 | 477.32 | 14.43 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_sql_batch | RuntimeMs | DirectRunner | 13644.34 | 16005.5 | 17.31 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1967.9 |
2447.64 | 24.38 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_streaming | RuntimeMs | FlinkRunner | 2716.93 | 3261.41 | 20.04 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_batch | RuntimeMs | DirectRunner | 7690.32 | 8764.32 | 13.97 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_14_streaming | RuntimeMs | FlinkRunner | 2317.86 | 3059.68 | 32.0 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_16_batch | RuntimeMs | SparkRunner | 2180.38 | 2632.09 | 20.72 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_16_streaming | RuntimeMs | FlinkRunner | 747.45 | 947.64 | 26.78 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_sql_batch | RuntimeMs | DirectRunner | 7782.1 | 9583.14 | 23.14 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_sql_batch | RuntimeMs | FlinkRunner | 813.17 | 937.18 | 15.25 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_sql_batch | RuntimeMs | DirectRunner | 3591.21 | 4625.73 | 28.81 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_sql_batch | RuntimeMs | FlinkRunner | 382.34 | 485.59 | 27.0 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 808.48 |
931.82 | 15.26 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_zetasql_batch | RuntimeMs | FlinkRunner | 1653.34 | 1920.73 | 16.17
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_zetasql_batch | RuntimeMs | SparkRunner | 1499.03 | 1682.23 | 12.22
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_3_batch | RuntimeMs | SparkRunner | 2903.79 | 3234.95 | 11.4 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_sql_batch | RuntimeMs | DirectRunner | 6725.72 | 8107.86 | 20.55 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_3_sql_batch | RuntimeMs | FlinkRunner | 1572.76 | 1780.86 | 13.23 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_3_sql_streaming | RuntimeMs | DirectRunner | 21689.56 | 25918.61 |
19.5 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_5_batch | RuntimeMs | FlinkRunner | 1809.21 | 2035.09 | 12.49 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_5_streaming | RuntimeMs | FlinkRunner | 2689.55 | 3038.82 | 12.99 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_6_batch | RuntimeMs | SparkRunner | 947.31 | 1114.55 | 17.65 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 8835.62 |
9810.05 | 11.03 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_streaming | RuntimeMs | FlinkRunner | 1787.52 | 1976.77 | 10.59 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_8_batch | RuntimeMs | DirectRunner | 5815.21 | 6711.5 | 15.41 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_8_batch | RuntimeMs | SparkRunner | 1638.17 | 1855.5 | 13.27 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_9_streaming | RuntimeMs | FlinkRunner | 421.76 | 509.64 | 20.84 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
tpcds_query79_Calcite_1GB | RuntimeMs | FlinkRunner | 27408.55 | 30380.0 |
10.84 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
## Possible improvement
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
java_batch_cogbk_3 | dataflow_v2_java17_runtime_sec | - | 20.39 | 17.23 |
-15.5 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | dataflow_v2_java11_runtime_sec | - | 21.59 | 18.91 |
-12.4 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | dataflow_v2_java17_runtime_sec | - | 18.73 | 15.48 |
-17.35 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | sparkstructuredstreaming_runtime_sec | - | 16.45 | 13.93
| -15.3 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_combine_2 | sparkstructuredstreaming_runtime_sec | - | 71.14 |
51.63 | -27.42 |
java_batch_combine_3 | dataflow_runtime_sec | - | 42.48 | 31.52 | -25.81 |
java_batch_gbk_2 | dataflow_runtime_sec | - | 45.05 | 39.07 | -13.27 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | sparkstructuredstreaming_runtime_sec | - | 69.92 | 61.6 |
-11.91 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_runtime_sec | - | 14.41 | 12.37 | -14.14 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | sparkstructuredstreaming_runtime_sec | - | 16.07 | 11.93 |
-25.73 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | sparkstructuredstreaming_runtime_sec | - | 56.63 | 49.37 |
-12.81 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_pardo_1 | sparkstructuredstreaming_runtime_sec | - | 21.13 | 14.33
| -32.17 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_2 | sparkstructuredstreaming_runtime_sec | - | 75.08 | 53.34
| -28.96 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | sparkstructuredstreaming_runtime_sec | - | 18.46 | 13.48
| -26.96 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_cogbk_2 | dataflow_runtime_sec | - | 882.68 | 787.42 | -10.79 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_combine_3 | dataflow_runtime_sec | - | 267.91 | 240.7 | -10.16
|
java_streaming_gbk_2 | dataflow_v2_java11_runtime_sec | - | 2568.89 | 2221.36
| -13.53 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_2 | dataflow_v2_java17_runtime_sec | - | 2473.09 | 2052.51
| -17.01 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_6 | dataflow_v2_java11_runtime_sec | - | 73.64 | 65.22 |
-11.44 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_7 | dataflow_runtime_sec | - | 139.25 | 121.5 | -12.75 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_7 | dataflow_v2_java11_runtime_sec | - | 168.76 | 90.55 |
-46.35 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_7 | dataflow_v2_java17_runtime_sec | - | 114.17 | 93.66 |
-17.96 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_pardo_2 | dataflow_v2_java17_runtime_sec | - | 112.46 | 96.68 |
-14.03 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
null_directread_pushdown | read_time | - | 10.57 | 9.49 | -10.31 |
python_batch_combine_1 | python_flink_batch_combine_1_runtime | - | 2548.57 |
2155.4 | -15.43 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_2 | python_dataflow_batch_combine_2_runtime | - | 24.71 |
19.0 | -23.12 |
python_batch_combine_4 | python_flink_batch_combine_4_runtime | - | 123.71 |
94.2 | -23.86 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_5 | python_flink_batch_combine_5_runtime | - | 125.71 |
109.8 | -12.66 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_pardo_1 | python_flink_batch_pardo_1_runtime | - | 571.86 | 460.8
| -19.42 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_4 | python_flink_batch_pardo_4_runtime | - | 2046.93 |
1662.6 | -18.78 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_sideinput_3 | python_dataflow_batch_sideinput_3_runtime | - |
3.57 | 3.0 | -16.0 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_8 | python_dataflow_batch_sideinput_8_runtime | - |
130.57 | 112.2 | -14.07 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_direct_microbenchmarks | fn_api_runner_microbenchmark_runtime_sec | - |
484.25 | 407.35 | -15.88 |
python_direct_microbenchmarks | teststream_microbenchmark_runtime_sec | - |
325.06 | 289.91 | -10.81 |
python_psio_2GB_results | pubsub_io_perf_read_runtime | - | 87.86 | 73.8 |
-16.0 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_psio_2GB_results | pubsub_io_perf_write_runtime | - | 115.71 | 95.83 |
-17.18 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_streaming_cogbk_1 | python_dataflow_streaming_cogbk_1_runtime | - |
377.0 | 328.8 | -12.79 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_pardo_1 | python_flink_streaming_pardo_5_runtime | - | 300.14
| 254.6 | -15.17 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_2 | python_flink_streaming_pardo_2_runtime | - |
10034.14 | 7829.0 | -21.98 | [[1]](http://metrics.beam.apache.org/d/MOi-
kf3Zk)
python_streaming_pardo_3 | python_flink_streaming_pardo_3_runtime | - | 399.29
| 333.8 | -16.4 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_4 | python_flink_streaming_pardo_4_runtime | - |
1012.86 | 711.0 | -29.8 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_6 | python_flink_streaming_pardo_6_runtime | - | 490.86
| 381.8 | -22.22 |
nexmark_11_batch | RuntimeMs | SparkStructuredStreamingRunner | 1696.9 |
1471.36 | -13.29 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_batch | RuntimeMs | SparkStructuredStreamingRunner | 1327.52 |
1066.64 | -19.65 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_batch | RuntimeMs | SparkStructuredStreamingRunner | 2215.34 |
1360.86 | -38.57 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_streaming | RuntimeMs | DirectRunner | 29074.46 | 25353.57 | -12.8
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_batch | RuntimeMs | SparkStructuredStreamingRunner | 1409.62 |
1185.5 | -15.9 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_14_streaming | RuntimeMs | DirectRunner | 29373.46 | 24969.33 | -14.99
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_15_batch | RuntimeMs | SparkRunner | 1492.38 | 1192.36 | -20.1 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_16_batch | RuntimeMs | SparkStructuredStreamingRunner | 956.66 | 806.0
| -15.75 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_batch | RuntimeMs | SparkStructuredStreamingRunner | 392.97 | 338.41
| -13.88 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_sql_streaming | RuntimeMs | DataflowRunner | 21769.0 | 15576.11 |
-28.45 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_4_batch | RuntimeMs | SparkStructuredStreamingRunner | 4263.62 |
3833.23 | -10.09 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_4_streaming | RuntimeMs | DirectRunner | 5588.32 | 4956.38 | -11.31 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_batch | RuntimeMs | SparkStructuredStreamingRunner | 2174.52 |
1946.36 | -10.49 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_6_streaming | RuntimeMs | DirectRunner | 5076.75 | 4471.38 | -11.92 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_7_batch | RuntimeMs | SparkStructuredStreamingRunner | 1813.34 |
1590.91 | -12.27 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_sql_batch | RuntimeMs | DirectRunner | 1062470.28 | 903973.5 |
-14.92 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_sql_batch | RuntimeMs | SparkRunner | 13160.34 | 11478.86 | -12.78 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_8_batch | RuntimeMs | SparkStructuredStreamingRunner | 1983.97 |
1717.18 | -13.45 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
tpcds_query10_Calcite_1GB | RuntimeMs | SparkRunner | 57290.86 | 48870.41 |
-14.7 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query38_Calcite_1GB | RuntimeMs | SparkRunner | 24055.03 | 21595.73 |
-10.22 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query52_Calcite_1GB | RuntimeMs | SparkRunner | 20975.76 | 17927.86 |
-14.53 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query55_Calcite_1GB | RuntimeMs | SparkRunner | 21455.1 | 19203.32 |
-10.5 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query69_Calcite_1GB | RuntimeMs | SparkRunner | 52230.69 | 43363.14 |
-16.98 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query79_Calcite_1GB | RuntimeMs | SparkRunner | 37559.62 | 33439.18 |
-10.97 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query7_Calcite_1GB | RuntimeMs | SparkRunner | 42889.48 | 36249.5 |
-15.48 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query84_Calcite_1GB | RuntimeMs | SparkRunner | 16711.97 | 14865.59 |
-11.05 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
## All metrics
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
avroioit_hdfs_results | read_time | - | 99.49 | 97.32 | -2.18 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_hdfs_results | write_time | - | 150.01 | 142.89 | -4.75 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_results | read_time | - | 104.31 | 102.11 | -2.11 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_results | write_time | - | 148.95 | 143.06 | -3.96 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_avro | avro_write_time | - | 34.03 | 34.59 | 1.66
| [[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_avro | read_time | - | 40.28 | 41.75 | 3.65 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_json | read_time | - | 42.1 | 42.83 | 1.74 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_json | write_time | - | 56.99 | 59.23 | 3.94 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_stream | read_time | - | 41.71 | 53.42 | 28.08 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_stream | write_time | - | 222.63 | 230.53 | 3.55 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
cdapioit_results | read_time | - | 17.71 | 19.68 | 11.14 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
cdapioit_results | write_time | - | 27.59 | 26.72 | -3.15 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
cloudml_benchmark_cirteo_no_shuffle_10GB | runtime_sec | - | 2482.17 | 2402.81
| -3.2 | [[1]](http://metrics.beam.apache.org/d/C9nj1oxVk)
cloudml_benchmark_criteo_10GB | runtime_sec | - | 2362.96 | 2397.01 | 1.44 |
[[1]](http://metrics.beam.apache.org/d/C9nj1oxVk)
cloudml_benchmark_criteo_small | runtime_sec | - | 955.01 | 955.22 | 0.02 |
compressed_textioit_hdfs_results | read_time | - | 152.77 | 150.71 | -1.35 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_hdfs_results | write_time | - | 262.2 | 257.05 | -1.96 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_results | read_time | - | 156.62 | 162.28 | 3.61 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_results | write_time | - | 257.79 | 256.78 | -0.39 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
go_batch_cogbk_1 | dataflow_runtime | - | 222.09 | 219.49 | -1.17 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_cogbk_2 | dataflow_runtime | - | 136.62 | 141.08 | 3.27 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_cogbk_3 | dataflow_runtime | - | 108.87 | 117.05 | 7.52 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_cogbk_4 | dataflow_runtime | - | 106.56 | 118.07 | 10.81 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_combine_1 | dataflow_runtime | - | 447.52 | 444.32 | -0.71 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
go_batch_combine_2 | dataflow_runtime | - | 68.3 | 72.21 | 5.72 |
go_batch_combine_3 | dataflow_runtime | - | 64.71 | 66.15 | 2.22 |
go_batch_gbk_1 | dataflow_runtime | - | 404.04 | 395.18 | -2.19 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_2 | dataflow_runtime | - | 97.48 | 98.02 | 0.55 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_3 | dataflow_runtime | - | 18.25 | 21.17 | 16.05 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_4 | dataflow_runtime | - | 48.8 | 47.49 | -2.68 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_5 | dataflow_runtime | - | 40.77 | 37.27 | -8.57 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_6 | dataflow_runtime | - | 96.25 | 100.36 | 4.28 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_7 | dataflow_runtime | - | 100.87 | 100.4 | -0.46 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_pardo_1 | dataflow_runtime | - | 84.89 | 86.15 | 1.48 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_1 | flink_runtime | - | 386.29 | 375.6 | -2.77 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_2 | dataflow_runtime | - | 683.2 | 703.78 | 3.01 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_2 | flink_runtime | - | 3163.49 | 2971.78 | -6.06 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_3 | dataflow_runtime | - | 66.6 | 64.93 | -2.49 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_3 | flink_runtime | - | 272.15 | 274.5 | 0.86 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_4 | dataflow_runtime | - | 69.27 | 68.26 | -1.46 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_4 | flink_runtime | - | 308.18 | 311.4 | 1.05 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_sideinput_1 | dataflow_runtime | - | 3.02 | 3.11 | 2.9 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
go_batch_sideinput_2 | dataflow_runtime | - | 241.45 | 263.12 | 8.98 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
hadoopformatioit_results | read_time | - | 16.3 | 17.35 | 6.49 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
hadoopformatioit_results | write_time | - | 27.74 | 26.51 | -4.44 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
java_batch_cogbk_1 | dataflow_runtime_sec | - | 46.72 | 49.5 | 5.97 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_1 | dataflow_v2_java11_runtime_sec | - | 43.26 | 46.62 | 7.76
| [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_1 | dataflow_v2_java17_runtime_sec | - | 44.22 | 46.21 | 4.5
| [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_1 | sparkstructuredstreaming_runtime_sec | - | 70.24 | 68.83
| -2.01 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | dataflow_runtime_sec | - | 45.62 | 45.31 | -0.68 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | dataflow_v2_java11_runtime_sec | - | 50.91 | 62.4 | 22.57
| [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | dataflow_v2_java17_runtime_sec | - | 46.4 | 48.55 | 4.64
| [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | sparkstructuredstreaming_runtime_sec | - | 64.96 | 61.18
| -5.82 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | dataflow_runtime_sec | - | 17.09 | 17.35 | 1.51 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | dataflow_v2_java11_runtime_sec | - | 21.2 | 19.8 | -6.58
| [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | dataflow_v2_java17_runtime_sec | - | 20.39 | 17.23 |
-15.5 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | sparkstructuredstreaming_runtime_sec | - | 16.08 | 14.53
| -9.65 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | dataflow_runtime_sec | - | 19.88 | 19.05 | -4.16 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | dataflow_v2_java11_runtime_sec | - | 21.59 | 18.91 |
-12.4 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | dataflow_v2_java17_runtime_sec | - | 18.73 | 15.48 |
-17.35 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | sparkstructuredstreaming_runtime_sec | - | 16.45 | 13.93
| -15.3 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_combine_1 | dataflow_runtime_sec | - | 72.7 | 76.61 | 5.38 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_1 | sparkstructuredstreaming_runtime_sec | - | 221.57 |
224.94 | 1.52 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_2 | dataflow_runtime_sec | - | 31.79 | 29.4 | -7.49 |
java_batch_combine_2 | sparkstructuredstreaming_runtime_sec | - | 71.14 |
51.63 | -27.42 |
java_batch_combine_3 | dataflow_runtime_sec | - | 42.48 | 31.52 | -25.81 |
java_batch_combine_3 | sparkstructuredstreaming_runtime_sec | - | 55.62 |
53.66 | -3.53 |
java_batch_gbk_1 | dataflow_runtime_sec | - | 137.99 | 135.15 | -2.06 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_1 | dataflow_v2_java11_runtime_sec | - | 89.2 | 88.09 | -1.25 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_1 | dataflow_v2_java17_runtime_sec | - | 81.27 | 88.42 | 8.8 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_1 | sparkstructuredstreaming_runtime_sec | - | 230.5 | 252.79 |
9.67 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | dataflow_runtime_sec | - | 45.05 | 39.07 | -13.27 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | dataflow_v2_java11_runtime_sec | - | 31.92 | 42.58 | 33.42
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | dataflow_v2_java17_runtime_sec | - | 35.74 | 39.62 | 10.85
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | sparkstructuredstreaming_runtime_sec | - | 69.92 | 61.6 |
-11.91 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_runtime_sec | - | 14.41 | 12.37 | -14.14 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_v2_java11_runtime_sec | - | 13.52 | 16.36 | 20.96
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_v2_java17_runtime_sec | - | 13.12 | 16.09 | 22.68
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | sparkstructuredstreaming_runtime_sec | - | 16.07 | 11.93 |
-25.73 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | dataflow_runtime_sec | - | 24.87 | 26.3 | 5.73 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | dataflow_v2_java11_runtime_sec | - | 19.35 | 19.92 | 2.92 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | dataflow_v2_java17_runtime_sec | - | 22.32 | 31.05 | 39.16
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | sparkstructuredstreaming_runtime_sec | - | 56.63 | 49.37 |
-12.81 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | dataflow_runtime_sec | - | 26.51 | 24.12 | -9.02 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | dataflow_v2_java11_runtime_sec | - | 17.69 | 19.21 | 8.59 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | dataflow_v2_java17_runtime_sec | - | 20.34 | 20.52 | 0.89 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | sparkstructuredstreaming_runtime_sec | - | 48.35 | 51.36 |
6.22 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | dataflow_runtime_sec | - | 35.73 | 42.92 | 20.1 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | dataflow_v2_java11_runtime_sec | - | 23.66 | 30.84 | 30.33
| [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | dataflow_v2_java17_runtime_sec | - | 24.39 | 25.81 | 5.83 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | sparkstructuredstreaming_runtime_sec | - | 38.25 | 42.61 |
11.41 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | dataflow_runtime_sec | - | 45.48 | 50.59 | 11.22 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | dataflow_v2_java11_runtime_sec | - | 33.45 | 36.04 | 7.73 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | dataflow_v2_java17_runtime_sec | - | 31.18 | 33.34 | 6.93 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | sparkstructuredstreaming_runtime_sec | - | 43.21 | 46.75 |
8.2 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_pardo_1 | dataflow_runtime_sec | - | 24.54 | 26.42 | 7.69 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_1 | dataflow_v2_java11_runtime_sec | - | 14.31 | 15.49 | 8.25
| [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_1 | dataflow_v2_java17_runtime_sec | - | 15.28 | 15.16 |
-0.79 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_1 | sparkstructuredstreaming_runtime_sec | - | 21.13 | 14.33
| -32.17 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_2 | dataflow_runtime_sec | - | 239.24 | 242.39 | 1.32 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_2 | dataflow_v2_java11_runtime_sec | - | 66.87 | 63.79 | -4.6
| [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_2 | dataflow_v2_java17_runtime_sec | - | 66.53 | 60.65 |
-8.84 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_2 | sparkstructuredstreaming_runtime_sec | - | 75.08 | 53.34
| -28.96 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | dataflow_runtime_sec | - | 17.28 | 19.61 | 13.5 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | dataflow_v2_java11_runtime_sec | - | 11.49 | 16.39 |
42.68 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | dataflow_v2_java17_runtime_sec | - | 11.94 | 16.72 |
40.08 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | sparkstructuredstreaming_runtime_sec | - | 18.46 | 13.48
| -26.96 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_4 | dataflow_runtime_sec | - | 29.74 | 31.93 | 7.36 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_4 | dataflow_v2_java11_runtime_sec | - | 23.62 | 32.99 |
39.68 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_4 | dataflow_v2_java17_runtime_sec | - | 23.19 | 31.07 |
33.98 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_4 | sparkstructuredstreaming_runtime_sec | - | 47.87 | 43.33
| -9.5 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_cogbk_1 | dataflow_runtime_sec | - | 822.03 | 790.33 | -3.86 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_1 | dataflow_v2_java11_runtime_sec | - | 836.51 | 805.56
| -3.7 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_1 | dataflow_v2_java17_runtime_sec | - | 833.72 | 770.02
| -7.64 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_2 | dataflow_runtime_sec | - | 882.68 | 787.42 | -10.79 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_2 | dataflow_v2_java11_runtime_sec | - | 818.42 | 769.45
| -5.98 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_2 | dataflow_v2_java17_runtime_sec | - | 800.96 | 763.89
| -4.63 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_3 | dataflow_runtime_sec | - | 117.69 | 116.16 | -1.3 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_3 | dataflow_v2_java11_runtime_sec | - | 114.04 | 112.05
| -1.74 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_3 | dataflow_v2_java17_runtime_sec | - | 114.36 | 112.42
| -1.69 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_4 | dataflow_runtime_sec | - | 112.05 | 110.88 | -1.04 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_4 | dataflow_v2_java11_runtime_sec | - | 116.31 | 112.37
| -3.39 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_4 | dataflow_v2_java17_runtime_sec | - | 118.56 | 117.05
| -1.27 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_combine_1 | dataflow_runtime_sec | - | 495.81 | 507.32 | 2.32 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_combine_2 | dataflow_runtime_sec | - | 269.45 | 243.33 | -9.69
|
java_streaming_combine_3 | dataflow_runtime_sec | - | 267.91 | 240.7 | -10.16
|
java_streaming_gbk_1 | dataflow_runtime_sec | - | 700.39 | 697.53 | -0.41 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_1 | dataflow_v2_java11_runtime_sec | - | 420.92 | 596.41 |
41.69 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_1 | dataflow_v2_java17_runtime_sec | - | 342.22 | 354.39 |
3.55 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_2 | dataflow_runtime_sec | - | 718.4 | 712.68 | -0.8 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_2 | dataflow_v2_java11_runtime_sec | - | 2568.89 | 2221.36
| -13.53 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_2 | dataflow_v2_java17_runtime_sec | - | 2473.09 | 2052.51
| -17.01 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_3 | dataflow_runtime_sec | - | 28.53 | 30.82 | 8.01 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_3 | dataflow_v2_java11_runtime_sec | - | 42.67 | 91.3 |
113.98 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_3 | dataflow_v2_java17_runtime_sec | - | 43.73 | 43.48 |
-0.57 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_4 | dataflow_runtime_sec | - | 251.11 | 257.67 | 2.61 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_4 | dataflow_v2_java11_runtime_sec | - | 554.68 | 609.67 |
9.91 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_4 | dataflow_v2_java17_runtime_sec | - | 560.99 | 561.75 |
0.14 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_5 | dataflow_runtime_sec | - | 267.03 | 261.08 | -2.23 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_5 | dataflow_v2_java11_runtime_sec | - | 483.35 | 491.95 |
1.78 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_5 | dataflow_v2_java17_runtime_sec | - | 473.32 | 511.89 |
8.15 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_6 | dataflow_runtime_sec | - | 79.8 | 92.95 | 16.47 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_6 | dataflow_v2_java11_runtime_sec | - | 73.64 | 65.22 |
-11.44 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_6 | dataflow_v2_java17_runtime_sec | - | 67.11 | 71.11 |
5.97 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_7 | dataflow_runtime_sec | - | 139.25 | 121.5 | -12.75 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_7 | dataflow_v2_java11_runtime_sec | - | 168.76 | 90.55 |
-46.35 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_7 | dataflow_v2_java17_runtime_sec | - | 114.17 | 93.66 |
-17.96 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_pardo_1 | dataflow_runtime_sec | - | 30.38 | 28.47 | -6.3 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_1 | dataflow_v2_java11_runtime_sec | - | 25.36 | 25.2 |
-0.64 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_1 | dataflow_v2_java17_runtime_sec | - | 25.22 | 29.21 |
15.83 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_2 | dataflow_runtime_sec | - | 316.42 | 321.73 | 1.68 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_2 | dataflow_v2_java11_runtime_sec | - | 107.8 | 97.25 |
-9.79 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_2 | dataflow_v2_java17_runtime_sec | - | 112.46 | 96.68 |
-14.03 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_3 | dataflow_runtime_sec | - | 14.54 | 16.96 | 16.67 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_3 | dataflow_v2_java11_runtime_sec | - | 26.15 | 27.12 |
3.73 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_3 | dataflow_v2_java17_runtime_sec | - | 21.48 | 23.37 |
8.79 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_4 | dataflow_runtime_sec | - | 33.35 | 34.89 | 4.63 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_4 | dataflow_v2_java11_runtime_sec | - | 42.95 | 42.78 |
-0.4 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_4 | dataflow_v2_java17_runtime_sec | - | 39.91 | 39.78 |
-0.33 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
jdbcioit_results | read_time | - | 26.71 | 26.46 | -0.91 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
jdbcioit_results | write_time | - | 39.37 | 41.1 | 4.39 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_hdfs_results | read_time | - | 14.58 | 15.36 | 5.41 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_hdfs_results | write_time | - | 70.19 | 67.85 | -3.33 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_results | read_time | - | 23.85 | 23.12 | -3.05 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_results | write_time | - | 63.71 | 59.93 | -5.93 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
ml_transform_large_movie_review_dataset_process_metrics | runtime_sec | - |
1316.6 | 1296.45 | -1.53 |
mongodbioit_results | read_time | - | 30.66 | 31.32 | 2.15 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
mongodbioit_results | write_time | - | 53.72 | 52.43 | -2.4 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
null_default | read_time | - | 59.02 | 57.66 | -2.31 |
null_directread | read_time | - | 51.33 | 51.15 | -0.35 |
null_directread_pushdown | read_time | - | 10.57 | 9.49 | -10.31 |
parquetioit_hdfs_results | read_time | - | 94.08 | 96.03 | 2.07 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_hdfs_results | write_time | - | 158.36 | 164.7 | 4.0 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_results | read_time | - | 99.0 | 102.41 | 3.45 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_results | write_time | - | 157.73 | 162.01 | 2.71 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
python_batch_cogbk_1 | python_dataflow_batch_cogbk_1_runtime | - | 244.71 |
255.2 | 4.28 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_1 | python_flink_batch_cogbk_1_runtime | - | 3532.57 |
4034.2 | 14.2 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_2 | python_dataflow_batch_cogbk_2_runtime | - | 128.86 |
122.2 | -5.17 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_2 | python_flink_batch_cogbk_2_runtime | - | 3647.64 |
3983.0 | 9.19 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_3 | python_dataflow_batch_cogbk_3_runtime | - | 112.14 |
122.0 | 8.79 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_4 | python_dataflow_batch_cogbk_4_runtime | - | 115.29 |
114.8 | -0.42 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_combine_1 | python_dataflow_batch_combine_1_runtime | - | 435.43
| 414.8 | -4.74 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_1 | python_flink_batch_combine_1_runtime | - | 2548.57 |
2155.4 | -15.43 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_2 | python_dataflow_batch_combine_2_runtime | - | 24.71 |
19.0 | -23.12 |
python_batch_combine_3 | python_dataflow_batch_combine_3_runtime | - | 21.43 |
19.8 | -7.6 |
python_batch_combine_4 | python_flink_batch_combine_4_runtime | - | 123.71 |
94.2 | -23.86 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_5 | python_flink_batch_combine_5_runtime | - | 125.71 |
109.8 | -12.66 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_gbk_1 | python_dataflow_batch_gbk_1_runtime | - | 958.29 | 948.8
| -0.99 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_2 | python_dataflow_batch_gbk_2_runtime | - | 193.43 | 199.4
| 3.09 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_3 | python_dataflow_batch_gbk_3_runtime | - | 11.86 | 17.2 |
45.06 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_4 | python_dataflow_batch_gbk_4_runtime | - | 72.43 | 69.8 |
-3.63 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_5 | python_dataflow_batch_gbk_5_runtime | - | 52.71 | 66.4 |
25.96 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_6 | python_dataflow_batch_gbk_6_runtime | - | 117.29 | 125.4
| 6.92 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_7 | python_dataflow_batch_gbk_7_runtime | - | 130.57 | 147.8
| 13.19 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_pardo_1 | python_dataflow_batch_pardo_1_runtime | - | 103.29 |
116.8 | 13.08 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_1 | python_flink_batch_pardo_1_runtime | - | 571.86 | 460.8
| -19.42 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_2 | python_dataflow_batch_pardo_2_runtime | - | 1258.71 |
1202.2 | -4.49 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_3 | python_dataflow_batch_pardo_3_runtime | - | 88.71 |
110.2 | 24.22 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_4 | python_dataflow_batch_pardo_4_runtime | - | 258.43 |
260.8 | 0.92 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_4 | python_flink_batch_pardo_4_runtime | - | 2046.93 |
1662.6 | -18.78 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_sideinput_1 | python_dataflow_batch_sideinput_1_runtime | - |
2.43 | 3.0 | 23.53 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_10 | python_dataflow_batch_sideinput_10_runtime | - |
789.86 | 727.0 | -7.96 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_2 | python_dataflow_batch_sideinput_2_runtime | - |
2.57 | 2.6 | 1.11 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_3 | python_dataflow_batch_sideinput_3_runtime | - |
3.57 | 3.0 | -16.0 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_4 | python_dataflow_batch_sideinput_4_runtime | - |
29.29 | 28.8 | -1.66 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_5 | python_dataflow_batch_sideinput_5_runtime | - |
2.57 | 2.6 | 1.11 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_6 | python_dataflow_batch_sideinput_6_runtime | - |
2.57 | 2.6 | 1.11 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_7 | python_dataflow_batch_sideinput_7_runtime | - |
117.86 | 108.2 | -8.19 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_8 | python_dataflow_batch_sideinput_8_runtime | - |
130.57 | 112.2 | -14.07 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_9 | python_dataflow_batch_sideinput_9_runtime | - |
818.14 | 780.6 | -4.59 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_bqio_read_10GB_results | bqio_read_10GB_results_runtime | - | 95.29 |
98.33 | 3.2 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_bqio_write_10GB_results | bqio_write_10GB_results_runtime | - | 204.86
| 205.0 | 0.07 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_direct_microbenchmarks | fn_api_runner_microbenchmark_runtime_sec | - |
484.25 | 407.35 | -15.88 |
python_direct_microbenchmarks | teststream_microbenchmark_runtime_sec | - |
325.06 | 289.91 | -10.81 |
python_psio_2GB_results | pubsub_io_perf_read_runtime | - | 87.86 | 73.8 |
-16.0 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_psio_2GB_results | pubsub_io_perf_write_runtime | - | 115.71 | 95.83 |
-17.18 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_spanner_write_2GB_results | pyspanner_write_2GB_results_runtime | - |
1207.14 | 1153.0 | -4.49 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_spannerio_read_2GB_results | pyspanner_read_2GB_results_runtime | - |
19.43 | 20.33 | 4.66 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_streaming_cogbk_1 | python_dataflow_streaming_cogbk_1_runtime | - |
377.0 | 328.8 | -12.79 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_2 | python_dataflow_streaming_cogbk_2_runtime | - |
141.86 | 136.6 | -3.71 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_3 | python_dataflow_streaming_cogbk_3_runtime | - |
186.71 | 183.4 | -1.78 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_4 | python_dataflow_streaming_cogbk_4_runtime | - |
126.29 | 120.4 | -4.66 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_combine_1 | python_dataflow_streaming_combine_1_runtime | - |
6802.86 | 6694.67 | -1.59 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_streaming_combine_4 | python_dataflow_streaming_combine_4_runtime | - |
1485.86 | 1536.5 | 3.41 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_streaming_combine_5 | python_dataflow_streaming_combine_5_runtime | - |
783.86 | 791.33 | 0.95 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_streaming_gbk_3 | python_dataflow_streaming_gbk_3_runtime | - | 48.71 |
47.4 | -2.7 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_gbk_6 | python_dataflow_streaming_gbk_6_runtime | - | 261.43
| 269.0 | 2.9 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_gbk_7 | python_dataflow_streaming_gbk_7_runtime | - | 317.0 |
288.6 | -8.96 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_pardo_1 | python_dataflow_streaming_pardo_1_runtime | - |
128.71 | 183.0 | 42.18 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_1 | python_flink_streaming_pardo_5_runtime | - | 300.14
| 254.6 | -15.17 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_2 | python_dataflow_streaming_pardo_2_runtime | - |
2392.0 | 2254.6 | -5.74 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_2 | python_flink_streaming_pardo_2_runtime | - |
10034.14 | 7829.0 | -21.98 | [[1]](http://metrics.beam.apache.org/d/MOi-
kf3Zk)
python_streaming_pardo_3 | python_dataflow_streaming_pardo_3_runtime | - |
111.0 | 117.2 | 5.59 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_3 | python_flink_streaming_pardo_3_runtime | - | 399.29
| 333.8 | -16.4 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_4 | python_dataflow_streaming_pardo_4_runtime | - |
1392.14 | 1433.8 | 2.99 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_4 | python_flink_streaming_pardo_4_runtime | - |
1012.86 | 711.0 | -29.8 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_6 | python_flink_streaming_pardo_6_runtime | - | 490.86
| 381.8 | -22.22 |
python_textio_1GB_results | read_runtime | - | 88.57 | 86.4 | -2.45 |
[[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_textio_1GB_results | write_runtime | - | 209.14 | 215.0 | 2.8 |
[[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
singlestoreioit_results | read_time | - | 100.79 | 100.35 | -0.44 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
singlestoreioit_results | write_time | - | 29.47 | 29.23 | -0.82 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
sparkreceiverioit_results | read_time | - | 769.1 | 777.52 | 1.09 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_hdfs_results | read_time | - | 16.6 | 15.12 | -8.93 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_hdfs_results | write_time | - | 31.37 | 35.7 | 13.8 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_results | read_time | - | 18.42 | 18.89 | 2.58 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_results | write_time | - | 30.97 | 30.94 | -0.1 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
tfrecordioit_results | read_time | - | 19.52 | 19.79 | 1.39 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
tfrecordioit_results | write_time | - | 25.07 | 29.24 | 16.63 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
wordcount_py39_results | runtime | - | 1511.28 | 1411.79 | -6.58 |
xmlioit_hdfs_results | read_time | - | 23.41 | 22.29 | -4.77 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_hdfs_results | write_time | - | 24.89 | 23.12 | -7.1 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_results | read_time | - | 26.03 | 24.75 | -4.89 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_results | write_time | - | 23.47 | 23.6 | 0.58 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
nexmark_0_batch | RuntimeMs | DataflowRunner | 26077.56 | 26201.63 | 0.48 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_batch | RuntimeMs | DirectRunner | 10263.68 | 10688.91 | 4.14 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_batch | RuntimeMs | FlinkRunner | 2516.93 | 2559.91 | 1.71 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_batch | RuntimeMs | SparkRunner | 1904.1 | 1912.32 | 0.43 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_batch | RuntimeMs | SparkStructuredStreamingRunner | 1998.03 |
1892.36 | -5.29 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_sql_batch | RuntimeMs | DataflowRunner | 29707.29 | 28292.75 | -4.76
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_sql_batch | RuntimeMs | DirectRunner | 12872.41 | 13507.36 | 4.93 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_sql_batch | RuntimeMs | FlinkRunner | 2092.93 | 2513.05 | 20.07 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_sql_batch | RuntimeMs | SparkRunner | 3905.69 | 3666.68 | -6.12 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 2393.38 |
2525.23 | 5.51 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_sql_streaming | RuntimeMs | DataflowRunner | 25884.2 | 25333.89 |
-2.13 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_sql_streaming | RuntimeMs | DirectRunner | 42320.3 | 44604.17 | 5.4
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_sql_streaming | RuntimeMs | FlinkRunner | 3880.07 | 4520.68 | 16.51
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_streaming | RuntimeMs | DataflowRunner | 22840.47 | 22634.61 | -0.9
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_streaming | RuntimeMs | DirectRunner | 34146.86 | 33849.95 | -0.87 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_streaming | RuntimeMs | FlinkRunner | 3207.45 | 3485.68 | 8.67 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_zetasql_batch | RuntimeMs | DataflowRunner | 118773.39 | 119588.38 |
0.69 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_zetasql_batch | RuntimeMs | DirectRunner | 15288.66 | 15844.45 |
3.64 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_zetasql_batch | RuntimeMs | FlinkRunner | 3384.38 | 3710.86 | 9.65 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_zetasql_batch | RuntimeMs | SparkRunner | 5382.79 | 5729.05 | 6.43 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_zetasql_batch | RuntimeMs | SparkStructuredStreamingRunner | 4020.59
| 3904.64 | -2.88 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_zetasql_streaming | RuntimeMs | DataflowRunner | 73945.86 | 70931.86
| -4.08 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_0_zetasql_streaming | RuntimeMs | DirectRunner | 48730.86 | 45946.82 |
-5.71 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_streaming | RuntimeMs | FlinkRunner | 5984.21 | 6336.82 |
5.89 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_10_batch | RuntimeMs | DataflowRunner | 42948.76 | 44027.95 | 2.51 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_10_batch | RuntimeMs | DirectRunner | 31763.57 | 32508.23 | 2.34 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_10_batch | RuntimeMs | FlinkRunner | 957.17 | 981.36 | 2.53 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_10_batch | RuntimeMs | SparkRunner | 1096.97 | 1233.23 | 12.42 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_10_batch | RuntimeMs | SparkStructuredStreamingRunner | 1306.07 |
1201.27 | -8.02 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_10_streaming | RuntimeMs | DataflowRunner | 90321.98 | 90142.02 | -0.2
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_10_streaming | RuntimeMs | DirectRunner | 118330.57 | 106871.0 | -9.68
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_10_streaming | RuntimeMs | FlinkRunner | 2638.62 | 2867.18 | 8.66 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_11_batch | RuntimeMs | DataflowRunner | 28574.35 | 29509.39 | 3.27 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_batch | RuntimeMs | DirectRunner | 6716.89 | 7373.55 | 9.78 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_11_batch | RuntimeMs | FlinkRunner | 518.31 | 481.77 | -7.05 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_11_batch | RuntimeMs | SparkRunner | 1656.9 | 1866.05 | 12.62 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_11_batch | RuntimeMs | SparkStructuredStreamingRunner | 1696.9 |
1471.36 | -13.29 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_streaming | RuntimeMs | DataflowRunner | 151737.75 | 148358.23 |
-2.23 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_11_streaming | RuntimeMs | DirectRunner | 18826.46 | 17493.62 | -7.08
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_11_streaming | RuntimeMs | FlinkRunner | 3601.14 | 3709.0 | 3.0 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_12_batch | RuntimeMs | DataflowRunner | 18112.64 | 17694.74 | -2.31 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_12_batch | RuntimeMs | DirectRunner | 5468.5 | 5837.41 | 6.75 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_12_batch | RuntimeMs | FlinkRunner | 450.34 | 418.59 | -7.05 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_12_batch | RuntimeMs | SparkRunner | 1130.86 | 1245.36 | 10.13 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_12_batch | RuntimeMs | SparkStructuredStreamingRunner | 1327.52 |
1066.64 | -19.65 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_12_streaming | RuntimeMs | DataflowRunner | 83447.49 | 80873.05 |
-3.09 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_12_streaming | RuntimeMs | DirectRunner | 21486.36 | 19548.86 | -9.02
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_streaming | RuntimeMs | FlinkRunner | 950.1 | 1181.05 | 24.31 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_batch | RuntimeMs | DataflowRunner | 31391.55 | 31818.77 | 1.36 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_batch | RuntimeMs | DirectRunner | 9184.29 | 8969.91 | -2.33 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_batch | RuntimeMs | FlinkRunner | 664.93 | 631.23 | -5.07 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_batch | RuntimeMs | SparkRunner | 417.14 | 477.32 | 14.43 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_batch | RuntimeMs | SparkStructuredStreamingRunner | 2215.34 |
1360.86 | -38.57 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_sql_batch | RuntimeMs | DataflowRunner | 53969.14 | 54410.38 | 0.82
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_sql_batch | RuntimeMs | DirectRunner | 13644.34 | 16005.5 | 17.31 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_sql_batch | RuntimeMs | FlinkRunner | 1529.14 | 1668.27 | 9.1 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_sql_batch | RuntimeMs | SparkRunner | 4218.62 | 3879.14 | -8.05 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1967.9 |
2447.64 | 24.38 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_sql_streaming | RuntimeMs | DataflowRunner | 43183.8 | 39735.11 |
-7.99 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_sql_streaming | RuntimeMs | DirectRunner | 57489.67 | 58679.56 |
2.07 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_sql_streaming | RuntimeMs | FlinkRunner | 4748.55 | 5163.5 | 8.74 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_streaming | RuntimeMs | DataflowRunner | 29082.02 | 28796.57 |
-0.98 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_streaming | RuntimeMs | DirectRunner | 29074.46 | 25353.57 | -12.8
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_streaming | RuntimeMs | FlinkRunner | 2716.93 | 3261.41 | 20.04 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_batch | RuntimeMs | DataflowRunner | 274271.35 | 268890.15
| -1.96 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_zetasql_batch | RuntimeMs | DirectRunner | 20444.45 | 18725.5 |
-8.41 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_zetasql_batch | RuntimeMs | FlinkRunner | 4789.59 | 4980.55 | 3.99
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_zetasql_batch | RuntimeMs | SparkRunner | 6268.41 | 6756.32 | 7.78
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_zetasql_batch | RuntimeMs | SparkStructuredStreamingRunner |
6455.86 | 5839.55 | -9.55 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_zetasql_streaming | RuntimeMs | DataflowRunner | 121311.33 |
120295.5 | -0.84 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_streaming | RuntimeMs | DirectRunner | 64806.9 | 61665.05 |
-4.85 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_13_zetasql_streaming | RuntimeMs | FlinkRunner | 7079.72 | 6432.27 |
-9.15 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_14_batch | RuntimeMs | DataflowRunner | 57643.6 | 57412.66 | -0.4 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_14_batch | RuntimeMs | DirectRunner | 7690.32 | 8764.32 | 13.97 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_14_batch | RuntimeMs | FlinkRunner | 896.24 | 898.77 | 0.28 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_14_batch | RuntimeMs | SparkRunner | 1202.28 | 1187.14 | -1.26 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_14_batch | RuntimeMs | SparkStructuredStreamingRunner | 1409.62 |
1185.5 | -15.9 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_14_streaming | RuntimeMs | DataflowRunner | 130472.84 | 123598.59 |
-5.27 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_14_streaming | RuntimeMs | DirectRunner | 29373.46 | 24969.33 | -14.99
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_14_streaming | RuntimeMs | FlinkRunner | 2317.86 | 3059.68 | 32.0 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_15_batch | RuntimeMs | DataflowRunner | 44547.08 | 44988.92 | 0.99 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_15_batch | RuntimeMs | DirectRunner | 36883.11 | 37771.0 | 2.41 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_15_batch | RuntimeMs | FlinkRunner | 1227.31 | 1296.27 | 5.62 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_15_batch | RuntimeMs | SparkRunner | 1492.38 | 1192.36 | -20.1 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_15_batch | RuntimeMs | SparkStructuredStreamingRunner | 1667.52 |
1550.64 | -7.01 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_16_batch | RuntimeMs | DataflowRunner | 45980.85 | 46717.05 | 1.6 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_16_batch | RuntimeMs | DirectRunner | 209510.39 | 211079.55 | 0.75 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_16_batch | RuntimeMs | FlinkRunner | 809.79 | 738.82 | -8.76 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_16_batch | RuntimeMs | SparkRunner | 2180.38 | 2632.09 | 20.72 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_16_batch | RuntimeMs | SparkStructuredStreamingRunner | 956.66 | 806.0
| -15.75 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_16_streaming | RuntimeMs | DataflowRunner | 65789.56 | 63720.07 |
-3.15 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_16_streaming | RuntimeMs | DirectRunner | 398552.61 | 400299.0 | 0.44
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_16_streaming | RuntimeMs | FlinkRunner | 747.45 | 947.64 | 26.78 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_batch | RuntimeMs | DataflowRunner | 20679.13 | 20887.26 | 1.01 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_batch | RuntimeMs | DirectRunner | 7337.79 | 7263.05 | -1.02 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_batch | RuntimeMs | FlinkRunner | 684.55 | 730.68 | 6.74 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_batch | RuntimeMs | SparkRunner | 609.41 | 657.5 | 7.89 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_batch | RuntimeMs | SparkStructuredStreamingRunner | 662.66 | 636.14
| -4.0 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_sql_batch | RuntimeMs | DataflowRunner | 25797.43 | 24718.75 | -4.18
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_sql_batch | RuntimeMs | DirectRunner | 7782.1 | 9583.14 | 23.14 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_sql_batch | RuntimeMs | FlinkRunner | 813.17 | 937.18 | 15.25 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_sql_batch | RuntimeMs | SparkRunner | 2869.17 | 2698.91 | -5.93 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 980.79 |
1025.5 | 4.56 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_sql_streaming | RuntimeMs | DataflowRunner | 24002.2 | 22617.78 |
-5.77 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_streaming | RuntimeMs | DirectRunner | 35182.3 | 35690.06 | 1.44
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_sql_streaming | RuntimeMs | FlinkRunner | 2093.1 | 2254.32 | 7.7 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_streaming | RuntimeMs | DataflowRunner | 20289.75 | 19800.3 | -2.41
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_1_streaming | RuntimeMs | DirectRunner | 25151.93 | 23909.71 | -4.94 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_streaming | RuntimeMs | FlinkRunner | 1777.93 | 1837.36 | 3.34 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_batch | RuntimeMs | DataflowRunner | 14039.61 | 13887.37 | -1.08 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_batch | RuntimeMs | DirectRunner | 3788.68 | 3690.59 | -2.59 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_batch | RuntimeMs | FlinkRunner | 279.28 | 276.27 | -1.08 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_batch | RuntimeMs | SparkRunner | 380.21 | 413.14 | 8.66 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_batch | RuntimeMs | SparkStructuredStreamingRunner | 392.97 | 338.41
| -13.88 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_sql_batch | RuntimeMs | DataflowRunner | 17377.71 | 17355.25 | -0.13
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_sql_batch | RuntimeMs | DirectRunner | 3591.21 | 4625.73 | 28.81 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_sql_batch | RuntimeMs | FlinkRunner | 382.34 | 485.59 | 27.0 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_sql_batch | RuntimeMs | SparkRunner | 913.41 | 940.64 | 2.98 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 808.48 |
931.82 | 15.26 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_sql_streaming | RuntimeMs | DataflowRunner | 21769.0 | 15576.11 |
-28.45 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_sql_streaming | RuntimeMs | DirectRunner | 19889.81 | 19778.67 |
-0.56 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_sql_streaming | RuntimeMs | FlinkRunner | 1182.1 | 1256.45 | 6.29 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_streaming | RuntimeMs | DataflowRunner | 13292.72 | 13560.45 | 2.01
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_streaming | RuntimeMs | DirectRunner | 14715.93 | 14061.52 | -4.45 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_streaming | RuntimeMs | FlinkRunner | 637.9 | 638.95 | 0.17 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_zetasql_batch | RuntimeMs | DataflowRunner | 73454.04 | 71739.46 |
-2.33 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_zetasql_batch | RuntimeMs | DirectRunner | 6539.66 | 6090.23 | -6.87
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_zetasql_batch | RuntimeMs | FlinkRunner | 1653.34 | 1920.73 | 16.17
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_zetasql_batch | RuntimeMs | SparkRunner | 1499.03 | 1682.23 | 12.22
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_zetasql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1818.17
| 1828.36 | 0.56 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_zetasql_streaming | RuntimeMs | DataflowRunner | 42664.19 | 43493.14
| 1.94 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_streaming | RuntimeMs | DirectRunner | 22875.41 | 23931.09 |
4.61 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_2_zetasql_streaming | RuntimeMs | FlinkRunner | 2122.31 | 2254.5 |
6.23 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_batch | RuntimeMs | DataflowRunner | 18675.93 | 18015.2 | -3.54 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_batch | RuntimeMs | DirectRunner | 6104.18 | 6366.68 | 4.3 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_batch | RuntimeMs | FlinkRunner | 2174.1 | 2255.5 | 3.74 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_batch | RuntimeMs | SparkRunner | 2903.79 | 3234.95 | 11.4 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_sql_batch | RuntimeMs | DataflowRunner | 19317.07 | 19737.38 | 2.18
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_3_sql_batch | RuntimeMs | DirectRunner | 6725.72 | 8107.86 | 20.55 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_3_sql_batch | RuntimeMs | FlinkRunner | 1572.76 | 1780.86 | 13.23 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_3_sql_batch | RuntimeMs | SparkRunner | 4271.55 | 4047.27 | -5.25 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_sql_streaming | RuntimeMs | DataflowRunner | 36348.0 | 35832.11 |
-1.42 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_sql_streaming | RuntimeMs | DirectRunner | 21689.56 | 25918.61 |
19.5 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_sql_streaming | RuntimeMs | FlinkRunner | 2122.45 | 2247.55 | 5.89 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_streaming | RuntimeMs | DataflowRunner | 23203.54 | 25506.8 | 9.93 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_streaming | RuntimeMs | DirectRunner | 20332.43 | 19180.14 | -5.67 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_streaming | RuntimeMs | FlinkRunner | 1144.62 | 1153.77 | 0.8 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_zetasql_batch | RuntimeMs | DataflowRunner | 61071.43 | 60434.0 |
-1.04 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_zetasql_batch | RuntimeMs | DirectRunner | 8798.21 | 8431.73 | -4.17
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_zetasql_batch | RuntimeMs | FlinkRunner | 1995.0 | 1990.32 | -0.23 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_zetasql_batch | RuntimeMs | SparkRunner | 4074.14 | 4443.64 | 9.07 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_3_zetasql_streaming | RuntimeMs | DataflowRunner | 50851.1 | 49301.07
| -3.05 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_zetasql_streaming | RuntimeMs | DirectRunner | 23196.72 | 23146.32 |
-0.22 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_3_zetasql_streaming | RuntimeMs | FlinkRunner | 2374.69 | 2299.0 |
-3.19 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_4_batch | RuntimeMs | DataflowRunner | 21869.93 | 21745.27 | -0.57 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_4_batch | RuntimeMs | DirectRunner | 4697.14 | 4525.36 | -3.66 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_4_batch | RuntimeMs | FlinkRunner | 595.14 | 598.32 | 0.53 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_4_batch | RuntimeMs | SparkRunner | 1246.52 | 1369.27 | 9.85 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_4_batch | RuntimeMs | SparkStructuredStreamingRunner | 4263.62 |
3833.23 | -10.09 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_4_streaming | RuntimeMs | DataflowRunner | 50102.26 | 49685.11 | -0.83
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_4_streaming | RuntimeMs | DirectRunner | 5588.32 | 4956.38 | -11.31 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_streaming | RuntimeMs | FlinkRunner | 1017.52 | 1072.23 | 5.38 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_batch | RuntimeMs | DataflowRunner | 28458.02 | 27854.6 | -2.12 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_5_batch | RuntimeMs | DirectRunner | 17713.96 | 18537.18 | 4.65 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_5_batch | RuntimeMs | FlinkRunner | 1809.21 | 2035.09 | 12.49 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_5_batch | RuntimeMs | SparkRunner | 1886.66 | 1966.64 | 4.24 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_5_batch | RuntimeMs | SparkStructuredStreamingRunner | 2574.34 |
2392.77 | -7.05 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_5_streaming | RuntimeMs | DataflowRunner | 119546.02 | 117006.7 |
-2.12 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_5_streaming | RuntimeMs | DirectRunner | 38825.21 | 35354.48 | -8.94 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_5_streaming | RuntimeMs | FlinkRunner | 2689.55 | 3038.82 | 12.99 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_6_batch | RuntimeMs | DataflowRunner | 21626.59 | 20944.61 | -3.15 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_6_batch | RuntimeMs | DirectRunner | 3716.61 | 3820.95 | 2.81 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_6_batch | RuntimeMs | FlinkRunner | 337.76 | 368.64 | 9.14 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_6_batch | RuntimeMs | SparkRunner | 947.31 | 1114.55 | 17.65 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_6_batch | RuntimeMs | SparkStructuredStreamingRunner | 2174.52 |
1946.36 | -10.49 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_6_streaming | RuntimeMs | DataflowRunner | 33764.33 | 34440.39 | 2.0 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_6_streaming | RuntimeMs | DirectRunner | 5076.75 | 4471.38 | -11.92 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_6_streaming | RuntimeMs | FlinkRunner | 496.21 | 519.77 | 4.75 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_7_batch | RuntimeMs | DataflowRunner | 42108.36 | 42300.75 | 0.46 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_batch | RuntimeMs | DirectRunner | 53017.79 | 56557.86 | 6.68 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_batch | RuntimeMs | FlinkRunner | 1143.9 | 1194.23 | 4.4 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_batch | RuntimeMs | SparkRunner | 1743.69 | 1877.14 | 7.65 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_batch | RuntimeMs | SparkStructuredStreamingRunner | 1813.34 |
1590.91 | -12.27 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_sql_batch | RuntimeMs | DataflowRunner | 75599.79 | 73376.75 | -2.94
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_sql_batch | RuntimeMs | DirectRunner | 1062470.28 | 903973.5 |
-14.92 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_sql_batch | RuntimeMs | FlinkRunner | 4096.59 | 4343.45 | 6.03 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_sql_batch | RuntimeMs | SparkRunner | 13160.34 | 11478.86 | -12.78 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 8835.62 |
9810.05 | 11.03 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_sql_streaming | RuntimeMs | DataflowRunner | 918129.2 | 880844.78 |
-4.06 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_7_sql_streaming | RuntimeMs | DirectRunner | 4562777.41 | 4127146.78 |
-9.55 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_7_sql_streaming | RuntimeMs | FlinkRunner | 6902.34 | 6909.86 | 0.11 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_streaming | RuntimeMs | DataflowRunner | 57686.25 | 56490.14 | -2.07
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_streaming | RuntimeMs | DirectRunner | 2368390.32 | 2192786.24 |
-7.41 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_7_streaming | RuntimeMs | FlinkRunner | 1787.52 | 1976.77 | 10.59 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_8_batch | RuntimeMs | DataflowRunner | 19566.97 | 20092.43 | 2.69 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_8_batch | RuntimeMs | DirectRunner | 5815.21 | 6711.5 | 15.41 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_8_batch | RuntimeMs | FlinkRunner | 672.14 | 708.41 | 5.4 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_batch | RuntimeMs | SparkRunner | 1638.17 | 1855.5 | 13.27 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_8_batch | RuntimeMs | SparkStructuredStreamingRunner | 1983.97 |
1717.18 | -13.45 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_8_streaming | RuntimeMs | DataflowRunner | 47623.18 | 45902.86 | -3.61
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_8_streaming | RuntimeMs | DirectRunner | 17865.39 | 18212.29 | 1.94 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_8_streaming | RuntimeMs | FlinkRunner | 919.69 | 980.27 | 6.59 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_batch | RuntimeMs | DataflowRunner | 20618.79 | 18901.82 | -8.33 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_9_batch | RuntimeMs | DirectRunner | 2813.43 | 3087.5 | 9.74 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_batch | RuntimeMs | FlinkRunner | 243.59 | 260.41 | 6.91 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_batch | RuntimeMs | SparkRunner | 779.38 | 780.32 | 0.12 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_9_batch | RuntimeMs | SparkStructuredStreamingRunner | 1740.17 |
1591.23 | -8.56 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_9_streaming | RuntimeMs | DataflowRunner | 31890.05 | 30757.7 | -3.55
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_9_streaming | RuntimeMs | DirectRunner | 3345.86 | 3257.05 | -2.65 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
nexmark_9_streaming | RuntimeMs | FlinkRunner | 421.76 | 509.64 | 20.84 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
tpcds_query10_Calcite_1GB | RuntimeMs | DataflowRunner | 388288.11 | 389448.9
| 0.3 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query10_Calcite_1GB | RuntimeMs | FlinkRunner | 29829.59 | 31407.0 |
5.29 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query10_Calcite_1GB | RuntimeMs | SparkRunner | 57290.86 | 48870.41 |
-14.7 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query10_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
46720.62 | 42842.14 | -8.3 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query25_Calcite_1GB | RuntimeMs | DataflowRunner | 0.0 | 0.0 | 0.0 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query25_Calcite_1GB | RuntimeMs | FlinkRunner | 0.0 | 0.0 | 0.0 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query25_Calcite_1GB | RuntimeMs | SparkRunner | 0.0 | 0.0 | 0.0 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query25_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner | 0.0 |
0.0 | 0.0 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query26_Calcite_1GB | RuntimeMs | DataflowRunner | 356893.07 | 359804.67
| 0.82 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query26_Calcite_1GB | RuntimeMs | FlinkRunner | 17479.55 | 18540.09 |
6.07 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query26_Calcite_1GB | RuntimeMs | SparkRunner | 21516.69 | 21414.82 |
-0.47 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query26_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
20775.93 | 20921.5 | 0.7 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query29_Calcite_1GB | RuntimeMs | DataflowRunner | 0.0 | 0.0 | 0.0 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query29_Calcite_1GB | RuntimeMs | FlinkRunner | 0.0 | 0.0 | 0.0 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query29_Calcite_1GB | RuntimeMs | SparkRunner | 0.0 | 0.0 | 0.0 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query29_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner | 0.0 |
0.0 | 0.0 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query35_Calcite_1GB | RuntimeMs | DataflowRunner | 383720.63 | 403771.95
| 5.23 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query35_Calcite_1GB | RuntimeMs | FlinkRunner | 26474.83 | 25068.09 |
-5.31 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query35_Calcite_1GB | RuntimeMs | SparkRunner | 49797.24 | 45919.18 |
-7.79 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query35_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
40445.14 | 37927.73 | -6.22 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query38_Calcite_1GB | RuntimeMs | DataflowRunner | 366481.41 | 373154.71
| 1.82 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query38_Calcite_1GB | RuntimeMs | FlinkRunner | 20515.31 | 19663.59 |
-4.15 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query38_Calcite_1GB | RuntimeMs | SparkRunner | 24055.03 | 21595.73 |
-10.22 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query38_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner | 0.0 |
0.0 | 0.0 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query3_Calcite_1GB | RuntimeMs | DataflowRunner | 350855.74 | 349906.86
| -0.27 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query3_Calcite_1GB | RuntimeMs | FlinkRunner | 32507.17 | 34569.09 |
6.34 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query3_Calcite_1GB | RuntimeMs | SparkRunner | 41286.55 | 39146.18 |
-5.18 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query3_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
41017.66 | 43716.82 | 6.58 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query40_Calcite_1GB | RuntimeMs | DataflowRunner | 0.0 | 0.0 | 0.0 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query40_Calcite_1GB | RuntimeMs | FlinkRunner | 0.0 | 0.0 | 0.0 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query40_Calcite_1GB | RuntimeMs | SparkRunner | 0.0 | 0.0 | 0.0 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query40_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner | 0.0 |
0.0 | 0.0 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query42_Calcite_1GB | RuntimeMs | DataflowRunner | 347243.59 | 348250.62
| 0.29 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query42_Calcite_1GB | RuntimeMs | FlinkRunner | 15581.72 | 15252.09 |
-2.12 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query42_Calcite_1GB | RuntimeMs | SparkRunner | 20339.9 | 18636.95 |
-8.37 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query42_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
17849.52 | 18163.41 | 1.76 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query43_Calcite_1GB | RuntimeMs | DataflowRunner | 0.0 | 0.0 | 0.0 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query43_Calcite_1GB | RuntimeMs | FlinkRunner | 0.0 | 0.0 | 0.0 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query43_Calcite_1GB | RuntimeMs | SparkRunner | 0.0 | 0.0 | 0.0 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query43_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner | 0.0 |
0.0 | 0.0 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query52_Calcite_1GB | RuntimeMs | DataflowRunner | 340177.89 | 336536.29
| -1.07 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query52_Calcite_1GB | RuntimeMs | FlinkRunner | 15788.59 | 16442.09 |
4.14 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query52_Calcite_1GB | RuntimeMs | SparkRunner | 20975.76 | 17927.86 |
-14.53 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query52_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
16979.38 | 17224.77 | 1.45 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query55_Calcite_1GB | RuntimeMs | DataflowRunner | 344538.37 | 342014.52
| -0.73 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query55_Calcite_1GB | RuntimeMs | FlinkRunner | 15962.93 | 15737.27 |
-1.41 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query55_Calcite_1GB | RuntimeMs | SparkRunner | 21455.1 | 19203.32 |
-10.5 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query55_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
17550.38 | 16485.59 | -6.07 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query69_Calcite_1GB | RuntimeMs | DataflowRunner | 392841.63 | 389830.62
| -0.77 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query69_Calcite_1GB | RuntimeMs | FlinkRunner | 25234.03 | 26218.86 |
3.9 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query69_Calcite_1GB | RuntimeMs | SparkRunner | 52230.69 | 43363.14 |
-16.98 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query69_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
41817.28 | 40720.68 | -2.62 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query79_Calcite_1GB | RuntimeMs | DataflowRunner | 377068.74 | 387555.76
| 2.78 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query79_Calcite_1GB | RuntimeMs | FlinkRunner | 27408.55 | 30380.0 |
10.84 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query79_Calcite_1GB | RuntimeMs | SparkRunner | 37559.62 | 33439.18 |
-10.97 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query79_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
34059.83 | 34668.5 | 1.79 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query7_Calcite_1GB | RuntimeMs | DataflowRunner | 367289.7 | 363740.86 |
-0.97 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query7_Calcite_1GB | RuntimeMs | FlinkRunner | 32680.24 | 31962.77 |
-2.2 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query7_Calcite_1GB | RuntimeMs | SparkRunner | 42889.48 | 36249.5 |
-15.48 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query7_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
36152.48 | 35032.91 | -3.1 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query83_Calcite_1GB | RuntimeMs | DataflowRunner | 354433.0 | 358633.0 |
1.18 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mq)
tpcds_query83_Calcite_1GB | RuntimeMs | FlinkRunner | 8464.03 | 9254.23 | 9.34
| [[1]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query83_Calcite_1GB | RuntimeMs | SparkRunner | 7866.14 | 7244.18 |
-7.91 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query83_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
11104.07 | 11909.77 | 7.26 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query84_Calcite_1GB | RuntimeMs | DataflowRunner | 347466.0 | 356587.76
| 2.63 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query84_Calcite_1GB | RuntimeMs | FlinkRunner | 15198.28 | 16387.91 |
7.83 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query84_Calcite_1GB | RuntimeMs | SparkRunner | 16711.97 | 14865.59 |
-11.05 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query84_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
15362.97 | 15727.14 | 2.37 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query87_Calcite_1GB | RuntimeMs | DataflowRunner | 364148.3 | 370135.48
| 1.64 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query87_Calcite_1GB | RuntimeMs | FlinkRunner | 18435.72 | 19391.05 |
5.18 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query87_Calcite_1GB | RuntimeMs | SparkRunner | 23845.34 | 21521.73 |
-9.74 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query87_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
21712.07 | 22112.64 | 1.84 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query93_Calcite_1GB | RuntimeMs | DataflowRunner | 377803.59 | 383313.71
| 1.46 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query93_Calcite_1GB | RuntimeMs | FlinkRunner | 30668.52 | 33274.68 |
8.5 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query93_Calcite_1GB | RuntimeMs | SparkRunner | 44814.0 | 40411.18 |
-9.82 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query93_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
34481.03 | 33161.45 | -3.83 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query96_Calcite_1GB | RuntimeMs | DataflowRunner | 352021.26 | 358044.67
| 1.71 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query96_Calcite_1GB | RuntimeMs | FlinkRunner | 21305.79 | 22057.77 |
3.53 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)
tpcds_query96_Calcite_1GB | RuntimeMs | SparkRunner | 19030.14 | 17737.5 |
-6.79 | [[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mv)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
tpcds_query96_Calcite_1GB | RuntimeMs | SparkStructuredStreamingRunner |
27000.55 | 26579.68 | -1.56 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mq)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk2)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mv)