You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/11/16 12:01:29 UTC
Beam Metrics Report (2020-11-16)
# Beam Metrics Report
Color legend: >= 20 | >= 10 | <= -10 | <= -20
---|---|---|---
## Possible regression
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
java_batch_gbk_2 | sparkstructuredstreaming_runtime_sec | - | 116.89 | 137.09
| 17.28 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | sparkstructuredstreaming_runtime_sec | - | 8.78 | 9.92 |
13.05 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
jdbcioit_results | write_time | - | 55.45 | 66.93 | 20.71 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
python_streaming_gbk_3 | python_dataflow_streaming_gbk_3_runtime | - | 154.71
| 175.0 | 13.11 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
nexmark_2_batch | RuntimeMs | FlinkRunner | 120.32 | 146.56 | 21.8 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
## Possible improvement
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
bqio_10GB_results_java_stream | read_time | - | 1.14 | 0.0 | -100.0 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
java_batch_gbk_4 | dataflow_runtime_sec | - | 38.58 | 33.95 | -12.0 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | sparkstructuredstreaming_runtime_sec | - | 130.35 | 115.97
| -11.04 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_1 | dataflow_runtime_sec | - | 855.8 | 740.69 | -13.45 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
kafkaioit_results_runner_v2 | read_time | - | 369.98 | 1.49 | -99.6 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results_runner_v2 | write_time | - | 125.83 | 11.93 | -90.52 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results_sdf_wrapper | read_time | - | 189.69 | 110.99 | -41.49 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results_sdf_wrapper | write_time | - | 141.31 | 11.17 | -92.1 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_results | read_time | - | 58.34 | 46.26 | -20.71 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
python_batch_combine_5 | python_dataflow_batch_combine_5_runtime | - | 39.29 |
34.5 | -12.18 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_gbk_3 | python_dataflow_batch_gbk_3_runtime | - | 37.14 | 32.5 |
-12.5 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_sideinput_1 | python_dataflow_batch_sideinput_1_runtime | - |
3.43 | 2.2 | -35.83 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_10 | python_dataflow_batch_sideinput_10_runtime | - |
2213.86 | 1321.5 | -40.31 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_2 | python_dataflow_batch_sideinput_2_runtime | - |
3.29 | 2.4 | -26.96 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_3 | python_dataflow_batch_sideinput_3_runtime | - |
24.14 | 21.4 | -11.36 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_4 | python_dataflow_batch_sideinput_4_runtime | - |
25.43 | 21.75 | -14.47 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_6 | python_dataflow_batch_sideinput_6_runtime | - | 3.0
| 2.5 | -16.67 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_7 | python_dataflow_batch_sideinput_7_runtime | - |
253.29 | 211.75 | -16.4 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_8 | python_dataflow_batch_sideinput_8_runtime | - |
355.43 | 214.25 | -39.72 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_9 | python_dataflow_batch_sideinput_9_runtime | - |
1759.43 | 1295.0 | -26.4 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_streaming_pardo_6 | python_flink_streaming_pardo_6_runtime | - | 265.8
| 0.0 | -100.0 |
textioit_hdfs_results | write_time | - | 49.44 | 43.27 | -12.48 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_results | write_time | - | 50.48 | 44.31 | -12.23 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_hdfs_results | read_time | - | 28.5 | -94420026.21 | -331252806.93 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_results | read_time | - | 31.18 | 27.99 | -10.23 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
nexmark_11_batch | RuntimeMs | FlinkRunner | 308.36 | 257.61 | -16.46 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_zetasql_streaming | RuntimeMs | DirectRunner | 11672.0 | 10487.5 |
-10.15 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_batch | RuntimeMs | DataflowRunner | 70980.25 | 63427.61 |
-10.64 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_batch | RuntimeMs | DataflowRunner | 51229.89 | 45900.33 | -10.4 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_batch | RuntimeMs | SparkStructuredStreamingRunner | 228.96 | 197.06
| -13.94 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_zetasql_batch | RuntimeMs | DataflowRunner | 325760.54 | 280040.61 |
-14.03 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_batch | RuntimeMs | DirectRunner | 4686.14 | 4007.89 |
-14.47 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_zetasql_streaming | RuntimeMs | DirectRunner | 5621.46 | 4929.78 |
-12.3 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_streaming | RuntimeMs | FlinkRunner | 4722.04 | 4030.33 |
-14.65 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_batch | RuntimeMs | DataflowRunner | 62057.96 | 53862.33 |
-13.21 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_batch | RuntimeMs | DataflowRunner | 108884.82 | 96543.67 | -11.33 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
## All metrics
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
avroioit_hdfs_results | read_time | - | 124.79 | 118.4 | -5.12 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_hdfs_results | write_time | - | 175.55 | 179.84 | 2.45 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_results | read_time | - | 122.33 | 126.25 | 3.21 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_results | write_time | - | 167.64 | 163.72 | -2.34 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_avro | avro_write_time | - | 59.43 | 58.15 |
-2.16 | [[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_avro | read_time | - | 81.4 | 77.41 | -4.9 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_json | read_time | - | 66.08 | 64.03 | -3.11 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_json | write_time | - | 95.9 | 94.74 | -1.21 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_stream | read_time | - | 1.14 | 0.0 | -100.0 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_stream | write_time | - | 118.02 | 119.78 | 1.49 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_hdfs_results | read_time | - | 218.87 | 232.75 | 6.34 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_hdfs_results | write_time | - | 301.27 | 291.49 | -3.25 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_results | read_time | - | 201.09 | 202.09 | 0.5 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_results | write_time | - | 280.39 | 271.9 | -3.03 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
hadoopformatioit_results | read_time | - | 8.38 | 9.04 | 7.85 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
hadoopformatioit_results | write_time | - | 13.6 | 12.75 | -6.22 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
java_batch_cogbk_1 | dataflow_runtime_sec | - | 74.88 | 74.89 | 0.01 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_1 | sparkstructuredstreaming_runtime_sec | - | 133.32 |
132.51 | -0.61 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | dataflow_runtime_sec | - | 75.28 | 75.17 | -0.15 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | sparkstructuredstreaming_runtime_sec | - | 129.48 |
125.65 | -2.96 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | dataflow_runtime_sec | - | 30.12 | 30.3 | 0.6 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | sparkstructuredstreaming_runtime_sec | - | 19.94 | 19.4 |
-2.7 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | dataflow_runtime_sec | - | 30.48 | 29.77 | -2.34 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | sparkstructuredstreaming_runtime_sec | - | 19.55 | 19.65
| 0.49 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_combine_1 | dataflow_runtime_sec | - | 88.37 | 86.83 | -1.75 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_1 | sparkstructuredstreaming_runtime_sec | - | 797.22 |
767.65 | -3.71 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_4 | dataflow_runtime_sec | - | 40.0 | 36.74 | -8.15 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_4 | sparkstructuredstreaming_runtime_sec | - | 150.59 |
155.52 | 3.28 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_5 | dataflow_runtime_sec | - | 39.63 | 38.4 | -3.13 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_5 | sparkstructuredstreaming_runtime_sec | - | 150.67 |
155.44 | 3.16 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_gbk_1 | dataflow_runtime_sec | - | 262.26 | 251.09 | -4.26 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_1 | sparkstructuredstreaming_runtime_sec | - | 671.81 | 710.67
| 5.78 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | dataflow_runtime_sec | - | 61.54 | 63.75 | 3.6 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | sparkstructuredstreaming_runtime_sec | - | 116.89 | 137.09
| 17.28 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_runtime_sec | - | 28.4 | 28.09 | -1.09 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | sparkstructuredstreaming_runtime_sec | - | 8.78 | 9.92 |
13.05 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | dataflow_runtime_sec | - | 38.58 | 33.95 | -12.0 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | sparkstructuredstreaming_runtime_sec | - | 130.35 | 115.97
| -11.04 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | dataflow_runtime_sec | - | 33.22 | 33.46 | 0.7 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | sparkstructuredstreaming_runtime_sec | - | 122.45 | 123.76
| 1.08 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | dataflow_runtime_sec | - | 74.46 | 74.04 | -0.56 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | sparkstructuredstreaming_runtime_sec | - | 65.61 | 65.95 |
0.51 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | dataflow_runtime_sec | - | 109.18 | 106.12 | -2.8 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | sparkstructuredstreaming_runtime_sec | - | 94.8 | 98.22 |
3.61 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_pardo_1 | dataflow_runtime_sec | - | 29.2 | 28.52 | -2.32 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_1 | sparkstructuredstreaming_runtime_sec | - | 55.83 | 59.54
| 6.66 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_2 | dataflow_runtime_sec | - | 187.98 | 194.89 | 3.68 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | dataflow_runtime_sec | - | 22.08 | 21.09 | -4.48 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_4 | dataflow_runtime_sec | - | 36.09 | 38.02 | 5.36 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_cogbk_1 | dataflow_runtime_sec | - | 978.71 | 1033.3 | 5.58 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_2 | dataflow_runtime_sec | - | 976.97 | 939.13 | -3.87 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_3 | dataflow_runtime_sec | - | 132.56 | 127.6 | -3.74 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_4 | dataflow_runtime_sec | - | 133.34 | 127.15 | -4.64 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_combine_1 | dataflow_runtime_sec | - | 589.67 | 574.72 | -2.54
| [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_combine_4 | dataflow_runtime_sec | - | 335.56 | 312.88 | -6.76
| [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_combine_5 | dataflow_runtime_sec | - | 338.89 | 337.88 | -0.3 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_gbk_1 | dataflow_runtime_sec | - | 855.8 | 740.69 | -13.45 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_2 | dataflow_runtime_sec | - | 868.85 | 850.57 | -2.1 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_3 | dataflow_runtime_sec | - | 28.93 | 27.36 | -5.43 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_4 | dataflow_runtime_sec | - | 312.8 | 301.67 | -3.56 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_5 | dataflow_runtime_sec | - | 329.73 | 297.67 | -9.72 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_6 | dataflow_runtime_sec | - | 84.08 | 81.21 | -3.41 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_7 | dataflow_runtime_sec | - | 145.67 | 143.67 | -1.37 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_pardo_1 | dataflow_runtime_sec | - | 21.14 | 19.91 | -5.81 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_2 | dataflow_runtime_sec | - | 210.5 | 214.57 | 1.93 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_3 | dataflow_runtime_sec | - | 12.81 | 12.43 | -2.92 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_4 | dataflow_runtime_sec | - | 31.01 | 30.96 | -0.16 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
jdbcioit_results | read_time | - | 37.67 | 36.94 | -1.91 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
jdbcioit_results | write_time | - | 55.45 | 66.93 | 20.71 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results | read_time | - | 792.72 | 793.42 | 0.09 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results | write_time | - | 191.32 | 181.91 | -4.92 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results_runner_v2 | read_time | - | 369.98 | 1.49 | -99.6 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results_runner_v2 | write_time | - | 125.83 | 11.93 | -90.52 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results_sdf_wrapper | read_time | - | 189.69 | 110.99 | -41.49 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results_sdf_wrapper | write_time | - | 141.31 | 11.17 | -92.1 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_hdfs_results | read_time | - | 25.2 | 26.25 | 4.17 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_hdfs_results | write_time | - | 114.24 | 110.41 | -3.35 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_results | read_time | - | 58.34 | 46.26 | -20.71 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_results | write_time | - | 124.08 | 112.39 | -9.42 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
mongodbioit_results | read_time | - | 33.24 | 31.68 | -4.72 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
mongodbioit_results | write_time | - | 72.77 | 73.72 | 1.3 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_hdfs_results | read_time | - | 117.3 | 113.15 | -3.54 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_hdfs_results | write_time | - | 195.81 | 201.52 | 2.92 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_results | read_time | - | 118.43 | 116.06 | -2.01 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_results | write_time | - | 192.73 | 187.21 | -2.87 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
python_batch_cogbk_1 | python_dataflow_batch_cogbk_1_runtime | - | 461.0 |
446.25 | -3.2 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_2 | python_dataflow_batch_cogbk_2_runtime | - | 308.29 |
307.25 | -0.34 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_3 | python_dataflow_batch_cogbk_3_runtime | - | 299.0 |
293.0 | -2.01 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_4 | python_dataflow_batch_cogbk_4_runtime | - | 306.71 |
299.5 | -2.35 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_combine_1 | python_dataflow_batch_combine_1_runtime | - | 932.43
| 924.25 | -0.88 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_1 | python_flink_batch_combine_1_runtime | - | 5437.2 |
4894.0 | -9.99 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_4 | python_dataflow_batch_combine_4_runtime | - | 40.57 |
38.0 | -6.34 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_4 | python_flink_batch_combine_4_runtime | - | 187.2 |
200.75 | 7.24 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_5 | python_dataflow_batch_combine_5_runtime | - | 39.29 |
34.5 | -12.18 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_5 | python_flink_batch_combine_5_runtime | - | 133.8 |
144.5 | 8.0 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_gbk_1 | python_dataflow_batch_gbk_1_runtime | - | 1945.29 |
1913.0 | -1.66 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_2 | python_dataflow_batch_gbk_2_runtime | - | 351.71 | 339.5
| -3.47 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_3 | python_dataflow_batch_gbk_3_runtime | - | 37.14 | 32.5 |
-12.5 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_4 | python_dataflow_batch_gbk_4_runtime | - | 105.57 | 103.75
| -1.73 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_5 | python_dataflow_batch_gbk_5_runtime | - | 106.29 | 104.25
| -1.92 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_6 | python_dataflow_batch_gbk_6_runtime | - | 381.14 | 361.5
| -5.15 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_7 | python_dataflow_batch_gbk_7_runtime | - | 368.57 | 368.25
| -0.09 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_pardo_1 | python_dataflow_batch_pardo_1_runtime | - | 165.57 |
152.5 | -7.89 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_1 | python_flink_batch_pardo_1_runtime | - | 805.17 |
794.75 | -1.29 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_2 | python_dataflow_batch_pardo_2_runtime | - | 1407.71 |
1368.5 | -2.79 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_3 | python_dataflow_batch_pardo_3_runtime | - | 136.43 |
140.25 | 2.8 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_3 | python_flink_batch_pardo_3_runtime | - | 714.33 |
701.75 | -1.76 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_4 | python_dataflow_batch_pardo_4_runtime | - | 345.29 |
347.25 | 0.57 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_4 | python_flink_batch_pardo_4_runtime | - | 2496.67 |
2431.5 | -2.61 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_sideinput_1 | python_dataflow_batch_sideinput_1_runtime | - |
3.43 | 2.2 | -35.83 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_10 | python_dataflow_batch_sideinput_10_runtime | - |
2213.86 | 1321.5 | -40.31 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_2 | python_dataflow_batch_sideinput_2_runtime | - |
3.29 | 2.4 | -26.96 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_3 | python_dataflow_batch_sideinput_3_runtime | - |
24.14 | 21.4 | -11.36 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_4 | python_dataflow_batch_sideinput_4_runtime | - |
25.43 | 21.75 | -14.47 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_5 | python_dataflow_batch_sideinput_5_runtime | - |
2.71 | 2.5 | -7.89 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_6 | python_dataflow_batch_sideinput_6_runtime | - | 3.0
| 2.5 | -16.67 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_7 | python_dataflow_batch_sideinput_7_runtime | - |
253.29 | 211.75 | -16.4 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_8 | python_dataflow_batch_sideinput_8_runtime | - |
355.43 | 214.25 | -39.72 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_9 | python_dataflow_batch_sideinput_9_runtime | - |
1759.43 | 1295.0 | -26.4 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_bqio_read_10GB_results | bqio_read_10GB_results_runtime | - | 166.14 |
164.75 | -0.84 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_bqio_write_10GB_results | bqio_write_10GB_results_runtime | - | 259.86
| 258.0 | -0.71 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_psio_2GB_results | pubsub_io_perf_read_runtime | - | 183.86 | 182.5 |
-0.74 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_psio_2GB_results | pubsub_io_perf_write_runtime | - | 104.71 | 98.0 |
-6.41 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_streaming_cogbk_1 | python_dataflow_streaming_cogbk_1_runtime | - |
626.14 | 633.25 | 1.14 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_2 | python_dataflow_streaming_cogbk_2_runtime | - |
468.29 | 433.0 | -7.54 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_3 | python_dataflow_streaming_cogbk_3_runtime | - |
753.14 | 737.5 | -2.08 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_4 | python_dataflow_streaming_cogbk_4_runtime | - |
277.57 | 298.75 | 7.63 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_combine_4 | python_flink_streaming_combine_4_runtime | - |
250.29 | 245.5 | -1.91 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_streaming_combine_5 | python_flink_streaming_combine_5_runtime | - |
243.2 | 246.33 | 1.29 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_streaming_gbk_3 | python_dataflow_streaming_gbk_3_runtime | - | 154.71
| 175.0 | 13.11 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_gbk_6 | python_dataflow_streaming_gbk_6_runtime | - | 446.71
| 469.0 | 4.99 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_gbk_7 | python_dataflow_streaming_gbk_7_runtime | - | 456.29
| 445.25 | -2.42 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_pardo_1 | python_dataflow_streaming_pardo_1_runtime | - |
204.57 | 195.75 | -4.31 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_1 | python_flink_streaming_pardo_5_runtime | - | 168.57
| 169.5 | 0.55 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_2 | python_dataflow_streaming_pardo_2_runtime | - |
2517.71 | 2465.25 | -2.08 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_2 | python_flink_streaming_pardo_2_runtime | - | 4237.0
| 4246.0 | 0.21 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_3 | python_dataflow_streaming_pardo_3_runtime | - |
162.43 | 164.25 | 1.12 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_3 | python_flink_streaming_pardo_3_runtime | - | 259.6
| 271.75 | 4.68 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_4 | python_dataflow_streaming_pardo_4_runtime | - |
526.86 | 513.0 | -2.63 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_4 | python_flink_streaming_pardo_4_runtime | - | 761.2
| 689.0 | -9.49 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_6 | python_flink_streaming_pardo_6_runtime | - | 265.8
| 0.0 | -100.0 |
textioit_hdfs_results | read_time | - | 28.13 | 25.64 | -8.86 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_hdfs_results | write_time | - | 49.44 | 43.27 | -12.48 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_results | read_time | - | 30.1 | 29.24 | -2.89 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_results | write_time | - | 50.48 | 44.31 | -12.23 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
tfrecordioit_results | read_time | - | 26.19 | 24.14 | -7.83 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
tfrecordioit_results | write_time | - | 33.89 | 31.57 | -6.84 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
wordcount_py37_results | runtime | - | 836.15 | 832.1 | -0.48 |
[[1]](http://metrics.beam.apache.org/d/1cnwVDkGk)
xmlioit_hdfs_results | read_time | - | 28.5 | -94420026.21 | -331252806.93 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_hdfs_results | write_time | - | 48.56 | 50.15 | 3.27 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_results | read_time | - | 31.18 | 27.99 | -10.23 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_results | write_time | - | 43.87 | 40.67 | -7.3 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
nexmark_0_batch | RuntimeMs | DataflowRunner | 74905.5 | 71301.06 | -4.81 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_batch | RuntimeMs | DirectRunner | 2402.32 | 2482.61 | 3.34 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_batch | RuntimeMs | FlinkRunner | 1103.21 | 1143.72 | 3.67 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_batch | RuntimeMs | SparkRunner | 1083.25 | 1181.22 | 9.04 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_batch | RuntimeMs | SparkStructuredStreamingRunner | 1095.71 |
1066.56 | -2.66 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_sql_batch | RuntimeMs | DataflowRunner | 74450.79 | 68583.17 | -7.88
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_sql_batch | RuntimeMs | DirectRunner | 3670.71 | 3708.44 | 1.03 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_sql_batch | RuntimeMs | SparkRunner | 1058.86 | 1053.5 | -0.51 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1083.93 |
1086.67 | 0.25 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_sql_streaming | RuntimeMs | DataflowRunner | 25232.07 | 24531.72 |
-2.78 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_sql_streaming | RuntimeMs | DirectRunner | 6318.93 | 6298.72 | -0.32
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_sql_streaming | RuntimeMs | FlinkRunner | 1646.89 | 1741.56 | 5.75 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_streaming | RuntimeMs | DataflowRunner | 23810.68 | 22894.72 | -3.85
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_streaming | RuntimeMs | DirectRunner | 4907.36 | 4829.94 | -1.58 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_streaming | RuntimeMs | FlinkRunner | 1536.14 | 1481.06 | -3.59 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_batch | RuntimeMs | DataflowRunner | 458018.93 | 414367.67 |
-9.53 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_zetasql_batch | RuntimeMs | DirectRunner | 8088.93 | 7362.33 | -8.98
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_zetasql_streaming | RuntimeMs | DataflowRunner | 195068.36 |
176786.33 | -9.37 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_streaming | RuntimeMs | DirectRunner | 10502.96 | 9877.06 |
-5.96 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_streaming | RuntimeMs | FlinkRunner | 7384.68 | 7055.61 |
-4.46 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_batch | RuntimeMs | DataflowRunner | 98975.61 | 93982.61 | -5.04 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_10_batch | RuntimeMs | DirectRunner | 2670.54 | 2703.0 | 1.22 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_10_batch | RuntimeMs | FlinkRunner | 567.39 | 619.0 | 9.1 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_10_batch | RuntimeMs | SparkRunner | 594.5 | 599.56 | 0.85 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_10_batch | RuntimeMs | SparkStructuredStreamingRunner | 919.54 |
901.17 | -2.0 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_10_streaming | RuntimeMs | DataflowRunner | 95875.75 | 96202.11 | 0.34
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_streaming | RuntimeMs | DirectRunner | 14428.64 | 14510.5 | 0.57 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_streaming | RuntimeMs | FlinkRunner | 1438.18 | 1442.61 | 0.31 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_batch | RuntimeMs | DataflowRunner | 73731.96 | 68447.22 | -7.17 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_11_batch | RuntimeMs | DirectRunner | 2464.07 | 2432.17 | -1.29 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_batch | RuntimeMs | FlinkRunner | 308.36 | 257.61 | -16.46 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_11_batch | RuntimeMs | SparkRunner | 493.21 | 515.94 | 4.61 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_batch | RuntimeMs | SparkStructuredStreamingRunner | 585.32 | 576.0
| -1.59 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_streaming | RuntimeMs | DataflowRunner | 192853.04 | 186308.83 |
-3.39 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_streaming | RuntimeMs | DirectRunner | 3254.39 | 3272.61 | 0.56 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_streaming | RuntimeMs | FlinkRunner | 1481.36 | 1493.89 | 0.85 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_batch | RuntimeMs | DataflowRunner | 56806.0 | 54385.11 | -4.26 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_12_batch | RuntimeMs | DirectRunner | 1632.89 | 1635.22 | 0.14 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_batch | RuntimeMs | FlinkRunner | 191.5 | 179.28 | -6.38 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_batch | RuntimeMs | SparkRunner | 200.21 | 205.11 | 2.45 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_12_batch | RuntimeMs | SparkStructuredStreamingRunner | 329.14 |
350.78 | 6.57 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_12_streaming | RuntimeMs | DataflowRunner | 95262.04 | 93759.89 |
-1.58 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_streaming | RuntimeMs | DirectRunner | 2189.11 | 2167.5 | -0.99 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_streaming | RuntimeMs | FlinkRunner | 702.04 | 706.22 | 0.6 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_batch | RuntimeMs | DataflowRunner | 64003.04 | 58766.44 | -8.18 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_batch | RuntimeMs | DirectRunner | 1595.43 | 1590.78 | -0.29 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_batch | RuntimeMs | FlinkRunner | 347.86 | 334.22 | -3.92 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_batch | RuntimeMs | SparkRunner | 283.36 | 285.89 | 0.89 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_batch | RuntimeMs | SparkStructuredStreamingRunner | 382.36 |
371.78 | -2.77 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_sql_batch | RuntimeMs | DataflowRunner | 129342.29 | 124295.11 |
-3.9 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_sql_batch | RuntimeMs | DirectRunner | 4685.71 | 4624.56 | -1.31 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_sql_batch | RuntimeMs | SparkRunner | 1097.04 | 1097.33 | 0.03 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 953.43 |
960.11 | 0.7 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_sql_streaming | RuntimeMs | DataflowRunner | 39169.11 | 39704.44 |
1.37 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_streaming | RuntimeMs | DirectRunner | 5468.75 | 5414.22 | -1.0
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_streaming | RuntimeMs | FlinkRunner | 30106.75 | 30889.56 | 2.6
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_streaming | RuntimeMs | DataflowRunner | 30023.57 | 29814.39 | -0.7
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_streaming | RuntimeMs | DirectRunner | 2598.11 | 2603.06 | 0.19 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_streaming | RuntimeMs | FlinkRunner | 27821.93 | 27992.39 | 0.61 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_batch | RuntimeMs | DataflowRunner | 955812.75 | 878233.56
| -8.12 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_batch | RuntimeMs | DirectRunner | 14832.11 | 13595.0 |
-8.34 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_streaming | RuntimeMs | DataflowRunner | 390113.82 |
361481.11 | -7.34 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_streaming | RuntimeMs | DirectRunner | 11672.0 | 10487.5 |
-10.15 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_streaming | RuntimeMs | FlinkRunner | 41223.57 | 39083.39 |
-5.19 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_batch | RuntimeMs | DataflowRunner | 128791.07 | 122078.0 | -5.21 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_14_batch | RuntimeMs | DirectRunner | 2592.89 | 2570.72 | -0.86 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_14_batch | RuntimeMs | FlinkRunner | 534.25 | 568.89 | 6.48 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_batch | RuntimeMs | SparkRunner | 797.11 | 800.83 | 0.47 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_batch | RuntimeMs | SparkStructuredStreamingRunner | 816.54 |
810.94 | -0.68 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_streaming | RuntimeMs | DataflowRunner | 153156.86 | 150134.72 |
-1.97 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_streaming | RuntimeMs | DirectRunner | 3346.96 | 3345.28 | -0.05 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_streaming | RuntimeMs | FlinkRunner | 1745.04 | 1783.72 | 2.22 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_batch | RuntimeMs | DataflowRunner | 65216.64 | 60717.5 | -6.9 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_batch | RuntimeMs | DirectRunner | 1517.96 | 1535.44 | 1.15 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_batch | RuntimeMs | FlinkRunner | 272.39 | 270.17 | -0.82 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_1_batch | RuntimeMs | SparkRunner | 350.32 | 316.56 | -9.64 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_batch | RuntimeMs | SparkStructuredStreamingRunner | 393.86 | 379.83
| -3.56 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_1_sql_batch | RuntimeMs | DataflowRunner | 70980.25 | 63427.61 |
-10.64 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_1_sql_batch | RuntimeMs | DirectRunner | 2244.25 | 2178.0 | -2.95 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_sql_batch | RuntimeMs | SparkRunner | 429.75 | 426.78 | -0.69 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_1_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 495.75 |
503.83 | 1.63 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_streaming | RuntimeMs | DataflowRunner | 22377.5 | 21900.0 |
-2.13 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_streaming | RuntimeMs | DirectRunner | 3736.18 | 3642.0 | -2.52
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_streaming | RuntimeMs | FlinkRunner | 784.21 | 759.17 | -3.19 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_streaming | RuntimeMs | DataflowRunner | 19407.32 | 18743.39 | -3.42
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_streaming | RuntimeMs | DirectRunner | 3368.07 | 3342.83 | -0.75 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_streaming | RuntimeMs | FlinkRunner | 692.79 | 700.89 | 1.17 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_batch | RuntimeMs | DataflowRunner | 51229.89 | 45900.33 | -10.4 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_batch | RuntimeMs | DirectRunner | 968.04 | 959.11 | -0.92 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_batch | RuntimeMs | FlinkRunner | 120.32 | 146.56 | 21.8 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_batch | RuntimeMs | SparkRunner | 139.57 | 139.22 | -0.25 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_batch | RuntimeMs | SparkStructuredStreamingRunner | 228.96 | 197.06
| -13.94 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_sql_batch | RuntimeMs | DataflowRunner | 50852.36 | 48423.67 | -4.78
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_sql_batch | RuntimeMs | DirectRunner | 1266.93 | 1242.89 | -1.9 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_sql_batch | RuntimeMs | SparkRunner | 188.43 | 191.0 | 1.36 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 256.11 |
263.0 | 2.69 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_streaming | RuntimeMs | DataflowRunner | 13851.43 | 14439.28 |
4.24 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_streaming | RuntimeMs | DirectRunner | 2004.25 | 2022.78 | 0.92
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_streaming | RuntimeMs | FlinkRunner | 462.21 | 466.72 | 0.98 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_streaming | RuntimeMs | DataflowRunner | 11629.93 | 11167.72 | -3.97
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_streaming | RuntimeMs | DirectRunner | 1606.68 | 1554.39 | -3.25 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_streaming | RuntimeMs | FlinkRunner | 357.86 | 351.17 | -1.87 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_batch | RuntimeMs | DataflowRunner | 325760.54 | 280040.61 |
-14.03 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_batch | RuntimeMs | DirectRunner | 4686.14 | 4007.89 |
-14.47 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_zetasql_streaming | RuntimeMs | DataflowRunner | 142627.21 |
128651.06 | -9.8 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_streaming | RuntimeMs | DirectRunner | 5621.46 | 4929.78 |
-12.3 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_streaming | RuntimeMs | FlinkRunner | 4722.04 | 4030.33 |
-14.65 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_batch | RuntimeMs | DataflowRunner | 62533.32 | 58567.67 | -6.34 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_3_batch | RuntimeMs | DirectRunner | 2948.5 | 3014.89 | 2.25 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_batch | RuntimeMs | FlinkRunner | 1119.11 | 1156.56 | 3.35 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_batch | RuntimeMs | SparkRunner | 1052.86 | 1009.39 | -4.13 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_3_sql_batch | RuntimeMs | DataflowRunner | 62057.96 | 53862.33 |
-13.21 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_sql_batch | RuntimeMs | DirectRunner | 2408.36 | 2384.06 | -1.01 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_batch | RuntimeMs | SparkRunner | 1072.57 | 1070.61 | -0.18 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 632.71 |
643.67 | 1.73 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_streaming | RuntimeMs | DataflowRunner | 37745.46 | 38662.33 |
2.43 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_streaming | RuntimeMs | DirectRunner | 3670.61 | 3712.33 | 1.14
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_streaming | RuntimeMs | FlinkRunner | 985.5 | 1018.0 | 3.3 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_streaming | RuntimeMs | DataflowRunner | 45285.14 | 43640.17 | -3.63
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_streaming | RuntimeMs | DirectRunner | 3715.86 | 3726.83 | 0.3 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_streaming | RuntimeMs | FlinkRunner | 768.14 | 757.72 | -1.36 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_batch | RuntimeMs | DataflowRunner | 118994.68 | 114794.28 |
-3.53 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_3_zetasql_batch | RuntimeMs | DirectRunner | 2920.64 | 2850.17 | -2.41
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_streaming | RuntimeMs | DataflowRunner | 58178.5 | 57758.33
| -0.72 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_streaming | RuntimeMs | DirectRunner | 4197.93 | 4222.06 |
0.57 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_streaming | RuntimeMs | FlinkRunner | 1580.5 | 1517.83 |
-3.96 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_batch | RuntimeMs | DataflowRunner | 65410.61 | 60982.22 | -6.77 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_batch | RuntimeMs | DirectRunner | 1519.96 | 1506.22 | -0.9 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_batch | RuntimeMs | FlinkRunner | 871.14 | 921.17 | 5.74 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_batch | RuntimeMs | SparkRunner | 518.21 | 518.11 | -0.02 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_batch | RuntimeMs | SparkStructuredStreamingRunner | 1160.54 |
1194.61 | 2.94 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_streaming | RuntimeMs | DataflowRunner | 59165.36 | 57853.89 | -2.22
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_streaming | RuntimeMs | DirectRunner | 1292.5 | 1277.39 | -1.17 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_streaming | RuntimeMs | FlinkRunner | 1164.36 | 1180.17 | 1.36 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_batch | RuntimeMs | DataflowRunner | 79674.36 | 75758.44 | -4.91 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_batch | RuntimeMs | DirectRunner | 5216.54 | 5119.78 | -1.85 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_batch | RuntimeMs | FlinkRunner | 679.11 | 694.67 | 2.29 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_5_batch | RuntimeMs | SparkRunner | 610.64 | 595.56 | -2.47 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_5_batch | RuntimeMs | SparkStructuredStreamingRunner | 1255.36 |
1268.56 | 1.05 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_streaming | RuntimeMs | DataflowRunner | 147660.07 | 146371.5 |
-0.87 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_streaming | RuntimeMs | DirectRunner | 6110.54 | 6137.61 | 0.44 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_streaming | RuntimeMs | FlinkRunner | 1437.0 | 1383.06 | -3.75 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_batch | RuntimeMs | DataflowRunner | 63327.25 | 58900.72 | -6.99 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_6_batch | RuntimeMs | DirectRunner | 1020.21 | 1008.61 | -1.14 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_6_batch | RuntimeMs | FlinkRunner | 418.75 | 421.33 | 0.62 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_batch | RuntimeMs | SparkRunner | 260.14 | 257.39 | -1.06 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_batch | RuntimeMs | SparkStructuredStreamingRunner | 295.18 | 292.78
| -0.81 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_6_streaming | RuntimeMs | DataflowRunner | 49286.39 | 49648.0 | 0.73 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_streaming | RuntimeMs | DirectRunner | 932.25 | 943.39 | 1.19 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_streaming | RuntimeMs | FlinkRunner | 573.64 | 566.94 | -1.17 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_batch | RuntimeMs | DataflowRunner | 108884.82 | 96543.67 | -11.33 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_batch | RuntimeMs | DirectRunner | 3375.79 | 3311.72 | -1.9 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_batch | RuntimeMs | FlinkRunner | 555.32 | 588.39 | 5.95 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_batch | RuntimeMs | SparkRunner | 460.32 | 467.17 | 1.49 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_batch | RuntimeMs | SparkStructuredStreamingRunner | 1573.07 |
1589.11 | 1.02 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_sql_batch | RuntimeMs | DataflowRunner | 151474.61 | 143522.72 |
-5.25 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_sql_batch | RuntimeMs | DirectRunner | 92802.36 | 92227.61 | -0.62 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_batch | RuntimeMs | SparkRunner | 2397.29 | 2344.67 | -2.19 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 2903.11 |
2920.5 | 0.6 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_streaming | RuntimeMs | DataflowRunner | 1165419.68 | 1134892.17
| -2.62 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_streaming | RuntimeMs | DirectRunner | 106837.64 | 107333.28 |
0.46 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_streaming | RuntimeMs | FlinkRunner | 4100.32 | 4158.06 | 1.41 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_streaming | RuntimeMs | DataflowRunner | 114624.93 | 112601.39 |
-1.77 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_streaming | RuntimeMs | DirectRunner | 7938.64 | 7976.39 | 0.48 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_streaming | RuntimeMs | FlinkRunner | 8821.39 | 8876.83 | 0.63 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_batch | RuntimeMs | DataflowRunner | 61103.86 | 57430.0 | -6.01 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_8_batch | RuntimeMs | DirectRunner | 1510.18 | 1495.33 | -0.98 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_8_batch | RuntimeMs | FlinkRunner | 515.11 | 476.72 | -7.45 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_batch | RuntimeMs | SparkRunner | 372.18 | 369.17 | -0.81 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_batch | RuntimeMs | SparkStructuredStreamingRunner | 378.71 | 370.83
| -2.08 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_streaming | RuntimeMs | DataflowRunner | 52149.89 | 49521.89 | -5.04
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_streaming | RuntimeMs | DirectRunner | 2563.36 | 2571.94 | 0.34 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_streaming | RuntimeMs | FlinkRunner | 436.54 | 457.0 | 4.69 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_batch | RuntimeMs | DataflowRunner | 61166.57 | 56991.56 | -6.83 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_9_batch | RuntimeMs | DirectRunner | 700.43 | 702.44 | 0.29 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_9_batch | RuntimeMs | FlinkRunner | 309.79 | 290.44 | -6.24 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_9_batch | RuntimeMs | SparkRunner | 198.0 | 201.33 | 1.68 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_batch | RuntimeMs | SparkStructuredStreamingRunner | 169.57 | 171.44
| 1.1 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_9_streaming | RuntimeMs | DataflowRunner | 41196.71 | 40445.78 | -1.82
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_streaming | RuntimeMs | DirectRunner | 676.64 | 676.61 | -0.0 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_streaming | RuntimeMs | FlinkRunner | 401.36 | 409.39 | 2.0 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)