You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/09/20 12:01:44 UTC

Beam Metrics Report (2021-09-20)

# Beam Metrics Report

Color legend:  >= 20 | >= 10 | <= -10 | <= -20  
---|---|---|---  
  
## Possible regression

**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**  
---|---|---|---|---|---|---  
avroioit_results | read_time | - | 61.55 | 109.19 | 77.4 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
avroioit_results | write_time | - | 80.18 | 129.98 | 62.11 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_batch_avro | avro_write_time | - | 20.73 | 35.72 |
72.31 |  [[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_batch_avro | read_time | - | 18.41 | 43.65 | 137.12 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_batch_json | read_time | - | 28.32 | 42.06 | 48.49 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_batch_json | write_time | - | 37.79 | 56.36 | 49.13 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
compressed_textioit_results | read_time | - | 106.21 | 186.65 | 75.74 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
compressed_textioit_results | write_time | - | 133.38 | 232.44 | 74.26 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
java_batch_gbk_3 | dataflow_runtime_sec | - | 10.41 | 11.65 | 11.96 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_7 | dataflow_runtime_sec | - | 57.13 | 67.34 | 17.86 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_pardo_1 | sparkstructuredstreaming_runtime_sec | - | 49.27 | 81.16
| 64.73 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_3 | dataflow_runtime_sec | - | 13.93 | 16.21 | 16.39 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_gbk_1 | dataflow_runtime_sec | - | 698.82 | 772.83 | 10.59 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_2 | dataflow_runtime_sec | - | 903.6 | 1112.45 | 23.11 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_pardo_2 | dataflow_v2_java11_runtime_sec | - | 4334.11 |
4871.36 | 12.4 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_4 | dataflow_v2_java11_runtime_sec | - | 240.21 | 267.43
| 11.33 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
many_files_textioit_results | read_time | - | 10.51 | 24.52 | 133.34 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
many_files_textioit_results | write_time | - | 29.22 | 59.64 | 104.12 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
parquetioit_results | read_time | - | 33.46 | 100.7 | 200.99 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
parquetioit_results | write_time | - | 47.78 | 152.29 | 218.72 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
python_batch_gbk_3 | python_dataflow_batch_gbk_3_runtime | - | 15.0 | 19.5 |
30.0 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_psio_2GB_results | pubsub_io_perf_write_runtime | - | 65.5 | 81.75 |
24.81 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_streaming_gbk_3 | python_dataflow_streaming_gbk_3_runtime | - | 84.0 |
105.25 | 25.3 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_streaming_gbk_7 | python_dataflow_streaming_gbk_7_runtime | - | 343.17
| 435.25 | 26.83 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_streaming_pardo_6 | python_flink_streaming_pardo_6_runtime | - | 0.5 |
77.0 | 15300.0 |  
textioit_results | read_time | - | 6.82 | 22.33 | 227.24 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
textioit_results | write_time | - | 10.4 | 32.05 | 208.26 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
xmlioit_results | read_time | - | 16.44 | 25.92 | 57.61 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
xmlioit_results | write_time | - | 18.72 | 25.05 | 33.78 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
nexmark_0_batch | RuntimeMs | DataflowRunner | 17665.02 | 29292.83 | 65.82 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_0_sql_streaming | RuntimeMs | DataflowRunner | 19012.67 | 21774.5 |
14.53 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_streaming | RuntimeMs | DataflowRunner | 23197.76 | 31675.02 | 36.54
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_10_batch | RuntimeMs | DataflowRunner | 30292.08 | 50608.33 | 67.07 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_10_streaming | RuntimeMs | DataflowRunner | 79481.03 | 111779.57 |
40.64 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_11_batch | RuntimeMs | DataflowRunner | 22112.13 | 38774.78 | 75.36 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_11_streaming | RuntimeMs | DataflowRunner | 253178.08 | 335382.4 |
32.47 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_12_batch | RuntimeMs | DataflowRunner | 11940.21 | 18770.8 | 57.21 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_12_batch | RuntimeMs | SparkStructuredStreamingRunner | 733.43 |
818.72 | 11.63 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_12_streaming | RuntimeMs | DataflowRunner | 78612.95 | 112226.69 |
42.76 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_batch | RuntimeMs | DataflowRunner | 21319.79 | 32880.94 | 54.23 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_sql_batch | RuntimeMs | DataflowRunner | 61522.0 | 68731.67 | 11.72
|  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_streaming | RuntimeMs | DataflowRunner | 17297.25 | 27255.22 |
57.57 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_14_batch | RuntimeMs | DataflowRunner | 51025.36 | 64117.39 | 25.66 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_14_streaming | RuntimeMs | DataflowRunner | 75881.31 | 113981.44 |
50.21 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_15_batch | RuntimeMs | DataflowRunner | 28904.07 | 49791.31 | 72.26 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_1_batch | RuntimeMs | DataflowRunner | 14493.83 | 22541.41 | 55.52 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_1_sql_streaming | RuntimeMs | DataflowRunner | 17288.33 | 19872.11 |
14.95 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_streaming | RuntimeMs | DataflowRunner | 21256.46 | 25315.76 | 19.1
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_batch | RuntimeMs | DataflowRunner | 10225.08 | 15530.15 | 51.88 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_2_streaming | RuntimeMs | DataflowRunner | 12722.05 | 16787.6 | 31.96
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_batch | RuntimeMs | DataflowRunner | 15236.96 | 21986.06 | 44.29 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_3_sql_streaming | RuntimeMs | DataflowRunner | 27393.0 | 30699.83 |
12.07 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_streaming | RuntimeMs | DataflowRunner | 44433.22 | 54932.19 | 23.63
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_4_batch | RuntimeMs | DataflowRunner | 19319.29 | 31692.83 | 64.05 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_4_streaming | RuntimeMs | DataflowRunner | 33013.0 | 49260.44 | 49.22
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_5_batch | RuntimeMs | DataflowRunner | 19017.61 | 37544.17 | 97.42 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_5_streaming | RuntimeMs | DataflowRunner | 207063.43 | 307345.67 |
48.43 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_6_batch | RuntimeMs | DataflowRunner | 17735.14 | 26535.83 | 49.62 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_6_streaming | RuntimeMs | DataflowRunner | 26480.38 | 37157.22 | 40.32
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_7_batch | RuntimeMs | DataflowRunner | 32855.68 | 50403.94 | 53.41 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_streaming | RuntimeMs | DataflowRunner | 116955.05 | 181783.36 |
55.43 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_8_batch | RuntimeMs | DataflowRunner | 11739.98 | 20925.52 | 78.24 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_8_streaming | RuntimeMs | DataflowRunner | 59748.08 | 82247.48 | 37.66
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_9_batch | RuntimeMs | DataflowRunner | 15411.71 | 25128.06 | 63.05 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_9_streaming | RuntimeMs | DataflowRunner | 20166.25 | 30907.94 | 53.27
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
  
## Possible improvement

**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**  
---|---|---|---|---|---|---  
java_batch_cogbk_1 | dataflow_runtime_sec | - | 52.4 | 46.71 | -10.86 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_1 | sparkstructuredstreaming_runtime_sec | - | 149.61 |
119.98 | -19.81 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_2 | dataflow_runtime_sec | - | 59.26 | 52.25 | -11.84 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_2 | sparkstructuredstreaming_runtime_sec | - | 151.55 |
117.75 | -22.3 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_3 | dataflow_runtime_sec | - | 16.08 | 14.26 | -11.37 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_3 | dataflow_v2_java11_runtime_sec | - | 15.52 | 13.11 |
-15.52 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_3 | sparkstructuredstreaming_runtime_sec | - | 26.88 | 19.43
| -27.73 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_4 | dataflow_runtime_sec | - | 15.3 | 13.2 | -13.72 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_4 | sparkstructuredstreaming_runtime_sec | - | 27.03 | 19.51
| -27.8 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_combine_5 | dataflow_runtime_sec | - | 35.01 | 29.34 | -16.19 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_gbk_1 | dataflow_v2_java11_runtime_sec | - | 120.96 | 106.89 |
-11.63 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_1 | sparkstructuredstreaming_runtime_sec | - | 11741.51 |
540.19 | -95.4 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_2 | sparkstructuredstreaming_runtime_sec | - | 126.92 | 107.88
| -15.0 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_3 | sparkstructuredstreaming_runtime_sec | - | 11.97 | 8.62 |
-28.01 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_4 | dataflow_v2_java11_runtime_sec | - | 31.22 | 21.52 | -31.07
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_4 | sparkstructuredstreaming_runtime_sec | - | 120.27 | 101.11
| -15.93 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_5 | sparkstructuredstreaming_runtime_sec | - | 118.98 | 100.65
| -15.4 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_pardo_1 | dataflow_runtime_sec | - | 26.46 | 22.34 | -15.57 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_1 | dataflow_v2_java11_runtime_sec | - | 19.66 | 14.61 |
-25.67 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_3 | dataflow_v2_java11_runtime_sec | - | 15.46 | 11.81 |
-23.6 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_1 | dataflow_v2_java11_runtime_sec | - | 141.72 | 106.66
| -24.74 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_3 | dataflow_v2_java11_runtime_sec | - | 100.96 | 87.56 |
-13.28 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_cogbk_1 | python_dataflow_batch_cogbk_1_runtime | - | 474.14 |
416.0 | -12.26 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_batch_cogbk_4 | python_dataflow_batch_cogbk_4_runtime | - | 300.29 |
239.5 | -20.24 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_batch_combine_1 | python_dataflow_batch_combine_1_runtime | - | 918.83
| 822.25 | -10.51 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_combine_4 | python_dataflow_batch_combine_4_runtime | - | 26.8 |
24.0 | -10.45 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_combine_5 | python_dataflow_batch_combine_5_runtime | - | 22.2 |
19.5 | -12.16 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_gbk_1 | python_dataflow_batch_gbk_1_runtime | - | 2310.33 |
1793.25 | -22.38 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_4 | python_dataflow_batch_gbk_4_runtime | - | 114.33 | 99.75
| -12.76 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_5 | python_dataflow_batch_gbk_5_runtime | - | 113.0 | 85.75 |
-24.12 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_pardo_3 | python_dataflow_batch_pardo_3_runtime | - | 153.2 |
136.25 | -11.06 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_3 | python_flink_batch_pardo_3_runtime | - | 650.33 | 566.5
| -12.89 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_4 | python_flink_batch_pardo_4_runtime | - | 2079.33 |
1781.33 | -14.33 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_sideinput_6 | python_dataflow_batch_sideinput_6_runtime | - |
50.75 | 45.25 | -10.84 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_7 | python_dataflow_batch_sideinput_7_runtime | - |
6841.5 | 5105.5 | -25.37 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_direct_microbenchmarks | fn_api_runner_microbenchmark_runtime_sec | - |
112.55 | 95.67 | -15.0 |  
python_spannerio_read_2GB_results | pyspanner_read_2GB_results_runtime | - |
29.0 | 25.5 | -12.07 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_streaming_cogbk_1 | python_dataflow_streaming_cogbk_1_runtime | - |
624.33 | 534.5 | -14.39 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_streaming_combine_4 | python_flink_streaming_combine_4_runtime | - |
217.0 | 185.0 | -14.75 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_streaming_pardo_1 | python_dataflow_streaming_pardo_1_runtime | - |
165.5 | 145.75 | -11.93 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_1 | python_flink_streaming_pardo_5_runtime | - | 139.5
| 122.67 | -12.07 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_2 | python_flink_streaming_pardo_2_runtime | - | 3545.0
| 3113.67 | -12.17 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_3 | python_flink_streaming_pardo_3_runtime | - | 229.5
| 203.67 | -11.26 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_4 | python_dataflow_streaming_pardo_4_runtime | - |
448.33 | 400.25 | -10.72 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_4 | python_flink_streaming_pardo_4_runtime | - | 629.5
| 430.0 | -31.69 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
tfrecordioit_results | write_time | - | 27.36 | 22.64 | -17.24 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
nexmark_13_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1913.11 |
1623.67 | -15.13 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_14_batch | RuntimeMs | SparkStructuredStreamingRunner | 1087.96 |
952.89 | -12.42 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_15_batch | RuntimeMs | SparkStructuredStreamingRunner | 1539.82 |
1325.72 | -13.9 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 2805.64 |
2471.83 | -11.9 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_4_batch | RuntimeMs | SparkStructuredStreamingRunner | 2763.43 |
2317.94 | -16.12 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_6_batch | RuntimeMs | SparkStructuredStreamingRunner | 1170.29 |
891.94 | -23.78 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_7_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 4904.11 |
3957.67 | -19.3 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_9_batch | RuntimeMs | SparkStructuredStreamingRunner | 958.75 | 676.89
| -29.4 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
  
## All metrics

**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**  
---|---|---|---|---|---|---  
avroioit_results | read_time | - | 61.55 | 109.19 | 77.4 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
avroioit_results | write_time | - | 80.18 | 129.98 | 62.11 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_batch_avro | avro_write_time | - | 20.73 | 35.72 |
72.31 |  [[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_batch_avro | read_time | - | 18.41 | 43.65 | 137.12 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_batch_json | read_time | - | 28.32 | 42.06 | 48.49 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_batch_json | write_time | - | 37.79 | 56.36 | 49.13 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
compressed_textioit_results | read_time | - | 106.21 | 186.65 | 75.74 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
compressed_textioit_results | write_time | - | 133.38 | 232.44 | 74.26 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
java_batch_cogbk_1 | dataflow_runtime_sec | - | 52.4 | 46.71 | -10.86 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_1 | dataflow_v2_java11_runtime_sec | - | 59.49 | 58.18 |
-2.21 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_1 | sparkstructuredstreaming_runtime_sec | - | 149.61 |
119.98 | -19.81 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_2 | dataflow_runtime_sec | - | 59.26 | 52.25 | -11.84 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_2 | dataflow_v2_java11_runtime_sec | - | 64.11 | 59.63 |
-6.99 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_2 | sparkstructuredstreaming_runtime_sec | - | 151.55 |
117.75 | -22.3 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_3 | dataflow_runtime_sec | - | 16.08 | 14.26 | -11.37 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_3 | dataflow_v2_java11_runtime_sec | - | 15.52 | 13.11 |
-15.52 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_3 | sparkstructuredstreaming_runtime_sec | - | 26.88 | 19.43
| -27.73 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_4 | dataflow_runtime_sec | - | 15.3 | 13.2 | -13.72 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_4 | dataflow_v2_java11_runtime_sec | - | 13.49 | 12.39 |
-8.18 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_4 | sparkstructuredstreaming_runtime_sec | - | 27.03 | 19.51
| -27.8 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_combine_1 | dataflow_runtime_sec | - | 81.36 | 76.28 | -6.24 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_1 | sparkstructuredstreaming_runtime_sec | - | 569.05 |
597.36 | 4.97 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_4 | dataflow_runtime_sec | - | 29.95 | 31.33 | 4.63 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_4 | sparkstructuredstreaming_runtime_sec | - | 137.04 |
138.71 | 1.22 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_5 | dataflow_runtime_sec | - | 35.01 | 29.34 | -16.19 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_5 | sparkstructuredstreaming_runtime_sec | - | 135.09 |
135.46 | 0.27 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_gbk_1 | dataflow_runtime_sec | - | 151.4 | 152.72 | 0.87 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_1 | dataflow_v2_java11_runtime_sec | - | 120.96 | 106.89 |
-11.63 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_1 | sparkstructuredstreaming_runtime_sec | - | 11741.51 |
540.19 | -95.4 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_2 | dataflow_runtime_sec | - | 40.1 | 41.87 | 4.43 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_2 | dataflow_v2_java11_runtime_sec | - | 57.51 | 53.56 | -6.86
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_2 | sparkstructuredstreaming_runtime_sec | - | 126.92 | 107.88
| -15.0 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_3 | dataflow_runtime_sec | - | 10.41 | 11.65 | 11.96 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_3 | dataflow_v2_java11_runtime_sec | - | 14.34 | 13.84 | -3.44
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_3 | sparkstructuredstreaming_runtime_sec | - | 11.97 | 8.62 |
-28.01 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_4 | dataflow_runtime_sec | - | 18.27 | 19.96 | 9.24 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_4 | dataflow_v2_java11_runtime_sec | - | 31.22 | 21.52 | -31.07
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_4 | sparkstructuredstreaming_runtime_sec | - | 120.27 | 101.11
| -15.93 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_5 | dataflow_runtime_sec | - | 18.5 | 17.17 | -7.19 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_5 | dataflow_v2_java11_runtime_sec | - | 21.83 | 23.55 | 7.88 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_5 | sparkstructuredstreaming_runtime_sec | - | 118.98 | 100.65
| -15.4 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_6 | dataflow_runtime_sec | - | 44.67 | 44.69 | 0.06 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_6 | dataflow_v2_java11_runtime_sec | - | 32.87 | 29.93 | -8.95
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_6 | sparkstructuredstreaming_runtime_sec | - | 61.66 | 63.03 |
2.23 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_7 | dataflow_runtime_sec | - | 57.13 | 67.34 | 17.86 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_7 | dataflow_v2_java11_runtime_sec | - | 65.47 | 63.52 | -2.97
|  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_7 | sparkstructuredstreaming_runtime_sec | - | 93.69 | 90.31 |
-3.61 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_pardo_1 | dataflow_runtime_sec | - | 26.46 | 22.34 | -15.57 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_1 | dataflow_v2_java11_runtime_sec | - | 19.66 | 14.61 |
-25.67 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_1 | sparkstructuredstreaming_runtime_sec | - | 49.27 | 81.16
| 64.73 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_2 | dataflow_runtime_sec | - | 228.09 | 217.22 | -4.77 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_2 | dataflow_v2_java11_runtime_sec | - | 91.4 | 86.93 | -4.88
|  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_3 | dataflow_runtime_sec | - | 13.93 | 16.21 | 16.39 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_3 | dataflow_v2_java11_runtime_sec | - | 15.46 | 11.81 |
-23.6 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_4 | dataflow_runtime_sec | - | 25.49 | 24.8 | -2.69 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_4 | dataflow_v2_java11_runtime_sec | - | 26.26 | 27.69 | 5.43
|  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_cogbk_1 | dataflow_runtime_sec | - | 942.03 | 935.08 | -0.74 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_2 | dataflow_runtime_sec | - | 914.32 | 910.23 | -0.45 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_3 | dataflow_runtime_sec | - | 118.24 | 120.66 | 2.05 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_4 | dataflow_runtime_sec | - | 116.21 | 117.2 | 0.86 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_combine_1 | dataflow_runtime_sec | - | 495.41 | 531.23 | 7.23 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_streaming_combine_4 | dataflow_runtime_sec | - | 312.49 | 324.54 | 3.86 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_streaming_combine_5 | dataflow_runtime_sec | - | 344.83 | 318.77 | -7.56
|  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_streaming_gbk_1 | dataflow_runtime_sec | - | 698.82 | 772.83 | 10.59 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_2 | dataflow_runtime_sec | - | 903.6 | 1112.45 | 23.11 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_3 | dataflow_runtime_sec | - | 23.61 | 23.3 | -1.34 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_4 | dataflow_runtime_sec | - | 317.84 | 304.56 | -4.18 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_5 | dataflow_runtime_sec | - | 305.56 | 323.08 | 5.73 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_6 | dataflow_runtime_sec | - | 74.51 | 73.85 | -0.88 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_7 | dataflow_runtime_sec | - | 144.53 | 137.79 | -4.66 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_pardo_1 | dataflow_runtime_sec | - | 20.34 | 18.55 | -8.76 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_1 | dataflow_v2_java11_runtime_sec | - | 141.72 | 106.66
| -24.74 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_2 | dataflow_runtime_sec | - | 212.19 | 219.95 | 3.66 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_2 | dataflow_v2_java11_runtime_sec | - | 4334.11 |
4871.36 | 12.4 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_3 | dataflow_runtime_sec | - | 11.78 | 11.98 | 1.67 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_3 | dataflow_v2_java11_runtime_sec | - | 100.96 | 87.56 |
-13.28 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_4 | dataflow_runtime_sec | - | 30.56 | 30.99 | 1.41 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_4 | dataflow_v2_java11_runtime_sec | - | 240.21 | 267.43
| 11.33 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
many_files_textioit_results | read_time | - | 10.51 | 24.52 | 133.34 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
many_files_textioit_results | write_time | - | 29.22 | 59.64 | 104.12 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
parquetioit_results | read_time | - | 33.46 | 100.7 | 200.99 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
parquetioit_results | write_time | - | 47.78 | 152.29 | 218.72 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
python_batch_cogbk_1 | python_dataflow_batch_cogbk_1_runtime | - | 474.14 |
416.0 | -12.26 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_batch_cogbk_2 | python_dataflow_batch_cogbk_2_runtime | - | 284.43 |
256.75 | -9.73 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_batch_cogbk_3 | python_dataflow_batch_cogbk_3_runtime | - | 255.57 |
237.5 | -7.07 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_batch_cogbk_4 | python_dataflow_batch_cogbk_4_runtime | - | 300.29 |
239.5 | -20.24 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_batch_combine_1 | python_dataflow_batch_combine_1_runtime | - | 918.83
| 822.25 | -10.51 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_combine_1 | python_flink_batch_combine_1_runtime | - | 4083.5 |
4132.75 | 1.21 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_combine_4 | python_dataflow_batch_combine_4_runtime | - | 26.8 |
24.0 | -10.45 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_combine_4 | python_flink_batch_combine_4_runtime | - | 143.0 |
143.0 | 0.0 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_combine_5 | python_dataflow_batch_combine_5_runtime | - | 22.2 |
19.5 | -12.16 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_combine_5 | python_flink_batch_combine_5_runtime | - | 96.67 |
96.25 | -0.43 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_gbk_1 | python_dataflow_batch_gbk_1_runtime | - | 2310.33 |
1793.25 | -22.38 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_2 | python_dataflow_batch_gbk_2_runtime | - | 362.0 | 368.0 |
1.66 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_3 | python_dataflow_batch_gbk_3_runtime | - | 15.0 | 19.5 |
30.0 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_4 | python_dataflow_batch_gbk_4_runtime | - | 114.33 | 99.75
| -12.76 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_5 | python_dataflow_batch_gbk_5_runtime | - | 113.0 | 85.75 |
-24.12 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_6 | python_dataflow_batch_gbk_6_runtime | - | 352.6 | 322.75
| -8.47 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_7 | python_dataflow_batch_gbk_7_runtime | - | 311.2 | 300.25
| -3.52 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_pardo_1 | python_dataflow_batch_pardo_1_runtime | - | 148.0 |
156.5 | 5.74 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_1 | python_flink_batch_pardo_1_runtime | - | 708.0 | 671.33
| -5.18 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_2 | python_dataflow_batch_pardo_2_runtime | - | 1491.8 |
1479.0 | -0.86 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_3 | python_dataflow_batch_pardo_3_runtime | - | 153.2 |
136.25 | -11.06 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_3 | python_flink_batch_pardo_3_runtime | - | 650.33 | 566.5
| -12.89 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_4 | python_dataflow_batch_pardo_4_runtime | - | 319.8 |
309.25 | -3.3 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_4 | python_flink_batch_pardo_4_runtime | - | 2079.33 |
1781.33 | -14.33 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_sideinput_1 | python_dataflow_batch_sideinput_1_runtime | - |
46.14 | 46.0 | -0.31 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_2 | python_dataflow_batch_sideinput_2_runtime | - |
47.14 | 44.2 | -6.24 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_3 | python_dataflow_batch_sideinput_3_runtime | - |
6.43 | 6.0 | -6.67 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_4 | python_dataflow_batch_sideinput_4_runtime | - |
456.57 | 469.5 | 2.83 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_5 | python_dataflow_batch_sideinput_5_runtime | - |
48.4 | 47.0 | -2.89 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_6 | python_dataflow_batch_sideinput_6_runtime | - |
50.75 | 45.25 | -10.84 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_batch_sideinput_7 | python_dataflow_batch_sideinput_7_runtime | - |
6841.5 | 5105.5 | -25.37 |  [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)  
python_bqio_read_10GB_results | bqio_read_10GB_results_runtime | - | 97.4 |
97.5 | 0.1 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_bqio_write_10GB_results | bqio_write_10GB_results_runtime | - | 222.4 |
222.75 | 0.16 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_direct_microbenchmarks | fn_api_runner_microbenchmark_runtime_sec | - |
112.55 | 95.67 | -15.0 |  
python_direct_microbenchmarks | teststream_microbenchmark_runtime_sec | - |
342.51 | 344.02 | 0.44 |  
python_psio_2GB_results | pubsub_io_perf_write_runtime | - | 65.5 | 81.75 |
24.81 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_spanner_write_2GB_results | pyspanner_write_2GB_results_runtime | - |
1723.0 | 1551.25 | -9.97 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_spannerio_read_2GB_results | pyspanner_read_2GB_results_runtime | - |
29.0 | 25.5 | -12.07 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_streaming_cogbk_1 | python_dataflow_streaming_cogbk_1_runtime | - |
624.33 | 534.5 | -14.39 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_streaming_cogbk_2 | python_dataflow_streaming_cogbk_2_runtime | - |
279.0 | 293.0 | 5.02 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_streaming_cogbk_3 | python_dataflow_streaming_cogbk_3_runtime | - |
316.2 | 344.5 | 8.95 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_streaming_cogbk_4 | python_dataflow_streaming_cogbk_4_runtime | - |
179.6 | 196.0 | 9.13 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_streaming_combine_4 | python_flink_streaming_combine_4_runtime | - |
217.0 | 185.0 | -14.75 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_streaming_combine_5 | python_flink_streaming_combine_5_runtime | - |
212.0 | 193.5 | -8.73 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_streaming_gbk_3 | python_dataflow_streaming_gbk_3_runtime | - | 84.0 |
105.25 | 25.3 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_streaming_gbk_6 | python_dataflow_streaming_gbk_6_runtime | - | 333.83
| 304.5 | -8.79 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_streaming_gbk_7 | python_dataflow_streaming_gbk_7_runtime | - | 343.17
| 435.25 | 26.83 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_streaming_pardo_1 | python_dataflow_streaming_pardo_1_runtime | - |
165.5 | 145.75 | -11.93 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_1 | python_flink_streaming_pardo_5_runtime | - | 139.5
| 122.67 | -12.07 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_2 | python_dataflow_streaming_pardo_2_runtime | - |
2715.67 | 2678.25 | -1.38 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_2 | python_flink_streaming_pardo_2_runtime | - | 3545.0
| 3113.67 | -12.17 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_3 | python_dataflow_streaming_pardo_3_runtime | - |
137.17 | 126.5 | -7.78 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_3 | python_flink_streaming_pardo_3_runtime | - | 229.5
| 203.67 | -11.26 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_4 | python_dataflow_streaming_pardo_4_runtime | - |
448.33 | 400.25 | -10.72 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_4 | python_flink_streaming_pardo_4_runtime | - | 629.5
| 430.0 | -31.69 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_6 | python_flink_streaming_pardo_6_runtime | - | 0.5 |
77.0 | 15300.0 |  
textioit_results | read_time | - | 6.82 | 22.33 | 227.24 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
textioit_results | write_time | - | 10.4 | 32.05 | 208.26 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
tfrecordioit_results | read_time | - | 15.2 | 16.68 | 9.73 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
tfrecordioit_results | write_time | - | 27.36 | 22.64 | -17.24 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
wordcount_py37_results | runtime | - | 878.45 | 864.09 | -1.63 |
[[1]](http://metrics.beam.apache.org/d/1cnwVDkGk)  
xmlioit_results | read_time | - | 16.44 | 25.92 | 57.61 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
xmlioit_results | write_time | - | 18.72 | 25.05 | 33.78 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
nexmark_0_batch | RuntimeMs | DataflowRunner | 17665.02 | 29292.83 | 65.82 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_0_batch | RuntimeMs | DirectRunner | 4645.32 | 4599.61 | -0.98 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_batch | RuntimeMs | FlinkRunner | 1295.96 | 1270.72 | -1.95 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_0_batch | RuntimeMs | SparkRunner | 1477.18 | 1446.06 | -2.11 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_batch | RuntimeMs | SparkStructuredStreamingRunner | 1692.93 |
1633.72 | -3.5 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_sql_batch | RuntimeMs | DataflowRunner | 33492.0 | 32554.67 | -2.8 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_sql_batch | RuntimeMs | DirectRunner | 5523.61 | 5508.5 | -0.27 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_0_sql_batch | RuntimeMs | SparkRunner | 1519.54 | 1469.56 | -3.29 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_0_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1827.79 |
1770.61 | -3.13 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_sql_streaming | RuntimeMs | DataflowRunner | 19012.67 | 21774.5 |
14.53 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_sql_streaming | RuntimeMs | DirectRunner | 14302.07 | 14176.78 |
-0.88 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_sql_streaming | RuntimeMs | FlinkRunner | 1815.11 | 1813.12 | -0.11
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_streaming | RuntimeMs | DataflowRunner | 23197.76 | 31675.02 | 36.54
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_streaming | RuntimeMs | DirectRunner | 11961.89 | 11845.94 | -0.97 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_streaming | RuntimeMs | FlinkRunner | 1535.93 | 1424.24 | -7.27 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_zetasql_batch | RuntimeMs | DataflowRunner | 124489.5 | 122623.5 |
-1.5 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_0_zetasql_batch | RuntimeMs | DirectRunner | 6867.18 | 6717.39 | -2.18
|  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_0_zetasql_streaming | RuntimeMs | DataflowRunner | 71453.25 | 71988.89
| 0.75 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_0_zetasql_streaming | RuntimeMs | DirectRunner | 16314.14 | 16146.83 |
-1.03 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_0_zetasql_streaming | RuntimeMs | FlinkRunner | 3494.11 | 3319.59 |
-4.99 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_10_batch | RuntimeMs | DataflowRunner | 30292.08 | 50608.33 | 67.07 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_10_batch | RuntimeMs | DirectRunner | 11254.43 | 11301.0 | 0.41 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_10_batch | RuntimeMs | FlinkRunner | 653.82 | 611.5 | -6.47 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_10_batch | RuntimeMs | SparkRunner | 757.89 | 734.78 | -3.05 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_10_batch | RuntimeMs | SparkStructuredStreamingRunner | 1049.61 |
1103.56 | 5.14 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_10_streaming | RuntimeMs | DataflowRunner | 79481.03 | 111779.57 |
40.64 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_10_streaming | RuntimeMs | DirectRunner | 46889.96 | 47503.28 | 1.31 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_10_streaming | RuntimeMs | FlinkRunner | 1403.57 | 1349.06 | -3.88 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_11_batch | RuntimeMs | DataflowRunner | 22112.13 | 38774.78 | 75.36 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_11_batch | RuntimeMs | DirectRunner | 3155.86 | 3146.39 | -0.3 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_11_batch | RuntimeMs | FlinkRunner | 284.93 | 273.28 | -4.09 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_11_batch | RuntimeMs | SparkRunner | 1389.89 | 1365.83 | -1.73 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_11_batch | RuntimeMs | SparkStructuredStreamingRunner | 955.04 |
994.22 | 4.1 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_11_streaming | RuntimeMs | DataflowRunner | 253178.08 | 335382.4 |
32.47 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_11_streaming | RuntimeMs | DirectRunner | 8819.21 | 8670.44 | -1.69 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_11_streaming | RuntimeMs | FlinkRunner | 1433.68 | 1387.47 | -3.22 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_12_batch | RuntimeMs | DataflowRunner | 11940.21 | 18770.8 | 57.21 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_12_batch | RuntimeMs | DirectRunner | 2128.14 | 2143.17 | 0.71 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_12_batch | RuntimeMs | FlinkRunner | 197.43 | 196.61 | -0.41 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_12_batch | RuntimeMs | SparkRunner | 947.71 | 908.44 | -4.14 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_12_batch | RuntimeMs | SparkStructuredStreamingRunner | 733.43 |
818.72 | 11.63 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_12_streaming | RuntimeMs | DataflowRunner | 78612.95 | 112226.69 |
42.76 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_12_streaming | RuntimeMs | DirectRunner | 7513.18 | 7313.89 | -2.65 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_12_streaming | RuntimeMs | FlinkRunner | 660.32 | 640.94 | -2.93 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_batch | RuntimeMs | DataflowRunner | 21319.79 | 32880.94 | 54.23 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_batch | RuntimeMs | DirectRunner | 3551.61 | 3381.83 | -4.78 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_13_batch | RuntimeMs | FlinkRunner | 400.36 | 394.17 | -1.55 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_13_batch | RuntimeMs | SparkRunner | 338.5 | 345.94 | 2.2 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_13_batch | RuntimeMs | SparkStructuredStreamingRunner | 575.61 |
556.94 | -3.24 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_13_sql_batch | RuntimeMs | DataflowRunner | 61522.0 | 68731.67 | 11.72
|  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_sql_batch | RuntimeMs | DirectRunner | 8882.32 | 8972.33 | 1.01 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_13_sql_batch | RuntimeMs | SparkRunner | 1620.32 | 1565.61 | -3.38 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1913.11 |
1623.67 | -15.13 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_sql_streaming | RuntimeMs | DataflowRunner | 33305.89 | 36298.61 |
8.99 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_sql_streaming | RuntimeMs | DirectRunner | 17458.29 | 17465.94 |
0.04 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_sql_streaming | RuntimeMs | FlinkRunner | 23304.5 | 23118.0 | -0.8
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_streaming | RuntimeMs | DataflowRunner | 17297.25 | 27255.22 |
57.57 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_streaming | RuntimeMs | DirectRunner | 9853.11 | 9660.94 | -1.95 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_streaming | RuntimeMs | FlinkRunner | 21995.36 | 21818.29 | -0.81 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_zetasql_batch | RuntimeMs | DataflowRunner | 274008.0 | 270925.56 |
-1.12 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_zetasql_batch | RuntimeMs | DirectRunner | 10414.5 | 10482.11 |
0.65 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_13_zetasql_streaming | RuntimeMs | DataflowRunner | 126904.0 |
126765.78 | -0.11 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_13_zetasql_streaming | RuntimeMs | DirectRunner | 20054.18 | 20067.39
| 0.07 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_13_zetasql_streaming | RuntimeMs | FlinkRunner | 28077.61 | 27880.12 |
-0.7 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_14_batch | RuntimeMs | DataflowRunner | 51025.36 | 64117.39 | 25.66 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_14_batch | RuntimeMs | DirectRunner | 3353.82 | 3344.94 | -0.26 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_14_batch | RuntimeMs | FlinkRunner | 529.61 | 529.39 | -0.04 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_14_batch | RuntimeMs | SparkRunner | 905.71 | 871.83 | -3.74 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_14_batch | RuntimeMs | SparkStructuredStreamingRunner | 1087.96 |
952.89 | -12.42 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_14_streaming | RuntimeMs | DataflowRunner | 75881.31 | 113981.44 |
50.21 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_14_streaming | RuntimeMs | DirectRunner | 10552.43 | 10433.94 | -1.12
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_14_streaming | RuntimeMs | FlinkRunner | 1568.89 | 1531.53 | -2.38 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_15_batch | RuntimeMs | DataflowRunner | 28904.07 | 49791.31 | 72.26 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_15_batch | RuntimeMs | DirectRunner | 13107.71 | 13111.67 | 0.03 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_15_batch | RuntimeMs | FlinkRunner | 474.18 | 475.0 | 0.17 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_15_batch | RuntimeMs | SparkRunner | 796.57 | 764.72 | -4.0 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_15_batch | RuntimeMs | SparkStructuredStreamingRunner | 1539.82 |
1325.72 | -13.9 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_batch | RuntimeMs | DataflowRunner | 14493.83 | 22541.41 | 55.52 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_1_batch | RuntimeMs | DirectRunner | 3267.21 | 3196.61 | -2.16 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_1_batch | RuntimeMs | FlinkRunner | 370.79 | 374.72 | 1.06 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_1_batch | RuntimeMs | SparkRunner | 452.46 | 431.72 | -4.58 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_batch | RuntimeMs | SparkStructuredStreamingRunner | 634.21 | 608.44
| -4.06 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_1_sql_batch | RuntimeMs | DataflowRunner | 30237.56 | 30705.5 | 1.55 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_1_sql_batch | RuntimeMs | DirectRunner | 3221.96 | 3264.39 | 1.32 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_1_sql_batch | RuntimeMs | SparkRunner | 655.75 | 622.56 | -5.06 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_1_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 900.07 |
868.39 | -3.52 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_1_sql_streaming | RuntimeMs | DataflowRunner | 17288.33 | 19872.11 |
14.95 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_sql_streaming | RuntimeMs | DirectRunner | 10624.89 | 10604.22 |
-0.19 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_sql_streaming | RuntimeMs | FlinkRunner | 755.36 | 754.59 | -0.1 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_streaming | RuntimeMs | DataflowRunner | 21256.46 | 25315.76 | 19.1
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_streaming | RuntimeMs | DirectRunner | 7983.39 | 7961.61 | -0.27 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_1_streaming | RuntimeMs | FlinkRunner | 679.21 | 682.65 | 0.51 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_2_batch | RuntimeMs | DataflowRunner | 10225.08 | 15530.15 | 51.88 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_2_batch | RuntimeMs | DirectRunner | 1366.79 | 1391.67 | 1.82 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_batch | RuntimeMs | FlinkRunner | 180.43 | 181.17 | 0.41 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_batch | RuntimeMs | SparkRunner | 279.79 | 276.28 | -1.25 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_batch | RuntimeMs | SparkStructuredStreamingRunner | 462.68 | 440.0
| -4.9 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_sql_batch | RuntimeMs | DataflowRunner | 20823.89 | 19827.56 | -4.78
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_2_sql_batch | RuntimeMs | DirectRunner | 1602.18 | 1619.0 | 1.05 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_2_sql_batch | RuntimeMs | SparkRunner | 819.89 | 771.28 | -5.93 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_2_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 803.82 |
761.33 | -5.29 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_2_sql_streaming | RuntimeMs | DataflowRunner | 10787.11 | 11469.06 |
6.32 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_sql_streaming | RuntimeMs | DirectRunner | 6252.36 | 6212.72 | -0.63
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_sql_streaming | RuntimeMs | FlinkRunner | 339.0 | 354.24 | 4.49 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_streaming | RuntimeMs | DataflowRunner | 12722.05 | 16787.6 | 31.96
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_streaming | RuntimeMs | DirectRunner | 5108.39 | 5075.61 | -0.64 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_streaming | RuntimeMs | FlinkRunner | 280.14 | 283.18 | 1.08 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_zetasql_batch | RuntimeMs | DataflowRunner | 73139.38 | 71758.5 |
-1.89 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_2_zetasql_batch | RuntimeMs | DirectRunner | 2874.82 | 2786.5 | -3.07
|  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_2_zetasql_streaming | RuntimeMs | DataflowRunner | 40160.5 | 40152.22
| -0.02 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_zetasql_streaming | RuntimeMs | DirectRunner | 7703.39 | 7613.06 |
-1.17 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_2_zetasql_streaming | RuntimeMs | FlinkRunner | 1136.89 | 1127.82 |
-0.8 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_3_batch | RuntimeMs | DataflowRunner | 15236.96 | 21986.06 | 44.29 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_3_batch | RuntimeMs | DirectRunner | 2854.61 | 2813.06 | -1.46 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_3_batch | RuntimeMs | FlinkRunner | 1272.89 | 1234.61 | -3.01 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_3_batch | RuntimeMs | SparkRunner | 2037.25 | 1984.33 | -2.6 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_3_sql_batch | RuntimeMs | DataflowRunner | 23082.0 | 24295.61 | 5.26 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_3_sql_batch | RuntimeMs | DirectRunner | 3247.43 | 3197.17 | -1.55 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_3_sql_batch | RuntimeMs | SparkRunner | 3064.39 | 3068.56 | 0.14 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_3_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 2805.64 |
2471.83 | -11.9 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_3_sql_streaming | RuntimeMs | DataflowRunner | 27393.0 | 30699.83 |
12.07 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_sql_streaming | RuntimeMs | DirectRunner | 7811.64 | 7709.94 | -1.3
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_sql_streaming | RuntimeMs | FlinkRunner | 1118.57 | 1130.71 | 1.08 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_3_streaming | RuntimeMs | DataflowRunner | 44433.22 | 54932.19 | 23.63
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_3_streaming | RuntimeMs | DirectRunner | 6974.79 | 6890.22 | -1.21 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_3_streaming | RuntimeMs | FlinkRunner | 526.96 | 506.76 | -3.83 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_3_zetasql_batch | RuntimeMs | DataflowRunner | 54856.88 | 55680.5 |
1.5 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_3_zetasql_batch | RuntimeMs | DirectRunner | 3579.11 | 3563.06 | -0.45
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_3_zetasql_streaming | RuntimeMs | DataflowRunner | 43399.25 | 44241.33
| 1.94 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_3_zetasql_streaming | RuntimeMs | DirectRunner | 8385.79 | 8248.94 |
-1.63 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_3_zetasql_streaming | RuntimeMs | FlinkRunner | 1338.39 | 1288.59 |
-3.72 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_4_batch | RuntimeMs | DataflowRunner | 19319.29 | 31692.83 | 64.05 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_4_batch | RuntimeMs | DirectRunner | 2270.96 | 2317.0 | 2.03 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_4_batch | RuntimeMs | FlinkRunner | 904.46 | 864.44 | -4.42 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_4_batch | RuntimeMs | SparkRunner | 1026.5 | 989.44 | -3.61 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_4_batch | RuntimeMs | SparkStructuredStreamingRunner | 2763.43 |
2317.94 | -16.12 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_4_streaming | RuntimeMs | DataflowRunner | 33013.0 | 49260.44 | 49.22
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_4_streaming | RuntimeMs | DirectRunner | 2650.07 | 2636.06 | -0.53 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_4_streaming | RuntimeMs | FlinkRunner | 1188.79 | 1162.41 | -2.22 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_5_batch | RuntimeMs | DataflowRunner | 19017.61 | 37544.17 | 97.42 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_5_batch | RuntimeMs | DirectRunner | 7941.39 | 7813.5 | -1.61 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_5_batch | RuntimeMs | FlinkRunner | 823.57 | 781.44 | -5.12 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_5_batch | RuntimeMs | SparkRunner | 1582.25 | 1539.61 | -2.69 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_5_batch | RuntimeMs | SparkStructuredStreamingRunner | 1653.18 |
1781.94 | 7.79 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_5_streaming | RuntimeMs | DataflowRunner | 207063.43 | 307345.67 |
48.43 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_5_streaming | RuntimeMs | DirectRunner | 15163.04 | 14772.56 | -2.58 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_5_streaming | RuntimeMs | FlinkRunner | 1674.89 | 1548.24 | -7.56 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_6_batch | RuntimeMs | DataflowRunner | 17735.14 | 26535.83 | 49.62 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_6_batch | RuntimeMs | DirectRunner | 1682.0 | 1651.06 | -1.84 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_6_batch | RuntimeMs | FlinkRunner | 589.32 | 593.39 | 0.69 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_6_batch | RuntimeMs | SparkRunner | 691.89 | 646.56 | -6.55 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_6_batch | RuntimeMs | SparkStructuredStreamingRunner | 1170.29 |
891.94 | -23.78 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_6_streaming | RuntimeMs | DataflowRunner | 26480.38 | 37157.22 | 40.32
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_6_streaming | RuntimeMs | DirectRunner | 1833.86 | 1795.83 | -2.07 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_6_streaming | RuntimeMs | FlinkRunner | 655.64 | 636.71 | -2.89 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_7_batch | RuntimeMs | DataflowRunner | 32855.68 | 50403.94 | 53.41 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_batch | RuntimeMs | DirectRunner | 19570.43 | 19795.11 | 1.15 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_7_batch | RuntimeMs | FlinkRunner | 623.0 | 617.72 | -0.85 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/f0Q6T0dGk)  
nexmark_7_batch | RuntimeMs | SparkRunner | 1416.89 | 1371.44 | -3.21 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_batch | RuntimeMs | SparkStructuredStreamingRunner | 2149.54 |
2114.06 | -1.65 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_sql_batch | RuntimeMs | DataflowRunner | 83066.44 | 80927.83 | -2.57
|  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_7_sql_batch | RuntimeMs | DirectRunner | 116046.21 | 114440.56 | -1.38
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_7_sql_batch | RuntimeMs | SparkRunner | 4263.39 | 4206.11 | -1.34 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 4904.11 |
3957.67 | -19.3 |  [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_sql_streaming | RuntimeMs | DataflowRunner | 967150.11 | 1057423.5 |
9.33 |  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_7_sql_streaming | RuntimeMs | DirectRunner | 326757.32 | 326810.67 |
0.02 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_sql_streaming | RuntimeMs | FlinkRunner | 3714.79 | 3671.29 | -1.17
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_streaming | RuntimeMs | DataflowRunner | 116955.05 | 181783.36 |
55.43 |  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_streaming | RuntimeMs | DirectRunner | 838367.0 | 836436.44 | -0.23
|  [[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_7_streaming | RuntimeMs | FlinkRunner | 9466.18 | 9334.06 | -1.4 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_8_batch | RuntimeMs | DataflowRunner | 11739.98 | 20925.52 | 78.24 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_8_batch | RuntimeMs | DirectRunner | 1999.93 | 2007.94 | 0.4 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_8_batch | RuntimeMs | FlinkRunner | 477.54 | 465.56 | -2.51 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_8_batch | RuntimeMs | SparkRunner | 1396.11 | 1344.39 | -3.7 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_8_batch | RuntimeMs | SparkStructuredStreamingRunner | 1170.54 |
1057.17 | -9.69 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_8_streaming | RuntimeMs | DataflowRunner | 59748.08 | 82247.48 | 37.66
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_8_streaming | RuntimeMs | DirectRunner | 6010.89 | 5963.17 | -0.79 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_8_streaming | RuntimeMs | FlinkRunner | 584.68 | 551.24 | -5.72 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_9_batch | RuntimeMs | DataflowRunner | 15411.71 | 25128.06 | 63.05 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_9_batch | RuntimeMs | DirectRunner | 1276.0 | 1277.17 | 0.09 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_9_batch | RuntimeMs | FlinkRunner | 289.43 | 289.33 | -0.03 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_9_batch | RuntimeMs | SparkRunner | 538.61 | 508.5 | -5.59 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[4]](http://metrics.beam.apache.org/d/ahudA_zGz)  
nexmark_9_batch | RuntimeMs | SparkStructuredStreamingRunner | 958.75 | 676.89
| -29.4 |  [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[4]](http://metrics.beam.apache.org/d/tkqc0AdGk)  
nexmark_9_streaming | RuntimeMs | DataflowRunner | 20166.25 | 30907.94 | 53.27
|  [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_9_streaming | RuntimeMs | DirectRunner | 1474.61 | 1468.11 | -0.44 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/8INnSY9Mz)  
nexmark_9_streaming | RuntimeMs | FlinkRunner | 381.04 | 391.88 | 2.85 |
[[1]](http://metrics.beam.apache.org/d/8INnSY9Mz)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)