You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/09/14 12:01:31 UTC
Beam Metrics Report (2020-09-14)
/* * Licensed to the Apache Software Foundation (ASF) under one * or more
contributor license agreements. See the NOTICE file * distributed with this
work for additional information * regarding copyright ownership. The ASF
licenses this file * to you under the Apache License, Version 2.0 (the *
"License"); you may not use this file except in compliance * with the License.
You may obtain a copy of the License at * *
http://www.apache.org/licenses/LICENSE-2.0 * * Unless required by applicable
law or agreed to in writing, software * distributed under the License is
distributed on an "AS IS" BASIS, * WITHOUT WARRANTIES OR CONDITIONS OF ANY
KIND, either express or implied. * See the License for the specific language
governing permissions and * limitations under the License. */
# Beam Metrics Report
Color legend: >= 20 | >= 10 | <= -10 | <= -20
---|---|---|---
## Possible regression
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
bqio_10GB_results_java_stream | read_time | - | 16.19 | 19.78 | 22.17 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
java_batch_gbk_3 | sparkstructuredstreaming_runtime_sec | - | 8.82 | 10.31 |
16.95 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | sparkstructuredstreaming_runtime_sec | - | 70.36 | 89.39 |
27.05 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_5 | dataflow_runtime_sec | - | 339.92 | 377.87 | 11.16 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_pardo_3 | dataflow_runtime_sec | - | 13.56 | 16.69 | 23.04 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
kafkaioit_results | write_time | - | 216.95 | 251.31 | 15.84 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
python_streaming_cogbk_2 | python_dataflow_streaming_cogbk_2_runtime | - |
436.0 | 484.5 | 11.12 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_4 | python_dataflow_streaming_cogbk_4_runtime | - |
367.43 | 436.5 | 18.8 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_gbk_3 | python_dataflow_streaming_gbk_3_runtime | - | 175.5 |
199.5 | 13.68 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_pardo_6 | python_flink_streaming_pardo_6_runtime | - | 41.71
| 77.75 | 86.39 |
nexmark_0_batch | RuntimeMs | SparkRunner | 1247.0 | 1448.33 | 16.15 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_10_batch | RuntimeMs | SparkRunner | 653.29 | 812.0 | 24.29 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_14_batch | RuntimeMs | SparkRunner | 872.11 | 1050.0 | 20.4 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_1_batch | RuntimeMs | DirectRunner | 1774.36 | 1952.0 | 10.01 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_2_streaming | RuntimeMs | DataflowRunner | 11769.07 | 13181.67 | 12.0
| [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_3_batch | RuntimeMs | SparkRunner | 2095.82 | 2334.17 | 11.37 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_6_batch | RuntimeMs | SparkRunner | 595.18 | 815.06 | 36.94 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
## Possible improvement
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
hadoopformatioit_results | read_time | - | 9.58 | 8.49 | -11.41 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
java_batch_cogbk_3 | dataflow_runtime_sec | - | 31.4 | 25.38 | -19.19 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_pardo_3 | dataflow_runtime_sec | - | 25.65 | 19.05 | -25.71 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_gbk_1 | dataflow_runtime_sec | - | 847.58 | 754.3 | -11.01 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
parquetioit_hdfs_results | read_time | - | 125.61 | 108.2 | -13.86 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
python_batch_pardo_1 | python_dataflow_batch_pardo_1_runtime | - | 278.14 |
190.75 | -31.42 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_1 | python_flink_batch_pardo_1_runtime | - | 1808.29 |
1069.25 | -40.87 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_2 | python_dataflow_batch_pardo_2_runtime | - | 2952.86 |
1809.25 | -38.73 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_3 | python_dataflow_batch_pardo_3_runtime | - | 224.0 |
166.5 | -25.67 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_3 | python_flink_batch_pardo_3_runtime | - | 1365.0 |
904.25 | -33.75 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_4 | python_dataflow_batch_pardo_4_runtime | - | 445.57 |
379.5 | -14.83 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_4 | python_flink_batch_pardo_4_runtime | - | 3078.57 |
2677.25 | -13.04 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_psio_2GB_results | pubsub_io_perf_read_runtime | - | 79.29 | 65.75 |
-17.07 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_psio_2GB_results | pubsub_io_perf_write_runtime | - | 71.43 | 64.0 |
-10.4 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_streaming_combine_4 | python_dataflow_streaming_combine_4_runtime | - |
55.57 | 40.75 | -26.67 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_streaming_combine_5 | python_dataflow_streaming_combine_5_runtime | - |
60.29 | 50.25 | -16.65 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
nexmark_2_batch | RuntimeMs | FlinkRunner | 154.0 | 133.06 | -13.6 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_5_batch | RuntimeMs | FlinkRunner | 722.93 | 648.94 | -10.23 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_6_streaming | RuntimeMs | FlinkRunner | 445.5 | 391.5 | -12.12 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
## All metrics
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
avroioit_hdfs_results | read_time | - | 124.39 | 116.11 | -6.65 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_hdfs_results | write_time | - | 178.56 | 171.21 | -4.12 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_results | read_time | - | 123.07 | 114.78 | -6.74 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_results | write_time | - | 163.39 | 162.7 | -0.43 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_avro | avro_write_time | - | 54.13 | 52.76 |
-2.53 | [[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_avro | read_time | - | 66.28 | 64.55 | -2.62 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_json | read_time | - | 58.54 | 59.16 | 1.06 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_json | write_time | - | 93.44 | 94.78 | 1.44 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_stream | read_time | - | 16.19 | 19.78 | 22.17 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_stream | write_time | - | 143.9 | 137.14 | -4.7 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_hdfs_results | read_time | - | 216.69 | 215.18 | -0.7 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_hdfs_results | write_time | - | 296.0 | 289.87 | -2.07 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_results | read_time | - | 202.97 | 201.57 | -0.69 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_results | write_time | - | 278.75 | 266.57 | -4.37 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
hadoopformatioit_results | read_time | - | 9.58 | 8.49 | -11.41 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
hadoopformatioit_results | write_time | - | 12.7 | 13.22 | 4.12 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
java_batch_cogbk_1 | dataflow_runtime_sec | - | 78.39 | 77.87 | -0.66 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_1 | sparkstructuredstreaming_runtime_sec | - | 150.31 |
139.38 | -7.27 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | dataflow_runtime_sec | - | 76.7 | 77.68 | 1.28 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | sparkstructuredstreaming_runtime_sec | - | 144.54 |
133.58 | -7.59 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | dataflow_runtime_sec | - | 31.4 | 25.38 | -19.19 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | sparkstructuredstreaming_runtime_sec | - | 22.99 | 21.08
| -8.33 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | dataflow_runtime_sec | - | 28.81 | 28.24 | -1.95 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | sparkstructuredstreaming_runtime_sec | - | 22.94 | 22.03
| -3.98 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_combine_1 | dataflow_runtime_sec | - | 85.81 | 88.82 | 3.51 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_1 | sparkstructuredstreaming_runtime_sec | - | 558.16 |
586.38 | 5.05 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_4 | dataflow_runtime_sec | - | 37.33 | 35.25 | -5.56 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_4 | sparkstructuredstreaming_runtime_sec | - | 130.08 |
132.1 | 1.55 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_5 | dataflow_runtime_sec | - | 37.52 | 37.21 | -0.81 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_5 | sparkstructuredstreaming_runtime_sec | - | 129.49 |
142.36 | 9.94 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_gbk_1 | dataflow_runtime_sec | - | 266.62 | 265.51 | -0.42 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_1 | sparkstructuredstreaming_runtime_sec | - | 598.25 | 632.77
| 5.77 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | dataflow_runtime_sec | - | 65.65 | 64.53 | -1.71 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | sparkstructuredstreaming_runtime_sec | - | 115.98 | 120.94
| 4.28 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_runtime_sec | - | 32.3 | 30.2 | -6.5 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | sparkstructuredstreaming_runtime_sec | - | 8.82 | 10.31 |
16.95 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | dataflow_runtime_sec | - | 32.7 | 32.89 | 0.58 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | sparkstructuredstreaming_runtime_sec | - | 129.72 | 130.32
| 0.46 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | dataflow_runtime_sec | - | 33.03 | 33.21 | 0.56 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | sparkstructuredstreaming_runtime_sec | - | 131.77 | 126.2 |
-4.23 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | dataflow_runtime_sec | - | 76.17 | 70.4 | -7.58 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | sparkstructuredstreaming_runtime_sec | - | 70.36 | 89.39 |
27.05 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | dataflow_runtime_sec | - | 110.52 | 101.37 | -8.28 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | sparkstructuredstreaming_runtime_sec | - | 97.48 | 103.69 |
6.36 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_pardo_1 | dataflow_runtime_sec | - | 31.55 | 30.96 | -1.87 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_1 | sparkstructuredstreaming_runtime_sec | - | 44.33 | 42.67
| -3.74 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_2 | dataflow_runtime_sec | - | 189.67 | 190.39 | 0.38 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | dataflow_runtime_sec | - | 25.65 | 19.05 | -25.71 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_4 | dataflow_runtime_sec | - | 35.91 | 33.83 | -5.78 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_cogbk_1 | dataflow_runtime_sec | - | 983.48 | 1045.35 | 6.29 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_2 | dataflow_runtime_sec | - | 978.57 | 996.91 | 1.87 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_3 | dataflow_runtime_sec | - | 133.32 | 131.72 | -1.2 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_4 | dataflow_runtime_sec | - | 139.34 | 143.54 | 3.01 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_combine_1 | dataflow_runtime_sec | - | 555.1 | 574.48 | 3.49 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_combine_4 | dataflow_runtime_sec | - | 355.24 | 363.99 | 2.46 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_combine_5 | dataflow_runtime_sec | - | 336.53 | 331.37 | -1.53
| [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_gbk_1 | dataflow_runtime_sec | - | 847.58 | 754.3 | -11.01 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_2 | dataflow_runtime_sec | - | 943.78 | 956.71 | 1.37 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_3 | dataflow_runtime_sec | - | 28.16 | 26.63 | -5.43 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_4 | dataflow_runtime_sec | - | 336.6 | 340.44 | 1.14 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_5 | dataflow_runtime_sec | - | 339.92 | 377.87 | 11.16 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_6 | dataflow_runtime_sec | - | 82.04 | 86.96 | 6.0 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_7 | dataflow_runtime_sec | - | 140.19 | 141.45 | 0.9 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_pardo_1 | dataflow_runtime_sec | - | 19.67 | 19.38 | -1.46 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_2 | dataflow_runtime_sec | - | 217.99 | 218.63 | 0.29 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_3 | dataflow_runtime_sec | - | 13.56 | 16.69 | 23.04 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_4 | dataflow_runtime_sec | - | 33.05 | 31.01 | -6.18 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
jdbcioit_results | read_time | - | 36.85 | 36.51 | -0.91 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
jdbcioit_results | write_time | - | 63.95 | 60.84 | -4.87 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results | read_time | - | 790.17 | 796.47 | 0.8 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results | write_time | - | 216.95 | 251.31 | 15.84 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_hdfs_results | read_time | - | 20.84 | 20.9 | 0.31 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_hdfs_results | write_time | - | 109.42 | 100.9 | -7.79 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_results | read_time | - | 41.66 | 42.76 | 2.63 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_results | write_time | - | 117.23 | 114.09 | -2.68 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
mongodbioit_results | read_time | - | 30.07 | 30.17 | 0.33 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
mongodbioit_results | write_time | - | 74.33 | 75.99 | 2.22 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_hdfs_results | read_time | - | 125.61 | 108.2 | -13.86 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_hdfs_results | write_time | - | 194.7 | 179.3 | -7.91 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_results | read_time | - | 115.93 | 115.23 | -0.6 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_results | write_time | - | 189.58 | 184.36 | -2.75 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
python_batch_cogbk_1 | python_dataflow_batch_cogbk_1_runtime | - | 454.57 |
446.5 | -1.78 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_2 | python_dataflow_batch_cogbk_2_runtime | - | 306.0 |
305.0 | -0.33 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_3 | python_dataflow_batch_cogbk_3_runtime | - | 300.29 |
296.33 | -1.32 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_4 | python_dataflow_batch_cogbk_4_runtime | - | 296.14 |
292.67 | -1.17 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_combine_1 | python_dataflow_batch_combine_1_runtime | - | 927.43
| 920.75 | -0.72 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_1 | python_flink_batch_combine_1_runtime | - | 5103.0 |
5345.75 | 4.76 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_4 | python_dataflow_batch_combine_4_runtime | - | 35.29 |
34.0 | -3.64 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_4 | python_flink_batch_combine_4_runtime | - | 195.17 |
199.75 | 2.35 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_5 | python_dataflow_batch_combine_5_runtime | - | 32.71 |
31.0 | -5.24 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_5 | python_flink_batch_combine_5_runtime | - | 146.0 |
145.0 | -0.68 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_gbk_1 | python_dataflow_batch_gbk_1_runtime | - | 1963.57 |
1951.25 | -0.63 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_2 | python_dataflow_batch_gbk_2_runtime | - | 351.0 | 339.5 |
-3.28 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_3 | python_dataflow_batch_gbk_3_runtime | - | 37.86 | 36.25 |
-4.25 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_4 | python_dataflow_batch_gbk_4_runtime | - | 101.71 | 111.0
| 9.13 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_5 | python_dataflow_batch_gbk_5_runtime | - | 98.29 | 99.25 |
0.98 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_6 | python_dataflow_batch_gbk_6_runtime | - | 394.57 | 377.5
| -4.33 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_7 | python_dataflow_batch_gbk_7_runtime | - | 373.29 | 366.0
| -1.95 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_pardo_1 | python_dataflow_batch_pardo_1_runtime | - | 278.14 |
190.75 | -31.42 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_1 | python_flink_batch_pardo_1_runtime | - | 1808.29 |
1069.25 | -40.87 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_2 | python_dataflow_batch_pardo_2_runtime | - | 2952.86 |
1809.25 | -38.73 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_3 | python_dataflow_batch_pardo_3_runtime | - | 224.0 |
166.5 | -25.67 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_3 | python_flink_batch_pardo_3_runtime | - | 1365.0 |
904.25 | -33.75 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_4 | python_dataflow_batch_pardo_4_runtime | - | 445.57 |
379.5 | -14.83 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_4 | python_flink_batch_pardo_4_runtime | - | 3078.57 |
2677.25 | -13.04 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_bqio_read_10GB_results | bqio_read_10GB_results_runtime | - | 124.71 |
127.75 | 2.43 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_bqio_write_10GB_results | bqio_write_10GB_results_runtime | - | 261.71
| 263.5 | 0.68 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_psio_2GB_results | pubsub_io_perf_read_runtime | - | 79.29 | 65.75 |
-17.07 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_psio_2GB_results | pubsub_io_perf_write_runtime | - | 71.43 | 64.0 |
-10.4 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_streaming_cogbk_1 | python_dataflow_streaming_cogbk_1_runtime | - |
803.29 | 791.75 | -1.44 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_2 | python_dataflow_streaming_cogbk_2_runtime | - |
436.0 | 484.5 | 11.12 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_3 | python_dataflow_streaming_cogbk_3_runtime | - |
1277.29 | 1338.5 | 4.79 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_4 | python_dataflow_streaming_cogbk_4_runtime | - |
367.43 | 436.5 | 18.8 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_combine_1 | python_dataflow_streaming_combine_1_runtime | - |
1490.0 | 1599.25 | 7.33 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_streaming_combine_4 | python_dataflow_streaming_combine_4_runtime | - |
55.57 | 40.75 | -26.67 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_streaming_combine_5 | python_dataflow_streaming_combine_5_runtime | - |
60.29 | 50.25 | -16.65 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_streaming_gbk_3 | python_dataflow_streaming_gbk_3_runtime | - | 175.5 |
199.5 | 13.68 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_gbk_6 | python_dataflow_streaming_gbk_6_runtime | - | 435.0 |
459.25 | 5.57 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_gbk_7 | python_dataflow_streaming_gbk_7_runtime | - | 428.29
| 464.75 | 8.51 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_pardo_1 | python_flink_streaming_pardo_5_runtime | - | 180.71
| 180.25 | -0.26 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_6 | python_flink_streaming_pardo_6_runtime | - | 41.71
| 77.75 | 86.39 |
textioit_hdfs_results | read_time | - | 22.98 | 23.94 | 4.18 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_hdfs_results | write_time | - | 46.18 | 44.64 | -3.34 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_results | read_time | - | 24.89 | 24.26 | -2.54 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_results | write_time | - | 43.02 | 41.23 | -4.16 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
tfrecordioit_results | read_time | - | 26.07 | 24.77 | -4.96 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
tfrecordioit_results | write_time | - | 34.06 | 32.55 | -4.43 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
wordcount_py27_results | runtime | - | 903.65 | 886.03 | -1.95 |
[[1]](http://metrics.beam.apache.org/d/1cnwVDkGk)
wordcount_py37_results | runtime | - | 850.17 | 808.37 | -4.92 |
[[1]](http://metrics.beam.apache.org/d/1cnwVDkGk)
xmlioit_hdfs_results | read_time | - | 25.92 | 27.25 | 5.1 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_hdfs_results | write_time | - | 42.42 | 39.6 | -6.64 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_results | read_time | - | 28.56 | 26.77 | -6.27 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_results | write_time | - | 37.88 | 36.79 | -2.88 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
nexmark_0_batch | RuntimeMs | DataflowRunner | 60410.39 | 60276.89 | -0.22 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_0_batch | RuntimeMs | DirectRunner | 2602.39 | 2548.83 | -2.06 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_0_batch | RuntimeMs | FlinkRunner | 1086.75 | 1008.44 | -7.21 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_0_batch | RuntimeMs | SparkRunner | 1247.0 | 1448.33 | 16.15 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_0_batch | RuntimeMs | SparkStructuredStreamingRunner | 1522.5 |
1625.33 | 6.75 | [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_0_sql_batch | RuntimeMs | DataflowRunner | 58351.33 | 56248.61 | -3.6
| [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[3]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_0_sql_batch | RuntimeMs | DirectRunner | 3230.82 | 3153.5 | -2.39 |
[[1]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[3]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_0_sql_batch | RuntimeMs | SparkRunner | 1526.93 | 1507.17 | -1.29 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[3]](http://metrics.beam.apache.org/d/OG-w5jzGz)
nexmark_0_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1759.86 |
1811.0 | 2.91 | [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[3]](http://metrics.beam.apache.org/d/OG-w5jzGz)
nexmark_0_sql_streaming | RuntimeMs | DataflowRunner | 24997.67 | 26196.56 |
4.8 | [[1]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_0_sql_streaming | RuntimeMs | DirectRunner | 6471.5 | 6122.44 | -5.39
| [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)
nexmark_0_sql_streaming | RuntimeMs | FlinkRunner | 1616.21 | 1600.5 | -0.97 |
[[1]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_0_streaming | RuntimeMs | DataflowRunner | 23043.54 | 24695.39 | 7.17
| [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_0_streaming | RuntimeMs | DirectRunner | 4604.57 | 4522.17 | -1.79 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_0_streaming | RuntimeMs | FlinkRunner | 1392.68 | 1415.75 | 1.66 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_0_zetasql_batch | RuntimeMs | DataflowRunner | 1444558.89 | 1416655.11
| -1.93 | [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_0_zetasql_batch | RuntimeMs | DirectRunner | 14428.96 | 14050.0 |
-2.63 | [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_0_zetasql_streaming | RuntimeMs | DataflowRunner | 595276.26 |
599425.61 | 0.7 | [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_0_zetasql_streaming | RuntimeMs | DirectRunner | 16171.11 | 16113.39 |
-0.36 | [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_0_zetasql_streaming | RuntimeMs | FlinkRunner | 12459.79 | 12331.5 |
-1.03 | [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_10_batch | RuntimeMs | DataflowRunner | 92766.29 | 91759.0 | -1.09 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_10_batch | RuntimeMs | DirectRunner | 2661.04 | 2619.11 | -1.58 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_10_batch | RuntimeMs | FlinkRunner | 567.14 | 538.94 | -4.97 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_10_batch | RuntimeMs | SparkRunner | 653.29 | 812.0 | 24.29 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_10_batch | RuntimeMs | SparkStructuredStreamingRunner | 1069.71 |
1082.56 | 1.2 | [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_10_streaming | RuntimeMs | DataflowRunner | 94107.96 | 96414.0 | 2.45
| [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_10_streaming | RuntimeMs | DirectRunner | 16728.29 | 16770.61 | 0.25 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_10_streaming | RuntimeMs | FlinkRunner | 1262.79 | 1305.12 | 3.35 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_11_batch | RuntimeMs | DataflowRunner | 60422.21 | 57198.33 | -5.34 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_11_batch | RuntimeMs | DirectRunner | 2372.93 | 2320.44 | -2.21 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_11_batch | RuntimeMs | FlinkRunner | 260.96 | 250.28 | -4.1 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_11_batch | RuntimeMs | SparkRunner | 1351.82 | 1463.11 | 8.23 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_11_batch | RuntimeMs | SparkStructuredStreamingRunner | 891.96 |
900.44 | 0.95 | [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_11_streaming | RuntimeMs | DataflowRunner | 199136.43 | 207773.22 |
4.34 | [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_11_streaming | RuntimeMs | DirectRunner | 3167.5 | 3287.17 | 3.78 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_11_streaming | RuntimeMs | FlinkRunner | 1297.29 | 1264.12 | -2.56 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_12_batch | RuntimeMs | DataflowRunner | 42252.07 | 40780.22 | -3.48 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_12_batch | RuntimeMs | DirectRunner | 1589.79 | 1557.28 | -2.04 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_12_batch | RuntimeMs | FlinkRunner | 187.57 | 190.72 | 1.68 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_12_batch | RuntimeMs | SparkRunner | 841.46 | 902.94 | 7.31 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_12_batch | RuntimeMs | SparkStructuredStreamingRunner | 727.36 |
736.06 | 1.2 | [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_12_streaming | RuntimeMs | DataflowRunner | 92767.96 | 96512.94 | 4.04
| [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_12_streaming | RuntimeMs | DirectRunner | 2136.11 | 2251.33 | 5.39 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_12_streaming | RuntimeMs | FlinkRunner | 747.61 | 700.75 | -6.27 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_13_batch | RuntimeMs | DataflowRunner | 49722.93 | 48927.0 | -1.6 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_13_batch | RuntimeMs | DirectRunner | 1558.07 | 1537.22 | -1.34 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_13_batch | RuntimeMs | FlinkRunner | 370.93 | 338.72 | -8.68 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_13_batch | RuntimeMs | SparkRunner | 351.79 | 350.0 | -0.51 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_13_batch | RuntimeMs | SparkStructuredStreamingRunner | 484.57 |
479.61 | -1.02 | [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_13_sql_batch | RuntimeMs | DataflowRunner | 118911.67 | 118260.83 |
-0.55 | [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[3]](http://metrics.beam.apache.org/d/OG-w5jzGz)
nexmark_13_sql_batch | RuntimeMs | DirectRunner | 4851.11 | 4448.33 | -8.3 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[3]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_13_sql_batch | RuntimeMs | SparkRunner | 1507.79 | 1499.44 | -0.55 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[3]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_13_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1653.39 |
1606.22 | -2.85 | [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[3]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_13_sql_streaming | RuntimeMs | DataflowRunner | 39803.44 | 40080.11 |
0.7 | [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)
nexmark_13_sql_streaming | RuntimeMs | DirectRunner | 5287.07 | 5186.06 |
-1.91 | [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)
nexmark_13_sql_streaming | RuntimeMs | FlinkRunner | 2903.57 | 2853.12 | -1.74
| [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)
nexmark_13_streaming | RuntimeMs | DataflowRunner | 30283.11 | 30081.94 |
-0.66 | [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_13_streaming | RuntimeMs | DirectRunner | 2526.11 | 2489.06 | -1.47 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_13_streaming | RuntimeMs | FlinkRunner | 1223.21 | 1226.0 | 0.23 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_13_zetasql_batch | RuntimeMs | DataflowRunner | 3488696.96 |
3403926.28 | -2.43 | [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_13_zetasql_batch | RuntimeMs | DirectRunner | 29494.93 | 28884.06 |
-2.07 | [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_13_zetasql_streaming | RuntimeMs | DataflowRunner | 1210192.15 |
1245771.39 | 2.94 | [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_13_zetasql_streaming | RuntimeMs | DirectRunner | 25038.46 | 24065.33
| -3.89 | [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_13_zetasql_streaming | RuntimeMs | FlinkRunner | 22208.39 | 21338.75 |
-3.92 | [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_14_batch | RuntimeMs | DataflowRunner | 118600.96 | 113443.33 | -4.35
| [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_14_batch | RuntimeMs | DirectRunner | 2529.93 | 2466.06 | -2.52 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_14_batch | RuntimeMs | FlinkRunner | 522.29 | 523.56 | 0.24 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_14_batch | RuntimeMs | SparkRunner | 872.11 | 1050.0 | 20.4 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_14_batch | RuntimeMs | SparkStructuredStreamingRunner | 1057.96 |
1068.67 | 1.01 | [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_14_streaming | RuntimeMs | DataflowRunner | 156169.11 | 156061.5 |
-0.07 | [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_14_streaming | RuntimeMs | DirectRunner | 3255.14 | 3376.5 | 3.73 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_14_streaming | RuntimeMs | FlinkRunner | 1174.96 | 1143.5 | -2.68 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_1_batch | RuntimeMs | DataflowRunner | 52000.25 | 47623.17 | -8.42 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_1_batch | RuntimeMs | DirectRunner | 1774.36 | 1952.0 | 10.01 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_1_batch | RuntimeMs | FlinkRunner | 318.96 | 309.56 | -2.95 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_1_batch | RuntimeMs | SparkRunner | 444.18 | 474.83 | 6.9 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_1_batch | RuntimeMs | SparkStructuredStreamingRunner | 593.43 | 595.0
| 0.26 | [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_1_sql_batch | RuntimeMs | DataflowRunner | 53770.7 | 52851.78 | -1.71
| [[1]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[3]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_1_sql_batch | RuntimeMs | DirectRunner | 2101.18 | 2105.06 | 0.18 |
[[1]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[3]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_1_sql_batch | RuntimeMs | SparkRunner | 775.21 | 770.56 | -0.6 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[3]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_1_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 980.21 |
947.61 | -3.33 | [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[3]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_1_sql_streaming | RuntimeMs | DataflowRunner | 22493.81 | 23019.33 |
2.34 | [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)
nexmark_1_sql_streaming | RuntimeMs | DirectRunner | 3736.43 | 3519.17 | -5.81
| [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)
nexmark_1_sql_streaming | RuntimeMs | FlinkRunner | 689.64 | 686.12 | -0.51 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)
nexmark_1_streaming | RuntimeMs | DataflowRunner | 18747.25 | 20408.78 | 8.86
| [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_1_streaming | RuntimeMs | DirectRunner | 3263.82 | 3215.72 | -1.47 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_1_streaming | RuntimeMs | FlinkRunner | 629.04 | 602.88 | -4.16 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_2_batch | RuntimeMs | DataflowRunner | 34672.89 | 34032.94 | -1.85 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_2_batch | RuntimeMs | DirectRunner | 1280.57 | 1399.11 | 9.26 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_2_batch | RuntimeMs | FlinkRunner | 154.0 | 133.06 | -13.6 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_2_batch | RuntimeMs | SparkRunner | 274.07 | 283.5 | 3.44 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_2_batch | RuntimeMs | SparkStructuredStreamingRunner | 437.82 | 436.39
| -0.33 | [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_2_sql_batch | RuntimeMs | DataflowRunner | 37659.26 | 35859.44 | -4.78
| [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[3]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_2_sql_batch | RuntimeMs | DirectRunner | 1201.64 | 1188.0 | -1.14 |
[[1]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[3]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_2_sql_batch | RuntimeMs | SparkRunner | 583.07 | 580.89 | -0.37 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[3]](http://metrics.beam.apache.org/d/OG-w5jzGz)
nexmark_2_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 749.11 |
731.67 | -2.33 | [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[3]](http://metrics.beam.apache.org/d/OG-w5jzGz)
nexmark_2_sql_streaming | RuntimeMs | DataflowRunner | 14440.81 | 14569.28 |
0.89 | [[1]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_2_sql_streaming | RuntimeMs | DirectRunner | 1985.43 | 1963.56 | -1.1
| [[1]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_2_sql_streaming | RuntimeMs | FlinkRunner | 399.61 | 417.62 | 4.51 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)
nexmark_2_streaming | RuntimeMs | DataflowRunner | 11769.07 | 13181.67 | 12.0
| [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_2_streaming | RuntimeMs | DirectRunner | 1567.29 | 1573.89 | 0.42 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_2_streaming | RuntimeMs | FlinkRunner | 269.93 | 270.0 | 0.03 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_2_zetasql_batch | RuntimeMs | DataflowRunner | 1266577.3 | 1234838.94
| -2.51 | [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_2_zetasql_batch | RuntimeMs | DirectRunner | 11327.54 | 11062.33 |
-2.34 | [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_2_zetasql_streaming | RuntimeMs | DataflowRunner | 527202.19 |
546517.83 | 3.66 | [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_2_zetasql_streaming | RuntimeMs | DirectRunner | 11828.89 | 11524.89 |
-2.57 | [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_2_zetasql_streaming | RuntimeMs | FlinkRunner | 10605.61 | 10551.0 |
-0.51 | [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_3_batch | RuntimeMs | DataflowRunner | 46015.93 | 44604.17 | -3.07 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_3_batch | RuntimeMs | DirectRunner | 2739.21 | 2676.28 | -2.3 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_3_batch | RuntimeMs | FlinkRunner | 1213.07 | 1097.67 | -9.51 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_3_batch | RuntimeMs | SparkRunner | 2095.82 | 2334.17 | 11.37 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_3_sql_batch | RuntimeMs | DataflowRunner | 44067.22 | 42086.39 | -4.5
| [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[3]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_3_sql_batch | RuntimeMs | DirectRunner | 2250.71 | 2211.33 | -1.75 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[3]](http://metrics.beam.apache.org/d/OG-w5jzGz)
nexmark_3_sql_batch | RuntimeMs | SparkRunner | 3037.79 | 3035.72 | -0.07 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[3]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_3_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 2453.07 |
2366.78 | -3.52 | [[1]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[3]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_3_sql_streaming | RuntimeMs | DataflowRunner | 39769.78 | 41801.61 |
5.11 | [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)
nexmark_3_sql_streaming | RuntimeMs | DirectRunner | 3731.64 | 3786.28 | 1.46
| [[1]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_3_sql_streaming | RuntimeMs | FlinkRunner | 1396.71 | 1364.88 | -2.28
| [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)
nexmark_3_streaming | RuntimeMs | DataflowRunner | 43407.36 | 44408.72 | 2.31
| [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_3_streaming | RuntimeMs | DirectRunner | 3668.46 | 3588.5 | -2.18 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_3_streaming | RuntimeMs | FlinkRunner | 750.46 | 751.62 | 0.15 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_3_zetasql_batch | RuntimeMs | DataflowRunner | 204033.81 | 191761.11 |
-6.02 | [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_3_zetasql_batch | RuntimeMs | DirectRunner | 3449.21 | 3515.44 | 1.92
| [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_3_zetasql_streaming | RuntimeMs | DataflowRunner | 97538.07 | 97944.39
| 0.42 | [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_3_zetasql_streaming | RuntimeMs | DirectRunner | 4978.18 | 4796.83 |
-3.64 | [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_3_zetasql_streaming | RuntimeMs | FlinkRunner | 2210.89 | 2158.12 |
-2.39 | [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_4_batch | RuntimeMs | DataflowRunner | 49977.14 | 46302.0 | -7.35 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_4_batch | RuntimeMs | DirectRunner | 1469.64 | 1437.39 | -2.19 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_4_batch | RuntimeMs | FlinkRunner | 801.68 | 766.22 | -4.42 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_4_batch | RuntimeMs | SparkRunner | 942.07 | 913.28 | -3.06 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_4_batch | RuntimeMs | SparkStructuredStreamingRunner | 2273.61 |
2244.83 | -1.27 | [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_4_streaming | RuntimeMs | DataflowRunner | 57094.25 | 58969.5 | 3.28 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_4_streaming | RuntimeMs | DirectRunner | 1508.54 | 1520.89 | 0.82 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_4_streaming | RuntimeMs | FlinkRunner | 1007.29 | 1023.75 | 1.63 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_5_batch | RuntimeMs | DataflowRunner | 65383.5 | 63434.28 | -2.98 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_5_batch | RuntimeMs | DirectRunner | 5216.68 | 4973.11 | -4.67 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_5_batch | RuntimeMs | FlinkRunner | 722.93 | 648.94 | -10.23 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_5_batch | RuntimeMs | SparkRunner | 1492.71 | 1505.0 | 0.82 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_5_batch | RuntimeMs | SparkStructuredStreamingRunner | 1473.11 |
1456.11 | -1.15 | [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_5_streaming | RuntimeMs | DataflowRunner | 147552.43 | 152483.0 | 3.34
| [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_5_streaming | RuntimeMs | DirectRunner | 6620.93 | 6575.28 | -0.69 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_5_streaming | RuntimeMs | FlinkRunner | 1561.21 | 1558.5 | -0.17 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_6_batch | RuntimeMs | DataflowRunner | 47402.25 | 45248.39 | -4.54 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_6_batch | RuntimeMs | DirectRunner | 992.64 | 945.06 | -4.79 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_6_batch | RuntimeMs | FlinkRunner | 386.18 | 368.94 | -4.46 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_6_batch | RuntimeMs | SparkRunner | 595.18 | 815.06 | 36.94 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_6_batch | RuntimeMs | SparkStructuredStreamingRunner | 781.18 | 778.67
| -0.32 | [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_6_streaming | RuntimeMs | DataflowRunner | 45718.32 | 44729.11 | -2.16
| [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_6_streaming | RuntimeMs | DirectRunner | 1082.04 | 1088.89 | 0.63 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_6_streaming | RuntimeMs | FlinkRunner | 445.5 | 391.5 | -12.12 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_7_batch | RuntimeMs | DataflowRunner | 80283.82 | 78533.0 | -2.18 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_7_batch | RuntimeMs | DirectRunner | 3301.25 | 3187.61 | -3.44 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_7_batch | RuntimeMs | FlinkRunner | 555.29 | 533.78 | -3.87 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_7_batch | RuntimeMs | SparkRunner | 1370.43 | 1360.94 | -0.69 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_7_batch | RuntimeMs | SparkStructuredStreamingRunner | 2008.18 |
1989.56 | -0.93 | [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_7_sql_batch | RuntimeMs | DataflowRunner | 144225.26 | 141038.0 |
-2.21 | [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[3]](http://metrics.beam.apache.org/d/OG-w5jzGz)
nexmark_7_sql_batch | RuntimeMs | DirectRunner | 87557.43 | 86788.39 | -0.88 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[3]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_7_sql_batch | RuntimeMs | SparkRunner | 4107.71 | 4055.0 | -1.28 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[3]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_7_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 3883.11 |
3878.67 | -0.11 | [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[3]](http://metrics.beam.apache.org/d/OG-w5jzGz)
nexmark_7_sql_streaming | RuntimeMs | DataflowRunner | 1170755.3 | 1181876.94
| 0.95 | [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)
nexmark_7_sql_streaming | RuntimeMs | DirectRunner | 103819.64 | 102531.94 |
-1.24 | [[1]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_7_sql_streaming | RuntimeMs | FlinkRunner | 3854.07 | 3620.0 | -6.07 |
[[1]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_7_streaming | RuntimeMs | DataflowRunner | 109373.14 | 112995.44 |
3.31 | [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_7_streaming | RuntimeMs | DirectRunner | 8442.07 | 8434.78 | -0.09 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_7_streaming | RuntimeMs | FlinkRunner | 1214.96 | 1235.38 | 1.68 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_8_batch | RuntimeMs | DataflowRunner | 46814.32 | 47038.17 | 0.48 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_8_batch | RuntimeMs | DirectRunner | 1454.25 | 1459.5 | 0.36 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_8_batch | RuntimeMs | FlinkRunner | 441.43 | 421.33 | -4.55 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_8_batch | RuntimeMs | SparkRunner | 1305.68 | 1307.06 | 0.11 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_8_batch | RuntimeMs | SparkStructuredStreamingRunner | 971.89 | 956.5
| -1.58 | [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_8_streaming | RuntimeMs | DataflowRunner | 51077.71 | 51861.22 | 1.53
| [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_8_streaming | RuntimeMs | DirectRunner | 2439.64 | 2429.44 | -0.42 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_8_streaming | RuntimeMs | FlinkRunner | 579.96 | 571.38 | -1.48 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_9_batch | RuntimeMs | DataflowRunner | 46211.07 | 44241.44 | -4.26 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_9_batch | RuntimeMs | DirectRunner | 667.36 | 664.17 | -0.48 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_9_batch | RuntimeMs | FlinkRunner | 269.5 | 265.61 | -1.44 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_9_batch | RuntimeMs | SparkRunner | 475.93 | 469.06 | -1.44 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_9_batch | RuntimeMs | SparkStructuredStreamingRunner | 603.25 | 605.06
| 0.3 | [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
nexmark_9_streaming | RuntimeMs | DataflowRunner | 38974.29 | 41040.44 | 5.3 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_9_streaming | RuntimeMs | DirectRunner | 731.57 | 717.17 | -1.97 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
nexmark_9_streaming | RuntimeMs | FlinkRunner | 363.57 | 379.75 | 4.45 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)