You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/09/07 12:01:37 UTC

Beam Metrics Report (2020-09-07)

/* * Licensed to the Apache Software Foundation (ASF) under one * or more
contributor license agreements. See the NOTICE file * distributed with this
work for additional information * regarding copyright ownership. The ASF
licenses this file * to you under the Apache License, Version 2.0 (the *
"License"); you may not use this file except in compliance * with the License.
You may obtain a copy of the License at * *
http://www.apache.org/licenses/LICENSE-2.0 * * Unless required by applicable
law or agreed to in writing, software * distributed under the License is
distributed on an "AS IS" BASIS, * WITHOUT WARRANTIES OR CONDITIONS OF ANY
KIND, either express or implied. * See the License for the specific language
governing permissions and * limitations under the License. */

# Beam Metrics Report

Color legend:  >= 20 | >= 10 | <= -10 | <= -20  
---|---|---|---  
  
## Possible regression

**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**  
---|---|---|---|---|---|---  
compressed_textioit_hdfs_results | read_time | - | 197.3 | 217.38 | 10.18 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
compressed_textioit_hdfs_results | write_time | - | 269.48 | 298.85 | 10.9 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
hadoopformatioit_results | read_time | - | 8.25 | 10.21 | 23.86 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
hadoopformatioit_results | write_time | - | 11.6 | 12.8 | 10.35 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
java_batch_cogbk_3 | dataflow_runtime_sec | - | 27.16 | 33.4 | 23.0 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_4 | sparkstructuredstreaming_runtime_sec | - | 21.58 | 24.01
| 11.29 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_gbk_5 | sparkstructuredstreaming_runtime_sec | - | 127.45 | 146.09
| 14.62 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_7 | dataflow_runtime_sec | - | 102.36 | 113.99 | 11.36 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_pardo_3 | dataflow_runtime_sec | - | 21.07 | 24.53 | 16.43 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_gbk_1 | dataflow_runtime_sec | - | 696.08 | 855.16 | 22.85 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_2 | dataflow_runtime_sec | - | 856.49 | 965.25 | 12.7 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
jdbcioit_results | write_time | - | 55.28 | 64.02 | 15.81 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
parquetioit_hdfs_results | read_time | - | 115.17 | 130.24 | 13.08 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
python_psio_2GB_results | pubsub_io_perf_read_runtime | - | 65.86 | 78.75 |
19.58 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_streaming_cogbk_1 | python_dataflow_streaming_cogbk_1_runtime | - |
701.14 | 858.75 | 22.48 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_streaming_cogbk_2 | python_dataflow_streaming_cogbk_2_runtime | - |
369.14 | 446.75 | 21.02 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_streaming_pardo_6 | python_flink_streaming_pardo_6_runtime | - | 60.0 |
73.0 | 21.67 |  
xmlioit_hdfs_results | write_time | - | 39.2 | 43.45 | 10.83 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
xmlioit_results | write_time | - | 34.05 | 38.6 | 13.36 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
nexmark_11_batch | RuntimeMs | DataflowRunner | 54513.79 | 60363.0 | 10.73 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_2_sql_streaming | RuntimeMs | DataflowRunner | 13446.71 | 14955.29 |
11.22 |  [[1]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_6_batch | RuntimeMs | DataflowRunner | 42587.29 | 48321.06 | 13.46 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_7_sql_streaming | RuntimeMs | FlinkRunner | 3637.61 | 4036.56 | 10.97
|  [[1]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
  
## Possible improvement

**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**  
---|---|---|---|---|---|---  
bqio_10GB_results_java_stream | read_time | - | 19.03 | 16.45 | -13.56 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
java_batch_cogbk_1 | sparkstructuredstreaming_runtime_sec | - | 203.99 | 156.3
| -23.38 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_gbk_3 | sparkstructuredstreaming_runtime_sec | - | 9.46 | 8.22 |
-13.1 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_4 | sparkstructuredstreaming_runtime_sec | - | 142.87 | 124.83
| -12.63 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_combine_4 | python_flink_batch_combine_4_runtime | - | 216.67 |
191.0 | -11.85 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_streaming_combine_4 | python_dataflow_streaming_combine_4_runtime | - |
69.0 | 54.5 | -21.01 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
  
## All metrics

**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**  
---|---|---|---|---|---|---  
avroioit_hdfs_results | read_time | - | 116.77 | 122.27 | 4.71 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
avroioit_hdfs_results | write_time | - | 171.15 | 179.75 | 5.03 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
avroioit_results | read_time | - | 117.51 | 124.57 | 6.01 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
avroioit_results | write_time | - | 159.38 | 164.64 | 3.3 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_batch_avro | avro_write_time | - | 53.24 | 54.61 | 2.58
|  [[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_batch_avro | read_time | - | 61.42 | 67.49 | 9.9 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_batch_json | read_time | - | 58.13 | 58.68 | 0.93 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_batch_json | write_time | - | 91.14 | 93.85 | 2.98 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_stream | read_time | - | 19.03 | 16.45 | -13.56 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
bqio_10GB_results_java_stream | write_time | - | 140.79 | 146.01 | 3.71 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
compressed_textioit_hdfs_results | read_time | - | 197.3 | 217.38 | 10.18 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
compressed_textioit_hdfs_results | write_time | - | 269.48 | 298.85 | 10.9 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
compressed_textioit_results | read_time | - | 206.31 | 208.28 | 0.96 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
compressed_textioit_results | write_time | - | 271.36 | 281.69 | 3.81 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
hadoopformatioit_results | read_time | - | 8.25 | 10.21 | 23.86 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
hadoopformatioit_results | write_time | - | 11.6 | 12.8 | 10.35 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
java_batch_cogbk_1 | dataflow_runtime_sec | - | 73.67 | 77.61 | 5.35 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_1 | sparkstructuredstreaming_runtime_sec | - | 203.99 | 156.3
| -23.38 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_2 | dataflow_runtime_sec | - | 80.24 | 76.3 | -4.91 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_2 | sparkstructuredstreaming_runtime_sec | - | 161.68 | 148.0
| -8.46 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_3 | dataflow_runtime_sec | - | 27.16 | 33.4 | 23.0 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_3 | sparkstructuredstreaming_runtime_sec | - | 24.8 | 23.92 |
-3.52 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_4 | dataflow_runtime_sec | - | 27.25 | 29.88 | 9.66 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_cogbk_4 | sparkstructuredstreaming_runtime_sec | - | 21.58 | 24.01
| 11.29 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_batch_combine_1 | dataflow_runtime_sec | - | 82.27 | 86.57 | 5.23 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_1 | sparkstructuredstreaming_runtime_sec | - | 539.3 |
529.15 | -1.88 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_4 | dataflow_runtime_sec | - | 38.47 | 36.87 | -4.15 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_4 | sparkstructuredstreaming_runtime_sec | - | 124.99 |
128.58 | 2.87 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_5 | dataflow_runtime_sec | - | 36.48 | 37.84 | 3.73 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_combine_5 | sparkstructuredstreaming_runtime_sec | - | 134.35 |
128.2 | -4.58 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_batch_gbk_1 | dataflow_runtime_sec | - | 260.83 | 263.59 | 1.06 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_1 | sparkstructuredstreaming_runtime_sec | - | 570.29 | 598.52
| 4.95 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_2 | dataflow_runtime_sec | - | 65.96 | 67.8 | 2.8 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_2 | sparkstructuredstreaming_runtime_sec | - | 113.66 | 112.23
| -1.26 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_3 | dataflow_runtime_sec | - | 30.37 | 31.1 | 2.42 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_3 | sparkstructuredstreaming_runtime_sec | - | 9.46 | 8.22 |
-13.1 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_4 | dataflow_runtime_sec | - | 29.79 | 31.48 | 5.66 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_4 | sparkstructuredstreaming_runtime_sec | - | 142.87 | 124.83
| -12.63 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_5 | dataflow_runtime_sec | - | 34.98 | 33.62 | -3.88 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_5 | sparkstructuredstreaming_runtime_sec | - | 127.45 | 146.09
| 14.62 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_6 | dataflow_runtime_sec | - | 73.98 | 73.97 | -0.01 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_6 | sparkstructuredstreaming_runtime_sec | - | 68.69 | 73.2 |
6.57 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_7 | dataflow_runtime_sec | - | 102.36 | 113.99 | 11.36 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_gbk_7 | sparkstructuredstreaming_runtime_sec | - | 96.48 | 93.57 |
-3.02 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_batch_pardo_1 | dataflow_runtime_sec | - | 28.35 | 29.25 | 3.15 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_1 | sparkstructuredstreaming_runtime_sec | - | 43.16 | 42.53
| -1.45 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_2 | dataflow_runtime_sec | - | 183.86 | 191.75 | 4.29 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_3 | dataflow_runtime_sec | - | 21.07 | 24.53 | 16.43 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_batch_pardo_4 | dataflow_runtime_sec | - | 38.47 | 36.43 | -5.3 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_cogbk_1 | dataflow_runtime_sec | - | 971.69 | 1015.77 | 4.54 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_2 | dataflow_runtime_sec | - | 975.56 | 1003.45 | 2.86 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_3 | dataflow_runtime_sec | - | 131.39 | 137.61 | 4.74 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_cogbk_4 | dataflow_runtime_sec | - | 139.13 | 146.85 | 5.55 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
java_streaming_combine_1 | dataflow_runtime_sec | - | 554.16 | 556.31 | 0.39 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_streaming_combine_4 | dataflow_runtime_sec | - | 336.55 | 355.0 | 5.49 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_streaming_combine_5 | dataflow_runtime_sec | - | 324.66 | 335.91 | 3.46 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
java_streaming_gbk_1 | dataflow_runtime_sec | - | 696.08 | 855.16 | 22.85 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_2 | dataflow_runtime_sec | - | 856.49 | 965.25 | 12.7 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_3 | dataflow_runtime_sec | - | 29.38 | 29.78 | 1.37 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_4 | dataflow_runtime_sec | - | 312.04 | 340.02 | 8.97 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_5 | dataflow_runtime_sec | - | 306.64 | 322.41 | 5.14 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_6 | dataflow_runtime_sec | - | 80.51 | 82.99 | 3.08 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_gbk_7 | dataflow_runtime_sec | - | 146.06 | 138.52 | -5.16 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
java_streaming_pardo_1 | dataflow_runtime_sec | - | 20.31 | 20.28 | -0.14 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_2 | dataflow_runtime_sec | - | 213.8 | 214.92 | 0.52 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_3 | dataflow_runtime_sec | - | 14.62 | 13.84 | -5.33 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
java_streaming_pardo_4 | dataflow_runtime_sec | - | 31.5 | 33.2 | 5.39 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
jdbcioit_results | read_time | - | 34.11 | 37.43 | 9.74 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
jdbcioit_results | write_time | - | 55.28 | 64.02 | 15.81 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
kafkaioit_results | read_time | - | 764.41 | 788.14 | 3.1 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
kafkaioit_results | write_time | - | 195.99 | 215.04 | 9.72 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
many_files_textioit_hdfs_results | read_time | - | 20.24 | 20.48 | 1.21 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
many_files_textioit_hdfs_results | write_time | - | 100.35 | 104.56 | 4.2 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
many_files_textioit_results | read_time | - | 40.15 | 41.7 | 3.87 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
many_files_textioit_results | write_time | - | 111.18 | 117.32 | 5.52 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
mongodbioit_results | read_time | - | 27.26 | 29.21 | 7.14 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
mongodbioit_results | write_time | - | 71.95 | 72.13 | 0.25 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
parquetioit_hdfs_results | read_time | - | 115.17 | 130.24 | 13.08 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
parquetioit_hdfs_results | write_time | - | 184.36 | 196.34 | 6.49 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
parquetioit_results | read_time | - | 113.59 | 116.85 | 2.87 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
parquetioit_results | write_time | - | 178.85 | 190.67 | 6.61 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
python_batch_cogbk_1 | python_dataflow_batch_cogbk_1_runtime | - | 445.14 |
452.75 | 1.71 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_batch_cogbk_2 | python_dataflow_batch_cogbk_2_runtime | - | 299.14 |
308.0 | 2.96 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_batch_cogbk_3 | python_dataflow_batch_cogbk_3_runtime | - | 289.86 |
302.75 | 4.45 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_batch_cogbk_4 | python_dataflow_batch_cogbk_4_runtime | - | 292.57 |
294.25 | 0.57 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_batch_combine_1 | python_dataflow_batch_combine_1_runtime | - | 913.86
| 927.0 | 1.44 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_combine_1 | python_flink_batch_combine_1_runtime | - | 5147.0 |
4957.67 | -3.68 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_combine_4 | python_dataflow_batch_combine_4_runtime | - | 32.57 |
34.75 | 6.69 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_combine_4 | python_flink_batch_combine_4_runtime | - | 216.67 |
191.0 | -11.85 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_combine_5 | python_dataflow_batch_combine_5_runtime | - | 33.57 |
35.0 | 4.26 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_combine_5 | python_flink_batch_combine_5_runtime | - | 141.83 |
146.25 | 3.11 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_batch_gbk_1 | python_dataflow_batch_gbk_1_runtime | - | 1938.71 |
1952.75 | 0.72 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_2 | python_dataflow_batch_gbk_2_runtime | - | 348.14 | 352.75
| 1.32 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_3 | python_dataflow_batch_gbk_3_runtime | - | 36.14 | 39.25 |
8.6 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_4 | python_dataflow_batch_gbk_4_runtime | - | 97.57 | 101.0 |
3.51 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_5 | python_dataflow_batch_gbk_5_runtime | - | 94.29 | 100.75
| 6.86 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_6 | python_dataflow_batch_gbk_6_runtime | - | 363.29 | 389.0
| 7.08 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_gbk_7 | python_dataflow_batch_gbk_7_runtime | - | 371.57 | 370.5
| -0.29 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_batch_pardo_1 | python_dataflow_batch_pardo_1_runtime | - | 266.43 |
271.75 | 2.0 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_1 | python_flink_batch_pardo_1_runtime | - | 1862.75 |
1760.75 | -5.48 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_2 | python_dataflow_batch_pardo_2_runtime | - | 2929.0 |
2974.75 | 1.56 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_3 | python_dataflow_batch_pardo_3_runtime | - | 219.14 |
229.0 | 4.5 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_3 | python_flink_batch_pardo_3_runtime | - | 1422.0 |
1329.5 | -6.5 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_4 | python_dataflow_batch_pardo_4_runtime | - | 446.14 |
442.0 | -0.93 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_batch_pardo_4 | python_flink_batch_pardo_4_runtime | - | 3180.75 |
2994.25 | -5.86 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_bqio_read_10GB_results | bqio_read_10GB_results_runtime | - | 125.86 |
120.5 | -4.26 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_bqio_write_10GB_results | bqio_write_10GB_results_runtime | - | 262.86
| 263.0 | 0.05 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_psio_2GB_results | pubsub_io_perf_read_runtime | - | 65.86 | 78.75 |
19.58 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_psio_2GB_results | pubsub_io_perf_write_runtime | - | 69.29 | 64.75 |
-6.55 |  [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)  
python_streaming_cogbk_1 | python_dataflow_streaming_cogbk_1_runtime | - |
701.14 | 858.75 | 22.48 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_streaming_cogbk_2 | python_dataflow_streaming_cogbk_2_runtime | - |
369.14 | 446.75 | 21.02 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_streaming_cogbk_3 | python_dataflow_streaming_cogbk_3_runtime | - |
1215.29 | 1269.5 | 4.46 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_streaming_cogbk_4 | python_dataflow_streaming_cogbk_4_runtime | - |
346.29 | 319.5 | -7.74 |  [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)  
python_streaming_combine_1 | python_dataflow_streaming_combine_1_runtime | - |
1494.57 | 1429.75 | -4.34 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_streaming_combine_4 | python_dataflow_streaming_combine_4_runtime | - |
69.0 | 54.5 | -21.01 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_streaming_combine_5 | python_dataflow_streaming_combine_5_runtime | - |
62.0 | 59.5 | -4.03 |  [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)  
python_streaming_gbk_3 | python_dataflow_streaming_gbk_3_runtime | - | 165.71
| 177.75 | 7.26 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_streaming_gbk_6 | python_dataflow_streaming_gbk_6_runtime | - | 478.43
| 443.25 | -7.35 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_streaming_gbk_7 | python_dataflow_streaming_gbk_7_runtime | - | 445.57
| 426.25 | -4.34 |  [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)  
python_streaming_pardo_1 | python_flink_streaming_pardo_5_runtime | - | 182.0
| 176.5 | -3.02 |  [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)  
python_streaming_pardo_6 | python_flink_streaming_pardo_6_runtime | - | 60.0 |
73.0 | 21.67 |  
textioit_hdfs_results | read_time | - | 22.94 | 23.43 | 2.11 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
textioit_hdfs_results | write_time | - | 43.98 | 46.08 | 4.77 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
textioit_results | read_time | - | 23.1 | 25.04 | 8.41 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
textioit_results | write_time | - | 41.35 | 44.29 | 7.11 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
tfrecordioit_results | read_time | - | 23.68 | 25.97 | 9.68 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
tfrecordioit_results | write_time | - | 31.94 | 34.32 | 7.48 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
wordcount_py27_results | runtime | - | 888.11 | 905.51 | 1.96 |
[[1]](http://metrics.beam.apache.org/d/1cnwVDkGk)  
wordcount_py37_results | runtime | - | 809.71 | 817.12 | 0.92 |
[[1]](http://metrics.beam.apache.org/d/1cnwVDkGk)  
xmlioit_hdfs_results | read_time | - | 25.51 | 25.82 | 1.19 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
xmlioit_hdfs_results | write_time | - | 39.2 | 43.45 | 10.83 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
xmlioit_results | read_time | - | 25.9 | 28.06 | 8.35 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
xmlioit_results | write_time | - | 34.05 | 38.6 | 13.36 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)  
nexmark_0_batch | RuntimeMs | DataflowRunner | 56791.21 | 61125.33 | 7.63 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_0_batch | RuntimeMs | DirectRunner | 2547.36 | 2590.56 | 1.7 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_0_batch | RuntimeMs | FlinkRunner | 1105.93 | 1093.5 | -1.12 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_0_batch | RuntimeMs | SparkRunner | 1306.43 | 1254.17 | -4.0 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_0_batch | RuntimeMs | SparkStructuredStreamingRunner | 1542.96 |
1511.61 | -2.03 |  [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_0_sql_batch | RuntimeMs | DataflowRunner | 58370.65 | 59155.18 | 1.34
|  [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[3]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_0_sql_batch | RuntimeMs | DirectRunner | 3364.25 | 3225.11 | -4.14 |
[[1]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[3]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_0_sql_batch | RuntimeMs | SparkRunner | 1546.93 | 1534.72 | -0.79 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[3]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_0_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1776.79 |
1766.5 | -0.58 |  [[1]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[3]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_0_sql_streaming | RuntimeMs | DataflowRunner | 23455.71 | 24748.29 |
5.51 |  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)  
nexmark_0_sql_streaming | RuntimeMs | DirectRunner | 6246.39 | 6549.72 | 4.86
|  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)  
nexmark_0_sql_streaming | RuntimeMs | FlinkRunner | 1612.71 | 1624.17 | 0.71 |
[[1]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_0_streaming | RuntimeMs | DataflowRunner | 22179.96 | 22501.22 | 1.45
|  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_0_streaming | RuntimeMs | DirectRunner | 4584.36 | 4614.56 | 0.66 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_0_streaming | RuntimeMs | FlinkRunner | 1462.07 | 1393.17 | -4.71 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_0_zetasql_batch | RuntimeMs | DataflowRunner | 1420246.7 | 1449563.29
| 2.06 |  [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_0_zetasql_batch | RuntimeMs | DirectRunner | 14518.64 | 14457.61 |
-0.42 |  [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_0_zetasql_streaming | RuntimeMs | DataflowRunner | 588902.83 |
596610.06 | 1.31 |  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_0_zetasql_streaming | RuntimeMs | DirectRunner | 16421.0 | 16220.67 |
-1.22 |  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_0_zetasql_streaming | RuntimeMs | FlinkRunner | 12790.89 | 12444.56 |
-2.71 |  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_10_batch | RuntimeMs | DataflowRunner | 88686.79 | 92311.22 | 4.09 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_10_batch | RuntimeMs | DirectRunner | 2650.39 | 2680.56 | 1.14 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_10_batch | RuntimeMs | FlinkRunner | 563.25 | 567.78 | 0.8 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_10_batch | RuntimeMs | SparkRunner | 658.89 | 652.44 | -0.98 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_10_batch | RuntimeMs | SparkStructuredStreamingRunner | 1086.68 |
1065.39 | -1.96 |  [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_10_streaming | RuntimeMs | DataflowRunner | 92450.18 | 90790.5 | -1.8
|  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_10_streaming | RuntimeMs | DirectRunner | 16972.21 | 16766.22 | -1.21
|  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_10_streaming | RuntimeMs | FlinkRunner | 1242.0 | 1263.56 | 1.74 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_11_batch | RuntimeMs | DataflowRunner | 54513.79 | 60363.0 | 10.73 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_11_batch | RuntimeMs | DirectRunner | 2392.0 | 2378.61 | -0.56 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_11_batch | RuntimeMs | FlinkRunner | 263.71 | 262.28 | -0.54 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_11_batch | RuntimeMs | SparkRunner | 1374.43 | 1346.28 | -2.05 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_11_batch | RuntimeMs | SparkStructuredStreamingRunner | 913.71 |
897.44 | -1.78 |  [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_11_streaming | RuntimeMs | DataflowRunner | 186434.96 | 190708.44 |
2.29 |  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_11_streaming | RuntimeMs | DirectRunner | 3140.43 | 3166.28 | 0.82 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_11_streaming | RuntimeMs | FlinkRunner | 1319.11 | 1264.22 | -4.16 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_12_batch | RuntimeMs | DataflowRunner | 38090.54 | 41060.56 | 7.8 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_12_batch | RuntimeMs | DirectRunner | 1591.57 | 1581.33 | -0.64 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_12_batch | RuntimeMs | FlinkRunner | 190.25 | 181.72 | -4.48 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_12_batch | RuntimeMs | SparkRunner | 852.61 | 840.17 | -1.46 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_12_batch | RuntimeMs | SparkStructuredStreamingRunner | 715.75 |
728.83 | 1.83 |  [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_12_streaming | RuntimeMs | DataflowRunner | 88912.79 | 89209.11 | 0.33
|  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_12_streaming | RuntimeMs | DirectRunner | 2135.25 | 2133.0 | -0.11 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_12_streaming | RuntimeMs | FlinkRunner | 682.96 | 726.94 | 6.44 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_13_batch | RuntimeMs | DataflowRunner | 46255.0 | 49102.22 | 6.16 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_13_batch | RuntimeMs | DirectRunner | 1553.25 | 1550.78 | -0.16 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_13_batch | RuntimeMs | FlinkRunner | 370.07 | 363.44 | -1.79 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_13_batch | RuntimeMs | SparkRunner | 346.21 | 354.5 | 2.39 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_13_batch | RuntimeMs | SparkStructuredStreamingRunner | 494.07 |
483.83 | -2.07 |  [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_13_sql_batch | RuntimeMs | DataflowRunner | 118074.42 | 119858.71 |
1.51 |  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[3]](http://metrics.beam.apache.org/d/OG-w5jzGz)  
nexmark_13_sql_batch | RuntimeMs | DirectRunner | 4445.21 | 4720.83 | 6.2 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[3]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_13_sql_batch | RuntimeMs | SparkRunner | 1519.32 | 1502.33 | -1.12 |
[[1]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[3]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_13_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1711.07 |
1668.78 | -2.47 |  [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[3]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_13_sql_streaming | RuntimeMs | DataflowRunner | 38089.33 | 39244.94 |
3.03 |  [[1]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_13_sql_streaming | RuntimeMs | DirectRunner | 5300.64 | 5291.06 |
-0.18 |  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)  
nexmark_13_sql_streaming | RuntimeMs | FlinkRunner | 2950.54 | 2915.94 | -1.17
|  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)  
nexmark_13_streaming | RuntimeMs | DataflowRunner | 30861.32 | 30174.56 |
-2.23 |  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_13_streaming | RuntimeMs | DirectRunner | 2503.79 | 2525.0 | 0.85 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_13_streaming | RuntimeMs | FlinkRunner | 1200.21 | 1190.06 | -0.85 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_13_zetasql_batch | RuntimeMs | DataflowRunner | 3466510.13 |
3495294.65 | 0.83 |  [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_13_zetasql_batch | RuntimeMs | DirectRunner | 29960.11 | 29654.56 |
-1.02 |  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_13_zetasql_streaming | RuntimeMs | DataflowRunner | 1193359.65 |
1202020.0 | 0.73 |  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_13_zetasql_streaming | RuntimeMs | DirectRunner | 24397.04 | 25156.11
| 3.11 |  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_13_zetasql_streaming | RuntimeMs | FlinkRunner | 21969.21 | 22347.94 |
1.72 |  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_14_batch | RuntimeMs | DataflowRunner | 110891.61 | 115975.56 | 4.58 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_14_batch | RuntimeMs | DirectRunner | 2584.64 | 2526.28 | -2.26 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_14_batch | RuntimeMs | FlinkRunner | 539.68 | 528.67 | -2.04 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_14_batch | RuntimeMs | SparkRunner | 869.36 | 874.39 | 0.58 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_14_batch | RuntimeMs | SparkStructuredStreamingRunner | 1049.75 |
1072.44 | 2.16 |  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_14_streaming | RuntimeMs | DataflowRunner | 139665.57 | 153282.39 |
9.75 |  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_14_streaming | RuntimeMs | DirectRunner | 3243.75 | 3242.56 | -0.04 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_14_streaming | RuntimeMs | FlinkRunner | 1164.82 | 1143.22 | -1.85 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_1_batch | RuntimeMs | DataflowRunner | 46570.11 | 50241.0 | 7.88 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_1_batch | RuntimeMs | DirectRunner | 1764.0 | 1729.67 | -1.95 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_1_batch | RuntimeMs | FlinkRunner | 309.0 | 327.72 | 6.06 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_1_batch | RuntimeMs | SparkRunner | 444.68 | 444.67 | -0.0 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_1_batch | RuntimeMs | SparkStructuredStreamingRunner | 595.71 | 591.28
| -0.74 |  [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_1_sql_batch | RuntimeMs | DataflowRunner | 51111.58 | 54637.94 | 6.9 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[3]](http://metrics.beam.apache.org/d/OG-w5jzGz)  
nexmark_1_sql_batch | RuntimeMs | DirectRunner | 2130.0 | 2124.56 | -0.26 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[3]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_1_sql_batch | RuntimeMs | SparkRunner | 772.79 | 778.61 | 0.75 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[3]](http://metrics.beam.apache.org/d/OG-w5jzGz)  
nexmark_1_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 994.25 |
985.0 | -0.93 |  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[3]](http://metrics.beam.apache.org/d/OG-w5jzGz)  
nexmark_1_sql_streaming | RuntimeMs | DataflowRunner | 21624.17 | 22702.35 |
4.99 |  [[1]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_1_sql_streaming | RuntimeMs | DirectRunner | 3514.82 | 3643.17 | 3.65
|  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)  
nexmark_1_sql_streaming | RuntimeMs | FlinkRunner | 693.18 | 698.56 | 0.78 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)  
nexmark_1_streaming | RuntimeMs | DataflowRunner | 18288.43 | 18559.11 | 1.48
|  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_1_streaming | RuntimeMs | DirectRunner | 3254.96 | 3219.67 | -1.08 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_1_streaming | RuntimeMs | FlinkRunner | 659.18 | 629.5 | -4.5 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_2_batch | RuntimeMs | DataflowRunner | 32179.18 | 33163.39 | 3.06 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_2_batch | RuntimeMs | DirectRunner | 1285.57 | 1283.06 | -0.2 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_2_batch | RuntimeMs | FlinkRunner | 171.68 | 155.06 | -9.68 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_2_batch | RuntimeMs | SparkRunner | 286.79 | 272.67 | -4.92 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_2_batch | RuntimeMs | SparkStructuredStreamingRunner | 440.61 | 440.72
| 0.03 |  [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_2_sql_batch | RuntimeMs | DataflowRunner | 35515.46 | 38582.59 | 8.64
|  [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[3]](http://metrics.beam.apache.org/d/OG-w5jzGz)  
nexmark_2_sql_batch | RuntimeMs | DirectRunner | 1209.75 | 1223.94 | 1.17 |
[[1]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[3]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_2_sql_batch | RuntimeMs | SparkRunner | 591.21 | 588.44 | -0.47 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[3]](http://metrics.beam.apache.org/d/OG-w5jzGz)  
nexmark_2_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 745.75 |
748.5 | 0.37 |  [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[3]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_2_sql_streaming | RuntimeMs | DataflowRunner | 13446.71 | 14955.29 |
11.22 |  [[1]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_2_sql_streaming | RuntimeMs | DirectRunner | 1950.86 | 1997.67 | 2.4 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)  
nexmark_2_sql_streaming | RuntimeMs | FlinkRunner | 410.18 | 408.11 | -0.5 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)  
nexmark_2_streaming | RuntimeMs | DataflowRunner | 11083.71 | 11220.17 | 1.23
|  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_2_streaming | RuntimeMs | DirectRunner | 1562.29 | 1573.67 | 0.73 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_2_streaming | RuntimeMs | FlinkRunner | 285.64 | 272.67 | -4.54 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_2_zetasql_batch | RuntimeMs | DataflowRunner | 1232605.87 | 1268764.24
| 2.93 |  [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_2_zetasql_batch | RuntimeMs | DirectRunner | 11470.54 | 11267.33 |
-1.77 |  [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_2_zetasql_streaming | RuntimeMs | DataflowRunner | 505960.57 |
523947.71 | 3.56 |  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_2_zetasql_streaming | RuntimeMs | DirectRunner | 11723.18 | 11837.56 |
0.98 |  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_2_zetasql_streaming | RuntimeMs | FlinkRunner | 10611.18 | 10659.83 |
0.46 |  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_3_batch | RuntimeMs | DataflowRunner | 43495.61 | 45648.11 | 4.95 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_3_batch | RuntimeMs | DirectRunner | 2732.18 | 2737.94 | 0.21 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_3_batch | RuntimeMs | FlinkRunner | 1214.82 | 1232.5 | 1.46 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_3_batch | RuntimeMs | SparkRunner | 2213.46 | 2103.11 | -4.99 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_3_sql_batch | RuntimeMs | DataflowRunner | 41849.65 | 44985.65 | 7.49
|  [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[3]](http://metrics.beam.apache.org/d/OG-w5jzGz)  
nexmark_3_sql_batch | RuntimeMs | DirectRunner | 2274.93 | 2257.72 | -0.76 |
[[1]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[3]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_3_sql_batch | RuntimeMs | SparkRunner | 3071.14 | 3056.89 | -0.46 |
[[1]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[3]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_3_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 2460.32 |
2429.94 | -1.23 |  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[3]](http://metrics.beam.apache.org/d/OG-w5jzGz)  
nexmark_3_sql_streaming | RuntimeMs | DataflowRunner | 37648.12 | 40324.29 |
7.11 |  [[1]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_3_sql_streaming | RuntimeMs | DirectRunner | 3744.46 | 3756.11 | 0.31
|  [[1]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_3_sql_streaming | RuntimeMs | FlinkRunner | 1423.14 | 1394.5 | -2.01 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)  
nexmark_3_streaming | RuntimeMs | DataflowRunner | 43221.68 | 42011.67 | -2.8
|  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_3_streaming | RuntimeMs | DirectRunner | 3643.89 | 3672.22 | 0.78 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_3_streaming | RuntimeMs | FlinkRunner | 753.43 | 742.22 | -1.49 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_3_zetasql_batch | RuntimeMs | DataflowRunner | 195533.26 | 199131.53 |
1.84 |  [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_3_zetasql_batch | RuntimeMs | DirectRunner | 3474.82 | 3453.56 | -0.61
|  [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_3_zetasql_streaming | RuntimeMs | DataflowRunner | 96512.04 | 98207.53
| 1.76 |  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_3_zetasql_streaming | RuntimeMs | DirectRunner | 4886.04 | 5066.67 |
3.7 |  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_3_zetasql_streaming | RuntimeMs | FlinkRunner | 2179.57 | 2213.83 |
1.57 |  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_4_batch | RuntimeMs | DataflowRunner | 45201.71 | 49214.11 | 8.88 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_4_batch | RuntimeMs | DirectRunner | 1460.36 | 1465.56 | 0.36 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_4_batch | RuntimeMs | FlinkRunner | 809.64 | 796.56 | -1.62 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_4_batch | RuntimeMs | SparkRunner | 958.64 | 936.67 | -2.29 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_4_batch | RuntimeMs | SparkStructuredStreamingRunner | 2300.39 |
2278.5 | -0.95 |  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_4_streaming | RuntimeMs | DataflowRunner | 56357.14 | 54881.44 | -2.62
|  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_4_streaming | RuntimeMs | DirectRunner | 1470.39 | 1513.83 | 2.95 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_4_streaming | RuntimeMs | FlinkRunner | 1017.25 | 987.33 | -2.94 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_5_batch | RuntimeMs | DataflowRunner | 61423.21 | 63202.0 | 2.9 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_5_batch | RuntimeMs | DirectRunner | 5025.36 | 5285.39 | 5.17 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_5_batch | RuntimeMs | FlinkRunner | 728.93 | 722.22 | -0.92 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_5_batch | RuntimeMs | SparkRunner | 1497.86 | 1470.0 | -1.86 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_5_batch | RuntimeMs | SparkStructuredStreamingRunner | 1487.07 |
1471.72 | -1.03 |  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_5_streaming | RuntimeMs | DataflowRunner | 140151.11 | 141931.5 | 1.27
|  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_5_streaming | RuntimeMs | DirectRunner | 6810.86 | 6639.39 | -2.52 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_5_streaming | RuntimeMs | FlinkRunner | 1625.21 | 1541.11 | -5.17 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_6_batch | RuntimeMs | DataflowRunner | 42587.29 | 48321.06 | 13.46 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_6_batch | RuntimeMs | DirectRunner | 960.93 | 994.06 | 3.45 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_6_batch | RuntimeMs | FlinkRunner | 373.86 | 383.89 | 2.68 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_6_batch | RuntimeMs | SparkRunner | 598.71 | 598.5 | -0.04 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_6_batch | RuntimeMs | SparkStructuredStreamingRunner | 793.46 | 788.67
| -0.6 |  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_6_streaming | RuntimeMs | DataflowRunner | 45039.14 | 46158.0 | 2.48 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_6_streaming | RuntimeMs | DirectRunner | 1112.0 | 1082.56 | -2.65 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_6_streaming | RuntimeMs | FlinkRunner | 420.04 | 448.06 | 6.67 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_7_batch | RuntimeMs | DataflowRunner | 73640.96 | 79970.72 | 8.6 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_7_batch | RuntimeMs | DirectRunner | 3242.25 | 3309.94 | 2.09 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_7_batch | RuntimeMs | FlinkRunner | 563.64 | 552.67 | -1.95 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_7_batch | RuntimeMs | SparkRunner | 1392.07 | 1373.22 | -1.35 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_7_batch | RuntimeMs | SparkStructuredStreamingRunner | 2008.21 |
2020.39 | 0.61 |  [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_7_sql_batch | RuntimeMs | DataflowRunner | 135505.0 | 144372.41 | 6.54
|  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[3]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_7_sql_batch | RuntimeMs | DirectRunner | 87343.57 | 87538.72 | 0.22 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[3]](http://metrics.beam.apache.org/d/OG-w5jzGz)  
nexmark_7_sql_batch | RuntimeMs | SparkRunner | 4154.71 | 4118.89 | -0.86 |
[[1]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[3]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_7_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 3910.32 |
3907.11 | -0.08 |  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[3]](http://metrics.beam.apache.org/d/OG-w5jzGz)  
nexmark_7_sql_streaming | RuntimeMs | DataflowRunner | 1071863.96 | 1172797.0
| 9.42 |  [[1]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_7_sql_streaming | RuntimeMs | DirectRunner | 103486.39 | 103782.06 |
0.29 |  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/OG-w5jzGz)  
nexmark_7_sql_streaming | RuntimeMs | FlinkRunner | 3637.61 | 4036.56 | 10.97
|  [[1]](http://metrics.beam.apache.org/d/OG-w5jzGz)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_7_streaming | RuntimeMs | DataflowRunner | 104140.25 | 108848.72 |
4.52 |  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_7_streaming | RuntimeMs | DirectRunner | 8445.61 | 8475.83 | 0.36 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_7_streaming | RuntimeMs | FlinkRunner | 1244.68 | 1200.33 | -3.56 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_8_batch | RuntimeMs | DataflowRunner | 44958.0 | 46394.39 | 3.19 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_8_batch | RuntimeMs | DirectRunner | 1454.96 | 1454.39 | -0.04 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_8_batch | RuntimeMs | FlinkRunner | 436.75 | 445.5 | 2.0 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_8_batch | RuntimeMs | SparkRunner | 1327.25 | 1312.89 | -1.08 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_8_batch | RuntimeMs | SparkStructuredStreamingRunner | 977.14 | 974.5
| -0.27 |  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_8_streaming | RuntimeMs | DataflowRunner | 48067.0 | 50521.44 | 5.11 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_8_streaming | RuntimeMs | DirectRunner | 2507.0 | 2450.5 | -2.25 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_8_streaming | RuntimeMs | FlinkRunner | 593.68 | 581.83 | -2.0 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_9_batch | RuntimeMs | DataflowRunner | 42757.46 | 46423.72 | 8.57 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_9_batch | RuntimeMs | DirectRunner | 680.57 | 668.56 | -1.77 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)
[[2]](http://metrics.beam.apache.org/d/WaMsRCzGk)  
nexmark_9_batch | RuntimeMs | FlinkRunner | 267.75 | 268.72 | 0.36 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_9_batch | RuntimeMs | SparkRunner | 493.11 | 474.5 | -3.77 |
[[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_9_batch | RuntimeMs | SparkStructuredStreamingRunner | 619.82 | 606.72
| -2.11 |  [[1]](http://metrics.beam.apache.org/d/WaMsRCzGk)
[[2]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_9_streaming | RuntimeMs | DataflowRunner | 39973.36 | 37489.39 | -6.21
|  [[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_9_streaming | RuntimeMs | DirectRunner | 723.29 | 719.67 | -0.5 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)  
nexmark_9_streaming | RuntimeMs | FlinkRunner | 371.61 | 360.72 | -2.93 |
[[1]](http://metrics.beam.apache.org/d/ahuaA_zGz)