You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/09/28 12:01:31 UTC
Beam Metrics Report (2020-09-28)
/* * Licensed to the Apache Software Foundation (ASF) under one * or more
contributor license agreements. See the NOTICE file * distributed with this
work for additional information * regarding copyright ownership. The ASF
licenses this file * to you under the Apache License, Version 2.0 (the *
"License"); you may not use this file except in compliance * with the License.
You may obtain a copy of the License at * *
http://www.apache.org/licenses/LICENSE-2.0 * * Unless required by applicable
law or agreed to in writing, software * distributed under the License is
distributed on an "AS IS" BASIS, * WITHOUT WARRANTIES OR CONDITIONS OF ANY
KIND, either express or implied. * See the License for the specific language
governing permissions and * limitations under the License. */
# Beam Metrics Report
Color legend: >= 20 | >= 10 | <= -10 | <= -20
---|---|---|---
## Possible regression
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
java_batch_gbk_1 | sparkstructuredstreaming_runtime_sec | - | 575.84 | 636.13
| 10.47 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | sparkstructuredstreaming_runtime_sec | - | 8.71 | 10.06 |
15.44 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_combine_4 | dataflow_runtime_sec | - | 342.72 | 401.0 | 17.01 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_gbk_5 | dataflow_runtime_sec | - | 342.1 | 448.64 | 31.14 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_psio_2GB_results | pubsub_io_perf_read_runtime | - | 64.29 | 86.5 |
34.56 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_psio_2GB_results | pubsub_io_perf_write_runtime | - | 65.71 | 76.0 |
15.65 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_streaming_pardo_6 | python_flink_streaming_pardo_6_runtime | - | 43.29
| 74.25 | 71.53 |
nexmark_0_batch | RuntimeMs | DirectRunner | 2777.04 | 3219.33 | 15.93 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_batch | RuntimeMs | FlinkRunner | 951.5 | 1119.44 | 17.65 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_batch | RuntimeMs | SparkRunner | 1751.54 | 2335.33 | 33.33 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_batch | RuntimeMs | SparkStructuredStreamingRunner | 1501.54 |
2154.61 | 43.49 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_sql_batch | RuntimeMs | DirectRunner | 3240.82 | 3765.06 | 16.18 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_sql_batch | RuntimeMs | SparkRunner | 1476.07 | 1975.0 | 33.8 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1686.32 |
2322.78 | 37.74 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_sql_streaming | RuntimeMs | DirectRunner | 6192.29 | 6882.17 | 11.14
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_streaming | RuntimeMs | DirectRunner | 4557.54 | 5101.83 | 11.94 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_batch | RuntimeMs | DirectRunner | 13981.54 | 16884.06 |
20.76 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_zetasql_streaming | RuntimeMs | DirectRunner | 15868.14 | 18344.67 |
15.61 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_batch | RuntimeMs | DirectRunner | 2643.68 | 2985.11 | 12.92 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_10_batch | RuntimeMs | FlinkRunner | 513.96 | 589.17 | 14.63 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_batch | RuntimeMs | SparkRunner | 646.18 | 831.33 | 28.65 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_10_batch | RuntimeMs | SparkStructuredStreamingRunner | 1044.07 |
1436.17 | 37.55 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_batch | RuntimeMs | DirectRunner | 2357.29 | 2599.89 | 10.29 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_11_batch | RuntimeMs | FlinkRunner | 236.18 | 272.17 | 15.24 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_batch | RuntimeMs | SparkRunner | 1768.54 | 2219.22 | 25.48 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_batch | RuntimeMs | SparkStructuredStreamingRunner | 859.39 |
1110.56 | 29.23 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_11_streaming | RuntimeMs | DirectRunner | 3168.96 | 3487.28 | 10.04 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_batch | RuntimeMs | DirectRunner | 1582.71 | 1764.44 | 11.48 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_12_batch | RuntimeMs | SparkRunner | 842.68 | 1106.17 | 31.27 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_12_batch | RuntimeMs | SparkStructuredStreamingRunner | 709.89 |
1011.83 | 42.53 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_12_streaming | RuntimeMs | DirectRunner | 2112.57 | 2348.89 | 11.19 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_batch | RuntimeMs | FlinkRunner | 294.36 | 347.61 | 18.09 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_batch | RuntimeMs | SparkRunner | 306.36 | 399.94 | 30.55 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_batch | RuntimeMs | SparkStructuredStreamingRunner | 491.71 |
661.06 | 34.44 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_sql_batch | RuntimeMs | SparkRunner | 1467.61 | 1862.22 | 26.89 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1601.32 |
2043.78 | 27.63 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_batch | RuntimeMs | DirectRunner | 28645.18 | 34574.0 |
20.7 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_zetasql_streaming | RuntimeMs | DirectRunner | 24013.36 | 27832.56
| 15.9 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_batch | RuntimeMs | DirectRunner | 2473.25 | 2746.89 | 11.06 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_14_batch | RuntimeMs | SparkRunner | 1275.71 | 1418.06 | 11.16 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_14_batch | RuntimeMs | SparkStructuredStreamingRunner | 1078.57 |
1499.89 | 39.06 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_14_streaming | RuntimeMs | DirectRunner | 3241.89 | 3570.28 | 10.13 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_batch | RuntimeMs | DirectRunner | 2208.64 | 2596.78 | 17.57 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_batch | RuntimeMs | SparkRunner | 507.82 | 654.5 | 28.88 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_batch | RuntimeMs | SparkStructuredStreamingRunner | 580.18 | 724.94
| 24.95 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_1_sql_batch | RuntimeMs | DirectRunner | 2085.75 | 2430.61 | 16.53 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_1_sql_batch | RuntimeMs | SparkRunner | 748.54 | 980.56 | 31.0 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_1_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 935.36 |
1265.89 | 35.34 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_batch | RuntimeMs | SparkRunner | 347.0 | 464.39 | 33.83 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_batch | RuntimeMs | SparkStructuredStreamingRunner | 421.71 | 554.67
| 31.53 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_sql_batch | RuntimeMs | DirectRunner | 1204.86 | 1338.56 | 11.1 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_sql_batch | RuntimeMs | SparkRunner | 555.07 | 783.28 | 41.11 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 712.36 |
963.67 | 35.28 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_streaming | RuntimeMs | DirectRunner | 1941.54 | 2160.22 | 11.26
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_batch | RuntimeMs | DirectRunner | 10976.11 | 13430.5 |
22.36 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_zetasql_streaming | RuntimeMs | DirectRunner | 11528.07 | 13567.5 |
17.69 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_batch | RuntimeMs | DirectRunner | 2785.68 | 3165.83 | 13.65 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_batch | RuntimeMs | FlinkRunner | 1029.86 | 1207.0 | 17.2 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_batch | RuntimeMs | SparkRunner | 2688.21 | 3505.44 | 30.4 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_batch | RuntimeMs | DirectRunner | 2266.82 | 2552.72 | 12.61 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_3_sql_batch | RuntimeMs | SparkRunner | 3007.82 | 3958.28 | 31.6 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 2350.39 |
3173.44 | 35.02 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_zetasql_batch | RuntimeMs | DirectRunner | 3423.25 | 3879.78 | 13.34
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_zetasql_streaming | RuntimeMs | DirectRunner | 4860.29 | 5508.61 |
13.34 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_batch | RuntimeMs | FlinkRunner | 754.18 | 830.11 | 10.07 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_4_batch | RuntimeMs | SparkRunner | 873.18 | 1215.89 | 39.25 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_4_batch | RuntimeMs | SparkStructuredStreamingRunner | 2189.25 |
3073.33 | 40.38 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_streaming | RuntimeMs | DirectRunner | 1475.04 | 1657.78 | 12.39 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_batch | RuntimeMs | FlinkRunner | 613.43 | 730.78 | 19.13 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_5_batch | RuntimeMs | SparkRunner | 1469.54 | 1848.89 | 25.81 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_5_batch | RuntimeMs | SparkStructuredStreamingRunner | 1444.39 |
1872.06 | 29.61 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_streaming | RuntimeMs | DirectRunner | 6623.25 | 7362.78 | 11.17 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_batch | RuntimeMs | DirectRunner | 970.36 | 1083.94 | 11.71 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_batch | RuntimeMs | FlinkRunner | 393.0 | 443.72 | 12.91 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_6_batch | RuntimeMs | SparkRunner | 985.64 | 1150.56 | 16.73 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_6_batch | RuntimeMs | SparkStructuredStreamingRunner | 754.79 |
1035.89 | 37.24 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_6_streaming | RuntimeMs | DirectRunner | 1067.32 | 1225.61 | 14.83 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_batch | RuntimeMs | DirectRunner | 3285.86 | 3638.94 | 10.75 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_batch | RuntimeMs | SparkRunner | 1688.57 | 2159.17 | 27.87 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_batch | RuntimeMs | SparkStructuredStreamingRunner | 1936.86 |
2493.5 | 28.74 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_batch | RuntimeMs | SparkRunner | 4027.75 | 5079.83 | 26.12 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 3795.71 |
4835.28 | 27.39 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_8_batch | RuntimeMs | DirectRunner | 1460.11 | 1615.28 | 10.63 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_batch | RuntimeMs | FlinkRunner | 421.25 | 476.17 | 13.04 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_batch | RuntimeMs | SparkRunner | 1357.71 | 1666.06 | 22.71 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_batch | RuntimeMs | SparkStructuredStreamingRunner | 934.5 | 1214.17
| 29.93 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_9_batch | RuntimeMs | SparkRunner | 465.36 | 646.22 | 38.87 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_batch | RuntimeMs | SparkStructuredStreamingRunner | 583.11 | 807.44
| 38.47 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_9_streaming | RuntimeMs | DirectRunner | 705.96 | 779.78 | 10.46 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_PRs_0_batch | RuntimeMs | SparkRunner | 1725.0 | 2199.0 | 27.48 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_PRs_11_batch | RuntimeMs | SparkRunner | 1540.0 | 1878.0 | 21.95 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_PRs_13_sql_batch | RuntimeMs | SparkRunner | 1645.0 | 1816.0 | 10.4 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_PRs_1_batch | RuntimeMs | SparkRunner | 511.0 | 563.0 | 10.18 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_PRs_2_batch | RuntimeMs | SparkRunner | 317.0 | 371.0 | 17.03 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_PRs_2_sql_batch | RuntimeMs | SparkRunner | 593.0 | 658.0 | 10.96 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
## Possible improvement
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
java_streaming_pardo_3 | dataflow_runtime_sec | - | 13.83 | 12.41 | -10.32 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
jdbcioit_results | write_time | - | 52.35 | 46.71 | -10.76 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
python_batch_combine_4 | python_flink_batch_combine_4_runtime | - | 200.17 |
179.5 | -10.32 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_streaming_gbk_3 | python_dataflow_streaming_gbk_3_runtime | - | 180.71
| 146.25 | -19.07 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_gbk_6 | python_dataflow_streaming_gbk_6_runtime | - | 503.57
| 410.25 | -18.53 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_gbk_7 | python_dataflow_streaming_gbk_7_runtime | - | 499.71
| 418.25 | -16.3 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
nexmark_PRs_10_batch | RuntimeMs | SparkRunner | 1000.0 | 774.0 | -22.6 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
## All metrics
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
avroioit_hdfs_results | read_time | - | 116.92 | 116.6 | -0.27 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_hdfs_results | write_time | - | 173.69 | 171.21 | -1.43 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_results | read_time | - | 119.27 | 115.01 | -3.57 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_results | write_time | - | 160.25 | 160.1 | -0.1 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_avro | avro_write_time | - | 55.04 | 52.44 |
-4.72 | [[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_avro | read_time | - | 63.24 | 64.97 | 2.73 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_json | read_time | - | 58.44 | 60.05 | 2.77 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_json | write_time | - | 97.57 | 94.35 | -3.3 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_stream | read_time | - | 18.28 | 18.47 | 1.04 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_stream | write_time | - | 139.4 | 136.88 | -1.81 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_hdfs_results | read_time | - | 221.38 | 209.31 | -5.45 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_hdfs_results | write_time | - | 296.31 | 292.8 | -1.19 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_results | read_time | - | 205.78 | 199.63 | -2.99 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_results | write_time | - | 274.13 | 274.24 | 0.04 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
hadoopformatioit_results | read_time | - | 8.19 | 8.4 | 2.66 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
hadoopformatioit_results | write_time | - | 12.6 | 13.16 | 4.38 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
java_batch_cogbk_1 | dataflow_runtime_sec | - | 76.99 | 74.77 | -2.88 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_1 | sparkstructuredstreaming_runtime_sec | - | 140.38 |
148.99 | 6.13 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | dataflow_runtime_sec | - | 75.2 | 75.78 | 0.76 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | sparkstructuredstreaming_runtime_sec | - | 130.0 | 131.12
| 0.86 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | dataflow_runtime_sec | - | 28.04 | 27.82 | -0.79 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | sparkstructuredstreaming_runtime_sec | - | 21.02 | 20.93
| -0.41 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | dataflow_runtime_sec | - | 26.39 | 27.84 | 5.49 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | sparkstructuredstreaming_runtime_sec | - | 20.74 | 21.23
| 2.38 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_combine_1 | dataflow_runtime_sec | - | 84.45 | 85.88 | 1.69 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_1 | sparkstructuredstreaming_runtime_sec | - | 552.34 |
539.19 | -2.38 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_4 | dataflow_runtime_sec | - | 37.99 | 34.8 | -8.39 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_4 | sparkstructuredstreaming_runtime_sec | - | 127.7 |
128.83 | 0.88 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_5 | dataflow_runtime_sec | - | 36.31 | 35.99 | -0.89 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_5 | sparkstructuredstreaming_runtime_sec | - | 131.55 |
126.25 | -4.03 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_gbk_1 | dataflow_runtime_sec | - | 263.09 | 261.03 | -0.78 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_1 | sparkstructuredstreaming_runtime_sec | - | 575.84 | 636.13
| 10.47 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | dataflow_runtime_sec | - | 64.78 | 65.18 | 0.62 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | sparkstructuredstreaming_runtime_sec | - | 128.15 | 115.97
| -9.5 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_runtime_sec | - | 30.27 | 30.39 | 0.4 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | sparkstructuredstreaming_runtime_sec | - | 8.71 | 10.06 |
15.44 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | dataflow_runtime_sec | - | 30.76 | 30.86 | 0.35 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | sparkstructuredstreaming_runtime_sec | - | 112.19 | 117.02
| 4.31 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | dataflow_runtime_sec | - | 30.89 | 31.37 | 1.56 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | sparkstructuredstreaming_runtime_sec | - | 130.72 | 120.61
| -7.73 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | dataflow_runtime_sec | - | 74.39 | 73.12 | -1.7 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | sparkstructuredstreaming_runtime_sec | - | 66.54 | 63.79 |
-4.13 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | dataflow_runtime_sec | - | 105.31 | 107.6 | 2.18 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | sparkstructuredstreaming_runtime_sec | - | 95.73 | 101.82 |
6.36 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_pardo_1 | dataflow_runtime_sec | - | 26.82 | 25.56 | -4.72 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_1 | sparkstructuredstreaming_runtime_sec | - | 46.43 | 47.25
| 1.77 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_2 | dataflow_runtime_sec | - | 183.92 | 186.59 | 1.45 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | dataflow_runtime_sec | - | 20.33 | 21.32 | 4.84 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_4 | dataflow_runtime_sec | - | 33.23 | 34.11 | 2.67 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_cogbk_1 | dataflow_runtime_sec | - | 1023.66 | 1009.52 | -1.38
| [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_2 | dataflow_runtime_sec | - | 1065.52 | 1068.86 | 0.31 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_3 | dataflow_runtime_sec | - | 143.29 | 143.12 | -0.12 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_4 | dataflow_runtime_sec | - | 148.91 | 142.95 | -4.0 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_combine_1 | dataflow_runtime_sec | - | 581.98 | 580.51 | -0.25
| [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_combine_4 | dataflow_runtime_sec | - | 342.72 | 401.0 | 17.01 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_combine_5 | dataflow_runtime_sec | - | 341.63 | 333.12 | -2.49
| [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_gbk_1 | dataflow_runtime_sec | - | 787.25 | 804.98 | 2.25 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_2 | dataflow_runtime_sec | - | 932.82 | 941.21 | 0.9 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_3 | dataflow_runtime_sec | - | 26.92 | 29.02 | 7.79 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_4 | dataflow_runtime_sec | - | 341.54 | 341.26 | -0.08 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_5 | dataflow_runtime_sec | - | 342.1 | 448.64 | 31.14 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_6 | dataflow_runtime_sec | - | 86.82 | 86.49 | -0.38 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_7 | dataflow_runtime_sec | - | 146.24 | 144.79 | -0.99 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_pardo_1 | dataflow_runtime_sec | - | 19.5 | 18.77 | -3.75 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_2 | dataflow_runtime_sec | - | 222.14 | 222.31 | 0.07 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_3 | dataflow_runtime_sec | - | 13.83 | 12.41 | -10.32 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_4 | dataflow_runtime_sec | - | 31.0 | 31.89 | 2.89 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
jdbcioit_results | read_time | - | 37.11 | 36.85 | -0.7 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
jdbcioit_results | write_time | - | 52.35 | 46.71 | -10.76 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results | read_time | - | 804.55 | 803.84 | -0.09 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results | write_time | - | 181.9 | 175.52 | -3.51 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_hdfs_results | read_time | - | 20.58 | 20.98 | 1.96 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_hdfs_results | write_time | - | 106.58 | 106.85 | 0.26 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_results | read_time | - | 43.29 | 42.7 | -1.35 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_results | write_time | - | 119.28 | 114.85 | -3.72 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
mongodbioit_results | read_time | - | 28.81 | 29.49 | 2.37 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
mongodbioit_results | write_time | - | 69.46 | 67.81 | -2.37 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_hdfs_results | read_time | - | 116.62 | 122.86 | 5.35 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_hdfs_results | write_time | - | 193.47 | 191.51 | -1.02 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_results | read_time | - | 120.63 | 113.42 | -5.98 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_results | write_time | - | 190.86 | 189.03 | -0.96 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
python_batch_cogbk_1 | python_dataflow_batch_cogbk_1_runtime | - | 458.43 |
451.0 | -1.62 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_2 | python_dataflow_batch_cogbk_2_runtime | - | 308.71 |
304.0 | -1.53 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_3 | python_dataflow_batch_cogbk_3_runtime | - | 291.57 |
297.75 | 2.12 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_4 | python_dataflow_batch_cogbk_4_runtime | - | 303.43 |
294.5 | -2.94 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_combine_1 | python_dataflow_batch_combine_1_runtime | - | 915.86
| 941.5 | 2.8 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_1 | python_flink_batch_combine_1_runtime | - | 5216.14 |
4818.25 | -7.63 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_4 | python_dataflow_batch_combine_4_runtime | - | 35.0 |
32.75 | -6.43 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_4 | python_flink_batch_combine_4_runtime | - | 200.17 |
179.5 | -10.32 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_5 | python_dataflow_batch_combine_5_runtime | - | 31.57 |
29.75 | -5.77 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_5 | python_flink_batch_combine_5_runtime | - | 134.83 |
145.0 | 7.54 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_gbk_1 | python_dataflow_batch_gbk_1_runtime | - | 1974.29 |
1985.5 | 0.57 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_2 | python_dataflow_batch_gbk_2_runtime | - | 354.0 | 354.25
| 0.07 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_3 | python_dataflow_batch_gbk_3_runtime | - | 36.0 | 34.75 |
-3.47 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_4 | python_dataflow_batch_gbk_4_runtime | - | 105.57 | 103.0
| -2.44 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_5 | python_dataflow_batch_gbk_5_runtime | - | 106.86 | 99.25
| -7.12 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_6 | python_dataflow_batch_gbk_6_runtime | - | 374.57 | 366.75
| -2.09 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_7 | python_dataflow_batch_gbk_7_runtime | - | 376.83 | 369.75
| -1.88 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_pardo_1 | python_dataflow_batch_pardo_1_runtime | - | 163.57 |
157.75 | -3.56 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_1 | python_flink_batch_pardo_1_runtime | - | 824.0 | 768.0
| -6.8 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_2 | python_dataflow_batch_pardo_2_runtime | - | 1463.0 |
1416.75 | -3.16 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_3 | python_dataflow_batch_pardo_3_runtime | - | 143.86 |
137.25 | -4.59 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_3 | python_flink_batch_pardo_3_runtime | - | 737.14 | 665.5
| -9.72 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_4 | python_dataflow_batch_pardo_4_runtime | - | 345.86 |
343.0 | -0.83 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_4 | python_flink_batch_pardo_4_runtime | - | 2509.57 |
2260.0 | -9.94 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_bqio_read_10GB_results | bqio_read_10GB_results_runtime | - | 131.67 |
127.57 | -3.11 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_bqio_write_10GB_results | bqio_write_10GB_results_runtime | - | 269.0 |
256.25 | -4.74 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_psio_2GB_results | pubsub_io_perf_read_runtime | - | 64.29 | 86.5 |
34.56 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_psio_2GB_results | pubsub_io_perf_write_runtime | - | 65.71 | 76.0 |
15.65 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_streaming_cogbk_1 | python_dataflow_streaming_cogbk_1_runtime | - |
772.57 | 808.25 | 4.62 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_2 | python_dataflow_streaming_cogbk_2_runtime | - |
457.43 | 486.25 | 6.3 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_3 | python_dataflow_streaming_cogbk_3_runtime | - |
1355.57 | 1404.5 | 3.61 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_4 | python_dataflow_streaming_cogbk_4_runtime | - |
461.57 | 491.75 | 6.54 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_combine_4 | python_flink_streaming_combine_4_runtime | - |
211.0 | 222.25 | 5.33 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_streaming_gbk_3 | python_dataflow_streaming_gbk_3_runtime | - | 180.71
| 146.25 | -19.07 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_gbk_6 | python_dataflow_streaming_gbk_6_runtime | - | 503.57
| 410.25 | -18.53 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_gbk_7 | python_dataflow_streaming_gbk_7_runtime | - | 499.71
| 418.25 | -16.3 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_pardo_1 | python_dataflow_streaming_pardo_1_runtime | - |
234.71 | 248.75 | 5.98 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_1 | python_flink_streaming_pardo_5_runtime | - | 167.29
| 151.25 | -9.59 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_2 | python_dataflow_streaming_pardo_2_runtime | - |
3061.17 | 3105.0 | 1.43 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_2 | python_flink_streaming_pardo_2_runtime | - |
4208.86 | 4149.75 | -1.4 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_3 | python_dataflow_streaming_pardo_3_runtime | - |
196.0 | 191.0 | -2.55 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_3 | python_flink_streaming_pardo_3_runtime | - | 277.29
| 289.25 | 4.31 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_4 | python_dataflow_streaming_pardo_4_runtime | - |
600.0 | 568.0 | -5.33 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_4 | python_flink_streaming_pardo_4_runtime | - | 684.71
| 694.0 | 1.36 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_6 | python_flink_streaming_pardo_6_runtime | - | 43.29
| 74.25 | 71.53 |
textioit_hdfs_results | read_time | - | 22.25 | 23.9 | 7.4 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_hdfs_results | write_time | - | 44.7 | 43.59 | -2.47 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_results | read_time | - | 24.42 | 25.09 | 2.75 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_results | write_time | - | 41.82 | 42.51 | 1.64 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
tfrecordioit_results | read_time | - | 25.09 | 24.46 | -2.51 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
tfrecordioit_results | write_time | - | 31.26 | 30.47 | -2.53 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
wordcount_py27_results | runtime | - | 890.06 | 916.52 | 2.97 |
[[1]](http://metrics.beam.apache.org/d/1cnwVDkGk)
wordcount_py37_results | runtime | - | 814.77 | 794.63 | -2.47 |
[[1]](http://metrics.beam.apache.org/d/1cnwVDkGk)
xmlioit_hdfs_results | read_time | - | 24.38 | 24.84 | 1.87 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_hdfs_results | write_time | - | 38.41 | 39.04 | 1.63 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_results | read_time | - | 28.07 | 26.78 | -4.59 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_results | write_time | - | 36.03 | 36.35 | 0.87 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
nexmark_0_batch | RuntimeMs | DataflowRunner | 58980.25 | 59834.78 | 1.45 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_batch | RuntimeMs | DirectRunner | 2777.04 | 3219.33 | 15.93 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_batch | RuntimeMs | FlinkRunner | 951.5 | 1119.44 | 17.65 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_batch | RuntimeMs | SparkRunner | 1751.54 | 2335.33 | 33.33 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_batch | RuntimeMs | SparkStructuredStreamingRunner | 1501.54 |
2154.61 | 43.49 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_sql_batch | RuntimeMs | DataflowRunner | 57235.11 | 59478.39 | 3.92
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_sql_batch | RuntimeMs | DirectRunner | 3240.82 | 3765.06 | 16.18 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_sql_batch | RuntimeMs | SparkRunner | 1476.07 | 1975.0 | 33.8 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1686.32 |
2322.78 | 37.74 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_sql_streaming | RuntimeMs | DataflowRunner | 25855.93 | 26794.06 |
3.63 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_sql_streaming | RuntimeMs | DirectRunner | 6192.29 | 6882.17 | 11.14
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_streaming | RuntimeMs | DataflowRunner | 24753.75 | 25447.5 | 2.8 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_streaming | RuntimeMs | DirectRunner | 4557.54 | 5101.83 | 11.94 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_batch | RuntimeMs | DataflowRunner | 1437654.39 | 1405236.59
| -2.25 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_batch | RuntimeMs | DirectRunner | 13981.54 | 16884.06 |
20.76 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_zetasql_streaming | RuntimeMs | DataflowRunner | 614833.82 |
601853.47 | -2.11 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_streaming | RuntimeMs | DirectRunner | 15868.14 | 18344.67 |
15.61 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_batch | RuntimeMs | DataflowRunner | 89420.89 | 90225.44 | 0.9 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_batch | RuntimeMs | DirectRunner | 2643.68 | 2985.11 | 12.92 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_10_batch | RuntimeMs | FlinkRunner | 513.96 | 589.17 | 14.63 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_batch | RuntimeMs | SparkRunner | 646.18 | 831.33 | 28.65 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_10_batch | RuntimeMs | SparkStructuredStreamingRunner | 1044.07 |
1436.17 | 37.55 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_streaming | RuntimeMs | DataflowRunner | 99137.71 | 99622.06 | 0.49
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_streaming | RuntimeMs | DirectRunner | 16858.57 | 18356.72 | 8.89 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_batch | RuntimeMs | DataflowRunner | 57574.43 | 58662.61 | 1.89 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_batch | RuntimeMs | DirectRunner | 2357.29 | 2599.89 | 10.29 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_11_batch | RuntimeMs | FlinkRunner | 236.18 | 272.17 | 15.24 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_batch | RuntimeMs | SparkRunner | 1768.54 | 2219.22 | 25.48 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_batch | RuntimeMs | SparkStructuredStreamingRunner | 859.39 |
1110.56 | 29.23 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_11_streaming | RuntimeMs | DataflowRunner | 209322.71 | 208461.94 |
-0.41 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_streaming | RuntimeMs | DirectRunner | 3168.96 | 3487.28 | 10.04 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_batch | RuntimeMs | DataflowRunner | 39214.61 | 40045.33 | 2.12 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_12_batch | RuntimeMs | DirectRunner | 1582.71 | 1764.44 | 11.48 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_12_batch | RuntimeMs | FlinkRunner | 186.46 | 191.61 | 2.76 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_batch | RuntimeMs | SparkRunner | 842.68 | 1106.17 | 31.27 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_12_batch | RuntimeMs | SparkStructuredStreamingRunner | 709.89 |
1011.83 | 42.53 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_12_streaming | RuntimeMs | DataflowRunner | 99739.29 | 100846.67 |
1.11 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_streaming | RuntimeMs | DirectRunner | 2112.57 | 2348.89 | 11.19 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_batch | RuntimeMs | DataflowRunner | 48677.18 | 48622.5 | -0.11 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_batch | RuntimeMs | DirectRunner | 1567.71 | 1679.33 | 7.12 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_batch | RuntimeMs | FlinkRunner | 294.36 | 347.61 | 18.09 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_batch | RuntimeMs | SparkRunner | 306.36 | 399.94 | 30.55 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_batch | RuntimeMs | SparkStructuredStreamingRunner | 491.71 |
661.06 | 34.44 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_sql_batch | RuntimeMs | DataflowRunner | 118375.39 | 119443.72 |
0.9 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_sql_batch | RuntimeMs | DirectRunner | 4430.71 | 4838.67 | 9.21 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_sql_batch | RuntimeMs | SparkRunner | 1467.61 | 1862.22 | 26.89 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1601.32 |
2043.78 | 27.63 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_streaming | RuntimeMs | DataflowRunner | 42174.64 | 41229.28 |
-2.24 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_streaming | RuntimeMs | DirectRunner | 5252.75 | 5737.67 | 9.23
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_streaming | RuntimeMs | DataflowRunner | 30772.21 | 33005.89 | 7.26
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_streaming | RuntimeMs | DirectRunner | 2509.0 | 2737.89 | 9.12 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_batch | RuntimeMs | DataflowRunner | 3425766.46 |
3350396.06 | -2.2 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_batch | RuntimeMs | DirectRunner | 28645.18 | 34574.0 |
20.7 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_zetasql_streaming | RuntimeMs | DataflowRunner | 1241435.0 |
1247347.12 | 0.48 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_streaming | RuntimeMs | DirectRunner | 24013.36 | 27832.56
| 15.9 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_batch | RuntimeMs | DataflowRunner | 115187.21 | 113403.5 | -1.55 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_14_batch | RuntimeMs | DirectRunner | 2473.25 | 2746.89 | 11.06 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_14_batch | RuntimeMs | FlinkRunner | 507.71 | 528.28 | 4.05 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_batch | RuntimeMs | SparkRunner | 1275.71 | 1418.06 | 11.16 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_14_batch | RuntimeMs | SparkStructuredStreamingRunner | 1078.57 |
1499.89 | 39.06 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_14_streaming | RuntimeMs | DataflowRunner | 157980.36 | 159524.28 |
0.98 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_streaming | RuntimeMs | DirectRunner | 3241.89 | 3570.28 | 10.13 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_batch | RuntimeMs | DataflowRunner | 48426.32 | 50353.72 | 3.98 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_1_batch | RuntimeMs | DirectRunner | 2208.64 | 2596.78 | 17.57 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_batch | RuntimeMs | FlinkRunner | 257.54 | 274.61 | 6.63 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_batch | RuntimeMs | SparkRunner | 507.82 | 654.5 | 28.88 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_batch | RuntimeMs | SparkStructuredStreamingRunner | 580.18 | 724.94
| 24.95 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_1_sql_batch | RuntimeMs | DataflowRunner | 53017.18 | 53045.44 | 0.05
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_sql_batch | RuntimeMs | DirectRunner | 2085.75 | 2430.61 | 16.53 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_1_sql_batch | RuntimeMs | SparkRunner | 748.54 | 980.56 | 31.0 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_1_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 935.36 |
1265.89 | 35.34 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_1_sql_streaming | RuntimeMs | DataflowRunner | 23312.36 | 23514.72 |
0.87 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_streaming | RuntimeMs | DirectRunner | 3606.96 | 3945.28 | 9.38
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_streaming | RuntimeMs | DataflowRunner | 20486.75 | 19829.89 | -3.21
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_streaming | RuntimeMs | DirectRunner | 3307.54 | 3583.72 | 8.35 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_batch | RuntimeMs | DataflowRunner | 34118.29 | 34386.89 | 0.79 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_batch | RuntimeMs | DirectRunner | 1243.68 | 1291.28 | 3.83 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_batch | RuntimeMs | FlinkRunner | 109.14 | 101.17 | -7.31 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_batch | RuntimeMs | SparkRunner | 347.0 | 464.39 | 33.83 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_batch | RuntimeMs | SparkStructuredStreamingRunner | 421.71 | 554.67
| 31.53 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_sql_batch | RuntimeMs | DataflowRunner | 35436.11 | 37918.44 | 7.01
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_sql_batch | RuntimeMs | DirectRunner | 1204.86 | 1338.56 | 11.1 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_sql_batch | RuntimeMs | SparkRunner | 555.07 | 783.28 | 41.11 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 712.36 |
963.67 | 35.28 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_streaming | RuntimeMs | DataflowRunner | 14707.36 | 15135.61 |
2.91 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_streaming | RuntimeMs | DirectRunner | 1941.54 | 2160.22 | 11.26
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_streaming | RuntimeMs | DataflowRunner | 12245.32 | 12341.06 | 0.78
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_streaming | RuntimeMs | DirectRunner | 1573.04 | 1723.11 | 9.54 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_batch | RuntimeMs | DataflowRunner | 1247172.79 | 1221659.12
| -2.05 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_zetasql_batch | RuntimeMs | DirectRunner | 10976.11 | 13430.5 |
22.36 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_zetasql_streaming | RuntimeMs | DataflowRunner | 542489.07 |
529922.41 | -2.32 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_streaming | RuntimeMs | DirectRunner | 11528.07 | 13567.5 |
17.69 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_batch | RuntimeMs | DataflowRunner | 45552.93 | 46272.0 | 1.58 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_batch | RuntimeMs | DirectRunner | 2785.68 | 3165.83 | 13.65 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_batch | RuntimeMs | FlinkRunner | 1029.86 | 1207.0 | 17.2 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_batch | RuntimeMs | SparkRunner | 2688.21 | 3505.44 | 30.4 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_batch | RuntimeMs | DataflowRunner | 42517.64 | 43754.17 | 2.91
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_batch | RuntimeMs | DirectRunner | 2266.82 | 2552.72 | 12.61 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_3_sql_batch | RuntimeMs | SparkRunner | 3007.82 | 3958.28 | 31.6 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 2350.39 |
3173.44 | 35.02 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_sql_streaming | RuntimeMs | DataflowRunner | 39579.68 | 40946.33 |
3.45 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_streaming | RuntimeMs | DirectRunner | 3738.68 | 4105.78 | 9.82
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_streaming | RuntimeMs | DataflowRunner | 44280.82 | 46776.44 | 5.64
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_streaming | RuntimeMs | DirectRunner | 3651.18 | 3972.22 | 8.79 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_batch | RuntimeMs | DataflowRunner | 194432.89 | 195340.59 |
0.47 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_3_zetasql_batch | RuntimeMs | DirectRunner | 3423.25 | 3879.78 | 13.34
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_zetasql_streaming | RuntimeMs | DataflowRunner | 99032.18 |
100761.53 | 1.75 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_streaming | RuntimeMs | DirectRunner | 4860.29 | 5508.61 |
13.34 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_batch | RuntimeMs | DataflowRunner | 47270.25 | 48476.0 | 2.55 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_batch | RuntimeMs | DirectRunner | 1443.54 | 1587.33 | 9.96 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_4_batch | RuntimeMs | FlinkRunner | 754.18 | 830.11 | 10.07 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_4_batch | RuntimeMs | SparkRunner | 873.18 | 1215.89 | 39.25 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_4_batch | RuntimeMs | SparkStructuredStreamingRunner | 2189.25 |
3073.33 | 40.38 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_streaming | RuntimeMs | DataflowRunner | 59499.04 | 58774.44 | -1.22
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_streaming | RuntimeMs | DirectRunner | 1475.04 | 1657.78 | 12.39 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_batch | RuntimeMs | DataflowRunner | 63670.21 | 64691.33 | 1.6 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_batch | RuntimeMs | DirectRunner | 5118.61 | 5586.5 | 9.14 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_5_batch | RuntimeMs | FlinkRunner | 613.43 | 730.78 | 19.13 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_5_batch | RuntimeMs | SparkRunner | 1469.54 | 1848.89 | 25.81 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_5_batch | RuntimeMs | SparkStructuredStreamingRunner | 1444.39 |
1872.06 | 29.61 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_streaming | RuntimeMs | DataflowRunner | 151020.04 | 157283.11 |
4.15 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_streaming | RuntimeMs | DirectRunner | 6623.25 | 7362.78 | 11.17 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_batch | RuntimeMs | DataflowRunner | 44339.82 | 46560.06 | 5.01 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_batch | RuntimeMs | DirectRunner | 970.36 | 1083.94 | 11.71 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_batch | RuntimeMs | FlinkRunner | 393.0 | 443.72 | 12.91 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_6_batch | RuntimeMs | SparkRunner | 985.64 | 1150.56 | 16.73 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_6_batch | RuntimeMs | SparkStructuredStreamingRunner | 754.79 |
1035.89 | 37.24 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_6_streaming | RuntimeMs | DataflowRunner | 48274.39 | 47651.61 | -1.29
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_streaming | RuntimeMs | DirectRunner | 1067.32 | 1225.61 | 14.83 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_batch | RuntimeMs | DataflowRunner | 77881.5 | 79091.33 | 1.55 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_batch | RuntimeMs | DirectRunner | 3285.86 | 3638.94 | 10.75 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_batch | RuntimeMs | FlinkRunner | 541.18 | 582.89 | 7.71 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_batch | RuntimeMs | SparkRunner | 1688.57 | 2159.17 | 27.87 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_batch | RuntimeMs | SparkStructuredStreamingRunner | 1936.86 |
2493.5 | 28.74 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_batch | RuntimeMs | DataflowRunner | 144265.57 | 145539.28 |
0.88 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_sql_batch | RuntimeMs | DirectRunner | 86683.86 | 95252.44 | 9.88 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_sql_batch | RuntimeMs | SparkRunner | 4027.75 | 5079.83 | 26.12 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 3795.71 |
4835.28 | 27.39 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_sql_streaming | RuntimeMs | DataflowRunner | 1182953.79 | 1200209.83
| 1.46 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_streaming | RuntimeMs | DirectRunner | 103438.18 | 111423.39 |
7.72 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_streaming | RuntimeMs | DataflowRunner | 113757.79 | 116042.0 | 2.01
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_streaming | RuntimeMs | DirectRunner | 8531.11 | 9155.28 | 7.32 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_batch | RuntimeMs | DataflowRunner | 45261.39 | 46089.83 | 1.83 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_batch | RuntimeMs | DirectRunner | 1460.11 | 1615.28 | 10.63 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_batch | RuntimeMs | FlinkRunner | 421.25 | 476.17 | 13.04 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_batch | RuntimeMs | SparkRunner | 1357.71 | 1666.06 | 22.71 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_batch | RuntimeMs | SparkStructuredStreamingRunner | 934.5 | 1214.17
| 29.93 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_8_streaming | RuntimeMs | DataflowRunner | 51620.71 | 51664.28 | 0.08
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_streaming | RuntimeMs | DirectRunner | 2427.79 | 2657.22 | 9.45 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_batch | RuntimeMs | DataflowRunner | 44853.79 | 45063.44 | 0.47 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_9_batch | RuntimeMs | DirectRunner | 664.25 | 724.56 | 9.08 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_9_batch | RuntimeMs | FlinkRunner | 253.54 | 274.33 | 8.2 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_batch | RuntimeMs | SparkRunner | 465.36 | 646.22 | 38.87 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_batch | RuntimeMs | SparkStructuredStreamingRunner | 583.11 | 807.44
| 38.47 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_9_streaming | RuntimeMs | DataflowRunner | 41638.54 | 42081.11 | 1.06
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_streaming | RuntimeMs | DirectRunner | 705.96 | 779.78 | 10.46 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_PRs_0_batch | RuntimeMs | SparkRunner | 1725.0 | 2199.0 | 27.48 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_PRs_0_sql_batch | RuntimeMs | SparkRunner | 1605.0 | 1661.0 | 3.49 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_PRs_10_batch | RuntimeMs | SparkRunner | 1000.0 | 774.0 | -22.6 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_PRs_11_batch | RuntimeMs | SparkRunner | 1540.0 | 1878.0 | 21.95 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_PRs_12_batch | RuntimeMs | SparkRunner | 971.0 | 991.0 | 2.06 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_PRs_13_batch | RuntimeMs | SparkRunner | 372.0 | 388.0 | 4.3 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_PRs_13_sql_batch | RuntimeMs | SparkRunner | 1645.0 | 1816.0 | 10.4 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_PRs_14_batch | RuntimeMs | SparkRunner | 1489.0 | 1432.0 | -3.83 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_PRs_1_batch | RuntimeMs | SparkRunner | 511.0 | 563.0 | 10.18 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_PRs_1_sql_batch | RuntimeMs | SparkRunner | 854.0 | 871.0 | 1.99 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_PRs_2_batch | RuntimeMs | SparkRunner | 317.0 | 371.0 | 17.03 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_PRs_2_sql_batch | RuntimeMs | SparkRunner | 593.0 | 658.0 | 10.96 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_PRs_3_batch | RuntimeMs | SparkRunner | 2615.0 | 2865.0 | 9.56 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_PRs_3_sql_batch | RuntimeMs | SparkRunner | 3106.0 | 3249.0 | 4.6 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_PRs_4_batch | RuntimeMs | SparkRunner | 1006.0 | 995.0 | -1.09 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_PRs_5_batch | RuntimeMs | SparkRunner | 1563.0 | 1567.0 | 0.26 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_PRs_6_batch | RuntimeMs | SparkRunner | 1150.0 | 1064.0 | -7.48 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_PRs_7_batch | RuntimeMs | SparkRunner | 1541.0 | 1635.0 | 6.1 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_PRs_7_sql_batch | RuntimeMs | SparkRunner | 4147.0 | 4530.0 | 9.24 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_PRs_8_batch | RuntimeMs | SparkRunner | 1423.0 | 1495.0 | 5.06 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_PRs_9_batch | RuntimeMs | SparkRunner | 536.0 | 579.0 | 8.02 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
Re: Beam Metrics Report (2020-09-28)
Posted by Tyson Hamilton <ty...@google.com>.
There seems to be a regression related to nexmark benchmarks in Spark,
Flink, and DirectRunner. The same regression does not appear on the
Dataflow runner. I looked through the commit history around this time and
nothing obvious popped up. Since the only runner that isn't experiencing a
slowdown is the Dataflow runner, which is a service, my suspicion is that
it is related to the Jenkins environment. There haven't been any changes
recently to this and the load test instance appears to be running fine with
no CPU bottlenecks.
I'll keep an eye on it over the next few days to see if it returns back to
normal. If anyone is aware of changes please speak up!
On Mon, Sep 28, 2020 at 5:01 AM Apache Jenkins Server <
jenkins@builds.apache.org> wrote:
> /* * Licensed to the Apache Software Foundation (ASF) under one * or more
> contributor license agreements. See the NOTICE file * distributed with this
> work for additional information * regarding copyright ownership. The ASF
> licenses this file * to you under the Apache License, Version 2.0 (the *
> "License"); you may not use this file except in compliance * with the
> License. You may obtain a copy of the License at * *
> http://www.apache.org/licenses/LICENSE-2.0 * * Unless required by
> applicable law or agreed to in writing, software * distributed under the
> License is distributed on an "AS IS" BASIS, * WITHOUT WARRANTIES OR
> CONDITIONS OF ANY KIND, either express or implied. * See the License for
> the specific language governing permissions and * limitations under the
> License. */
> Beam Metrics Report Color legend:
> >= 20 >= 10 <= -10 <= -20 Possible regression
> *Measurement* *Metric* *Runner* *Mean previous week* *Mean last week* *Diff
> %* *Dashboard*
> java_batch_gbk_1 sparkstructuredstreaming_runtime_sec - 575.84 636.13
> 10.47 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_3 sparkstructuredstreaming_runtime_sec - 8.71 10.06 15.44
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_combine_4 dataflow_runtime_sec - 342.72 401.0 17.01 [1]
> <http://metrics.beam.apache.org/d/WNzYt13Zk>
> java_streaming_gbk_5 dataflow_runtime_sec - 342.1 448.64 31.14 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_psio_2GB_results pubsub_io_perf_read_runtime - 64.29 86.5 34.56 [1]
> <http://metrics.beam.apache.org/d/gP7vMPqZz>
> python_psio_2GB_results pubsub_io_perf_write_runtime - 65.71 76.0 15.65
> [1] <http://metrics.beam.apache.org/d/gP7vMPqZz>
> python_streaming_pardo_6 python_flink_streaming_pardo_6_runtime - 43.29
> 74.25 71.53
> nexmark_0_batch RuntimeMs DirectRunner 2777.04 3219.33 15.93 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_0_batch RuntimeMs FlinkRunner 951.5 1119.44 17.65 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_batch RuntimeMs SparkRunner 1751.54 2335.33 33.33 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_batch RuntimeMs SparkStructuredStreamingRunner 1501.54 2154.61
> 43.49 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_sql_batch RuntimeMs DirectRunner 3240.82 3765.06 16.18 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_sql_batch RuntimeMs SparkRunner 1476.07 1975.0 33.8 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_0_sql_batch RuntimeMs SparkStructuredStreamingRunner 1686.32
> 2322.78 37.74 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_sql_streaming RuntimeMs DirectRunner 6192.29 6882.17 11.14 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_streaming RuntimeMs DirectRunner 4557.54 5101.83 11.94 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_zetasql_batch RuntimeMs DirectRunner 13981.54 16884.06 20.76 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_0_zetasql_streaming RuntimeMs DirectRunner 15868.14 18344.67 15.61
> [1] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_10_batch RuntimeMs DirectRunner 2643.68 2985.11 12.92 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_10_batch RuntimeMs FlinkRunner 513.96 589.17 14.63 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_10_batch RuntimeMs SparkRunner 646.18 831.33 28.65 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_10_batch RuntimeMs SparkStructuredStreamingRunner 1044.07 1436.17
> 37.55 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_11_batch RuntimeMs DirectRunner 2357.29 2599.89 10.29 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_11_batch RuntimeMs FlinkRunner 236.18 272.17 15.24 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_11_batch RuntimeMs SparkRunner 1768.54 2219.22 25.48 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_11_batch RuntimeMs SparkStructuredStreamingRunner 859.39 1110.56
> 29.23 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_11_streaming RuntimeMs DirectRunner 3168.96 3487.28 10.04 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_12_batch RuntimeMs DirectRunner 1582.71 1764.44 11.48 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_12_batch RuntimeMs SparkRunner 842.68 1106.17 31.27 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_12_batch RuntimeMs SparkStructuredStreamingRunner 709.89 1011.83
> 42.53 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_12_streaming RuntimeMs DirectRunner 2112.57 2348.89 11.19 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_13_batch RuntimeMs FlinkRunner 294.36 347.61 18.09 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_13_batch RuntimeMs SparkRunner 306.36 399.94 30.55 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_13_batch RuntimeMs SparkStructuredStreamingRunner 491.71 661.06
> 34.44 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_13_sql_batch RuntimeMs SparkRunner 1467.61 1862.22 26.89 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_13_sql_batch RuntimeMs SparkStructuredStreamingRunner 1601.32
> 2043.78 27.63 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_13_zetasql_batch RuntimeMs DirectRunner 28645.18 34574.0 20.7 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_13_zetasql_streaming RuntimeMs DirectRunner 24013.36 27832.56 15.9
> [1] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_14_batch RuntimeMs DirectRunner 2473.25 2746.89 11.06 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_14_batch RuntimeMs SparkRunner 1275.71 1418.06 11.16 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_14_batch RuntimeMs SparkStructuredStreamingRunner 1078.57 1499.89
> 39.06 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_14_streaming RuntimeMs DirectRunner 3241.89 3570.28 10.13 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_1_batch RuntimeMs DirectRunner 2208.64 2596.78 17.57 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_1_batch RuntimeMs SparkRunner 507.82 654.5 28.88 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_1_batch RuntimeMs SparkStructuredStreamingRunner 580.18 724.94
> 24.95 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_1_sql_batch RuntimeMs DirectRunner 2085.75 2430.61 16.53 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_1_sql_batch RuntimeMs SparkRunner 748.54 980.56 31.0 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_1_sql_batch RuntimeMs SparkStructuredStreamingRunner 935.36
> 1265.89 35.34 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_2_batch RuntimeMs SparkRunner 347.0 464.39 33.83 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_2_batch RuntimeMs SparkStructuredStreamingRunner 421.71 554.67
> 31.53 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_2_sql_batch RuntimeMs DirectRunner 1204.86 1338.56 11.1 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_2_sql_batch RuntimeMs SparkRunner 555.07 783.28 41.11 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_2_sql_batch RuntimeMs SparkStructuredStreamingRunner 712.36 963.67
> 35.28 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_2_sql_streaming RuntimeMs DirectRunner 1941.54 2160.22 11.26 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_2_zetasql_batch RuntimeMs DirectRunner 10976.11 13430.5 22.36 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_2_zetasql_streaming RuntimeMs DirectRunner 11528.07 13567.5 17.69
> [1] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_batch RuntimeMs DirectRunner 2785.68 3165.83 13.65 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_batch RuntimeMs FlinkRunner 1029.86 1207.0 17.2 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_batch RuntimeMs SparkRunner 2688.21 3505.44 30.4 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_sql_batch RuntimeMs DirectRunner 2266.82 2552.72 12.61 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_3_sql_batch RuntimeMs SparkRunner 3007.82 3958.28 31.6 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_3_sql_batch RuntimeMs SparkStructuredStreamingRunner 2350.39
> 3173.44 35.02 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_3_zetasql_batch RuntimeMs DirectRunner 3423.25 3879.78 13.34 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_3_zetasql_streaming RuntimeMs DirectRunner 4860.29 5508.61 13.34
> [1] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_4_batch RuntimeMs FlinkRunner 754.18 830.11 10.07 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_4_batch RuntimeMs SparkRunner 873.18 1215.89 39.25 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_4_batch RuntimeMs SparkStructuredStreamingRunner 2189.25 3073.33
> 40.38 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_4_streaming RuntimeMs DirectRunner 1475.04 1657.78 12.39 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_5_batch RuntimeMs FlinkRunner 613.43 730.78 19.13 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_5_batch RuntimeMs SparkRunner 1469.54 1848.89 25.81 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_5_batch RuntimeMs SparkStructuredStreamingRunner 1444.39 1872.06
> 29.61 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_5_streaming RuntimeMs DirectRunner 6623.25 7362.78 11.17 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_6_batch RuntimeMs DirectRunner 970.36 1083.94 11.71 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_6_batch RuntimeMs FlinkRunner 393.0 443.72 12.91 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_6_batch RuntimeMs SparkRunner 985.64 1150.56 16.73 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_6_batch RuntimeMs SparkStructuredStreamingRunner 754.79 1035.89
> 37.24 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_6_streaming RuntimeMs DirectRunner 1067.32 1225.61 14.83 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_7_batch RuntimeMs DirectRunner 3285.86 3638.94 10.75 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_7_batch RuntimeMs SparkRunner 1688.57 2159.17 27.87 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_7_batch RuntimeMs SparkStructuredStreamingRunner 1936.86 2493.5
> 28.74 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_7_sql_batch RuntimeMs SparkRunner 4027.75 5079.83 26.12 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_7_sql_batch RuntimeMs SparkStructuredStreamingRunner 3795.71
> 4835.28 27.39 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_8_batch RuntimeMs DirectRunner 1460.11 1615.28 10.63 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_8_batch RuntimeMs FlinkRunner 421.25 476.17 13.04 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_8_batch RuntimeMs SparkRunner 1357.71 1666.06 22.71 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_8_batch RuntimeMs SparkStructuredStreamingRunner 934.5 1214.17
> 29.93 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_9_batch RuntimeMs SparkRunner 465.36 646.22 38.87 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_9_batch RuntimeMs SparkStructuredStreamingRunner 583.11 807.44
> 38.47 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_9_streaming RuntimeMs DirectRunner 705.96 779.78 10.46 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_PRs_0_batch RuntimeMs SparkRunner 1725.0 2199.0 27.48 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_PRs_11_batch RuntimeMs SparkRunner 1540.0 1878.0 21.95 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_PRs_13_sql_batch RuntimeMs SparkRunner 1645.0 1816.0 10.4 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_PRs_1_batch RuntimeMs SparkRunner 511.0 563.0 10.18 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_PRs_2_batch RuntimeMs SparkRunner 317.0 371.0 17.03 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_PRs_2_sql_batch RuntimeMs SparkRunner 593.0 658.0 10.96 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> Possible improvement
> *Measurement* *Metric* *Runner* *Mean previous week* *Mean last week* *Diff
> %* *Dashboard*
> java_streaming_pardo_3 dataflow_runtime_sec - 13.83 12.41 -10.32 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> jdbcioit_results write_time - 52.35 46.71 -10.76 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> python_batch_combine_4 python_flink_batch_combine_4_runtime - 200.17 179.5
> -10.32 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> python_streaming_gbk_3 python_dataflow_streaming_gbk_3_runtime - 180.71
> 146.25 -19.07 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_streaming_gbk_6 python_dataflow_streaming_gbk_6_runtime - 503.57
> 410.25 -18.53 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_streaming_gbk_7 python_dataflow_streaming_gbk_7_runtime - 499.71
> 418.25 -16.3 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> nexmark_PRs_10_batch RuntimeMs SparkRunner 1000.0 774.0 -22.6 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz> All metrics
> *Measurement* *Metric* *Runner* *Mean previous week* *Mean last week* *Diff
> %* *Dashboard*
> avroioit_hdfs_results read_time - 116.92 116.6 -0.27 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> avroioit_hdfs_results write_time - 173.69 171.21 -1.43 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> avroioit_results read_time - 119.27 115.01 -3.57 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> avroioit_results write_time - 160.25 160.1 -0.1 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> bqio_10GB_results_java_batch_avro avro_write_time - 55.04 52.44 -4.72 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> bqio_10GB_results_java_batch_avro read_time - 63.24 64.97 2.73 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> bqio_10GB_results_java_batch_json read_time - 58.44 60.05 2.77 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> bqio_10GB_results_java_batch_json write_time - 97.57 94.35 -3.3 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> bqio_10GB_results_java_stream read_time - 18.28 18.47 1.04 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> bqio_10GB_results_java_stream write_time - 139.4 136.88 -1.81 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> compressed_textioit_hdfs_results read_time - 221.38 209.31 -5.45 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> compressed_textioit_hdfs_results write_time - 296.31 292.8 -1.19 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> compressed_textioit_results read_time - 205.78 199.63 -2.99 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> compressed_textioit_results write_time - 274.13 274.24 0.04 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> hadoopformatioit_results read_time - 8.19 8.4 2.66 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> hadoopformatioit_results write_time - 12.6 13.16 4.38 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> java_batch_cogbk_1 dataflow_runtime_sec - 76.99 74.77 -2.88 [1]
> <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_1 sparkstructuredstreaming_runtime_sec - 140.38 148.99
> 6.13 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_2 dataflow_runtime_sec - 75.2 75.78 0.76 [1]
> <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_2 sparkstructuredstreaming_runtime_sec - 130.0 131.12
> 0.86 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_3 dataflow_runtime_sec - 28.04 27.82 -0.79 [1]
> <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_3 sparkstructuredstreaming_runtime_sec - 21.02 20.93
> -0.41 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_4 dataflow_runtime_sec - 26.39 27.84 5.49 [1]
> <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_cogbk_4 sparkstructuredstreaming_runtime_sec - 20.74 21.23 2.38
> [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_batch_combine_1 dataflow_runtime_sec - 84.45 85.88 1.69 [1]
> <http://metrics.beam.apache.org/d/WNzYt13Zk>
> java_batch_combine_1 sparkstructuredstreaming_runtime_sec - 552.34 539.19
> -2.38 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> java_batch_combine_4 dataflow_runtime_sec - 37.99 34.8 -8.39 [1]
> <http://metrics.beam.apache.org/d/WNzYt13Zk>
> java_batch_combine_4 sparkstructuredstreaming_runtime_sec - 127.7 128.83
> 0.88 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> java_batch_combine_5 dataflow_runtime_sec - 36.31 35.99 -0.89 [1]
> <http://metrics.beam.apache.org/d/WNzYt13Zk>
> java_batch_combine_5 sparkstructuredstreaming_runtime_sec - 131.55 126.25
> -4.03 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> java_batch_gbk_1 dataflow_runtime_sec - 263.09 261.03 -0.78 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_1 sparkstructuredstreaming_runtime_sec - 575.84 636.13
> 10.47 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_2 dataflow_runtime_sec - 64.78 65.18 0.62 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_2 sparkstructuredstreaming_runtime_sec - 128.15 115.97 -9.5
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_3 dataflow_runtime_sec - 30.27 30.39 0.4 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_3 sparkstructuredstreaming_runtime_sec - 8.71 10.06 15.44
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_4 dataflow_runtime_sec - 30.76 30.86 0.35 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_4 sparkstructuredstreaming_runtime_sec - 112.19 117.02 4.31
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_5 dataflow_runtime_sec - 30.89 31.37 1.56 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_5 sparkstructuredstreaming_runtime_sec - 130.72 120.61
> -7.73 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_6 dataflow_runtime_sec - 74.39 73.12 -1.7 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_6 sparkstructuredstreaming_runtime_sec - 66.54 63.79 -4.13
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_7 dataflow_runtime_sec - 105.31 107.6 2.18 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_gbk_7 sparkstructuredstreaming_runtime_sec - 95.73 101.82 6.36
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_batch_pardo_1 dataflow_runtime_sec - 26.82 25.56 -4.72 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_1 sparkstructuredstreaming_runtime_sec - 46.43 47.25 1.77
> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_2 dataflow_runtime_sec - 183.92 186.59 1.45 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_3 dataflow_runtime_sec - 20.33 21.32 4.84 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_batch_pardo_4 dataflow_runtime_sec - 33.23 34.11 2.67 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_cogbk_1 dataflow_runtime_sec - 1023.66 1009.52 -1.38 [1]
> <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_streaming_cogbk_2 dataflow_runtime_sec - 1065.52 1068.86 0.31 [1]
> <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_streaming_cogbk_3 dataflow_runtime_sec - 143.29 143.12 -0.12 [1]
> <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_streaming_cogbk_4 dataflow_runtime_sec - 148.91 142.95 -4.0 [1]
> <http://metrics.beam.apache.org/d/fK0U4JqWz>
> java_streaming_combine_1 dataflow_runtime_sec - 581.98 580.51 -0.25 [1]
> <http://metrics.beam.apache.org/d/WNzYt13Zk>
> java_streaming_combine_4 dataflow_runtime_sec - 342.72 401.0 17.01 [1]
> <http://metrics.beam.apache.org/d/WNzYt13Zk>
> java_streaming_combine_5 dataflow_runtime_sec - 341.63 333.12 -2.49 [1]
> <http://metrics.beam.apache.org/d/WNzYt13Zk>
> java_streaming_gbk_1 dataflow_runtime_sec - 787.25 804.98 2.25 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_2 dataflow_runtime_sec - 932.82 941.21 0.9 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_3 dataflow_runtime_sec - 26.92 29.02 7.79 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_4 dataflow_runtime_sec - 341.54 341.26 -0.08 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_5 dataflow_runtime_sec - 342.1 448.64 31.14 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_6 dataflow_runtime_sec - 86.82 86.49 -0.38 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_gbk_7 dataflow_runtime_sec - 146.24 144.79 -0.99 [1]
> <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> java_streaming_pardo_1 dataflow_runtime_sec - 19.5 18.77 -3.75 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_pardo_2 dataflow_runtime_sec - 222.14 222.31 0.07 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_pardo_3 dataflow_runtime_sec - 13.83 12.41 -10.32 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> java_streaming_pardo_4 dataflow_runtime_sec - 31.0 31.89 2.89 [1]
> <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> jdbcioit_results read_time - 37.11 36.85 -0.7 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> jdbcioit_results write_time - 52.35 46.71 -10.76 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> kafkaioit_results read_time - 804.55 803.84 -0.09 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> kafkaioit_results write_time - 181.9 175.52 -3.51 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> many_files_textioit_hdfs_results read_time - 20.58 20.98 1.96 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> many_files_textioit_hdfs_results write_time - 106.58 106.85 0.26 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> many_files_textioit_results read_time - 43.29 42.7 -1.35 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> many_files_textioit_results write_time - 119.28 114.85 -3.72 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> mongodbioit_results read_time - 28.81 29.49 2.37 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> mongodbioit_results write_time - 69.46 67.81 -2.37 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> parquetioit_hdfs_results read_time - 116.62 122.86 5.35 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> parquetioit_hdfs_results write_time - 193.47 191.51 -1.02 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> parquetioit_results read_time - 120.63 113.42 -5.98 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> parquetioit_results write_time - 190.86 189.03 -0.96 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> python_batch_cogbk_1 python_dataflow_batch_cogbk_1_runtime - 458.43 451.0
> -1.62 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> python_batch_cogbk_2 python_dataflow_batch_cogbk_2_runtime - 308.71 304.0
> -1.53 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> python_batch_cogbk_3 python_dataflow_batch_cogbk_3_runtime - 291.57 297.75
> 2.12 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> python_batch_cogbk_4 python_dataflow_batch_cogbk_4_runtime - 303.43 294.5
> -2.94 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> python_batch_combine_1 python_dataflow_batch_combine_1_runtime - 915.86
> 941.5 2.8 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> python_batch_combine_1 python_flink_batch_combine_1_runtime - 5216.14
> 4818.25 -7.63 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> python_batch_combine_4 python_dataflow_batch_combine_4_runtime - 35.0
> 32.75 -6.43 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> python_batch_combine_4 python_flink_batch_combine_4_runtime - 200.17 179.5
> -10.32 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> python_batch_combine_5 python_dataflow_batch_combine_5_runtime - 31.57
> 29.75 -5.77 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> python_batch_combine_5 python_flink_batch_combine_5_runtime - 134.83 145.0
> 7.54 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> python_batch_gbk_1 python_dataflow_batch_gbk_1_runtime - 1974.29 1985.5
> 0.57 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_batch_gbk_2 python_dataflow_batch_gbk_2_runtime - 354.0 354.25 0.07
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_batch_gbk_3 python_dataflow_batch_gbk_3_runtime - 36.0 34.75 -3.47
> [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_batch_gbk_4 python_dataflow_batch_gbk_4_runtime - 105.57 103.0
> -2.44 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_batch_gbk_5 python_dataflow_batch_gbk_5_runtime - 106.86 99.25
> -7.12 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_batch_gbk_6 python_dataflow_batch_gbk_6_runtime - 374.57 366.75
> -2.09 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_batch_gbk_7 python_dataflow_batch_gbk_7_runtime - 376.83 369.75
> -1.88 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_batch_pardo_1 python_dataflow_batch_pardo_1_runtime - 163.57 157.75
> -3.56 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_batch_pardo_1 python_flink_batch_pardo_1_runtime - 824.0 768.0 -6.8
> [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_batch_pardo_2 python_dataflow_batch_pardo_2_runtime - 1463.0
> 1416.75 -3.16 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_batch_pardo_3 python_dataflow_batch_pardo_3_runtime - 143.86 137.25
> -4.59 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_batch_pardo_3 python_flink_batch_pardo_3_runtime - 737.14 665.5
> -9.72 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_batch_pardo_4 python_dataflow_batch_pardo_4_runtime - 345.86 343.0
> -0.83 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_batch_pardo_4 python_flink_batch_pardo_4_runtime - 2509.57 2260.0
> -9.94 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_bqio_read_10GB_results bqio_read_10GB_results_runtime - 131.67
> 127.57 -3.11 [1] <http://metrics.beam.apache.org/d/gP7vMPqZz>
> python_bqio_write_10GB_results bqio_write_10GB_results_runtime - 269.0
> 256.25 -4.74 [1] <http://metrics.beam.apache.org/d/gP7vMPqZz>
> python_psio_2GB_results pubsub_io_perf_read_runtime - 64.29 86.5 34.56 [1]
> <http://metrics.beam.apache.org/d/gP7vMPqZz>
> python_psio_2GB_results pubsub_io_perf_write_runtime - 65.71 76.0 15.65
> [1] <http://metrics.beam.apache.org/d/gP7vMPqZz>
> python_streaming_cogbk_1 python_dataflow_streaming_cogbk_1_runtime -
> 772.57 808.25 4.62 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> python_streaming_cogbk_2 python_dataflow_streaming_cogbk_2_runtime -
> 457.43 486.25 6.3 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> python_streaming_cogbk_3 python_dataflow_streaming_cogbk_3_runtime -
> 1355.57 1404.5 3.61 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> python_streaming_cogbk_4 python_dataflow_streaming_cogbk_4_runtime -
> 461.57 491.75 6.54 [1] <http://metrics.beam.apache.org/d/fK0U4JqWz>
> python_streaming_combine_4 python_flink_streaming_combine_4_runtime -
> 211.0 222.25 5.33 [1] <http://metrics.beam.apache.org/d/WNzYt13Zk>
> python_streaming_gbk_3 python_dataflow_streaming_gbk_3_runtime - 180.71
> 146.25 -19.07 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_streaming_gbk_6 python_dataflow_streaming_gbk_6_runtime - 503.57
> 410.25 -18.53 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_streaming_gbk_7 python_dataflow_streaming_gbk_7_runtime - 499.71
> 418.25 -16.3 [1] <http://metrics.beam.apache.org/d/UYZ-oJ3Zk>
> python_streaming_pardo_1 python_dataflow_streaming_pardo_1_runtime -
> 234.71 248.75 5.98 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_streaming_pardo_1 python_flink_streaming_pardo_5_runtime - 167.29
> 151.25 -9.59 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_streaming_pardo_2 python_dataflow_streaming_pardo_2_runtime -
> 3061.17 3105.0 1.43 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_streaming_pardo_2 python_flink_streaming_pardo_2_runtime - 4208.86
> 4149.75 -1.4 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_streaming_pardo_3 python_dataflow_streaming_pardo_3_runtime - 196.0
> 191.0 -2.55 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_streaming_pardo_3 python_flink_streaming_pardo_3_runtime - 277.29
> 289.25 4.31 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_streaming_pardo_4 python_dataflow_streaming_pardo_4_runtime - 600.0
> 568.0 -5.33 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_streaming_pardo_4 python_flink_streaming_pardo_4_runtime - 684.71
> 694.0 1.36 [1] <http://metrics.beam.apache.org/d/MOi-kf3Zk>
> python_streaming_pardo_6 python_flink_streaming_pardo_6_runtime - 43.29
> 74.25 71.53
> textioit_hdfs_results read_time - 22.25 23.9 7.4 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> textioit_hdfs_results write_time - 44.7 43.59 -2.47 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> textioit_results read_time - 24.42 25.09 2.75 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> textioit_results write_time - 41.82 42.51 1.64 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> tfrecordioit_results read_time - 25.09 24.46 -2.51 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> tfrecordioit_results write_time - 31.26 30.47 -2.53 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> wordcount_py27_results runtime - 890.06 916.52 2.97 [1]
> <http://metrics.beam.apache.org/d/1cnwVDkGk>
> wordcount_py37_results runtime - 814.77 794.63 -2.47 [1]
> <http://metrics.beam.apache.org/d/1cnwVDkGk>
> xmlioit_hdfs_results read_time - 24.38 24.84 1.87 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> xmlioit_hdfs_results write_time - 38.41 39.04 1.63 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> xmlioit_results read_time - 28.07 26.78 -4.59 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> xmlioit_results write_time - 36.03 36.35 0.87 [1]
> <http://metrics.beam.apache.org/d/bnlHKP3Wz>
> nexmark_0_batch RuntimeMs DataflowRunner 58980.25 59834.78 1.45 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_0_batch RuntimeMs DirectRunner 2777.04 3219.33 15.93 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_0_batch RuntimeMs FlinkRunner 951.5 1119.44 17.65 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_batch RuntimeMs SparkRunner 1751.54 2335.33 33.33 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_batch RuntimeMs SparkStructuredStreamingRunner 1501.54 2154.61
> 43.49 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_sql_batch RuntimeMs DataflowRunner 57235.11 59478.39 3.92 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_0_sql_batch RuntimeMs DirectRunner 3240.82 3765.06 16.18 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_sql_batch RuntimeMs SparkRunner 1476.07 1975.0 33.8 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_0_sql_batch RuntimeMs SparkStructuredStreamingRunner 1686.32
> 2322.78 37.74 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_sql_streaming RuntimeMs DataflowRunner 25855.93 26794.06 3.63
> [1] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_sql_streaming RuntimeMs DirectRunner 6192.29 6882.17 11.14 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_streaming RuntimeMs DataflowRunner 24753.75 25447.5 2.8 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_streaming RuntimeMs DirectRunner 4557.54 5101.83 11.94 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_zetasql_batch RuntimeMs DataflowRunner 1437654.39 1405236.59
> -2.25 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_zetasql_batch RuntimeMs DirectRunner 13981.54 16884.06 20.76 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_0_zetasql_streaming RuntimeMs DataflowRunner 614833.82 601853.47
> -2.11 [1] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_0_zetasql_streaming RuntimeMs DirectRunner 15868.14 18344.67 15.61
> [1] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_10_batch RuntimeMs DataflowRunner 89420.89 90225.44 0.9 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_10_batch RuntimeMs DirectRunner 2643.68 2985.11 12.92 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_10_batch RuntimeMs FlinkRunner 513.96 589.17 14.63 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_10_batch RuntimeMs SparkRunner 646.18 831.33 28.65 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_10_batch RuntimeMs SparkStructuredStreamingRunner 1044.07 1436.17
> 37.55 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_10_streaming RuntimeMs DataflowRunner 99137.71 99622.06 0.49 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_10_streaming RuntimeMs DirectRunner 16858.57 18356.72 8.89 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_11_batch RuntimeMs DataflowRunner 57574.43 58662.61 1.89 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_11_batch RuntimeMs DirectRunner 2357.29 2599.89 10.29 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_11_batch RuntimeMs FlinkRunner 236.18 272.17 15.24 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_11_batch RuntimeMs SparkRunner 1768.54 2219.22 25.48 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_11_batch RuntimeMs SparkStructuredStreamingRunner 859.39 1110.56
> 29.23 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_11_streaming RuntimeMs DataflowRunner 209322.71 208461.94 -0.41
> [1] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_11_streaming RuntimeMs DirectRunner 3168.96 3487.28 10.04 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_12_batch RuntimeMs DataflowRunner 39214.61 40045.33 2.12 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_12_batch RuntimeMs DirectRunner 1582.71 1764.44 11.48 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_12_batch RuntimeMs FlinkRunner 186.46 191.61 2.76 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_12_batch RuntimeMs SparkRunner 842.68 1106.17 31.27 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_12_batch RuntimeMs SparkStructuredStreamingRunner 709.89 1011.83
> 42.53 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_12_streaming RuntimeMs DataflowRunner 99739.29 100846.67 1.11 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_12_streaming RuntimeMs DirectRunner 2112.57 2348.89 11.19 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_13_batch RuntimeMs DataflowRunner 48677.18 48622.5 -0.11 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_13_batch RuntimeMs DirectRunner 1567.71 1679.33 7.12 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_13_batch RuntimeMs FlinkRunner 294.36 347.61 18.09 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_13_batch RuntimeMs SparkRunner 306.36 399.94 30.55 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_13_batch RuntimeMs SparkStructuredStreamingRunner 491.71 661.06
> 34.44 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_13_sql_batch RuntimeMs DataflowRunner 118375.39 119443.72 0.9 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_13_sql_batch RuntimeMs DirectRunner 4430.71 4838.67 9.21 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_13_sql_batch RuntimeMs SparkRunner 1467.61 1862.22 26.89 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_13_sql_batch RuntimeMs SparkStructuredStreamingRunner 1601.32
> 2043.78 27.63 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_13_sql_streaming RuntimeMs DataflowRunner 42174.64 41229.28 -2.24
> [1] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_13_sql_streaming RuntimeMs DirectRunner 5252.75 5737.67 9.23 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_13_streaming RuntimeMs DataflowRunner 30772.21 33005.89 7.26 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_13_streaming RuntimeMs DirectRunner 2509.0 2737.89 9.12 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_13_zetasql_batch RuntimeMs DataflowRunner 3425766.46 3350396.06
> -2.2 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_13_zetasql_batch RuntimeMs DirectRunner 28645.18 34574.0 20.7 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_13_zetasql_streaming RuntimeMs DataflowRunner 1241435.0 1247347.12
> 0.48 [1] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_13_zetasql_streaming RuntimeMs DirectRunner 24013.36 27832.56 15.9
> [1] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_14_batch RuntimeMs DataflowRunner 115187.21 113403.5 -1.55 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_14_batch RuntimeMs DirectRunner 2473.25 2746.89 11.06 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_14_batch RuntimeMs FlinkRunner 507.71 528.28 4.05 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_14_batch RuntimeMs SparkRunner 1275.71 1418.06 11.16 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_14_batch RuntimeMs SparkStructuredStreamingRunner 1078.57 1499.89
> 39.06 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_14_streaming RuntimeMs DataflowRunner 157980.36 159524.28 0.98 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_14_streaming RuntimeMs DirectRunner 3241.89 3570.28 10.13 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_1_batch RuntimeMs DataflowRunner 48426.32 50353.72 3.98 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_1_batch RuntimeMs DirectRunner 2208.64 2596.78 17.57 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_1_batch RuntimeMs FlinkRunner 257.54 274.61 6.63 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_1_batch RuntimeMs SparkRunner 507.82 654.5 28.88 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_1_batch RuntimeMs SparkStructuredStreamingRunner 580.18 724.94
> 24.95 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_1_sql_batch RuntimeMs DataflowRunner 53017.18 53045.44 0.05 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_1_sql_batch RuntimeMs DirectRunner 2085.75 2430.61 16.53 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_1_sql_batch RuntimeMs SparkRunner 748.54 980.56 31.0 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_1_sql_batch RuntimeMs SparkStructuredStreamingRunner 935.36
> 1265.89 35.34 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_1_sql_streaming RuntimeMs DataflowRunner 23312.36 23514.72 0.87
> [1] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_1_sql_streaming RuntimeMs DirectRunner 3606.96 3945.28 9.38 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_1_streaming RuntimeMs DataflowRunner 20486.75 19829.89 -3.21 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_1_streaming RuntimeMs DirectRunner 3307.54 3583.72 8.35 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_2_batch RuntimeMs DataflowRunner 34118.29 34386.89 0.79 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_2_batch RuntimeMs DirectRunner 1243.68 1291.28 3.83 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_2_batch RuntimeMs FlinkRunner 109.14 101.17 -7.31 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_2_batch RuntimeMs SparkRunner 347.0 464.39 33.83 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_2_batch RuntimeMs SparkStructuredStreamingRunner 421.71 554.67
> 31.53 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_2_sql_batch RuntimeMs DataflowRunner 35436.11 37918.44 7.01 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_2_sql_batch RuntimeMs DirectRunner 1204.86 1338.56 11.1 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_2_sql_batch RuntimeMs SparkRunner 555.07 783.28 41.11 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_2_sql_batch RuntimeMs SparkStructuredStreamingRunner 712.36 963.67
> 35.28 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_2_sql_streaming RuntimeMs DataflowRunner 14707.36 15135.61 2.91
> [1] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_2_sql_streaming RuntimeMs DirectRunner 1941.54 2160.22 11.26 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_2_streaming RuntimeMs DataflowRunner 12245.32 12341.06 0.78 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_2_streaming RuntimeMs DirectRunner 1573.04 1723.11 9.54 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_2_zetasql_batch RuntimeMs DataflowRunner 1247172.79 1221659.12
> -2.05 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_2_zetasql_batch RuntimeMs DirectRunner 10976.11 13430.5 22.36 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_2_zetasql_streaming RuntimeMs DataflowRunner 542489.07 529922.41
> -2.32 [1] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_2_zetasql_streaming RuntimeMs DirectRunner 11528.07 13567.5 17.69
> [1] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_batch RuntimeMs DataflowRunner 45552.93 46272.0 1.58 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_batch RuntimeMs DirectRunner 2785.68 3165.83 13.65 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_batch RuntimeMs FlinkRunner 1029.86 1207.0 17.2 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_batch RuntimeMs SparkRunner 2688.21 3505.44 30.4 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_sql_batch RuntimeMs DataflowRunner 42517.64 43754.17 2.91 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_sql_batch RuntimeMs DirectRunner 2266.82 2552.72 12.61 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_3_sql_batch RuntimeMs SparkRunner 3007.82 3958.28 31.6 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_3_sql_batch RuntimeMs SparkStructuredStreamingRunner 2350.39
> 3173.44 35.02 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_3_sql_streaming RuntimeMs DataflowRunner 39579.68 40946.33 3.45
> [1] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_sql_streaming RuntimeMs DirectRunner 3738.68 4105.78 9.82 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_streaming RuntimeMs DataflowRunner 44280.82 46776.44 5.64 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_streaming RuntimeMs DirectRunner 3651.18 3972.22 8.79 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_zetasql_batch RuntimeMs DataflowRunner 194432.89 195340.59 0.47
> [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_3_zetasql_batch RuntimeMs DirectRunner 3423.25 3879.78 13.34 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_3_zetasql_streaming RuntimeMs DataflowRunner 99032.18 100761.53
> 1.75 [1] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_3_zetasql_streaming RuntimeMs DirectRunner 4860.29 5508.61 13.34
> [1] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_4_batch RuntimeMs DataflowRunner 47270.25 48476.0 2.55 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_4_batch RuntimeMs DirectRunner 1443.54 1587.33 9.96 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_4_batch RuntimeMs FlinkRunner 754.18 830.11 10.07 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_4_batch RuntimeMs SparkRunner 873.18 1215.89 39.25 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_4_batch RuntimeMs SparkStructuredStreamingRunner 2189.25 3073.33
> 40.38 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_4_streaming RuntimeMs DataflowRunner 59499.04 58774.44 -1.22 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_4_streaming RuntimeMs DirectRunner 1475.04 1657.78 12.39 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_5_batch RuntimeMs DataflowRunner 63670.21 64691.33 1.6 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_5_batch RuntimeMs DirectRunner 5118.61 5586.5 9.14 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_5_batch RuntimeMs FlinkRunner 613.43 730.78 19.13 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_5_batch RuntimeMs SparkRunner 1469.54 1848.89 25.81 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_5_batch RuntimeMs SparkStructuredStreamingRunner 1444.39 1872.06
> 29.61 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_5_streaming RuntimeMs DataflowRunner 151020.04 157283.11 4.15 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_5_streaming RuntimeMs DirectRunner 6623.25 7362.78 11.17 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_6_batch RuntimeMs DataflowRunner 44339.82 46560.06 5.01 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_6_batch RuntimeMs DirectRunner 970.36 1083.94 11.71 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_6_batch RuntimeMs FlinkRunner 393.0 443.72 12.91 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_6_batch RuntimeMs SparkRunner 985.64 1150.56 16.73 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_6_batch RuntimeMs SparkStructuredStreamingRunner 754.79 1035.89
> 37.24 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_6_streaming RuntimeMs DataflowRunner 48274.39 47651.61 -1.29 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_6_streaming RuntimeMs DirectRunner 1067.32 1225.61 14.83 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_7_batch RuntimeMs DataflowRunner 77881.5 79091.33 1.55 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_7_batch RuntimeMs DirectRunner 3285.86 3638.94 10.75 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_7_batch RuntimeMs FlinkRunner 541.18 582.89 7.71 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_7_batch RuntimeMs SparkRunner 1688.57 2159.17 27.87 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_7_batch RuntimeMs SparkStructuredStreamingRunner 1936.86 2493.5
> 28.74 [1] <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_7_sql_batch RuntimeMs DataflowRunner 144265.57 145539.28 0.88 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_7_sql_batch RuntimeMs DirectRunner 86683.86 95252.44 9.88 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_7_sql_batch RuntimeMs SparkRunner 4027.75 5079.83 26.12 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_7_sql_batch RuntimeMs SparkStructuredStreamingRunner 3795.71
> 4835.28 27.39 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_7_sql_streaming RuntimeMs DataflowRunner 1182953.79 1200209.83
> 1.46 [1] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_7_sql_streaming RuntimeMs DirectRunner 103438.18 111423.39 7.72
> [1] <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_7_streaming RuntimeMs DataflowRunner 113757.79 116042.0 2.01 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_7_streaming RuntimeMs DirectRunner 8531.11 9155.28 7.32 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_8_batch RuntimeMs DataflowRunner 45261.39 46089.83 1.83 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_8_batch RuntimeMs DirectRunner 1460.11 1615.28 10.63 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_8_batch RuntimeMs FlinkRunner 421.25 476.17 13.04 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_8_batch RuntimeMs SparkRunner 1357.71 1666.06 22.71 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_8_batch RuntimeMs SparkStructuredStreamingRunner 934.5 1214.17
> 29.93 [1] <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_8_streaming RuntimeMs DataflowRunner 51620.71 51664.28 0.08 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_8_streaming RuntimeMs DirectRunner 2427.79 2657.22 9.45 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_9_batch RuntimeMs DataflowRunner 44853.79 45063.44 0.47 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_9_batch RuntimeMs DirectRunner 664.25 724.56 9.08 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_9_batch RuntimeMs FlinkRunner 253.54 274.33 8.2 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_9_batch RuntimeMs SparkRunner 465.36 646.22 38.87 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_9_batch RuntimeMs SparkStructuredStreamingRunner 583.11 807.44
> 38.47 [1] <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_9_streaming RuntimeMs DataflowRunner 41638.54 42081.11 1.06 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_9_streaming RuntimeMs DirectRunner 705.96 779.78 10.46 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_PRs_0_batch RuntimeMs SparkRunner 1725.0 2199.0 27.48 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_PRs_0_sql_batch RuntimeMs SparkRunner 1605.0 1661.0 3.49 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_PRs_10_batch RuntimeMs SparkRunner 1000.0 774.0 -22.6 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_PRs_11_batch RuntimeMs SparkRunner 1540.0 1878.0 21.95 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_PRs_12_batch RuntimeMs SparkRunner 971.0 991.0 2.06 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_PRs_13_batch RuntimeMs SparkRunner 372.0 388.0 4.3 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_PRs_13_sql_batch RuntimeMs SparkRunner 1645.0 1816.0 10.4 [1]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_PRs_14_batch RuntimeMs SparkRunner 1489.0 1432.0 -3.83 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_PRs_1_batch RuntimeMs SparkRunner 511.0 563.0 10.18 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_PRs_1_sql_batch RuntimeMs SparkRunner 854.0 871.0 1.99 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_PRs_2_batch RuntimeMs SparkRunner 317.0 371.0 17.03 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_PRs_2_sql_batch RuntimeMs SparkRunner 593.0 658.0 10.96 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_PRs_3_batch RuntimeMs SparkRunner 2615.0 2865.0 9.56 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_PRs_3_sql_batch RuntimeMs SparkRunner 3106.0 3249.0 4.6 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_PRs_4_batch RuntimeMs SparkRunner 1006.0 995.0 -1.09 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_PRs_5_batch RuntimeMs SparkRunner 1563.0 1567.0 0.26 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_PRs_6_batch RuntimeMs SparkRunner 1150.0 1064.0 -7.48 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_PRs_7_batch RuntimeMs SparkRunner 1541.0 1635.0 6.1 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
> nexmark_PRs_7_sql_batch RuntimeMs SparkRunner 4147.0 4530.0 9.24 [1]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/tkqc0AdGk>
> nexmark_PRs_8_batch RuntimeMs SparkRunner 1423.0 1495.0 5.06 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk> [3]
> <http://metrics.beam.apache.org/d/ahudA_zGz>
> nexmark_PRs_9_batch RuntimeMs SparkRunner 536.0 579.0 8.02 [1]
> <http://metrics.beam.apache.org/d/tkqc0AdGk> [2]
> <http://metrics.beam.apache.org/d/ahudA_zGz> [3]
> <http://metrics.beam.apache.org/d/f0Q6T0dGk>
>