You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/02/15 12:01:27 UTC
Build failed in Jenkins: beam_Metrics_Report #24
See <https://ci-beam.apache.org/job/beam_Metrics_Report/24/display/redirect?page=changes>
Changes:
[David Morávek] Simplify LateDataDropping runner.
[sychen] Integrate BigQuery sink file loads with GroupIntoBatches
[nahian97] Changing query to sql to fix doc
[samuelw] [BEAM-11729] Remove calls to Class.getSimpleName() for WindowTracing
[heejong] [BEAM-11520] Stage extra PyPI dependencies with generated requirements
[Robert Bradshaw] [BEAM-11723] Use packed name for PairWithVoid consolidation.
[Robert Bradshaw] Only do pair-with-none packing when combiner packing is desired.
[Robert Bradshaw] Make eliminate_common_key_with_none private.
[shehzaad] [BEAM-10961] make mongo-java-driver dependency a named variable
[randomstep] [BEAM-11595] bump jackson to 2.12.1
[randomstep] [BEAM-11503] bump rockdbjni to 6.15.2
[ramazan.yapparov] Renamed build.gradle to build.gradle.kts
[ramazan.yapparov] Migrated build file to kotlin
[ramazan.yapparov] Reverted extra change
[noreply] [BEAM-11773] Add bhulette as an owner for pandas, pyarrow, numpy
[Boyuan Zhang] Using LoadingCache instead of Map to cache BundleProcessor
[noreply] [BEAM-9547] Produce better errors for some groupby() and set_index()
[yifanmai] Remove translations.eliminate_common_key_with_none from DataflowRunner
[noreply] [BEAM-11762] Upgrades Tensorflow, numpy, and grpcio dependencies
[tysonjh] [BEAM-11377] Add retries to mvn command.
[noreply] [BEAM-9918] Support Tagged external PTransforms (#13872)
[zyichi] Explicitly set dataflow runner v2 test shuffle mode to appliance
[noreply] [BEAM-11265] make sure sample text file gets copied into archetype
[noreply] [BEAM-11324] Impose consistent ordering on partitionings used in
[noreply] [BEAM-11659] Extract common payload serialization behavior for Row
[randomstep] [BEAM-11168] bump powermock to 2.0.9
[noreply] [BEAM-11781]: Update kafka-clients version in samza-runner (#13935)
[ramazan.yapparov] Removed kotlin-dsl plugin from buildSrc
[Kenneth Knowles] Maintain topological order for root transforms
[kawaigin] [BEAM-11045] Updated screen diff goldens
[daniel.o.programmer] Update programming guide: New python expansion service binary
[Rui Wang] [BEAM-10925] Test Java UDF on columns
[Kyle Weaver] [BEAM-11789] Upgrade gradle-dependency-analyze plugin.
[tysonjh] [BEAM-11377] Disable mvn http keepalive.
[noreply] [BEAM-11743] countif aggregate function implementation for zetasql
[noreply] [BEAM-11708] Skip combinefn_lifecycle_test.test_combining_value_state
[Pablo Estrada] [BEAM-11791] Continuously running microbenchmark for FnApiRunner
[chamikaramj] Removes VR test
[relax] update versions
[relax] update autovalue version
[chamikaramj] Fixes a checkstyle error in UdfTestProvider
[noreply] [BEAM-11787] Do not call `translations.optimize_pipeline` in Dataflow
[noreply] [BEAM-2914] Add portable merging window support to Python. (#12995)
[noreply] [BEAM-11647] Fix go:goBuild gradle rules for build collision (#13958)
[noreply] [BEAM-11611] Add transformation for computing approximate quantiles.
[Kyle Weaver] [BEAM-10925] Don't publish udf-test-provider to Maven.
[noreply] [BEAM-11780] Use vendored cloudbuild python client. (#13933)
[Brian Hulette] Revert "update versions"
[noreply] [BEAM-11804] Remove vendors/sdk-java-extensions-protobuf (#13968)
[noreply] [BEAM-7372][BEAM-9372] cleanup python 2.x and 3.5 codepaths (#13913)
[evgeny.belousov] [BEAM-11807] SDK Worker multithreading causes boto3 the KeyError
[heejong] raise exception for non-file type artifacts
[Brian Hulette] Revert "update autovalue version"
[noreply] [BEAM-11476] Resolve flakiness (#13984)
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-10 (beam) in workspace <https://ci-beam.apache.org/job/beam_Metrics_Report/ws/>
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # timeout=10
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision e092703c9686a40abadfb61725523224be95c835 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f e092703c9686a40abadfb61725523224be95c835 # timeout=10
Commit message: "[BEAM-11805] Revert version updates from #13765 (#13972)"
> git rev-list --no-walk b74fcf7b30d956fb42830d652a57b265a1546973 # timeout=10
No emails were triggered.
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
SETUPTOOLS_USE_DISTUTILS=stdlib
[EnvInject] - Variables injected successfully.
[Gradle] - Launching build.
[src] $ <https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/gradlew> --continue --max-****s=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g -Pdocker-pull-licenses -PinfluxDb=beam_test_metrics -PinfluxHost=10.128.0.96 -PinfluxPort=8086 :beam-test-jenkins:generateMetricsReport
Starting a Gradle Daemon, 1 busy Daemon could not be reused, use --status for details
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Task :buildSrc:assemble
> Task :buildSrc:spotlessGroovy FROM-CACHE
> Task :buildSrc:spotlessGroovyCheck UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradle FROM-CACHE
> Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE
> Task :buildSrc:spotlessCheck UP-TO-DATE
> Task :buildSrc:pluginUnderTestMetadata
> Task :buildSrc:compileTestJava NO-SOURCE
> Task :buildSrc:compileTestGroovy NO-SOURCE
> Task :buildSrc:processTestResources NO-SOURCE
> Task :buildSrc:testClasses UP-TO-DATE
> Task :buildSrc:test NO-SOURCE
> Task :buildSrc:validatePlugins FROM-CACHE
> Task :buildSrc:check UP-TO-DATE
> Task :buildSrc:build
Configuration on demand is an incubating feature.
> Task :beam-test-jenkins:setupVirtualenv
Using base prefix '/usr'
New python executable in <https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/build/gradleenv/-1871197473/bin/python3.8>
Also creating executable in <https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/build/gradleenv/-1871197473/bin/python>
Installing setuptools, pip, wheel...
done.
Running virtualenv with interpreter /usr/bin/python3.8
Collecting tox==3.20.1
Using cached tox-3.20.1-py2.py3-none-any.whl (83 kB)
Collecting grpcio-tools==1.30.0
Using cached grpcio_tools-1.30.0-cp38-cp38-manylinux2010_x86_64.whl (2.5 MB)
Collecting future==0.18.2
Using cached future-0.18.2-py3-none-any.whl
Collecting mypy-protobuf==1.18
Using cached mypy_protobuf-1.18-py3-none-any.whl (7.3 kB)
Collecting distlib==0.3.1
Using cached distlib-0.3.1-py2.py3-none-any.whl (335 kB)
Collecting protobuf>=3.5.0.post1
Using cached protobuf-3.14.0-cp38-cp38-manylinux1_x86_64.whl (1.0 MB)
Collecting grpcio>=1.30.0
Using cached grpcio-1.35.0-cp38-cp38-manylinux2014_x86_64.whl (4.1 MB)
Collecting toml>=0.9.4
Using cached toml-0.10.2-py2.py3-none-any.whl (16 kB)
Collecting pluggy>=0.12.0
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting filelock>=3.0.0
Using cached filelock-3.0.12-py3-none-any.whl (7.6 kB)
Collecting py>=1.4.17
Using cached py-1.10.0-py2.py3-none-any.whl (97 kB)
Collecting packaging>=14
Using cached packaging-20.9-py2.py3-none-any.whl (40 kB)
Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0
Using cached virtualenv-20.4.2-py2.py3-none-any.whl (7.2 MB)
Collecting six>=1.14.0
Using cached six-1.15.0-py2.py3-none-any.whl (10 kB)
Collecting pyparsing>=2.0.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting appdirs<2,>=1.4.3
Using cached appdirs-1.4.4-py2.py3-none-any.whl (9.6 kB)
Installing collected packages: six, pyparsing, filelock, distlib, appdirs, virtualenv, toml, py, protobuf, pluggy, packaging, grpcio, tox, mypy-protobuf, grpcio-tools, future
Successfully installed appdirs-1.4.4 distlib-0.3.1 filelock-3.0.12 future-0.18.2 grpcio-1.35.0 grpcio-tools-1.30.0 mypy-protobuf-1.18 packaging-20.9 pluggy-0.13.1 protobuf-3.14.0 py-1.10.0 pyparsing-2.4.7 six-1.15.0 toml-0.10.2 tox-3.20.1 virtualenv-20.4.2
> Task :beam-test-jenkins:generateMetricsReport
py38-test create: <https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/.test-infra/jenkins/metrics_report/.tox/py38-test>
py38-test installdeps: -rrequirements.txt
py38-test installed: certifi==2020.12.5,chardet==4.0.0,idna==2.10,influxdb==5.3.0,Jinja2==2.11.2,MarkupSafe==1.1.1,msgpack==0.6.1,prettytable==0.7.2,python-dateutil==2.8.1,pytz==2021.1,requests==2.25.1,six==1.15.0,urllib3==1.26.3
py38-test run-test-pre: PYTHONHASHSEED='3404288497'
py38-test run-test-pre: commands[0] | python --version
Python 3.8.5
py38-test run-test-pre: commands[1] | pip --version
pip 21.0.1 from <https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/.test-infra/jenkins/metrics_report/.tox/py38-test/lib/python3.8/site-packages/pip> (python 3.8)
py38-test run-test-pre: commands[2] | pip check
No broken requirements found.
py38-test run-test: commands[0] | python -m unittest dashboards_parser.py
...
----------------------------------------------------------------------
Ran 3 tests in 0.001s
OK
___________________________________ summary ____________________________________
py38-test: commands succeeded
congratulations :)
py38-generate-report create: <https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/.test-infra/jenkins/metrics_report/.tox/py38-generate-report>
py38-generate-report installdeps: -rrequirements.txt
py38-generate-report installed: certifi==2020.12.5,chardet==4.0.0,idna==2.10,influxdb==5.3.0,Jinja2==2.11.2,MarkupSafe==1.1.1,msgpack==0.6.1,prettytable==0.7.2,python-dateutil==2.8.1,pytz==2021.1,requests==2.25.1,six==1.15.0,urllib3==1.26.3
py38-generate-report run-test-pre: PYTHONHASHSEED='1473004561'
py38-generate-report run-test-pre: commands[0] | python --version
Python 3.8.5
py38-generate-report run-test-pre: commands[1] | pip --version
pip 21.0.1 from <https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/.test-infra/jenkins/metrics_report/.tox/py38-generate-report/lib/python3.8/site-packages/pip> (python 3.8)
py38-generate-report run-test-pre: commands[2] | pip check
No broken requirements found.
py38-generate-report run-test: commands[0] | python report_generator.py --influx-db=beam_test_metrics --influx-host=10.128.0.96 --influx-port=8086 --output-file=<https://ci-beam.apache.org/job/beam_Metrics_Report/24/artifact/src/.test-infra/jenkins/metrics_report/beam-metrics_report.html>
Traceback (most recent call last):
File "report_generator.py", line 227, in <module>
main()
File "report_generator.py", line 221, in main
data = get_metrics_data(client, influx_db)
File "report_generator.py", line 183, in get_metrics_data
data.extend(_get_query_runtime_data(client, bind_params))
File "report_generator.py", line 121, in _get_query_runtime_data
for dashboard in guess_dashboard_by_measurement(
File "<https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/.test-infra/jenkins/metrics_report/dashboards_parser.py",> line 77, in guess_dashboard_by_measurement
dashboards = list(Dashboard.get_dashboards_from_directory(directory))
File "<https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/.test-infra/jenkins/metrics_report/dashboards_parser.py",> line 67, in get_dashboards_from_directory
yield cls(file)
File "<https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/.test-infra/jenkins/metrics_report/dashboards_parser.py",> line 25, in __init__
self.uid, self.queries = self.get_dashboard_uid_and_queries(file)
File "<https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/.test-infra/jenkins/metrics_report/dashboards_parser.py",> line 33, in get_dashboard_uid_and_queries
data = json.load(f)
File "/usr/lib/python3.8/json/__init__.py", line 293, in load
return loads(fp.read(),
File "/usr/lib/python3.8/json/__init__.py", line 357, in loads
return _default_decoder.decode(s)
File "/usr/lib/python3.8/json/decoder.py", line 337, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "/usr/lib/python3.8/json/decoder.py", line 353, in raw_decode
obj, end = self.scan_once(s, idx)
json.decoder.JSONDecodeError: Expecting ',' delimiter: line 142 column 3 (char 3182)
ERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/.test-infra/jenkins/metrics_report/.tox/py38-generate-report/bin/python> report_generator.py --influx-db=beam_test_metrics --influx-host=10.128.0.96 --influx-port=8086 --output-file=<https://ci-beam.apache.org/job/beam_Metrics_Report/24/artifact/src/.test-infra/jenkins/metrics_report/beam-metrics_report.html> (exited with code 1)
___________________________________ summary ____________________________________
ERROR: py38-generate-report: commands failed
> Task :beam-test-jenkins:generateMetricsReport FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/.test-infra/jenkins/build.gradle'> line: 43
* What went wrong:
Execution failed for task ':beam-test-jenkins:generateMetricsReport'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 57s
2 actionable tasks: 2 executed
Publishing build scan...
https://gradle.com/s/t52xsl7uwrckq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_Metrics_Report #25
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_Metrics_Report/25/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Beam Metrics Report (2021-02-22)
Posted by Apache Jenkins Server <je...@builds.apache.org>.
# Beam Metrics Report
Color legend: >= 20 | >= 10 | <= -10 | <= -20
---|---|---|---
## Possible regression
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
go_batch_gbk_3 | dataflow_runtime | - | 36.83 | 40.71 | 10.53 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_5 | dataflow_runtime | - | 60.12 | 69.47 | 15.56 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_cogbk_4 | dataflow_runtime_sec | - | 26.74 | 30.02 | 12.27 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_pardo_3 | dataflow_runtime_sec | - | 20.27 | 22.3 | 10.02 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_gbk_1 | dataflow_runtime_sec | - | 701.64 | 921.46 | 31.33 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
kafkaioit_results_sdf_wrapper | read_time | - | 6.24 | 9.43 | 51.25 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
python_batch_combine_4 | python_dataflow_batch_combine_4_runtime | - | 34.0 |
49.75 | 46.32 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_gbk_1 | python_dataflow_batch_gbk_1_runtime | - | 1995.29 |
2252.5 | 12.89 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_2 | python_dataflow_batch_gbk_2_runtime | - | 355.57 | 403.75
| 13.55 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_3 | python_dataflow_batch_gbk_3_runtime | - | 34.29 | 38.0 |
10.83 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_pardo_2 | python_dataflow_batch_pardo_2_runtime | - | 1492.86 |
1658.0 | 11.06 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_3 | python_dataflow_batch_pardo_3_runtime | - | 141.71 |
159.25 | 12.37 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_4 | python_dataflow_batch_pardo_4_runtime | - | 335.71 |
380.25 | 13.27 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_sideinput_1 | python_dataflow_batch_sideinput_1_runtime | - |
2.29 | 30.8 | 1247.5 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_2 | python_dataflow_batch_sideinput_2_runtime | - |
1.86 | 35.8 | 1827.69 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_4 | python_dataflow_batch_sideinput_4_runtime | - |
17.67 | 308.5 | 1646.23 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_5 | python_dataflow_batch_sideinput_5_runtime | - | 3.0
| 35.25 | 1075.0 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_6 | python_dataflow_batch_sideinput_6_runtime | - |
1.67 | 32.75 | 1865.0 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_7 | python_dataflow_batch_sideinput_7_runtime | - |
262.33 | 4063.75 | 1449.08 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_8 | python_dataflow_batch_sideinput_8_runtime | - |
237.67 | 4304.5 | 1711.15 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_psio_2GB_results | pubsub_io_perf_read_runtime | - | 102.43 | 128.0 |
24.97 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_streaming_pardo_4 | python_flink_streaming_pardo_4_runtime | - | 522.6
| 585.0 | 11.94 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
xmlioit_results | write_time | - | 37.26 | 53.57 | 43.78 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
## Possible improvement
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
java_batch_combine_4 | sparkstructuredstreaming_runtime_sec | - | 170.89 |
138.48 | -18.96 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_5 | sparkstructuredstreaming_runtime_sec | - | 170.23 |
139.89 | -17.82 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_gbk_3 | dataflow_runtime_sec | - | 28.89 | 25.97 | -10.1 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | sparkstructuredstreaming_runtime_sec | - | 144.91 | 121.56
| -16.12 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | sparkstructuredstreaming_runtime_sec | - | 131.06 | 117.51
| -10.34 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_pardo_1 | sparkstructuredstreaming_runtime_sec | - | 60.45 | 51.37
| -15.02 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_sideinput_10 | python_dataflow_batch_sideinput_10_runtime | - |
2477.0 | 951.33 | -61.59 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_3 | python_dataflow_batch_sideinput_3_runtime | - |
12.5 | 4.8 | -61.6 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_9 | python_dataflow_batch_sideinput_9_runtime | - |
1431.0 | 915.33 | -36.04 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_streaming_gbk_3 | python_dataflow_streaming_gbk_3_runtime | - | 166.29
| 143.25 | -13.85 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_pardo_1 | python_dataflow_streaming_pardo_1_runtime | - |
180.57 | 152.25 | -15.68 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_2 | python_dataflow_streaming_pardo_2_runtime | - |
2897.14 | 2596.0 | -10.39 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_3 | python_dataflow_streaming_pardo_3_runtime | - |
150.17 | 124.25 | -17.26 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_6 | python_flink_streaming_pardo_6_runtime | - | 118.4
| 0.25 | -99.79 |
textioit_hdfs_results | write_time | - | 59.62 | 46.57 | -21.89 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_hdfs_results | write_time | - | 49.82 | 40.67 | -18.36 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
nexmark_0_sql_batch | RuntimeMs | DirectRunner | 4258.39 | 3752.61 | -11.88 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_10_batch | RuntimeMs | FlinkRunner | 773.64 | 672.22 | -13.11 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_11_batch | RuntimeMs | DataflowRunner | 68802.46 | 54423.0 | -20.9 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_batch | RuntimeMs | FlinkRunner | 292.07 | 250.89 | -14.1 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_14_batch | RuntimeMs | DataflowRunner | 119454.18 | 106174.22 | -11.12
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_batch | RuntimeMs | DataflowRunner | 67857.64 | 50368.33 | -25.77 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_batch | RuntimeMs | SparkStructuredStreamingRunner | 429.5 | 365.94
| -14.8 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_sql_batch | RuntimeMs | DataflowRunner | 62760.07 | 47586.33 |
-24.18 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_batch | RuntimeMs | SparkRunner | 150.89 | 135.67 | -10.09 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_sql_batch | RuntimeMs | DataflowRunner | 58848.29 | 39440.72 |
-32.98 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_batch | RuntimeMs | DataflowRunner | 60030.04 | 54018.11 | -10.01 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_batch | RuntimeMs | DataflowRunner | 58900.64 | 50947.39 | -13.5 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_6_batch | RuntimeMs | DataflowRunner | 59200.39 | 46278.83 | -21.83 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_batch | RuntimeMs | DataflowRunner | 93145.07 | 78131.67 | -16.12 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_batch | RuntimeMs | SparkRunner | 526.57 | 471.67 | -10.43 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_sql_streaming | RuntimeMs | FlinkRunner | 4861.61 | 4374.0 | -10.03
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_streaming | RuntimeMs | FlinkRunner | 12588.89 | 11023.72 | -12.43 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_batch | RuntimeMs | FlinkRunner | 702.14 | 597.11 | -14.96 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_9_batch | RuntimeMs | DataflowRunner | 54895.39 | 42666.33 | -22.28 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
## All metrics
**Measurement** | **Metric** | **Runner** | **Mean previous week** | **Mean
last week** | **Diff %** | **Dashboard**
---|---|---|---|---|---|---
avroioit_hdfs_results | read_time | - | 126.04 | 118.91 | -5.66 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_hdfs_results | write_time | - | 189.95 | 173.85 | -8.48 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_results | read_time | - | 120.02 | 116.02 | -3.33 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
avroioit_results | write_time | - | 162.36 | 160.32 | -1.25 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_avro | avro_write_time | - | 56.19 | 56.4 | 0.37
| [[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_avro | read_time | - | 65.95 | 67.82 | 2.84 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_json | read_time | - | 62.46 | 62.85 | 0.61 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
bqio_10GB_results_java_batch_json | write_time | - | 97.6 | 90.89 | -6.87 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_hdfs_results | read_time | - | 204.25 | 189.19 | -7.37 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_hdfs_results | write_time | - | 320.89 | 291.42 | -9.18 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_results | read_time | - | 201.39 | 203.62 | 1.11 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
compressed_textioit_results | write_time | - | 277.24 | 281.83 | 1.66 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
go_batch_cogbk_1 | dataflow_runtime | - | 357.44 | 324.85 | -9.12 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_cogbk_2 | dataflow_runtime | - | 210.45 | 209.3 | -0.55 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_cogbk_2 | flink_runtime | - | 614.9 | 647.89 | 5.36 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_cogbk_3 | dataflow_runtime | - | 176.9 | 189.95 | 7.38 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_cogbk_3 | flink_runtime | - | 705.5 | 707.72 | 0.32 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_cogbk_4 | dataflow_runtime | - | 176.9 | 190.41 | 7.64 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_cogbk_4 | flink_runtime | - | 641.31 | 645.95 | 0.72 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
go_batch_combine_1 | dataflow_runtime | - | 1547.44 | 1521.7 | -1.66 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
go_batch_combine_1 | flink_runtime | - | 3957.97 | 3974.75 | 0.42 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
go_batch_combine_4 | dataflow_runtime | - | 83.78 | 87.47 | 4.4 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
go_batch_combine_4 | flink_runtime | - | 143.51 | 147.28 | 2.62 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
go_batch_combine_5 | dataflow_runtime | - | 80.94 | 84.82 | 4.8 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
go_batch_combine_5 | flink_runtime | - | 110.77 | 107.72 | -2.76 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
go_batch_gbk_1 | dataflow_runtime | - | 713.86 | 748.5 | 4.85 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_1 | flink_runtime | - | 3247.2 | 3257.42 | 0.31 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_2 | dataflow_runtime | - | 156.18 | 162.45 | 4.02 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_2 | flink_runtime | - | 505.72 | 503.43 | -0.45 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_3 | dataflow_runtime | - | 36.83 | 40.71 | 10.53 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_3 | flink_runtime | - | 21.63 | 21.06 | -2.63 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_4 | dataflow_runtime | - | 68.4 | 74.07 | 8.28 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_4 | flink_runtime | - | 143.69 | 142.61 | -0.76 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_5 | dataflow_runtime | - | 60.12 | 69.47 | 15.56 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_5 | flink_runtime | - | 107.85 | 105.88 | -1.82 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_6 | dataflow_runtime | - | 155.42 | 169.28 | 8.92 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_6 | flink_runtime | - | 595.32 | 594.07 | -0.21 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_gbk_7 | dataflow_runtime | - | 163.93 | 171.71 | 4.75 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
go_batch_pardo_1 | dataflow_runtime | - | 160.83 | 167.35 | 4.05 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_1 | flink_runtime | - | 598.87 | 602.44 | 0.6 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_2 | dataflow_runtime | - | 1700.43 | 1711.38 | 0.64 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_2 | flink_runtime | - | 7063.74 | 7040.71 | -0.33 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_3 | dataflow_runtime | - | 94.21 | 94.74 | 0.56 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_3 | flink_runtime | - | 305.9 | 306.34 | 0.15 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_4 | dataflow_runtime | - | 102.08 | 102.53 | 0.45 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_pardo_4 | flink_runtime | - | 343.66 | 344.49 | 0.24 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
go_batch_sideinput_3 | flink_runtime | - | 13.79 | 14.06 | 2.01 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
go_batch_sideinput_4 | flink_runtime | - | 14.79 | 14.56 | -1.52 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
hadoopformatioit_results | read_time | - | 8.84 | 8.66 | -2.1 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
hadoopformatioit_results | write_time | - | 12.1 | 11.84 | -2.16 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
java_batch_cogbk_1 | dataflow_runtime_sec | - | 61.97 | 64.94 | 4.79 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_1 | sparkstructuredstreaming_runtime_sec | - | 133.04 |
129.08 | -2.98 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | dataflow_runtime_sec | - | 61.01 | 65.71 | 7.7 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_2 | sparkstructuredstreaming_runtime_sec | - | 132.21 | 133.8
| 1.2 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | dataflow_runtime_sec | - | 27.65 | 26.92 | -2.64 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_3 | sparkstructuredstreaming_runtime_sec | - | 20.3 | 20.29 |
-0.02 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | dataflow_runtime_sec | - | 26.74 | 30.02 | 12.27 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_cogbk_4 | sparkstructuredstreaming_runtime_sec | - | 20.85 | 20.54
| -1.48 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_batch_combine_1 | dataflow_runtime_sec | - | 85.59 | 85.84 | 0.29 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_1 | sparkstructuredstreaming_runtime_sec | - | 773.22 |
762.83 | -1.34 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_4 | dataflow_runtime_sec | - | 35.74 | 34.95 | -2.22 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_4 | sparkstructuredstreaming_runtime_sec | - | 170.89 |
138.48 | -18.96 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_5 | dataflow_runtime_sec | - | 36.19 | 34.5 | -4.67 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_combine_5 | sparkstructuredstreaming_runtime_sec | - | 170.23 |
139.89 | -17.82 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_batch_gbk_1 | dataflow_runtime_sec | - | 201.76 | 210.42 | 4.29 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_1 | sparkstructuredstreaming_runtime_sec | - | 619.59 | 666.84
| 7.63 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | dataflow_runtime_sec | - | 54.62 | 53.23 | -2.55 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_2 | sparkstructuredstreaming_runtime_sec | - | 120.96 | 118.12
| -2.35 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | dataflow_runtime_sec | - | 28.89 | 25.97 | -10.1 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_3 | sparkstructuredstreaming_runtime_sec | - | 10.11 | 9.7 |
-3.99 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | dataflow_runtime_sec | - | 31.57 | 29.62 | -6.17 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_4 | sparkstructuredstreaming_runtime_sec | - | 144.91 | 121.56
| -16.12 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | dataflow_runtime_sec | - | 31.7 | 29.21 | -7.86 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_5 | sparkstructuredstreaming_runtime_sec | - | 131.06 | 117.51
| -10.34 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | dataflow_runtime_sec | - | 66.97 | 70.63 | 5.46 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_6 | sparkstructuredstreaming_runtime_sec | - | 62.56 | 68.38 |
9.3 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | dataflow_runtime_sec | - | 83.31 | 87.41 | 4.93 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_gbk_7 | sparkstructuredstreaming_runtime_sec | - | 86.77 | 92.42 |
6.51 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_batch_pardo_1 | dataflow_runtime_sec | - | 28.72 | 29.57 | 2.99 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_1 | sparkstructuredstreaming_runtime_sec | - | 60.45 | 51.37
| -15.02 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_2 | dataflow_runtime_sec | - | 214.19 | 198.68 | -7.24 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_3 | dataflow_runtime_sec | - | 20.27 | 22.3 | 10.02 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_batch_pardo_4 | dataflow_runtime_sec | - | 34.99 | 35.82 | 2.39 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_cogbk_1 | dataflow_runtime_sec | - | 996.35 | 977.68 | -1.87 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_2 | dataflow_runtime_sec | - | 930.21 | 945.06 | 1.6 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_3 | dataflow_runtime_sec | - | 125.55 | 121.5 | -3.22 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_cogbk_4 | dataflow_runtime_sec | - | 130.27 | 123.38 | -5.28 |
[[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
java_streaming_combine_1 | dataflow_runtime_sec | - | 546.11 | 513.28 | -6.01
| [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_combine_4 | dataflow_runtime_sec | - | 322.04 | 340.73 | 5.8 |
[[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_combine_5 | dataflow_runtime_sec | - | 334.03 | 317.06 | -5.08
| [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
java_streaming_gbk_1 | dataflow_runtime_sec | - | 701.64 | 921.46 | 31.33 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_2 | dataflow_runtime_sec | - | 848.87 | 895.81 | 5.53 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_3 | dataflow_runtime_sec | - | 22.84 | 23.34 | 2.18 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_4 | dataflow_runtime_sec | - | 314.47 | 296.64 | -5.67 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_5 | dataflow_runtime_sec | - | 308.03 | 290.33 | -5.75 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_6 | dataflow_runtime_sec | - | 74.75 | 75.8 | 1.4 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_gbk_7 | dataflow_runtime_sec | - | 132.82 | 133.64 | 0.61 |
[[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
java_streaming_pardo_1 | dataflow_runtime_sec | - | 18.57 | 18.45 | -0.65 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_2 | dataflow_runtime_sec | - | 215.48 | 212.0 | -1.61 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_3 | dataflow_runtime_sec | - | 11.52 | 11.66 | 1.19 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
java_streaming_pardo_4 | dataflow_runtime_sec | - | 31.21 | 30.4 | -2.59 |
[[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
jdbcioit_results | read_time | - | 38.61 | 38.27 | -0.86 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
jdbcioit_results | write_time | - | 58.36 | 60.38 | 3.47 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results | read_time | - | 784.42 | 782.36 | -0.26 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results | write_time | - | 195.39 | 183.58 | -6.04 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results_runner_v2 | read_time | - | 2.32 | 2.25 | -3.16 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results_runner_v2 | write_time | - | 11.36 | 11.07 | -2.53 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results_sdf_wrapper | read_time | - | 6.24 | 9.43 | 51.25 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
kafkaioit_results_sdf_wrapper | write_time | - | 10.69 | 10.83 | 1.32 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_hdfs_results | read_time | - | 24.36 | 24.57 | 0.86 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_hdfs_results | write_time | - | 100.27 | 98.85 | -1.42 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_results | read_time | - | 43.4 | 42.61 | -1.83 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
many_files_textioit_results | write_time | - | 107.65 | 111.69 | 3.75 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
mongodbioit_results | read_time | - | 30.07 | 28.45 | -5.38 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
mongodbioit_results | write_time | - | 77.13 | 78.55 | 1.83 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_hdfs_results | read_time | - | 115.99 | 124.95 | 7.73 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_hdfs_results | write_time | - | 203.44 | 203.61 | 0.08 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_results | read_time | - | 115.55 | 121.9 | 5.5 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
parquetioit_results | write_time | - | 194.53 | 191.92 | -1.34 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
python_batch_cogbk_1 | python_dataflow_batch_cogbk_1_runtime | - | 503.71 |
525.0 | 4.23 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_2 | python_dataflow_batch_cogbk_2_runtime | - | 325.14 |
339.75 | 4.49 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_3 | python_dataflow_batch_cogbk_3_runtime | - | 301.71 |
324.5 | 7.55 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_cogbk_4 | python_dataflow_batch_cogbk_4_runtime | - | 315.14 |
338.75 | 7.49 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_batch_combine_1 | python_dataflow_batch_combine_1_runtime | - | 971.0 |
992.75 | 2.24 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_1 | python_flink_batch_combine_1_runtime | - | 4444.43 |
4632.75 | 4.24 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_4 | python_dataflow_batch_combine_4_runtime | - | 34.0 |
49.75 | 46.32 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_4 | python_flink_batch_combine_4_runtime | - | 165.86 |
160.5 | -3.23 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_5 | python_dataflow_batch_combine_5_runtime | - | 37.43 |
36.75 | -1.81 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_combine_5 | python_flink_batch_combine_5_runtime | - | 107.43 |
101.25 | -5.75 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_batch_gbk_1 | python_dataflow_batch_gbk_1_runtime | - | 1995.29 |
2252.5 | 12.89 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_2 | python_dataflow_batch_gbk_2_runtime | - | 355.57 | 403.75
| 13.55 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_3 | python_dataflow_batch_gbk_3_runtime | - | 34.29 | 38.0 |
10.83 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_4 | python_dataflow_batch_gbk_4_runtime | - | 112.14 | 117.25
| 4.55 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_5 | python_dataflow_batch_gbk_5_runtime | - | 108.57 | 110.25
| 1.55 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_6 | python_dataflow_batch_gbk_6_runtime | - | 413.29 | 426.0
| 3.08 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_gbk_7 | python_dataflow_batch_gbk_7_runtime | - | 378.29 | 386.5
| 2.17 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_batch_pardo_1 | python_dataflow_batch_pardo_1_runtime | - | 162.29 |
176.0 | 8.45 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_1 | python_flink_batch_pardo_1_runtime | - | 684.29 |
691.75 | 1.09 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_2 | python_dataflow_batch_pardo_2_runtime | - | 1492.86 |
1658.0 | 11.06 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_3 | python_dataflow_batch_pardo_3_runtime | - | 141.71 |
159.25 | 12.37 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_3 | python_flink_batch_pardo_3_runtime | - | 607.43 | 622.5
| 2.48 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_4 | python_dataflow_batch_pardo_4_runtime | - | 335.71 |
380.25 | 13.27 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_pardo_4 | python_flink_batch_pardo_4_runtime | - | 1866.29 |
1906.25 | 2.14 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_batch_sideinput_1 | python_dataflow_batch_sideinput_1_runtime | - |
2.29 | 30.8 | 1247.5 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_10 | python_dataflow_batch_sideinput_10_runtime | - |
2477.0 | 951.33 | -61.59 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_2 | python_dataflow_batch_sideinput_2_runtime | - |
1.86 | 35.8 | 1827.69 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_3 | python_dataflow_batch_sideinput_3_runtime | - |
12.5 | 4.8 | -61.6 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_4 | python_dataflow_batch_sideinput_4_runtime | - |
17.67 | 308.5 | 1646.23 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_5 | python_dataflow_batch_sideinput_5_runtime | - | 3.0
| 35.25 | 1075.0 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_6 | python_dataflow_batch_sideinput_6_runtime | - |
1.67 | 32.75 | 1865.0 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_7 | python_dataflow_batch_sideinput_7_runtime | - |
262.33 | 4063.75 | 1449.08 |
[[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_8 | python_dataflow_batch_sideinput_8_runtime | - |
237.67 | 4304.5 | 1711.15 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_batch_sideinput_9 | python_dataflow_batch_sideinput_9_runtime | - |
1431.0 | 915.33 | -36.04 | [[1]](http://metrics.beam.apache.org/d/-E9aGlFGk)
python_bqio_read_10GB_results | bqio_read_10GB_results_runtime | - | 151.0 |
162.5 | 7.62 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_bqio_write_10GB_results | bqio_write_10GB_results_runtime | - | 267.57
| 274.75 | 2.68 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_psio_2GB_results | pubsub_io_perf_read_runtime | - | 102.43 | 128.0 |
24.97 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_psio_2GB_results | pubsub_io_perf_write_runtime | - | 96.14 | 102.67 |
6.79 | [[1]](http://metrics.beam.apache.org/d/gP7vMPqZz)
python_streaming_cogbk_1 | python_dataflow_streaming_cogbk_1_runtime | - |
594.57 | 603.25 | 1.46 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_2 | python_dataflow_streaming_cogbk_2_runtime | - |
385.0 | 376.0 | -2.34 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_3 | python_dataflow_streaming_cogbk_3_runtime | - |
695.0 | 718.0 | 3.31 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_cogbk_4 | python_dataflow_streaming_cogbk_4_runtime | - |
253.71 | 268.75 | 5.93 | [[1]](http://metrics.beam.apache.org/d/fK0U4JqWz)
python_streaming_combine_4 | python_flink_streaming_combine_4_runtime | - |
228.33 | 222.5 | -2.55 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_streaming_combine_5 | python_flink_streaming_combine_5_runtime | - |
219.2 | 228.0 | 4.01 | [[1]](http://metrics.beam.apache.org/d/WNzYt13Zk)
python_streaming_gbk_3 | python_dataflow_streaming_gbk_3_runtime | - | 166.29
| 143.25 | -13.85 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_gbk_6 | python_dataflow_streaming_gbk_6_runtime | - | 438.71
| 425.25 | -3.07 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_gbk_7 | python_dataflow_streaming_gbk_7_runtime | - | 428.14
| 425.75 | -0.56 | [[1]](http://metrics.beam.apache.org/d/UYZ-oJ3Zk)
python_streaming_pardo_1 | python_dataflow_streaming_pardo_1_runtime | - |
180.57 | 152.25 | -15.68 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_1 | python_flink_streaming_pardo_5_runtime | - | 147.0
| 157.75 | 7.31 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_2 | python_dataflow_streaming_pardo_2_runtime | - |
2897.14 | 2596.0 | -10.39 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_2 | python_flink_streaming_pardo_2_runtime | - | 3243.2
| 3505.0 | 8.07 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_3 | python_dataflow_streaming_pardo_3_runtime | - |
150.17 | 124.25 | -17.26 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_3 | python_flink_streaming_pardo_3_runtime | - | 224.2
| 222.75 | -0.65 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_4 | python_dataflow_streaming_pardo_4_runtime | - |
455.67 | 412.67 | -9.44 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_4 | python_flink_streaming_pardo_4_runtime | - | 522.6
| 585.0 | 11.94 | [[1]](http://metrics.beam.apache.org/d/MOi-kf3Zk)
python_streaming_pardo_6 | python_flink_streaming_pardo_6_runtime | - | 118.4
| 0.25 | -99.79 |
textioit_hdfs_results | read_time | - | 25.52 | 25.47 | -0.19 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_hdfs_results | write_time | - | 59.62 | 46.57 | -21.89 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_results | read_time | - | 26.57 | 26.53 | -0.17 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
textioit_results | write_time | - | 45.06 | 45.26 | 0.44 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
tfrecordioit_results | read_time | - | 27.91 | 28.13 | 0.79 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
tfrecordioit_results | write_time | - | 31.79 | 31.93 | 0.45 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
wordcount_py37_results | runtime | - | 865.88 | 882.58 | 1.93 |
[[1]](http://metrics.beam.apache.org/d/1cnwVDkGk)
xmlioit_hdfs_results | read_time | - | 26.3 | 26.21 | -0.34 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_hdfs_results | write_time | - | 49.82 | 40.67 | -18.36 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_results | read_time | - | 28.38 | 30.25 | 6.59 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
xmlioit_results | write_time | - | 37.26 | 53.57 | 43.78 |
[[1]](http://metrics.beam.apache.org/d/bnlHKP3Wz)
nexmark_0_batch | RuntimeMs | DataflowRunner | 60413.96 | 56243.33 | -6.9 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_batch | RuntimeMs | DirectRunner | 3072.39 | 2985.28 | -2.84 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_batch | RuntimeMs | FlinkRunner | 1345.89 | 1233.11 | -8.38 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_batch | RuntimeMs | SparkRunner | 1139.96 | 1080.67 | -5.2 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_batch | RuntimeMs | SparkStructuredStreamingRunner | 1192.54 |
1135.22 | -4.81 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_sql_batch | RuntimeMs | DataflowRunner | 53422.64 | 55478.83 | 3.85
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_sql_batch | RuntimeMs | DirectRunner | 4258.39 | 3752.61 | -11.88 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_sql_batch | RuntimeMs | SparkRunner | 1212.64 | 1160.5 | -4.3 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1254.18 |
1200.72 | -4.26 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_0_sql_streaming | RuntimeMs | DataflowRunner | 21602.93 | 20756.44 |
-3.92 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_sql_streaming | RuntimeMs | DirectRunner | 6852.07 | 6391.67 | -6.72
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_sql_streaming | RuntimeMs | FlinkRunner | 2081.29 | 1988.56 | -4.46
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_streaming | RuntimeMs | DataflowRunner | 21376.61 | 22128.28 | 3.52
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_streaming | RuntimeMs | DirectRunner | 5458.04 | 5230.22 | -4.17 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_streaming | RuntimeMs | FlinkRunner | 1842.71 | 1705.89 | -7.43 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_batch | RuntimeMs | DataflowRunner | 173563.43 | 174410.5 |
0.49 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_zetasql_batch | RuntimeMs | DirectRunner | 5637.75 | 5135.22 | -8.91
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_0_zetasql_streaming | RuntimeMs | DataflowRunner | 71104.39 | 71796.06
| 0.97 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_streaming | RuntimeMs | DirectRunner | 8270.61 | 7801.22 |
-5.68 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_0_zetasql_streaming | RuntimeMs | FlinkRunner | 3911.5 | 3631.44 |
-7.16 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_batch | RuntimeMs | DataflowRunner | 79499.75 | 83410.78 | 4.92 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_batch | RuntimeMs | DirectRunner | 3126.11 | 2978.94 | -4.71 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_batch | RuntimeMs | FlinkRunner | 773.64 | 672.22 | -13.11 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_10_batch | RuntimeMs | SparkRunner | 678.79 | 644.67 | -5.03 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_10_batch | RuntimeMs | SparkStructuredStreamingRunner | 1049.29 |
966.17 | -7.92 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_10_streaming | RuntimeMs | DataflowRunner | 89823.39 | 89371.39 | -0.5
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_streaming | RuntimeMs | DirectRunner | 16756.29 | 16444.0 | -1.86 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_10_streaming | RuntimeMs | FlinkRunner | 1733.64 | 1580.94 | -8.81 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_batch | RuntimeMs | DataflowRunner | 68802.46 | 54423.0 | -20.9 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_batch | RuntimeMs | DirectRunner | 2846.29 | 2679.0 | -5.88 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_batch | RuntimeMs | FlinkRunner | 292.07 | 250.89 | -14.1 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_11_batch | RuntimeMs | SparkRunner | 572.25 | 529.94 | -7.39 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_11_batch | RuntimeMs | SparkStructuredStreamingRunner | 715.61 |
654.83 | -8.49 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_11_streaming | RuntimeMs | DataflowRunner | 154275.57 | 159430.72 |
3.34 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_streaming | RuntimeMs | DirectRunner | 3747.14 | 3569.61 | -4.74 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_11_streaming | RuntimeMs | FlinkRunner | 1775.68 | 1687.11 | -4.99 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_batch | RuntimeMs | DataflowRunner | 50922.25 | 53700.94 | 5.46 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_batch | RuntimeMs | DirectRunner | 1910.82 | 1835.61 | -3.94 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_12_batch | RuntimeMs | FlinkRunner | 198.18 | 188.56 | -4.86 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_12_batch | RuntimeMs | SparkRunner | 254.07 | 235.44 | -7.33 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_12_batch | RuntimeMs | SparkStructuredStreamingRunner | 394.36 |
391.28 | -0.78 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_streaming | RuntimeMs | DataflowRunner | 75169.25 | 75519.39 | 0.47
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_streaming | RuntimeMs | DirectRunner | 2510.57 | 2385.67 | -4.98 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_12_streaming | RuntimeMs | FlinkRunner | 825.36 | 773.56 | -6.28 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_batch | RuntimeMs | DataflowRunner | 44607.32 | 44552.56 | -0.12 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_batch | RuntimeMs | DirectRunner | 1852.82 | 1782.89 | -3.77 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_batch | RuntimeMs | FlinkRunner | 353.96 | 326.94 | -7.63 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_batch | RuntimeMs | SparkRunner | 266.43 | 243.94 | -8.44 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_batch | RuntimeMs | SparkStructuredStreamingRunner | 397.04 |
391.83 | -1.31 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_sql_batch | RuntimeMs | DataflowRunner | 119583.25 | 108450.61 |
-9.31 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_sql_batch | RuntimeMs | DirectRunner | 5248.29 | 4858.89 | -7.42 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_sql_batch | RuntimeMs | SparkRunner | 1114.43 | 1080.0 | -3.09 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 1079.18 |
1044.67 | -3.2 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_sql_streaming | RuntimeMs | DataflowRunner | 34134.79 | 35758.89 |
4.76 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_streaming | RuntimeMs | DirectRunner | 5915.68 | 5597.78 |
-5.37 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_sql_streaming | RuntimeMs | FlinkRunner | 37624.93 | 34056.11 |
-9.49 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_streaming | RuntimeMs | DataflowRunner | 25561.11 | 25438.56 |
-0.48 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_streaming | RuntimeMs | DirectRunner | 2929.61 | 2824.83 | -3.58 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_streaming | RuntimeMs | FlinkRunner | 33153.61 | 31594.5 | -4.7 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_batch | RuntimeMs | DataflowRunner | 351576.11 | 351879.78
| 0.09 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_13_zetasql_batch | RuntimeMs | DirectRunner | 8079.79 | 7585.28 |
-6.12 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_13_zetasql_streaming | RuntimeMs | DataflowRunner | 126332.29 |
126619.33 | 0.23 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_streaming | RuntimeMs | DirectRunner | 7368.61 | 6881.06 |
-6.62 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_13_zetasql_streaming | RuntimeMs | FlinkRunner | 41278.29 | 39987.89 |
-3.13 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_batch | RuntimeMs | DataflowRunner | 119454.18 | 106174.22 | -11.12
| [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_batch | RuntimeMs | DirectRunner | 3006.61 | 2883.44 | -4.1 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_14_batch | RuntimeMs | FlinkRunner | 542.79 | 498.44 | -8.17 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_batch | RuntimeMs | SparkRunner | 899.79 | 863.56 | -4.03 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_14_batch | RuntimeMs | SparkStructuredStreamingRunner | 905.04 | 827.0
| -8.62 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_14_streaming | RuntimeMs | DataflowRunner | 116159.93 | 114898.61 |
-1.09 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_streaming | RuntimeMs | DirectRunner | 3878.89 | 3655.0 | -5.77 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_14_streaming | RuntimeMs | FlinkRunner | 1779.0 | 1691.72 | -4.91 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_batch | RuntimeMs | DataflowRunner | 67857.64 | 50368.33 | -25.77 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_batch | RuntimeMs | DirectRunner | 1664.89 | 1574.22 | -5.45 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_1_batch | RuntimeMs | FlinkRunner | 281.36 | 268.61 | -4.53 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_batch | RuntimeMs | SparkRunner | 368.61 | 361.61 | -1.9 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_1_batch | RuntimeMs | SparkStructuredStreamingRunner | 429.5 | 365.94
| -14.8 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_sql_batch | RuntimeMs | DataflowRunner | 62760.07 | 47586.33 |
-24.18 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_1_sql_batch | RuntimeMs | DirectRunner | 2187.36 | 2020.5 | -7.63 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_sql_batch | RuntimeMs | SparkRunner | 410.04 | 392.0 | -4.4 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_1_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 536.86 |
543.39 | 1.22 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_1_sql_streaming | RuntimeMs | DataflowRunner | 18735.96 | 18891.33 |
0.83 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_streaming | RuntimeMs | DirectRunner | 4145.96 | 3790.06 | -8.58
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_sql_streaming | RuntimeMs | FlinkRunner | 814.39 | 794.83 | -2.4 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_streaming | RuntimeMs | DataflowRunner | 17187.43 | 16672.06 | -3.0
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_streaming | RuntimeMs | DirectRunner | 3950.68 | 3607.44 | -8.69 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_1_streaming | RuntimeMs | FlinkRunner | 810.86 | 770.06 | -5.03 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_batch | RuntimeMs | DataflowRunner | 38603.39 | 36280.83 | -6.02 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_batch | RuntimeMs | DirectRunner | 1247.57 | 1213.89 | -2.7 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_batch | RuntimeMs | FlinkRunner | 140.43 | 133.72 | -4.78 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_batch | RuntimeMs | SparkRunner | 150.89 | 135.67 | -10.09 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_batch | RuntimeMs | SparkStructuredStreamingRunner | 187.71 | 187.39
| -0.17 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_sql_batch | RuntimeMs | DataflowRunner | 58848.29 | 39440.72 |
-32.98 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_sql_batch | RuntimeMs | DirectRunner | 1160.25 | 1081.83 | -6.76 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_sql_batch | RuntimeMs | SparkRunner | 223.89 | 215.44 | -3.77 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 214.32 |
218.78 | 2.08 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_2_sql_streaming | RuntimeMs | DataflowRunner | 11756.32 | 11318.94 |
-3.72 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_streaming | RuntimeMs | DirectRunner | 2058.82 | 1931.94 | -6.16
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_sql_streaming | RuntimeMs | FlinkRunner | 515.68 | 543.0 | 5.3 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_streaming | RuntimeMs | DataflowRunner | 11015.71 | 10949.89 | -0.6
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_streaming | RuntimeMs | DirectRunner | 1833.54 | 1742.67 | -4.96 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_streaming | RuntimeMs | FlinkRunner | 395.64 | 381.44 | -3.59 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_batch | RuntimeMs | DataflowRunner | 100626.43 | 99654.11 |
-0.97 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_zetasql_batch | RuntimeMs | DirectRunner | 2233.61 | 2101.5 | -5.91
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_2_zetasql_streaming | RuntimeMs | DataflowRunner | 40838.39 | 39542.61
| -3.17 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_streaming | RuntimeMs | DirectRunner | 3769.61 | 3551.61 |
-5.78 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_2_zetasql_streaming | RuntimeMs | FlinkRunner | 1418.68 | 1368.0 |
-3.57 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_batch | RuntimeMs | DataflowRunner | 60030.04 | 54018.11 | -10.01 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_batch | RuntimeMs | DirectRunner | 2482.54 | 2369.94 | -4.54 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_batch | RuntimeMs | FlinkRunner | 1391.82 | 1271.39 | -8.65 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_batch | RuntimeMs | SparkRunner | 1002.71 | 961.89 | -4.07 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_sql_batch | RuntimeMs | DataflowRunner | 43876.93 | 42083.06 | -4.09
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_3_sql_batch | RuntimeMs | DirectRunner | 2851.61 | 2673.94 | -6.23 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_sql_batch | RuntimeMs | SparkRunner | 1233.43 | 1128.0 | -8.55 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_3_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 723.32 |
671.61 | -7.15 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_3_sql_streaming | RuntimeMs | DataflowRunner | 30452.54 | 31876.83 |
4.68 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_streaming | RuntimeMs | DirectRunner | 3995.64 | 3754.78 | -6.03
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_sql_streaming | RuntimeMs | FlinkRunner | 1107.68 | 1048.61 | -5.33
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_streaming | RuntimeMs | DataflowRunner | 19533.82 | 18774.0 | -3.89
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_streaming | RuntimeMs | DirectRunner | 3567.68 | 3340.67 | -6.36 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_streaming | RuntimeMs | FlinkRunner | 610.68 | 581.94 | -4.71 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_batch | RuntimeMs | DataflowRunner | 101474.11 | 98842.94 |
-2.59 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_3_zetasql_batch | RuntimeMs | DirectRunner | 2965.29 | 2779.06 | -6.28
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_streaming | RuntimeMs | DataflowRunner | 46525.71 | 44185.06
| -5.03 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_streaming | RuntimeMs | DirectRunner | 4426.46 | 4139.78 |
-6.48 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_3_zetasql_streaming | RuntimeMs | FlinkRunner | 1426.5 | 1301.94 |
-8.73 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_batch | RuntimeMs | DataflowRunner | 58900.64 | 50947.39 | -13.5 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_4_batch | RuntimeMs | DirectRunner | 1824.0 | 1743.39 | -4.42 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_4_batch | RuntimeMs | FlinkRunner | 1133.07 | 1048.0 | -7.51 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_4_batch | RuntimeMs | SparkRunner | 707.0 | 662.17 | -6.34 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_batch | RuntimeMs | SparkStructuredStreamingRunner | 1444.75 |
1335.17 | -7.58 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_streaming | RuntimeMs | DataflowRunner | 48984.43 | 49357.17 | 0.76
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_streaming | RuntimeMs | DirectRunner | 1522.07 | 1434.39 | -5.76 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_4_streaming | RuntimeMs | FlinkRunner | 1459.14 | 1320.06 | -9.53 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_batch | RuntimeMs | DataflowRunner | 70727.32 | 68216.89 | -3.55 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_5_batch | RuntimeMs | DirectRunner | 8297.82 | 7582.44 | -8.62 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_5_batch | RuntimeMs | FlinkRunner | 898.0 | 819.44 | -8.75 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_batch | RuntimeMs | SparkRunner | 675.25 | 647.56 | -4.1 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_batch | RuntimeMs | SparkStructuredStreamingRunner | 1534.5 |
1461.06 | -4.79 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_5_streaming | RuntimeMs | DataflowRunner | 121641.43 | 116526.17 |
-4.21 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_streaming | RuntimeMs | DirectRunner | 8710.96 | 8006.44 | -8.09 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_5_streaming | RuntimeMs | FlinkRunner | 1681.32 | 1541.83 | -8.3 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_batch | RuntimeMs | DataflowRunner | 59200.39 | 46278.83 | -21.83 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_batch | RuntimeMs | DirectRunner | 1308.18 | 1195.17 | -8.64 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_6_batch | RuntimeMs | FlinkRunner | 577.21 | 549.39 | -4.82 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_6_batch | RuntimeMs | SparkRunner | 380.61 | 363.61 | -4.47 |
[[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_6_batch | RuntimeMs | SparkStructuredStreamingRunner | 349.71 | 345.28
| -1.27 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_6_streaming | RuntimeMs | DataflowRunner | 42152.86 | 39719.39 | -5.77
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_streaming | RuntimeMs | DirectRunner | 1132.39 | 1065.44 | -5.91 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_6_streaming | RuntimeMs | FlinkRunner | 807.43 | 758.11 | -6.11 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_batch | RuntimeMs | DataflowRunner | 93145.07 | 78131.67 | -16.12 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_batch | RuntimeMs | DirectRunner | 3938.39 | 3855.61 | -2.1 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_batch | RuntimeMs | FlinkRunner | 693.04 | 642.61 | -7.28 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_batch | RuntimeMs | SparkRunner | 526.57 | 471.67 | -10.43 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
nexmark_7_batch | RuntimeMs | SparkStructuredStreamingRunner | 1752.57 |
1654.56 | -5.59 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_sql_batch | RuntimeMs | DataflowRunner | 130514.43 | 129487.22 |
-0.79 | [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_sql_batch | RuntimeMs | DirectRunner | 105062.79 | 98681.22 | -6.07
| [[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_batch | RuntimeMs | SparkRunner | 2941.93 | 2696.06 | -8.36 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_7_sql_batch | RuntimeMs | SparkStructuredStreamingRunner | 3294.46 |
3112.61 | -5.52 | [[1]](http://metrics.beam.apache.org/d/tkqc0AdGk)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_streaming | RuntimeMs | DataflowRunner | 1079622.32 | 1090564.28
| 1.01 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_streaming | RuntimeMs | DirectRunner | 119469.39 | 112691.67 |
-5.67 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_sql_streaming | RuntimeMs | FlinkRunner | 4861.61 | 4374.0 | -10.03
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_streaming | RuntimeMs | DataflowRunner | 103527.18 | 102624.17 |
-0.87 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_streaming | RuntimeMs | DirectRunner | 9021.04 | 8615.28 | -4.5 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_7_streaming | RuntimeMs | FlinkRunner | 12588.89 | 11023.72 | -12.43 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_batch | RuntimeMs | DataflowRunner | 60753.86 | 57102.89 | -6.01 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_8_batch | RuntimeMs | DirectRunner | 1783.25 | 1731.17 | -2.92 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_8_batch | RuntimeMs | FlinkRunner | 702.14 | 597.11 | -14.96 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_8_batch | RuntimeMs | SparkRunner | 479.64 | 451.61 | -5.84 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_8_batch | RuntimeMs | SparkStructuredStreamingRunner | 450.14 | 450.56
| 0.09 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_8_streaming | RuntimeMs | DataflowRunner | 43232.79 | 42592.0 | -1.48
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_streaming | RuntimeMs | DirectRunner | 2882.14 | 2735.72 | -5.08 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_8_streaming | RuntimeMs | FlinkRunner | 523.04 | 504.17 | -3.61 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_batch | RuntimeMs | DataflowRunner | 54895.39 | 42666.33 | -22.28 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_9_batch | RuntimeMs | DirectRunner | 813.11 | 794.17 | -2.33 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_9_batch | RuntimeMs | FlinkRunner | 389.96 | 361.56 | -7.28 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_9_batch | RuntimeMs | SparkRunner | 242.86 | 225.56 | -7.12 |
[[1]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[2]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_9_batch | RuntimeMs | SparkStructuredStreamingRunner | 200.11 | 188.17
| -5.97 | [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
[[2]](http://metrics.beam.apache.org/d/f0Q6T0dGk)
[[3]](http://metrics.beam.apache.org/d/tkqc0AdGk)
nexmark_9_streaming | RuntimeMs | DataflowRunner | 31714.18 | 31727.39 | 0.04
| [[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_streaming | RuntimeMs | DirectRunner | 779.5 | 729.28 | -6.44 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)
nexmark_9_streaming | RuntimeMs | FlinkRunner | 471.93 | 436.94 | -7.41 |
[[1]](http://metrics.beam.apache.org/d/ahudA_zGz)