You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Łukasz Gajowy (JIRA)" <ji...@apache.org> on 2018/05/30 12:03:00 UTC
[jira] [Updated] (BEAM-4430) Improve Performance Testing
Documentation
[ https://issues.apache.org/jira/browse/BEAM-4430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Łukasz Gajowy updated BEAM-4430:
--------------------------------
Description:
Currently, the only documentation regarding IO Performance Testing can be found here: [https://beam.apache.org/documentation/io/testing/#i-o-transform-integration-tests]. This is certainly not enough given that the performance testing framework currently allows to run tests:
- on local or hdfs filesystems
- on direct or dataflow runners
- manually using integrationTest task
- automatically using performanceTest task
- using pkb.py tool directly (PerfKitBenchmarker)
- on demand from pending Pull Requests
- detecting anomallies
- gathering results in dashboards
All the above bullets (and maybe others - to be investigated) need more explanation in the docs to make the Performance Testing Framework usable by the broader community.
was:
Currently, the only documentation regarding IO Performance Testing can be found here: [https://beam.apache.org/documentation/io/testing/#i-o-transform-integration-tests]. This is certainly not enough given that the performance testing framework currently allows to run tests:
- on local or hdfs filesystems
- on direct or dataflow runners
- manually using integrationTest task
- automatically using performanceTest task
- using pkb.py tool directly (PerfKitBenchmarker)
- on demand from pending Pull Requests
All the above bullets (and maybe others - to be investigated) need more explanation in the docs to make the Performance Testing Framework usable by the broader community.
> Improve Performance Testing Documentation
> -----------------------------------------
>
> Key: BEAM-4430
> URL: https://issues.apache.org/jira/browse/BEAM-4430
> Project: Beam
> Issue Type: Wish
> Components: testing
> Reporter: Łukasz Gajowy
> Assignee: Łukasz Gajowy
> Priority: Critical
>
> Currently, the only documentation regarding IO Performance Testing can be found here: [https://beam.apache.org/documentation/io/testing/#i-o-transform-integration-tests]. This is certainly not enough given that the performance testing framework currently allows to run tests:
> - on local or hdfs filesystems
> - on direct or dataflow runners
> - manually using integrationTest task
> - automatically using performanceTest task
> - using pkb.py tool directly (PerfKitBenchmarker)
> - on demand from pending Pull Requests
> - detecting anomallies
> - gathering results in dashboards
> All the above bullets (and maybe others - to be investigated) need more explanation in the docs to make the Performance Testing Framework usable by the broader community.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)