You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Stephen Sisk (JIRA)" <ji...@apache.org> on 2017/07/21 16:17:00 UTC
[jira] [Created] (BEAM-2654) io-it-suite profile: support ability
to use other runners
Stephen Sisk created BEAM-2654:
----------------------------------
Summary: io-it-suite profile: support ability to use other runners
Key: BEAM-2654
URL: https://issues.apache.org/jira/browse/BEAM-2654
Project: Beam
Issue Type: Improvement
Components: testing
Reporter: Stephen Sisk
Currently, we do not have the ability to run integration tests on clusters of > 1 node using any runners other than dataflow. So we currently do not support the ability to invoke them in io-it-suite.
Once we can run the integration tests on clusters of > 1 node, we'll want to be able to run the IO ITs on them. That involves:
1. In the io-it-suite profiles, we should have a runner flag or something like it to allow choosing a runner
2. Add support for them in dpb_service in PerfKit Benchmarker - flesh out dpb_service and beam_integration_benchmark for the newly supported runners.
While we are building this, we should improve the mechanism by which we invoke the direct runner in io-it-suite. Currently, we use forceDirectRunner, which is a maven property that overrides the runner options/profiles to be added to the mvn invocation of io-it. We'll need to talk to the pkb team about how we should better support this since we'll need to make a modification on their side.
cc [~iemejia] [~jasonkuster]
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)