You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Ahmet Altay (JIRA)" <ji...@apache.org> on 2019/08/03 01:23:00 UTC
[jira] [Created] (BEAM-7888) Test Multi Process Direct Runner With
Largish Data
Ahmet Altay created BEAM-7888:
---------------------------------
Summary: Test Multi Process Direct Runner With Largish Data
Key: BEAM-7888
URL: https://issues.apache.org/jira/browse/BEAM-7888
Project: Beam
Issue Type: Bug
Components: sdk-py-core
Reporter: Ahmet Altay
Assignee: Hannah Jiang
Filing this as a tracker.
We can test multiprocess runner with a largish amount of data to the extend that we can do this on Jenkins. This will serve 2 purposes:
- Find out issues related to multi processing. It would be easier to find rare issues when running over non-trivial data.
- Serve as a baseline (if not a benchmark) to understand the limits of the multiprocess runner.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)