You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Thomas Weise (JIRA)" <ji...@apache.org> on 2018/12/01 03:11:00 UTC
[jira] [Commented] (BEAM-5167) Use concurrency information from SDK
Harness in Flink Portable Runner
[ https://issues.apache.org/jira/browse/BEAM-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16705594#comment-16705594 ]
Thomas Weise commented on BEAM-5167:
------------------------------------
The issue can be reproduced by running wordcount in *batch mode* with embedded Flink with --parallelism=8 --experiments=worker_threads=8
Changing to --parallelism=8 --experiments=worker_threads=12 allows the pipeline to complete.
Streaming mode does not exhibit the same problem.
> Use concurrency information from SDK Harness in Flink Portable Runner
> ---------------------------------------------------------------------
>
> Key: BEAM-5167
> URL: https://issues.apache.org/jira/browse/BEAM-5167
> Project: Beam
> Issue Type: New Feature
> Components: runner-flink
> Reporter: Ankur Goenka
> Assignee: Ankur Goenka
> Priority: Major
>
> Based on the discussion [https://lists.apache.org/thread.html/0cbf73d696e0d3a5bb8e93618ac9d6bb81daecf2c9c8e11ee220c8ae@%3Cdev.beam.apache.org%3E]
> Use SDK Harness concurrency information in Flink runner to schedule bundles.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)