You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Rui Fan (Jira)" <ji...@apache.org> on 2022/11/25 10:30:00 UTC
[jira] [Comment Edited] (FLINK-30214) The resource is not enough
[ https://issues.apache.org/jira/browse/FLINK-30214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17638616#comment-17638616 ]
Rui Fan edited comment on FLINK-30214 at 11/25/22 10:29 AM:
------------------------------------------------------------
Hi [~gyfora] , thanks for your quick feedback.
I run a flink job in IDEA, I didn't set any conf for the minicluster. Flink helps user start the minicluster by maximumParallelism of all tasks.
This is my demo: [https://github.com/1996fanrui/flink/commit/52692249c86cbc366f3e5fb54d7744da75586972]
And I have updated the PR, it can fix this bug. In other words: minicluster should adapt {_}jobvertex-parallelism-overrides{_}.
And I will add some tests later.
was (Author: fanrui):
Hi [~gyfora] , thanks for your quick feedback.
I run a flink job in IDEA, I didn't set any conf for the minicluster. Flink helps user start the minicluster by maximumParallelism of all tasks.
This is my demo: [https://github.com/1996fanrui/flink/commit/52692249c86cbc366f3e5fb54d7744da75586972]
And I have updated the PR, it can fix this bug. And I will add some tests later.
> The resource is not enough
> --------------------------
>
> Key: FLINK-30214
> URL: https://issues.apache.org/jira/browse/FLINK-30214
> Project: Flink
> Issue Type: Bug
> Reporter: Rui Fan
> Priority: Major
> Labels: pull-request-available
> Attachments: image-2022-11-25-17-18-36-935.png, image-2022-11-25-17-23-14-208.png
>
>
> When turn up the parallelism, the resources isn't enough for MiniCluster. I'm not sure whether the flink on yarn or k8s is right? I can test later.
>
> I guess the parallelism should be changed in a right place. And we should add more unit test or ITCase to check these cases. And it's my honor to make these improvements and bug fixes.
> !image-2022-11-25-17-18-36-935.png!
>
> !image-2022-11-25-17-23-14-208.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)