You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Weijie Guo (Jira)" <ji...@apache.org> on 2022/11/01 03:43:00 UTC

[jira] [Commented] (FLINK-8712) Cannot execute job with multiple slot sharing groups on LocalExecutor

    [ https://issues.apache.org/jira/browse/FLINK-8712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17626944#comment-17626944 ] 

Weijie Guo commented on FLINK-8712:
-----------------------------------

[~mandarmohile] Hi, you should calculate the number of slots your job actually need, and then set the number of TMs and the number of slots for each TM. If there is still a problem in ensuring that the calculation is correct, feel free to paste your code.

> Cannot execute job with multiple slot sharing groups on LocalExecutor
> ---------------------------------------------------------------------
>
>                 Key: FLINK-8712
>                 URL: https://issues.apache.org/jira/browse/FLINK-8712
>             Project: Flink
>          Issue Type: Bug
>          Components: Runtime / Task
>    Affects Versions: 1.5.0
>            Reporter: Till Rohrmann
>            Priority: Not a Priority
>              Labels: auto-deprioritized-critical, auto-deprioritized-major, auto-deprioritized-minor
>
> Currently, it is not possible to run a job with multiple slot sharing groups on the LocalExecutor. The problem is that we determine the number of required slots simply by looking for the max parallelism of the job but do not consider slot sharing groups.
>  
> {code:java}
> // set up the streaming execution environment
> final StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment();
> env.setParallelism(1);
> final DataStreamSource<Integer> input = env.addSource(new InfinitySource());
> final SingleOutputStreamOperator<Integer> different = input.map(new MapFunction<Integer, Integer>() {
>    @Override
>    public Integer map(Integer integer) throws Exception {
>       return integer;
>    }
> }).slotSharingGroup("Different");
> different.print();
> // execute program
> env.execute("Flink Streaming Java API Skeleton");{code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)