You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Nico Kruber (Jira)" <ji...@apache.org> on 2020/08/03 07:09:00 UTC

[jira] [Commented] (FLINK-18767) Streaming job stuck when disabling operator chaining

    [ https://issues.apache.org/jira/browse/FLINK-18767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17169769#comment-17169769 ] 

Nico Kruber commented on FLINK-18767:
-------------------------------------

[~zjwang] I actually tried 1.8.2 and it showed the same behaviour (but didn't try any earlier version). Why did you remove that tag?

> Streaming job stuck when disabling operator chaining
> ----------------------------------------------------
>
>                 Key: FLINK-18767
>                 URL: https://issues.apache.org/jira/browse/FLINK-18767
>             Project: Flink
>          Issue Type: Bug
>          Components: Runtime / Network
>    Affects Versions: 1.9.3, 1.10.1, 1.11.1
>            Reporter: Nico Kruber
>            Assignee: Zhijiang
>            Priority: Critical
>
> The following code is stuck sending data from the source to the map operator. Two settings seem to have an influence here: {{env.setBufferTimeout(-1);}} and {{env.disableOperatorChaining();}} - if I remove either of these, the job works as expected.
> (I pre-populated my Kafka topic with one element to reproduce easily)
> {code}
>     StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment();
>     // comment either these two and the job works
>     env.setBufferTimeout(-1);
>     env.disableOperatorChaining(); 
>     Properties properties = new Properties();
>     properties.setProperty("bootstrap.servers", "localhost:9092");
>     properties.setProperty("group.id", "test");
>     FlinkKafkaConsumer<String> consumer = new FlinkKafkaConsumer<>("topic", new SimpleStringSchema(), properties);
>     consumer.setStartFromEarliest();
>     DataStreamSource<String> input = env.addSource(consumer);
>     input
>         .map((x) -> x)
>         .print();
>     env.execute();
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)