You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Jürgen Kreileder (Jira)" <ji...@apache.org> on 2020/01/19 10:17:00 UTC

[jira] [Comment Edited] (FLINK-15634) disableAutoGeneratedUIDs fails with coGroup and join

    [ https://issues.apache.org/jira/browse/FLINK-15634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018676#comment-17018676 ] 

Jürgen Kreileder edited comment on FLINK-15634 at 1/19/20 10:16 AM:
--------------------------------------------------------------------

No, it's not – see the code from my first comment. Tested with release-1.10 branch as of 2020-01-16.


was (Author: jkreileder):
No, it's not – see the code from my first comment. Tested with release-1.10 branch as of 2020-01-19.

> disableAutoGeneratedUIDs fails with coGroup and join
> ----------------------------------------------------
>
>                 Key: FLINK-15634
>                 URL: https://issues.apache.org/jira/browse/FLINK-15634
>             Project: Flink
>          Issue Type: Bug
>          Components: API / DataStream
>    Affects Versions: 1.10.0
>            Reporter: Jürgen Kreileder
>            Priority: Major
>
> coGroup/join seems to generate two Map operators for which you can't set the UID. 
> Here's a test case:
> {code:java}
> @Test
> public void testDisablingAutoUidsWorksWithCoGroup() throws Exception {
>    StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment();
>    env.getConfig().disableAutoGeneratedUIDs();
>    env
>       .addSource(new NoOpSourceFunction()).setUidHash("aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa")
>       .coGroup(env.addSource(new NoOpSourceFunction()).setUidHash("bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"))
>       .where(o -> o).equalTo(o -> o)
>       .window(TumblingEventTimeWindows.of(Time.days(1)))
>       .with(new CoGroupFunction<String, String, Object>() {
>          @Override
>          public void coGroup(Iterable<String> first, Iterable<String> second, Collector<Object> out) throws Exception {
>          }
>       }).setUidHash("cccccccccccccccccccccccccccccccc")
>       .addSink(new DiscardingSink<>()).setUidHash("dddddddddddddddddddddddddddddddd");
>    env.execute();
> }
> {code}
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)