You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Jürgen Kreileder (Jira)" <ji...@apache.org> on 2020/01/19 10:17:00 UTC
[jira] [Comment Edited] (FLINK-15634) disableAutoGeneratedUIDs
fails with coGroup and join
[ https://issues.apache.org/jira/browse/FLINK-15634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018676#comment-17018676 ]
Jürgen Kreileder edited comment on FLINK-15634 at 1/19/20 10:16 AM:
--------------------------------------------------------------------
No, it's not – see the code from my first comment. Tested with release-1.10 branch as of 2020-01-16.
was (Author: jkreileder):
No, it's not – see the code from my first comment. Tested with release-1.10 branch as of 2020-01-19.
> disableAutoGeneratedUIDs fails with coGroup and join
> ----------------------------------------------------
>
> Key: FLINK-15634
> URL: https://issues.apache.org/jira/browse/FLINK-15634
> Project: Flink
> Issue Type: Bug
> Components: API / DataStream
> Affects Versions: 1.10.0
> Reporter: Jürgen Kreileder
> Priority: Major
>
> coGroup/join seems to generate two Map operators for which you can't set the UID.
> Here's a test case:
> {code:java}
> @Test
> public void testDisablingAutoUidsWorksWithCoGroup() throws Exception {
> StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment();
> env.getConfig().disableAutoGeneratedUIDs();
> env
> .addSource(new NoOpSourceFunction()).setUidHash("aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa")
> .coGroup(env.addSource(new NoOpSourceFunction()).setUidHash("bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"))
> .where(o -> o).equalTo(o -> o)
> .window(TumblingEventTimeWindows.of(Time.days(1)))
> .with(new CoGroupFunction<String, String, Object>() {
> @Override
> public void coGroup(Iterable<String> first, Iterable<String> second, Collector<Object> out) throws Exception {
> }
> }).setUidHash("cccccccccccccccccccccccccccccccc")
> .addSink(new DiscardingSink<>()).setUidHash("dddddddddddddddddddddddddddddddd");
> env.execute();
> }
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)