[jira] [Comment Edited] (FLINK-19065) java.lang.IllegalStateException: Auto generated UIDs have been disabled on join

["Maris (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLINK-19065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17186379#comment-17186379 ] 

Maris edited comment on FLINK-19065 at 8/28/20, 8:27 AM:
---------------------------------------------------------

execution plan:
{code:java}
{
 "nodes" : [ {
 "id" : 1,
 "type" : "Source: a",
 "pact" : "Data Source",
 "contents" : "Source: a",
 "parallelism" : 1
 }, {
 "id" : 2,
 "type" : "Source: b",
 "pact" : "Data Source",
 "contents" : "Source: b",
 "parallelism" : 1
 }, {
 "id" : 3,
 "type" : "Map",
 "pact" : "Operator",
 "contents" : "Map",
 "parallelism" : 1,
 "predecessors" : [ {
 "id" : 1,
 "ship_strategy" : "FORWARD",
 "side" : "second"
 } ]
 }, {
 "id" : 4,
 "type" : "Map",
 "pact" : "Operator",
 "contents" : "Map",
 "parallelism" : 1,
 "predecessors" : [ {
 "id" : 2,
 "ship_strategy" : "FORWARD",
 "side" : "second"
 } ]
 }, {
 "id" : 7,
 "type" : "joined",
 "pact" : "Operator",
 "contents" : "joined",
 "parallelism" : 16,
 "predecessors" : [ {
 "id" : 3,
 "ship_strategy" : "HASH",
 "side" : "second"
 }, {
 "id" : 4,
 "ship_strategy" : "HASH",
 "side" : "second"
 } ]
 }, {
 "id" : 8,
 "type" : "Sink: ab",
 "pact" : "Data Sink",
 "contents" : "Sink: ab",
 "parallelism" : 16,
 "predecessors" : [ {
 "id" : 7,
 "ship_strategy" : "FORWARD",
 "side" : "second"
 } ]
 } ]
}
{code}


was (Author: fr3akx):
execution plan:

{code}

{
 "nodes" : [ {
 "id" : 1,
 "type" : "Source: a",
 "pact" : "Data Source",
 "contents" : "Source: a",
 "parallelism" : 1aming.gamescavenger.JoinSpec 0s
 }, {
 "id" : 2,
 "type" : "Source: b",
 "pact" : "Data Source",
 "contents" : "Source: b",
 "parallelism" : 1
 }, {
 "id" : 3,
 "type" : "Map",
 "pact" : "Operator",
 "contents" : "Map",
 "parallelism" : 1,
 "predecessors" : [ {
 "id" : 1,
 "ship_strategy" : "FORWARD",
 "side" : "second"
 } ]
 }, {
 "id" : 4,
 "type" : "Map",
 "pact" : "Operator",
 "contents" : "Map",
 "parallelism" : 1,
 "predecessors" : [ {
 "id" : 2,
 "ship_strategy" : "FORWARD",
 "side" : "second"
 } ]
 }, {
 "id" : 7,
 "type" : "joined",
 "pact" : "Operator",
 "contents" : "joined",
 "parallelism" : 16,
 "predecessors" : [ {
 "id" : 3,
 "ship_strategy" : "HASH",
 "side" : "second"
 }, {
 "id" : 4,
 "ship_strategy" : "HASH",
 "side" : "second"
 } ]
 }, {
 "id" : 8,
 "type" : "Sink: ab",
 "pact" : "Data Sink",
 "contents" : "Sink: ab",
 "parallelism" : 16,
 "predecessors" : [ {
 "id" : 7,
 "ship_strategy" : "FORWARD",
 "side" : "second"
 } ]
 } ]
}
{code}

> java.lang.IllegalStateException: Auto generated UIDs have been disabled on join
> -------------------------------------------------------------------------------
>
>                 Key: FLINK-19065
>                 URL: https://issues.apache.org/jira/browse/FLINK-19065
>             Project: Flink
>          Issue Type: Bug
>          Components: API / DataStream
>    Affects Versions: 1.11.0, 1.11.1
>            Reporter: Maris
>            Priority: Major
>
> Join operation with AutoGeneratedUID disabled leads to 
> {code:java}
> java.lang.IllegalStateException: Auto generated UIDs have been disabled but no UID or hash has been assigned to operator Map
> {code}
> code to reproduce
> {code:java}
> class JoinSpec extends AnyFlatSpec with Matchers with Serializable {
>   it should "be able to join streams" in {
>     val env = StreamExecutionEnvironment.getExecutionEnvironment
>     env.getConfig.disableAutoGeneratedUIDs()
>     val a = env.fromCollection(List("1", "2", "3")).name("a").uid("source-uid")
>     val b = env.fromCollection(List("1", "2", "3")).name("b").uid("source-uid2")
>     val c = a
>       .join(b)
>       .where(identity)
>       .equalTo(identity)
>       .window(TumblingProcessingTimeWindows.of(Time.seconds(30)))((a, b) => a+b)
>       .uid("joined").name("joined")
>     c.addSink(s => println(s))
>       .name("ab")
>       .uid("ab")
>     println(env.getExecutionPlan)
>     env.execute
>     succeed
>   }
> }
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)