You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Dawid Wysakowicz (Jira)" <ji...@apache.org> on 2025/05/28 12:40:00 UTC

[jira] [Closed] (FLINK-37829) ChangelogNormalize fails with CURRENT_WATERMARK in the filter condition

     [ https://issues.apache.org/jira/browse/FLINK-37829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dawid Wysakowicz closed FLINK-37829.
------------------------------------
    Fix Version/s: 2.1.0
       Resolution: Fixed

Fixed in e36309a420c4c30ad98026c192881784edc58b7f

> ChangelogNormalize fails with CURRENT_WATERMARK in the filter condition
> -----------------------------------------------------------------------
>
>                 Key: FLINK-37829
>                 URL: https://issues.apache.org/jira/browse/FLINK-37829
>             Project: Flink
>          Issue Type: Bug
>          Components: Table SQL / Runtime
>            Reporter: Dawid Wysakowicz
>            Assignee: Dawid Wysakowicz
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 2.1.0
>
>
> If there is a `CURRENT_WATERMARK` that is pushed into a `ChangelogNormalize` it fails to compile because it lacks the `ctx`
> {code}
> java.lang.RuntimeException: Could not instantiate generated class 'PreFilterCondition$18'
> 	at org.apache.flink.table.runtime.generated.GeneratedClass.newInstance(GeneratedClass.java:74)
> 	at org.apache.flink.table.runtime.operators.deduplicate.ProcTimeDeduplicateKeepLastRowFunction.open(ProcTimeDeduplicateKeepLastRowFunction.java:77)
> 	at org.apache.flink.api.common.functions.util.FunctionUtils.openFunction(FunctionUtils.java:34)
> 	at org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.open(AbstractUdfStreamOperator.java:102)
> 	at org.apache.flink.streaming.api.operators.KeyedProcessOperator.open(KeyedProcessOperator.java:55)
> 	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:115)
> 	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:819)
> 	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:771)
> 	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
> 	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:771)
> 	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:724)
> 	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:1054)
> 	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:1013)
> 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:837)
> 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:651)
> 	at java.base/java.lang.Thread.run(Thread.java:829)
> Caused by: org.apache.flink.util.FlinkRuntimeException: org.apache.flink.api.common.InvalidProgramException: Table program cannot be compiled. This is a bug. Please file an issue.
> 	at org.apache.flink.table.runtime.generated.CompileUtils.compile(CompileUtils.java:94)
> 	at org.apache.flink.table.runtime.generated.GeneratedClass.compile(GeneratedClass.java:101)
> 	at org.apache.flink.table.runtime.generated.GeneratedClass.newInstance(GeneratedClass.java:68)
> 	... 15 more
> Caused by: org.apache.flink.shaded.guava33.com.google.common.util.concurrent.UncheckedExecutionException: org.apache.flink.api.common.InvalidProgramException: Table program cannot be compiled. This is a bug. Please file an issue.
> 	at org.apache.flink.shaded.guava33.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2086)
> 	at org.apache.flink.shaded.guava33.com.google.common.cache.LocalCache.get(LocalCache.java:4017)
> 	at org.apache.flink.shaded.guava33.com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4898)
> 	at org.apache.flink.table.runtime.generated.CompileUtils.compile(CompileUtils.java:92)
> 	... 17 more
> Caused by: org.apache.flink.api.common.InvalidProgramException: Table program cannot be compiled. This is a bug. Please file an issue.
> 	at org.apache.flink.table.runtime.generated.CompileUtils.doCompile(CompileUtils.java:107)
> 	at org.apache.flink.table.runtime.generated.CompileUtils.lambda$compile$0(CompileUtils.java:92)
> 	at org.apache.flink.shaded.guava33.com.google.common.cache.LocalCache$LocalManualCache$1.load(LocalCache.java:4903)
> 	at org.apache.flink.shaded.guava33.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3574)
> 	at org.apache.flink.shaded.guava33.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2316)
> 	at org.apache.flink.shaded.guava33.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2190)
> 	at org.apache.flink.shaded.guava33.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2080)
> 	... 20 more
> Caused by: org.codehaus.commons.compiler.CompileException: Line 49, Column 36: Unknown variable or type "ctx"
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)