[jira] [Commented] (FLINK-35117) AsyncScalarFunction has a dependency issue.

["Xuyang Zhong (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLINK-35117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17936128#comment-17936128 ] 

Xuyang Zhong commented on FLINK-35117:
--------------------------------------

Hi, [~saurabh9588] are you still interested in this bug? 

> AsyncScalarFunction has a dependency issue.
> -------------------------------------------
>
>                 Key: FLINK-35117
>                 URL: https://issues.apache.org/jira/browse/FLINK-35117
>             Project: Flink
>          Issue Type: Bug
>          Components: Table SQL / Planner
>    Affects Versions: 1.19.0
>         Environment: image: 1.19.0-scala_2.12-java11
>            Reporter: roland
>            Priority: Major
>              Labels: easyfix
>
> Hi,
>  
> I found a ClassNotFound exception when using Flink 1.19's AsyncScalarFunction. 
>  
> *Stack trace:*
>  
> {quote}Caused by: java.lang.ClassNotFoundException: org.apache.commons.text.StringSubstitutor
> at java.net.URLClassLoader.findClass(Unknown Source) ~[?:?]
> at java.lang.ClassLoader.loadClass(Unknown Source) ~[?:?]
> at org.apache.flink.core.classloading.ComponentClassLoader.loadClassFromComponentOnly(ComponentClassLoader.java:150) ~[flink-dist-1.19.0.jar:1.19.0]
> at org.apache.flink.core.classloading.ComponentClassLoader.loadClass(ComponentClassLoader.java:113) ~[flink-dist-1.19.0.jar:1.19.0]
> at java.lang.ClassLoader.loadClass(Unknown Source) ~[?:?]
> at org.apache.flink.table.planner.codegen.AsyncCodeGenerator.generateProcessCode(AsyncCodeGenerator.java:173) ~[?:?]
> at org.apache.flink.table.planner.codegen.AsyncCodeGenerator.generateFunction(AsyncCodeGenerator.java:77) ~[?:?]
> at org.apache.flink.table.planner.plan.nodes.exec.common.CommonExecAsyncCalc.getAsyncFunctionOperator(CommonExecAsyncCalc.java:146) ~[?:?]
> at org.apache.flink.table.planner.plan.nodes.exec.common.CommonExecAsyncCalc.createAsyncOneInputTransformation(CommonExecAsyncCalc.java:126) ~[?:?]
> at org.apache.flink.table.planner.plan.nodes.exec.common.CommonExecAsyncCalc.translateToPlanInternal(CommonExecAsyncCalc.java:89) ~[?:?]
> at org.apache.flink.table.planner.plan.nodes.exec.ExecNodeBase.translateToPlan(ExecNodeBase.java:168) ~[?:?]
> at org.apache.flink.table.planner.plan.nodes.exec.ExecEdge.translateToPlan(ExecEdge.java:259) ~[?:?]
> at org.apache.flink.table.planner.plan.nodes.exec.common.CommonExecCalc.translateToPlanInternal(CommonExecCalc.java:94) ~[?:?]
> at org.apache.flink.table.planner.plan.nodes.exec.ExecNodeBase.translateToPlan(ExecNodeBase.java:168) ~[?:?]
> at org.apache.flink.table.planner.plan.nodes.exec.ExecEdge.translateToPlan(ExecEdge.java:259) ~[?:?]
> at org.apache.flink.table.planner.plan.nodes.exec.stream.StreamExecSink.translateToPlanInternal(StreamExecSink.java:177) ~[?:?]
> at org.apache.flink.table.planner.plan.nodes.exec.ExecNodeBase.translateToPlan(ExecNodeBase.java:168) ~[?:?]
> at org.apache.flink.table.planner.delegation.StreamPlanner.$anonfun$translateToPlan$1(StreamPlanner.scala:85) ~[?:?]
> {quote}
>  
> *Root cause:*
>  
> `PlannerModule` uses a URLClassloader to load class and has an exceptional list to load owner owned classes:
>  
> {code:java}
> class PlannerModule {
>     /**
>      * The name of the table planner dependency jar, bundled with flink-table-planner-loader module
>      * artifact.
>      */
>     static final String FLINK_TABLE_PLANNER_FAT_JAR = "flink-table-planner.jar";
>     private static final String HINT_USAGE =
>             "mvn clean package -pl flink-table/flink-table-planner,flink-table/flink-table-planner-loader -DskipTests";
>     private static final String[] OWNER_CLASSPATH =
>             Stream.concat(
>                             Arrays.stream(CoreOptions.PARENT_FIRST_LOGGING_PATTERNS),
>                             Stream.of(
>                                     // These packages are shipped either by
>                                     // flink-table-runtime or flink-dist itself
>                                     "org.codehaus.janino",
>                                     "org.codehaus.commons",
>                                     "org.apache.commons.lang3",
>                                     "org.apache.commons.math3",
>                                     // with hive dialect, hadoop jar should be in classpath,
>                                     // also, we should make it loaded by owner classloader,
>                                     // otherwise, it'll throw class not found exception
>                                     // when initialize HiveParser which requires hadoop
>                                     "org.apache.hadoop"))
>                     .toArray(String[]::new);  {code}
> But the group of `org.apache.commons.text` is not on the list.
>  
> *Fix:*
> Add `org.apache.commons.text` to the list



--
This message was sent by Atlassian Jira
(v8.20.10#820010)