You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Martijn Visser (Jira)" <ji...@apache.org> on 2022/01/03 07:23:00 UTC

[jira] [Assigned] (FLINK-25491) Code generation: init method exceeds 64 KB when there is a large IN filter with Table API

     [ https://issues.apache.org/jira/browse/FLINK-25491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Martijn Visser reassigned FLINK-25491:
--------------------------------------

    Assignee: Caizhi Weng

> Code generation: init method exceeds 64 KB when there is a large IN filter with Table API
> -----------------------------------------------------------------------------------------
>
>                 Key: FLINK-25491
>                 URL: https://issues.apache.org/jira/browse/FLINK-25491
>             Project: Flink
>          Issue Type: Bug
>          Components: Table SQL / API, Table SQL / Runtime
>    Affects Versions: 1.14.2
>            Reporter: Daniel Cheng
>            Assignee: Caizhi Weng
>            Priority: Major
>
> When using Table API (Blink planner), if you are filtering using an IN filter with a lot of values, e.g. {{$(colName).in(<many values>)}}, it will result in the error
>  
> {{Code of method "<init>(...)V" of class "BatchExecCal$3006" grows beyond 64 KB}}
>  
> The size of the init method mainly comes from the below method, which initializes the hash set with all the values in the filter.
> addReusableHashSet in CodeGeneratorContext.scala
> [https://github.com/apache/flink/blob/master/flink-table/flink-table-planner/src/main/scala/org/apache/flink/table/planner/codegen/CodeGeneratorContext.scala#L409]
>  
> This affects older versions as well, with 1.14.2 being the latest version that exhibits this issue.
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)