You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Matthias Pohl (Jira)" <ji...@apache.org> on 2023/11/09 16:59:00 UTC
[jira] [Closed] (FLINK-33476) join table throw Record is too big Exception
[ https://issues.apache.org/jira/browse/FLINK-33476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matthias Pohl closed FLINK-33476.
---------------------------------
Resolution: Won't Fix
[~zhuyinjun] Unfortunately, I don't have an answer to your question. It's not my field of expertise. Please use the [user mailing list|https://flink.apache.org/what-is-flink/community/#mailing-lists] for questions like that. It's more likely to get an answer there than to ping individuals. Jira is preferably used for actual bugs or improvements.
I'm closing this issue as it doesn't seem to cover an actual bug.
> join table throw Record is too big Exception
> --------------------------------------------
>
> Key: FLINK-33476
> URL: https://issues.apache.org/jira/browse/FLINK-33476
> Project: Flink
> Issue Type: New Feature
> Reporter: zhu
> Priority: Major
>
> When I join a table, Flink throws a record too big Exception. What parameters should I configure to solve this problem
>
> Caused by: java.io.IOException: Record is too big, it can't be added to a empty InMemoryBuffer! Record size: 1163764, Buffer: 0
> at org.apache.flink.table.runtime.util.ResettableExternalBuffer.throwTooBigException(ResettableExternalBuffer.java:193)
> at org.apache.flink.table.runtime.util.ResettableExternalBuffer.add(ResettableExternalBuffer.java:149)
> at org.apache.flink.table.runtime.operators.join.SortMergeJoinIterator.bufferMatchingRows(SortMergeJoinIterator.java:118)
> at org.apache.flink.table.runtime.operators.join.SortMergeOneSideOuterJoinIterator.nextOuterJoin(SortMergeOneSideOuterJoinIterator.java:88)
> at org.apache.flink.table.runtime.operators.join.SortMergeJoinOperator.oneSideOuterJoin(SortMergeJoinOperator.java:413)
> at org.apache.flink.table.runtime.operators.join.SortMergeJoinOperator.doSortMergeJoin(SortMergeJoinOperator.java:298)
> at org.apache.flink.table.runtime.operators.join.SortMergeJoinOperator.endInput(SortMergeJoinOperator.java:248)
> at org.apache.flink.table.runtime.operators.multipleinput.TableOperatorWrapper.endOperatorInput(TableOperatorWrapper.java:124)
> at org.apache.flink.table.runtime.operators.multipleinput.TableOperatorWrapper.propagateEndOperatorInput(TableOperatorWrapper.java:136)
> at org.apache.flink.table.runtime.operators.multipleinput.TableOperatorWrapper.endOperatorInput(TableOperatorWrapper.java:130)
> at org.apache.flink.table.runtime.operators.multipleinput.TableOperatorWrapper.propagateEndOperatorInput(TableOperatorWrapper.java:136)
> at org.apache.flink.table.runtime.operators.multipleinput.TableOperatorWrapper.endOperatorInput(TableOperatorWrapper.java:122)
> at org.apache.flink.table.runtime.operators.multipleinput.TableOperatorWrapper.propagateEndOperatorInput(TableOperatorWrapper.java:136)
> at org.apache.flink.table.runtime.operators.multipleinput.TableOperatorWrapper.endOperatorInput(TableOperatorWrapper.java:122)
> at org.apache.flink.table.runtime.operators.multipleinput.BatchMultipleInputStreamOperator.endInput(BatchMultipleInputStreamOperator.java:56)
> at org.apache.flink.streaming.runtime.tasks.StreamOperatorWrapper.endOperatorInput(StreamOperatorWrapper.java:98)
> at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.endInput(RegularOperatorChain.java:97)
> at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:68)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)