You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Flink Jira Bot (Jira)" <ji...@apache.org> on 2022/07/07 10:40:00 UTC

[jira] [Updated] (FLINK-14875) Blink planner should pass the right ExecutionConfig to the creation of serializer

     [ https://issues.apache.org/jira/browse/FLINK-14875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Flink Jira Bot updated FLINK-14875:
-----------------------------------
    Labels: auto-deprioritized-major stale-minor  (was: auto-deprioritized-major)

I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help the community manage its development. I see this issues has been marked as Minor but is unassigned and neither itself nor its Sub-Tasks have been updated for 180 days. I have gone ahead and marked it "stale-minor". If this ticket is still Minor, please either assign yourself or give an update. Afterwards, please remove the label or in 7 days the issue will be deprioritized.


> Blink planner should pass the right ExecutionConfig to the creation of serializer
> ---------------------------------------------------------------------------------
>
>                 Key: FLINK-14875
>                 URL: https://issues.apache.org/jira/browse/FLINK-14875
>             Project: Flink
>          Issue Type: Bug
>          Components: Table SQL / Runtime
>            Reporter: Jing Zhang
>            Priority: Minor
>              Labels: auto-deprioritized-major, stale-minor
>         Attachments: ImmutableCollectionKryoDeserializerITCase.java
>
>
> If source contains data which has immutable collection, the exception will be thrown out:
> {code:java}
> Caused by: com.esotericsoftware.kryo.KryoException: java.lang.UnsupportedOperationException
> Serialization trace:
> logTags_ (com.aliyun.openservices.log.common.Logs$LogGroup)
> mLogGroup (com.aliyun.openservices.log.common.LogGroupData)
> 	at com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:125)
> 	at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:528)
> 	at com.esotericsoftware.kryo.Kryo.readObjectOrNull(Kryo.java:730)
> 	at com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:113)
> 	at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:528)
> 	at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:761)
> 	at org.apache.flink.api.java.typeutils.runtime.kryo.KryoSerializer.deserialize(KryoSerializer.java:315)
> 	at org.apache.flink.api.common.typeutils.base.ListSerializer.deserialize(ListSerializer.java:138)
> 	at org.apache.flink.api.common.typeutils.base.ListSerializer.deserialize(ListSerializer.java:47)
> 	at org.apache.flink.util.InstantiationUtil.deserializeFromByteArray(InstantiationUtil.java:463)
> 	at org.apache.flink.table.dataformat.BinaryRow.getGeneric(BinaryRow.java:440)
> 	at BaseRowSerializerProjection$52.apply(Unknown Source)
> 	at BaseRowSerializerProjection$52.apply(Unknown Source)
> 	at org.apache.flink.table.typeutils.BaseRowSerializer.baseRowToBinary(BaseRowSerializer.java:250)
> 	at org.apache.flink.table.typeutils.BaseRowSerializer.serializeToPages(BaseRowSerializer.java:285)
> 	at org.apache.flink.table.typeutils.BaseRowSerializer.serializeToPages(BaseRowSerializer.java:55)
> 	at org.apache.flink.table.runtime.sort.BinaryInMemorySortBuffer.write(BinaryInMemorySortBuffer.java:190)
> 	at org.apache.flink.table.runtime.sort.BinaryExternalSorter.write(BinaryExternalSorter.java:540)
> 	... 10 more
> Caused by: java.lang.UnsupportedOperationException
> 	at java.util.Collections$UnmodifiableCollection.add(Collections.java:1055)
> 	at com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:109)
> 	at com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:22)
> 	at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:679)
> 	at com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:106)
> 	... 27 more
> {code}
> the exception could also appears in a simple ITCase in attachments.
> I find similar problems in [How to set Unmodifiable collection serializer of Kryo in Spark code|https://stackoverflow.com/questions/46818293/how-to-set-unmodifiable-collection-serializer-of-kryo-in-spark-code], is there any way to set unmodifiable collection serializer of Kryo in at present? 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)