You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2021/11/15 07:38:01 UTC
[GitHub] [iceberg] Reo-LEI commented on issue #3551: Flink: Get KryoException when starting a flink job.
Reo-LEI commented on issue #3551:
URL: https://github.com/apache/iceberg/issues/3551#issuecomment-968612700
> Looks like we are trying to serialize the `RowDataWrapper` (which we don't guarantee the serialization ability) in some paths.
Thanks @openinx for step in. I think I encounter this problem on #2898 when flink try to extract the equality fields to distribute the messages. But In #2898 I have been load the RowDataWrapper lazily and still encounter the kryo serialization issues. Maybe there has other reason, but I will trying to reproduce this problem in unittest later.
https://github.com/apache/iceberg/blob/709e0d3501257d1331cb8633ea25c8029da6f5ad/flink/src/main/java/org/apache/iceberg/flink/sink/EqualityFieldKeySelector.java#L73
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org