You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Jozef Vilcek (Jira)" <ji...@apache.org> on 2020/01/27 10:30:00 UTC
[jira] [Commented] (FLINK-15773) ClosureCleaner fails with joda
DateTimeZone
[ https://issues.apache.org/jira/browse/FLINK-15773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17024222#comment-17024222 ]
Jozef Vilcek commented on FLINK-15773:
--------------------------------------
I am not sure how this should be fixed. Not familiar with closure cleaner, but what is a reason for checking serialization recursively down for each field. Is it not enough that top level class is serializable?
> ClosureCleaner fails with joda DateTimeZone
> -------------------------------------------
>
> Key: FLINK-15773
> URL: https://issues.apache.org/jira/browse/FLINK-15773
> Project: Flink
> Issue Type: Bug
> Components: API / Core
> Affects Versions: 1.9.1
> Reporter: Jozef Vilcek
> Priority: Minor
>
> Flink fails to launch my Apache Beam job which uses windowing function with time zone. Closure cleaner reports time zone as not serializable. Part of stack trace:
>
> {noformat}
> org.joda.time.tz.DateTimeZoneBuilder$OfYear@3b035d0c is not serializable. The object probably contains or references non serializable fields.
> org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:151)
> org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:126)
> org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:126)
> org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:126)
> org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:126)
> org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:126)
> org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:126)
> org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:71)
> org.apache.flink.api.java.DataSet.clean(DataSet.java:186)
> org.apache.flink.api.java.DataSet.flatMap(DataSet.java:267)
> ....{noformat}
> Actual instance of DateTimeZone is [PrecalculatedZone|https://github.com/JodaOrg/joda-time/blob/v2.10.5/src/main/java/org/joda/time/tz/DateTimeZoneBuilder.java#L1373] which itself is serializable but it's fields are not necessarily standalone java serializable, because enclosing class it managing their serialization and deserialization.
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)