You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Aljoscha Krettek (JIRA)" <ji...@apache.org> on 2016/01/18 16:19:39 UTC

[jira] [Commented] (FLINK-3253) deserializeObject exception on WindowOperator

    [ https://issues.apache.org/jira/browse/FLINK-3253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105419#comment-15105419 ] 

Aljoscha Krettek commented on FLINK-3253:
-----------------------------------------

Hi,
could you please specify what kind of WindowAssigner/Trigger you are using so that I can investigate the problem.

> deserializeObject exception on WindowOperator
> ---------------------------------------------
>
>                 Key: FLINK-3253
>                 URL: https://issues.apache.org/jira/browse/FLINK-3253
>             Project: Flink
>          Issue Type: Bug
>          Components: DataStream API
>    Affects Versions: 0.10.0
>         Environment: flink on yarn, hadoop 2.6
> state backend: hdfs
> jobmanager: high-availability
>            Reporter: godfrey he
>
> It's seem that the data in the WindowOperator can serialize successfully. however deserialize failed when the taskmanager restarted by jobmanager. 
> Root exception
> java.lang.Exception: Could not restore checkpointed state to operators and functions
> 	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateLazy(StreamTask.java:414)
> 	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:208)
> 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:584)
> 	at java.lang.Thread.run(Thread.java:744)
> Caused by: java.io.StreamCorruptedException: invalid type code: 00
> 	at java.io.ObjectInputStream$BlockDataInputStream.readBlockHeader(ObjectInputStream.java:2508)
> 	at java.io.ObjectInputStream$BlockDataInputStream.refill(ObjectInputStream.java:2543)
> 	at java.io.ObjectInputStream$BlockDataInputStream.read(ObjectInputStream.java:2615)
> 	at java.io.DataInputStream.readInt(DataInputStream.java:387)
> 	at java.io.ObjectInputStream$BlockDataInputStream.readInt(ObjectInputStream.java:2820)
> 	at java.io.ObjectInputStream.readInt(ObjectInputStream.java:971)
> 	at java.util.HashMap.readObject(HashMap.java:1158)
> 	at sun.reflect.GeneratedMethodAccessor29.invoke(Unknown Source)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:606)
> 	at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017)
> 	at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1893)
> 	at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)
> 	at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)
> 	at java.io.ObjectInputStream.readObject(ObjectInputStream.java:370)
> 	at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:294)
> 	at org.apache.flink.streaming.runtime.operators.windowing.WindowOperator$Context.<init>(WindowOperator.java:446)
> 	at org.apache.flink.streaming.runtime.operators.windowing.WindowOperator.restoreState(WindowOperator.java:621)
> 	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateLazy(StreamTask.java:406)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)