You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Péter Szabó (JIRA)" <ji...@apache.org> on 2015/03/13 14:00:44 UTC

[jira] [Created] (FLINK-1701) Serialization problems with TestStreamEnvironment

Péter Szabó created FLINK-1701:
----------------------------------

             Summary: Serialization problems with TestStreamEnvironment
                 Key: FLINK-1701
                 URL: https://issues.apache.org/jira/browse/FLINK-1701
             Project: Flink
          Issue Type: Bug
          Components: Streaming
            Reporter: Péter Szabó


When mapWindowing a stream of tuples of a custom class with TestStreamEnvironment, serialization of StreamDiscretizer fails in StreamConfig.

[Example here|https://github.com/mbalassi/flink/blob/6682762bca7b08cb87c68ee4b2ee592a5da3479e/flink-staging/flink-streaming/flink-streaming-core/src/test/java/org/apache/flink/streaming/api/DeltaWithCustomClassTest.java]

The same example runs with StreamExecutionEnvironment without any problem. I'm wondering what is the difference.

StackTrace:
java.lang.RuntimeException: Cannot serialize invokable object class org.apache.flink.streaming.api.invokable.operator.windowing.StreamDiscretizer
	at org.apache.flink.streaming.api.StreamConfig.setUserInvokable(StreamConfig.java:173)
	at org.apache.flink.streaming.api.StreamingJobGraphGenerator.setVertexConfig(StreamingJobGraphGenerator.java:213)
	at org.apache.flink.streaming.api.StreamingJobGraphGenerator.createChain(StreamingJobGraphGenerator.java:129)
	at org.apache.flink.streaming.api.StreamingJobGraphGenerator.createChain(StreamingJobGraphGenerator.java:121)
	at org.apache.flink.streaming.api.StreamingJobGraphGenerator.createChain(StreamingJobGraphGenerator.java:116)
	at org.apache.flink.streaming.api.StreamingJobGraphGenerator.createChain(StreamingJobGraphGenerator.java:121)
	at org.apache.flink.streaming.api.StreamingJobGraphGenerator.setChaining(StreamingJobGraphGenerator.java:95)
	at org.apache.flink.streaming.api.StreamingJobGraphGenerator.createJobGraph(StreamingJobGraphGenerator.java:86)
	at org.apache.flink.streaming.api.StreamGraph.getJobGraph(StreamGraph.java:510)
	at org.apache.flink.streaming.util.TestStreamEnvironment.execute(TestStreamEnvironment.java:59)
	at org.apache.flink.streaming.util.TestStreamEnvironment.execute(TestStreamEnvironment.java:54)
	at org.apache.flink.streaming.api.ComplexIntegrationTest.complexIntegrationTest7(ComplexIntegrationTest.java:433)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:160)
	at com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:74)
	at com.intellij.rt.execution.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:211)
	at com.intellij.rt.execution.junit.JUnitStarter.main(JUnitStarter.java:67)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at com.intellij.rt.execution.application.AppMain.main(AppMain.java:134)
Caused by: org.apache.commons.lang3.SerializationException: java.io.NotSerializableException: org.apache.flink.streaming.api.ComplexIntegrationTest
	at org.apache.commons.lang3.SerializationUtils.serialize(SerializationUtils.java:157)
	at org.apache.commons.lang3.SerializationUtils.serialize(SerializationUtils.java:179)
	at org.apache.flink.streaming.api.StreamConfig.setUserInvokable(StreamConfig.java:171)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)