You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/01/16 10:55:26 UTC
[jira] [Commented] (BEAM-1273) Error with FlinkPipelineOptions
serialization after setStateBackend
[ https://issues.apache.org/jira/browse/BEAM-1273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15823769#comment-15823769 ]
ASF GitHub Bot commented on BEAM-1273:
--------------------------------------
GitHub user xhumanoid opened a pull request:
https://github.com/apache/beam/pull/1779
[BEAM-1273] Error with FlinkPipelineOptions serialization after setStateBackend
Because value of StateBackend required only on stage setup stream environment we don't need serialize his.
Other problem: implementations of AbstractStateBackend can't be serialize-deserialize because can't pass Serializer.ensureSerializable. On deserialization step of validation we try read serialized value like type defined in interface.
ProxyInvocationHandler.java:706
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/xhumanoid/incubator-beam BEAM-1273-FlinkPipelineOptions-serialization-problem
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/beam/pull/1779.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1779
----
commit 360f58d8bf00d35c57abea902d86f5a48e965ac2
Author: Alexey Diomin <di...@gmail.com>
Date: 2017-01-16T10:46:08Z
[BEAM-1273] Error with FlinkPipelineOptions serialization after setStateBackend
----
> Error with FlinkPipelineOptions serialization after setStateBackend
> -------------------------------------------------------------------
>
> Key: BEAM-1273
> URL: https://issues.apache.org/jira/browse/BEAM-1273
> Project: Beam
> Issue Type: Bug
> Components: runner-flink
> Reporter: Alexey Diomin
> Assignee: Alexey Diomin
>
> Trying setup FlinkPipelineOptions.setStateBackend cause error:
> {code}
> Caused by: com.fasterxml.jackson.databind.JsonMappingException: Can not construct instance of org.apache.flink.runtime.state.AbstractStateBackend: abstract types either need to be mapped to concrete types, have custom deserializer, or contain additional type information.
> {code}
> Exception was thrown in SerializedPipelineOptions.
> Main problem then AbstractStateBackend and their implementation can't be mapped in JSON schema for serialization.
> Error starting after:
> [BEAM-617][flink] introduce option to set state backend
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)