You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/01/16 10:55:26 UTC

[jira] [Commented] (BEAM-1273) Error with FlinkPipelineOptions serialization after setStateBackend

    [ https://issues.apache.org/jira/browse/BEAM-1273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15823769#comment-15823769 ] 

ASF GitHub Bot commented on BEAM-1273:
--------------------------------------

GitHub user xhumanoid opened a pull request:

    https://github.com/apache/beam/pull/1779

    [BEAM-1273] Error with FlinkPipelineOptions serialization after setStateBackend

    Because value of StateBackend required only on stage setup stream environment we don't need serialize his. 
    
    Other problem: implementations of AbstractStateBackend can't be serialize-deserialize because can't pass Serializer.ensureSerializable. On deserialization step of validation we try read serialized value like type defined in interface.
    
    ProxyInvocationHandler.java:706
    


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/xhumanoid/incubator-beam BEAM-1273-FlinkPipelineOptions-serialization-problem

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/beam/pull/1779.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #1779
    
----
commit 360f58d8bf00d35c57abea902d86f5a48e965ac2
Author: Alexey Diomin <di...@gmail.com>
Date:   2017-01-16T10:46:08Z

    [BEAM-1273] Error with FlinkPipelineOptions serialization after setStateBackend

----


> Error with FlinkPipelineOptions serialization after setStateBackend
> -------------------------------------------------------------------
>
>                 Key: BEAM-1273
>                 URL: https://issues.apache.org/jira/browse/BEAM-1273
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-flink
>            Reporter: Alexey Diomin
>            Assignee: Alexey Diomin
>
> Trying setup FlinkPipelineOptions.setStateBackend cause error:
> {code}
> Caused by: com.fasterxml.jackson.databind.JsonMappingException: Can not construct instance of org.apache.flink.runtime.state.AbstractStateBackend: abstract types either need to be mapped to concrete types, have custom deserializer, or contain additional type information.
> {code}
> Exception was thrown in SerializedPipelineOptions.
> Main problem then AbstractStateBackend and their implementation can't be mapped in JSON schema for serialization.
> Error starting after:
> [BEAM-617][flink] introduce option to set state backend



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)