You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "mingleizhang (JIRA)" <ji...@apache.org> on 2017/06/12 08:33:00 UTC

[jira] [Commented] (FLINK-3387) Replace all ByteArrayOutputStream and DataOutputStream use in State Backends by DataOutputSerializer

    [ https://issues.apache.org/jira/browse/FLINK-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16046328#comment-16046328 ] 

mingleizhang commented on FLINK-3387:
-------------------------------------

I checked the class {{HeapListState}} currently still use {{ByteArrayOutputStream}} as it's serializer. Not VERY sure about the {{SavepointSerializer}} interface and it's concret implementation classes {{SavepointV0Serializer}} , {{SavepointV1Serializer}} and {{SavepointV2Serializer}} whether belongs to state backends or not. I guess it should be though. [~srichter] [~StephanEwen]. Could you take a look at them and check if I have missing about those stuff which still use {{ByteArrayOutputStream}} or {{DataOutputStream}}. It would be great helpful and thanks to you both.

> Replace all ByteArrayOutputStream and DataOutputStream use in State Backends by DataOutputSerializer
> ----------------------------------------------------------------------------------------------------
>
>                 Key: FLINK-3387
>                 URL: https://issues.apache.org/jira/browse/FLINK-3387
>             Project: Flink
>          Issue Type: Bug
>          Components: State Backends, Checkpointing
>    Affects Versions: 1.0.0
>            Reporter: Stephan Ewen
>            Assignee: Subhobrata Dey
>
> Currently, the {{byte[]}} to object conversion and vice versa is always done by creating new byte array streams and Data Input/Output streams. That is pretty wasteful, we can optimize this with Flink's own classes:
>   - {{DataInputSerializer}}
>   - {{DataOutputSerializer}}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)