You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Nick Dimiduk (JIRA)" <ji...@apache.org> on 2016/01/11 22:28:40 UTC
[jira] [Commented] (FLINK-2551) Fix Several Bugs in Input/Output
Formats
[ https://issues.apache.org/jira/browse/FLINK-2551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15092711#comment-15092711 ]
Nick Dimiduk commented on FLINK-2551:
-------------------------------------
bq. The Streaming API does not call {{setInputType}} if a format implements {{InputTypeConfigurable}}.
I just ran into this in a test while using {{LocalCollectionOutputFormat}} in combination with {{DataStream.write}}. The {{write}} method wraps the provided {{OutputFormat}} in a {{FileSinkFunctionByMillis}}, which does not implement {{InputTypeConfigurable}} and does not proxy calls to the delegate {{format}} instance.
[~aljoscha] are you planning to pick up this ticket? Maybe it can be broken into subtasks that can be committed as folks find time?
> Fix Several Bugs in Input/Output Formats
> ----------------------------------------
>
> Key: FLINK-2551
> URL: https://issues.apache.org/jira/browse/FLINK-2551
> Project: Flink
> Issue Type: Bug
> Affects Versions: 0.9
> Reporter: Aljoscha Krettek
> Assignee: Aljoscha Krettek
>
> This is a collection of several things that are wrong (or possibly problematic) in the handling of Input/Output formats.
> The things I have so far:
> - TypeSerializerInputFormat was changed to take a TypeInformation instead of a TypeSerialzer. The javadoc is not updated, however
> - This lead to another bug: When the serializer is created from the TypeInformation it is not given the correct ExecutionConfig from the ExecutionEnvironment and thus custom serializers don't work. (This one, I broke)
> - In BinaryOutputFormat some fields are not declared transient even though they should be
> - The Streaming API does not call {{setInputType}} if a format implements {{InputTypeConfigurable}}.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)