[jira] [Created] (FLINK-20060) Add a Collector to KinsesisDeserializationSchema

["Timo Walther (Jira)" <ji...@apache.org>]

Timo Walther created FLINK-20060:
------------------------------------

             Summary: Add a Collector to KinsesisDeserializationSchema
                 Key: FLINK-20060
                 URL: https://issues.apache.org/jira/browse/FLINK-20060
             Project: Flink
          Issue Type: New Feature
          Components: Connectors / Kinesis
            Reporter: Timo Walther


We did not add support for a collector in the KinesisDeserializationSchema.

The problem with that connector lays in the threading model, where there is a pool of threads that read and deserialize records and then they handover the deserialized messages through a queue to the main thread. The problem is that we would need to create many temporary collections to put the deserialized records into the handover queue, which potentially would significantly affect performance, especially in the usual case of deserializing a single record from a single message.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)