You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Aljoscha Krettek (JIRA)" <ji...@apache.org> on 2017/04/18 15:55:41 UTC
[jira] [Created] (FLINK-6323) Add new Sink interface with access to
more meta data
Aljoscha Krettek created FLINK-6323:
---------------------------------------
Summary: Add new Sink interface with access to more meta data
Key: FLINK-6323
URL: https://issues.apache.org/jira/browse/FLINK-6323
Project: Flink
Issue Type: Improvement
Components: DataStream API
Reporter: Aljoscha Krettek
The current {{SinkFunction}} cannot access the timestamps of elements which resulted in the (somewhat hacky) {{FlinkKafkaProducer010}}. Due to other limitations {{GenericWriteAheadSink}} is currently also a {{StreamOperator}} and not a {{SinkFunction}}.
We should add a new interface for sinks that takes a context parameter, similar to {{ProcessFunction}}. This will allow sinks to query additional meta data about the element that they're receiving.
This is one ML thread where a user ran into a problem caused by this: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Why-I-am-getting-Null-pointer-exception-while-accessing-RuntimeContext-in-FlinkKafkaProducer010-td12633.html#a12635
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)