You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Jordan Moore (JIRA)" <ji...@apache.org> on 2018/01/12 23:25:00 UTC

[jira] [Commented] (NIFI-4487) ConsumerKafka V10&V11 should write Kafka Timestamp attribute

    [ https://issues.apache.org/jira/browse/NIFI-4487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16324720#comment-16324720 ] 

Jordan Moore commented on NIFI-4487:
------------------------------------

I am interested in this ticket for a MirrorMaker-like alternative. 

For producer, would be nice to see the option to use either a timestamp that can come from attributes, or data itself. (But putting a processor ahead of the publish to extract data to add the attribute is okay).

For consumer, extract mentioned metadata and expose as attributes. 

> ConsumerKafka V10&V11 should write Kafka Timestamp attribute
> ------------------------------------------------------------
>
>                 Key: NIFI-4487
>                 URL: https://issues.apache.org/jira/browse/NIFI-4487
>             Project: Apache NiFi
>          Issue Type: Improvement
>          Components: Extensions
>    Affects Versions: 1.4.0, 1.5.0
>            Reporter: Pawel Niezgoda
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> Starting from kafka v10 kafka provides info about message timestamp.
> We should expose that data together with other attributes (like topic, partition, offset).
> We should add:
> @WritesAttribute(attribute = KafkaProcessorUtils.KAFKA_TIMESTAMP, description = "Kafka message timestamp"),
>         @WritesAttribute(attribute = KafkaProcessorUtils.KAFKA_TIMESTAMP_TYPE, description = "Kafka message timestamp type") 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)