You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Jordan Moore (JIRA)" <ji...@apache.org> on 2018/01/12 23:25:00 UTC
[jira] [Commented] (NIFI-4487) ConsumerKafka V10&V11 should write
Kafka Timestamp attribute
[ https://issues.apache.org/jira/browse/NIFI-4487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16324720#comment-16324720 ]
Jordan Moore commented on NIFI-4487:
------------------------------------
I am interested in this ticket for a MirrorMaker-like alternative.
For producer, would be nice to see the option to use either a timestamp that can come from attributes, or data itself. (But putting a processor ahead of the publish to extract data to add the attribute is okay).
For consumer, extract mentioned metadata and expose as attributes.
> ConsumerKafka V10&V11 should write Kafka Timestamp attribute
> ------------------------------------------------------------
>
> Key: NIFI-4487
> URL: https://issues.apache.org/jira/browse/NIFI-4487
> Project: Apache NiFi
> Issue Type: Improvement
> Components: Extensions
> Affects Versions: 1.4.0, 1.5.0
> Reporter: Pawel Niezgoda
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> Starting from kafka v10 kafka provides info about message timestamp.
> We should expose that data together with other attributes (like topic, partition, offset).
> We should add:
> @WritesAttribute(attribute = KafkaProcessorUtils.KAFKA_TIMESTAMP, description = "Kafka message timestamp"),
> @WritesAttribute(attribute = KafkaProcessorUtils.KAFKA_TIMESTAMP_TYPE, description = "Kafka message timestamp type")
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)