You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@druid.apache.org by Travis CI <bu...@travis-ci.com> on 2021/01/09 07:28:52 UTC

[CRON] Fixed: apache/druid#29849 (master - 118b501)

Build Update for apache/druid
-------------------------------------

Build: #29849
Status: Fixed

Duration: 8 mins and 44 secs
Commit: 118b501 (master)
Author: Xavier Léauté
Message: Introduce KafkaRecordEntity to support Kafka headers in InputFormats (#10730)

Today Kafka message support in streaming indexing tasks is limited to
message values, and does not provide a way to expose Kafka headers,
timestamps, or keys, which may be of interest to more specialized
Druid input formats. For instance, Kafka headers may be used to indicate
payload format/encoding or additional metadata, and timestamps are often
omitted from values in Kafka streams applications, since they are
included in the record.

This change proposes to introduce KafkaRecordEntity as InputEntity,
which would give input formats full access to the underlying Kafka record,
including headers, key, timestamps. It would also open access to low-level
information such as topic, partition, offset if needed.

KafkaEntity is a subclass of ByteEntity for backwards compatibility with
existing input formats, and to avoid introducing unnecessary complexity
for Kinesis indexing tasks.

View the changeset: https://github.com/apache/druid/compare/2837a9b62fe6ec779bcab837d51ceffadcb83f25...118b50195e5c2989e04e0f5290aa72cae114db39

View the full build log and details: https://travis-ci.com/github/apache/druid/builds/212539528?utm_medium=notification&utm_source=email


--

You can unsubscribe from build emails from the apache/druid repository going to https://travis-ci.com/account/preferences/unsubscribe?repository=16806911&utm_medium=notification&utm_source=email.
Or unsubscribe from *all* email updating your settings at https://travis-ci.com/account/preferences/unsubscribe?utm_medium=notification&utm_source=email.
Or configure specific recipients for build notifications in your .travis.yml file. See https://docs.travis-ci.com/user/notifications.