You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2018/05/06 02:04:00 UTC
[jira] [Work logged] (BEAM-4038) Support Kafka Headers in KafkaIO
[ https://issues.apache.org/jira/browse/BEAM-4038?focusedWorklogId=98761&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-98761 ]
ASF GitHub Bot logged work on BEAM-4038:
----------------------------------------
Author: ASF GitHub Bot
Created on: 06/May/18 02:03
Start Date: 06/May/18 02:03
Worklog Time Spent: 10m
Work Description: gkumar7 opened a new pull request #5287: [BEAM-4038] Support writing ProducerRecords to Kafka
URL: https://github.com/apache/beam/pull/5287
Add support to write ```ProducerRecords``` to Kafka, works for previous Kafka versions as well. @rangadi, I thought it would be beneficial to share these initial changes. If the approach seems good, I will refactor and add test cases. Following are the additional changes which need to be done:
- [ ] Remove code duplication in ```ProducerRecordCoder``` and ```ProducerRecordWriter```.
- [ ] Add checks for timestamp.
- this may not be necessary as Kafka versions before 0.10.1.0 are deprecated and timestamps were already added in this version [(KAFKA-2511)](https://issues.apache.org/jira/browse/KAFKA-2511). On the other hand, if this is required, as part of these changes, I would also like to remove ```KafkaTimestampType```.
- [ ] Make similar changes to ```KafkaExactlyOnceSink``` to write ```ProducerRecords```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 98761)
Time Spent: 9h 20m (was: 9h 10m)
> Support Kafka Headers in KafkaIO
> --------------------------------
>
> Key: BEAM-4038
> URL: https://issues.apache.org/jira/browse/BEAM-4038
> Project: Beam
> Issue Type: New Feature
> Components: io-java-kafka
> Reporter: Geet Kumar
> Assignee: Geet Kumar
> Priority: Major
> Fix For: 2.5.0
>
> Time Spent: 9h 20m
> Remaining Estimate: 0h
>
> Headers have been added to Kafka Consumer/Producer records (KAFKA-4208). The purpose of this JIRA is to support this feature in KafkaIO.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)