You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/08/17 09:24:56 UTC

[GitHub] [hudi] Tandoy opened a new issue #3490: [SUPPORT] About using HoodieDeltaStreamer to ingest Kafka data consumption offset setting

Tandoy opened a new issue #3490:
URL: https://github.com/apache/hudi/issues/3490


   **Steps to reproduce the behavior:**
   When I reverted to Kafka to produce new channel data, HoodieDeltaStreamer data can use the latest Kafka, but the original data is not ingested. But what I have set in the configuration file is auto.offset.reset=earliest.
   
   **Expected behavior:**
   Use HoodieDeltaStreamer to ingest Kafka data
   
   **Additional context:**
   I checked the source code and found that KAFKA_AUTO_RESET_OFFSETS = "auto.reset.offsets" was used by default when creating the KafkaOffsetGen class, but the official configuration file kafka-source.properties was auto.offset.reset. If this is a problem, I am willing to try to modify it.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] Tandoy closed issue #3490: [SUPPORT] About using HoodieDeltaStreamer to ingest Kafka data consumption offset setting

Posted by GitBox <gi...@apache.org>.
Tandoy closed issue #3490:
URL: https://github.com/apache/hudi/issues/3490


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org