You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "BleethNie (via GitHub)" <gi...@apache.org> on 2023/04/28 02:45:08 UTC

[GitHub] [doris] BleethNie commented on issue #19174: [Bug] Kafka 通过 Routine Load 方式写 Doris Bug

BleethNie commented on issue #19174:
URL: https://github.com/apache/doris/issues/19174#issuecomment-1526903102

   > OFFSET_END:系统会自动查找topic对应的所有分区并从 OFFSET_END 开始消费,如果你的kafka没有生产消息进来,那么你的routine load 任务消费也就只有0分区,kafka offset 10 开始消费
   
   我使用的kafka是 aliyun 的kafka集群,从管理平台可以看到,kafka的其它分区都是有数据的(当然我也验证了不是kafka问题,我通过代码方式消费这些分区的数据,所有分区都可以正常消费),并不是只有0号分区有数据,但是只有0号分区数据被消费了,其它分区都是无法消费的,但是将其它分区OFFSET_END修改为0后,则所有分区都可以正常消费


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org