You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "LuGuangming (via GitHub)" <gi...@apache.org> on 2026/04/02 12:47:26 UTC
Re: [PR] [fix](cloud) fix CloudMode Stream load occasionally fails [doris]
LuGuangming commented on PR #61906:
URL: https://github.com/apache/doris/pull/61906#issuecomment-4177628135
> I can not understand how it happens.
1. 当执行stream load任务时,会不断调用memtable flush方法
2. Doris的segment在OBS/S3上创建后会关闭文件流,紧接着memtable flush开始访问OBS/S3上的segment并把数据同步到OBS/S3上的segment文件里
3. segment创建后,对应的文件流关闭过程是异步的,较小的概率会导致文件流还未完全关闭,memtable flush去访问OBS/S3上的segment,由于找不到segment导致stream load任务偶现报错。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org