You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@doris.apache.org by "HelloPtr (via GitHub)" <gi...@apache.org> on 2025/06/03 07:01:53 UTC
[I] 导入数据只导入了一部分 [doris-streamloader]
HelloPtr opened a new issue, #30:
URL: https://github.com/apache/doris-streamloader/issues/30
./doris-streamloader --source_file=save_doris_tmp.txt --url="http://xxx" --header="column_separator:&?format:csv?max_filter_ratio:0" --db="xxx" --table=xxx --u="ad_data" --p="x@x" --auto_retry_interval=5
INFO[2025-06-03 14:53:13] worker number is 0, which is <= 0, trigger automatic inference. Final worker number is 1 line=doris-streamloader/main.go:328
INFO[2025-06-03 14:53:13] redirect to http:xxxxxxxx/_stream_load? line=loader/stream_loader.go:272
INFO[2025-06-03 14:53:14] resp: {
"TxnId": 10111649,
"Label": "a2fb52b7-db87-4364-9e53-ae4291297a4f",
"Comment": "",
"TwoPhaseCommit": "false",
"Status": "Success",
"Message": "OK",
"NumberTotalRows": 27578,
"NumberLoadedRows": 27578,
"NumberFilteredRows": 0,
"NumberUnselectedRows": 0,
"LoadBytes": 9436958,
"LoadTimeMs": 197,
"BeginTxnTimeMs": 0,
"StreamLoadPutTimeMs": 2,
"ReadDataTimeMs": 10,
"WriteDataTimeMs": 169,
"CommitAndPublishTimeMs": 24
} line=loader/stream_loader.go:294
INFO[2025-06-03 14:53:14] execute worker exit line=loader/stream_loader.go:364
Load Result: {
"Status": "Success",
"TotalRows": 27578,
"FailLoadRows": 0,
"LoadedRows": 27578,
"FilteredRows": 0,
"UnselectedRows": 0,
"LoadBytes": 9436958,
"LoadTimeMs": 209,
"LoadFiles": [
"save_doris_tmp.txt"
]
}
但我的save_doris_tmp.txt 有79751 行,
当我第二次重试的时候,又成功导入了79751行
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@doris.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@doris.apache.org
For additional commands, e-mail: dev-help@doris.apache.org