You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@doris.apache.org by "HelloPtr (via GitHub)" <gi...@apache.org> on 2025/06/03 07:01:53 UTC

[I] 导入数据只导入了一部分 [doris-streamloader]

HelloPtr opened a new issue, #30:
URL: https://github.com/apache/doris-streamloader/issues/30

   ./doris-streamloader --source_file=save_doris_tmp.txt --url="http://xxx" --header="column_separator:&?format:csv?max_filter_ratio:0" --db="xxx" --table=xxx --u="ad_data" --p="x@x" --auto_retry_interval=5
   INFO[2025-06-03 14:53:13] worker number is 0, which is <= 0, trigger automatic inference. Final worker number is 1  line=doris-streamloader/main.go:328
   INFO[2025-06-03 14:53:13] redirect to http:xxxxxxxx/_stream_load?  line=loader/stream_loader.go:272
   INFO[2025-06-03 14:53:14] resp: {
       "TxnId": 10111649,
       "Label": "a2fb52b7-db87-4364-9e53-ae4291297a4f",
       "Comment": "",
       "TwoPhaseCommit": "false",
       "Status": "Success",
       "Message": "OK",
       "NumberTotalRows": 27578,
       "NumberLoadedRows": 27578,
       "NumberFilteredRows": 0,
       "NumberUnselectedRows": 0,
       "LoadBytes": 9436958,
       "LoadTimeMs": 197,
       "BeginTxnTimeMs": 0,
       "StreamLoadPutTimeMs": 2,
       "ReadDataTimeMs": 10,
       "WriteDataTimeMs": 169,
       "CommitAndPublishTimeMs": 24
   }  line=loader/stream_loader.go:294
   INFO[2025-06-03 14:53:14] execute worker exit                           line=loader/stream_loader.go:364
   Load Result: {
           "Status": "Success",
           "TotalRows": 27578,
           "FailLoadRows": 0,
           "LoadedRows": 27578,
           "FilteredRows": 0,
           "UnselectedRows": 0,
           "LoadBytes": 9436958,
           "LoadTimeMs": 209,
           "LoadFiles": [
                   "save_doris_tmp.txt"
           ]
   }
   但我的save_doris_tmp.txt 有79751 行,
   当我第二次重试的时候,又成功导入了79751行
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@doris.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@doris.apache.org
For additional commands, e-mail: dev-help@doris.apache.org