You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "HHoflittlefish777 (via GitHub)" <gi...@apache.org> on 2024/01/12 03:37:52 UTC
[PR] [improve](insert-into) add log in parse insert into values data [doris]
HHoflittlefish777 opened a new pull request, #29903:
URL: https://github.com/apache/doris/pull/29903
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888757765
<details>
<summary>TPC-DS: <b>Total hot run time: 177720 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5985b5b79d32ea25fd34bbf7b1097c2c1da2d2ff, data reload: false
query1 925 332 326 326
query2 6732 1849 1865 1849
query3 6720 207 198 198
query4 27235 21996 22132 21996
query5 7536 547 585 547
query6 262 176 182 176
query7 4618 275 274 274
query8 233 205 195 195
query9 9222 2791 2760 2760
query10 534 243 242 242
query11 16295 15286 15376 15286
query12 133 80 70 70
query13 1700 385 387 385
query14 11890 7236 7238 7236
query15 228 193 190 190
query16 5919 254 240 240
query17 1952 494 481 481
query18 1957 267 259 259
query19 291 150 144 144
query20 78 82 71 71
query21 192 137 123 123
query22 5059 4697 4646 4646
query23 32253 30843 30737 30737
query24 10960 2805 2771 2771
query25 545 327 321 321
query26 1348 151 151 151
query27 2850 280 277 277
query28 6921 1863 1831 1831
query29 1131 680 682 680
query30 278 139 139 139
query31 974 768 773 768
query32 95 60 60 60
query33 708 253 249 249
query34 970 475 468 468
query35 865 733 778 733
query36 1382 1229 1307 1229
query37 104 69 73 69
query38 3409 3248 3252 3248
query39 1327 1285 1292 1285
query40 211 94 99 94
query41 40 34 36 34
query42 98 98 99 98
query43 529 505 498 498
query44 1107 703 709 703
query45 211 182 182 182
query46 1070 668 649 649
query47 1667 1592 1585 1585
query48 392 310 310 310
query49 1142 314 302 302
query50 696 313 320 313
query51 5300 5173 5169 5169
query52 100 92 94 92
query53 366 292 291 291
query54 909 451 465 451
query55 91 84 97 84
query56 211 190 191 190
query57 988 981 931 931
query58 208 198 192 192
query59 2670 2530 2444 2444
query60 226 219 220 219
query61 86 83 79 79
query62 672 434 362 362
query63 304 286 284 284
query64 4901 1643 1639 1639
query65 3356 3259 3253 3253
query66 1156 319 322 319
query67 15509 15034 15059 15034
query68 12129 512 514 512
query69 698 389 385 385
query70 1734 1535 1507 1507
query71 575 234 232 232
query72 5255 2796 2804 2796
query73 2267 323 315 315
query74 6978 6424 6422 6422
query75 5033 2331 2296 2296
query76 6371 1091 1121 1091
query77 692 273 293 273
query78 9753 8632 8563 8563
query79 1025 499 490 490
query80 557 334 339 334
query81 458 208 212 208
query82 206 90 88 88
query83 147 121 125 121
query84 279 73 76 73
query85 1031 335 337 335
query86 367 413 383 383
query87 3507 3412 3367 3367
query88 3087 2235 2210 2210
query89 451 377 385 377
query90 1957 203 200 200
query91 164 131 123 123
query92 63 57 54 54
query93 1037 451 417 417
query94 1171 187 179 179
query95 544 477 474 474
query96 623 317 318 317
query97 4281 4152 4204 4152
query98 192 196 187 187
query99 998 746 728 728
Total cold run time: 293677 ms
Total hot run time: 177720 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "liaoxin01 (via GitHub)" <gi...@apache.org>.
liaoxin01 commented on code in PR #29903:
URL: https://github.com/apache/doris/pull/29903#discussion_r1449911184
##########
be/src/vec/exec/vunion_node.cpp:
##########
@@ -229,12 +229,14 @@ Status VUnionNode::get_next_const(RuntimeState* state, Block* block) {
&result_list[i]));
}
tmp_block.erase_not_in(result_list);
+ LOG(INFO) << "tmp_block rows: " << tmp_block.rows();
if (tmp_block.rows() > 0) {
RETURN_IF_ERROR(mblock.merge(tmp_block));
tmp_block.clear();
}
}
block->set_columns(std::move(mblock.mutable_columns()));
+ LOG(INFO) << "block rows: " << block->rows();
Review Comment:
can we print query id here?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improve](insert-into) add log in parse insert into values data [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888411347
<details>
<summary>ClickBench: <b>Total hot run time: 30.36 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 70b88cd8becfbc951de68bef38bba44665976935, data reload: false
query1 0.06 0.06 0.05
query2 0.05 0.02 0.02
query3 0.26 0.11 0.10
query4 1.77 0.12 0.11
query5 0.52 0.51 0.51
query6 1.35 0.64 0.62
query7 0.02 0.01 0.01
query8 0.03 0.02 0.02
query9 0.55 0.50 0.48
query10 0.54 0.55 0.53
query11 0.13 0.09 0.09
query12 0.12 0.10 0.10
query13 0.61 0.60 0.60
query14 0.77 0.81 0.79
query15 0.82 0.80 0.79
query16 0.35 0.35 0.34
query17 0.95 0.96 0.95
query18 0.26 0.24 0.25
query19 1.86 1.77 1.78
query20 0.01 0.01 0.01
query21 15.41 0.56 0.54
query22 2.44 2.18 1.84
query23 17.29 1.14 0.76
query24 16.09 0.57 0.59
query25 2.17 0.16 0.15
query26 0.13 0.13 0.14
query27 0.15 0.14 0.14
query28 5.84 0.82 0.81
query29 12.55 3.18 3.20
query30 0.59 0.50 0.47
query31 2.77 0.35 0.35
query32 3.38 0.48 0.48
query33 3.17 3.23 3.23
query34 15.79 4.14 4.15
query35 4.14 4.18 4.15
query36 1.10 1.06 1.03
query37 0.06 0.05 0.04
query38 0.04 0.03 0.03
query39 0.02 0.02 0.02
query40 0.16 0.13 0.14
query41 0.07 0.02 0.01
query42 0.03 0.01 0.01
query43 0.02 0.02 0.02
Total cold run time: 114.44 s
Total hot run time: 30.36 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888660466
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888557462
<details>
<summary>ClickBench: <b>Total hot run time: 30.27 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a217d3ba93b64acb355de2ddef9c3c755a7ff7fc, data reload: false
query1 0.06 0.06 0.06
query2 0.05 0.03 0.02
query3 0.25 0.13 0.11
query4 1.77 0.12 0.11
query5 0.52 0.52 0.52
query6 1.36 0.64 0.63
query7 0.02 0.01 0.02
query8 0.03 0.02 0.03
query9 0.56 0.51 0.48
query10 0.54 0.55 0.56
query11 0.12 0.09 0.08
query12 0.11 0.10 0.09
query13 0.61 0.60 0.59
query14 0.80 0.79 0.82
query15 0.82 0.80 0.79
query16 0.35 0.36 0.35
query17 1.00 1.00 0.99
query18 0.26 0.26 0.25
query19 1.86 1.78 1.78
query20 0.02 0.01 0.01
query21 15.43 0.58 0.56
query22 2.91 2.38 1.62
query23 17.43 0.78 0.80
query24 16.08 0.61 0.58
query25 2.13 0.15 0.15
query26 0.13 0.13 0.14
query27 0.15 0.14 0.14
query28 5.48 0.84 0.82
query29 12.54 3.31 3.16
query30 0.52 0.48 0.47
query31 2.78 0.34 0.35
query32 3.42 0.48 0.50
query33 3.21 3.20 3.26
query34 15.82 4.15 4.16
query35 4.14 4.18 4.18
query36 1.09 1.04 1.04
query37 0.06 0.05 0.05
query38 0.03 0.02 0.03
query39 0.02 0.02 0.01
query40 0.16 0.13 0.13
query41 0.07 0.02 0.01
query42 0.03 0.01 0.02
query43 0.03 0.02 0.01
Total cold run time: 114.77 s
Total hot run time: 30.27 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888770187
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 46.72 seconds
stream load tsv: 557 seconds loaded 74807831229 Bytes, about 128 MB/s
stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 21.3 seconds inserted 10000000 Rows, about 469K ops/s
storage size: 17183529474 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888684049
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888525646
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1889126459
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improve](insert-into) add log in parse insert into values data [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888400735
<details>
<summary>TPC-H: <b>Total hot run time: 38928 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 70b88cd8becfbc951de68bef38bba44665976935, data reload: false
------ Round 1 ----------------------------------
q1 17901 5000 4987 4987
q2 2050 139 148 139
q3 11611 1151 1210 1151
q4 10878 814 843 814
q5 8150 3235 3254 3235
q6 209 129 130 129
q7 920 548 512 512
q8 9621 2039 2042 2039
q9 7422 6534 6473 6473
q10 8269 3075 3084 3075
q11 422 217 216 216
q12 364 195 196 195
q13 18127 3415 3412 3412
q14 244 211 215 211
q15 563 519 511 511
q16 450 381 381 381
q17 949 569 495 495
q18 7428 6756 6646 6646
q19 1588 1339 1401 1339
q20 540 285 309 285
q21 2827 2400 2381 2381
q22 353 309 302 302
Total cold run time: 110886 ms
Total hot run time: 38928 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5009 5013 5023 5013
q2 318 199 201 199
q3 3353 3332 3319 3319
q4 2269 2270 2262 2262
q5 5802 5796 5817 5796
q6 195 121 121 121
q7 2317 1874 1862 1862
q8 3467 3558 3592 3558
q9 8900 8809 8775 8775
q10 3794 3842 3822 3822
q11 574 449 427 427
q12 784 602 635 602
q13 7746 3202 3218 3202
q14 300 262 257 257
q15 569 521 506 506
q16 511 455 464 455
q17 2055 2013 2025 2013
q18 8784 8335 8286 8286
q19 1619 1638 1625 1625
q20 2175 1956 1940 1940
q21 6108 5721 5805 5721
q22 547 468 486 468
Total cold run time: 67196 ms
Total hot run time: 60229 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888709081
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "HHoflittlefish777 (via GitHub)" <gi...@apache.org>.
HHoflittlefish777 commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1889065479
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1889233621
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 022370cff963db542bb19ed42d827fcb221b1127 with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 12.3 seconds inserted 10000000 Rows, about 813K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1889135787
TeamCity be ut coverage result:
Function Coverage: 36.71% (8649/23562)
Line Coverage: 28.72% (70427/245234)
Region Coverage: 27.64% (36413/131741)
Branch Coverage: 24.36% (18625/76460)
Coverage Report: http://coverage.selectdb-in.cc/coverage/022370cff963db542bb19ed42d827fcb221b1127_022370cff963db542bb19ed42d827fcb221b1127/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improve](insert-into) add log in parse insert into values data [doris]
Posted by "HHoflittlefish777 (via GitHub)" <gi...@apache.org>.
HHoflittlefish777 commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888388828
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improve](insert-into) add log in parse insert into values data [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888413219
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 70b88cd8becfbc951de68bef38bba44665976935 with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 12.9 seconds inserted 10000000 Rows, about 775K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888560365
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit a217d3ba93b64acb355de2ddef9c3c755a7ff7fc with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 13.8 seconds inserted 10000000 Rows, about 724K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improve](insert-into) add log in parse insert into values data [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888407928
<details>
<summary>TPC-DS: <b>Total hot run time: 179446 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 70b88cd8becfbc951de68bef38bba44665976935, data reload: false
query1 920 348 330 330
query2 6705 1938 1832 1832
query3 6702 209 205 205
query4 26078 22040 22302 22040
query5 5216 522 497 497
query6 267 181 183 181
query7 4628 285 270 270
query8 231 207 198 198
query9 9222 2709 2856 2709
query10 465 241 238 238
query11 16128 15357 15361 15357
query12 127 74 77 74
query13 1727 378 387 378
query14 12669 7139 7155 7139
query15 272 190 197 190
query16 6585 255 248 248
query17 2008 489 479 479
query18 1945 275 258 258
query19 290 150 148 148
query20 81 75 70 70
query21 195 124 134 124
query22 4904 4855 4854 4854
query23 31778 31006 30845 30845
query24 11951 2786 2811 2786
query25 560 328 319 319
query26 1752 147 156 147
query27 2860 281 277 277
query28 6825 1846 1841 1841
query29 2077 697 698 697
query30 286 140 140 140
query31 977 767 780 767
query32 87 62 61 61
query33 716 258 250 250
query34 1144 457 459 457
query35 875 715 750 715
query36 1334 1278 1225 1225
query37 188 68 67 67
query38 3417 3313 3317 3313
query39 1324 1293 1298 1293
query40 312 100 92 92
query41 41 36 34 34
query42 99 97 96 96
query43 557 495 499 495
query44 1041 696 707 696
query45 206 192 189 189
query46 1067 639 656 639
query47 1692 1544 1591 1544
query48 393 338 317 317
query49 1279 325 311 311
query50 703 323 312 312
query51 5367 5191 5196 5191
query52 96 101 95 95
query53 365 299 291 291
query54 2073 1618 1581 1581
query55 91 89 89 89
query56 206 203 202 202
query57 1002 964 954 954
query58 210 198 197 197
query59 2740 2566 2497 2497
query60 235 216 230 216
query61 85 82 85 82
query62 589 397 373 373
query63 312 287 282 282
query64 5674 1682 1634 1634
query65 3333 3261 3265 3261
query66 1341 332 327 327
query67 15507 15159 15095 15095
query68 10063 510 526 510
query69 646 385 376 376
query70 1686 1508 1513 1508
query71 488 258 240 240
query72 4319 2837 2821 2821
query73 1928 305 309 305
query74 6955 6444 6408 6408
query75 4806 2301 2279 2279
query76 6187 1112 1060 1060
query77 867 277 284 277
query78 9592 8735 8732 8732
query79 1045 495 489 489
query80 670 344 342 342
query81 455 214 211 211
query82 236 92 92 92
query83 162 126 119 119
query84 264 73 76 73
query85 1053 347 336 336
query86 402 359 364 359
query87 3581 3429 3393 3393
query88 2958 2188 2185 2185
query89 444 400 391 391
query90 2031 218 199 199
query91 170 126 135 126
query92 63 58 53 53
query93 973 413 430 413
query94 1133 185 182 182
query95 517 463 467 463
query96 614 313 309 309
query97 4283 4196 4170 4170
query98 211 185 190 185
query99 1045 747 729 729
Total cold run time: 291979 ms
Total hot run time: 179446 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improve](insert-into) add log in parse insert into values data [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888408606
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 46.48 seconds
stream load tsv: 559 seconds loaded 74807831229 Bytes, about 127 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 21.2 seconds inserted 10000000 Rows, about 471K ops/s
storage size: 17183798180 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888539114
TeamCity be ut coverage result:
Function Coverage: 36.72% (8652/23565)
Line Coverage: 28.73% (70467/245289)
Region Coverage: 27.64% (36412/131715)
Branch Coverage: 24.36% (18628/76476)
Coverage Report: http://coverage.selectdb-in.cc/coverage/a217d3ba93b64acb355de2ddef9c3c755a7ff7fc_a217d3ba93b64acb355de2ddef9c3c755a7ff7fc/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888702838
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1889184814
<details>
<summary>TPC-H: <b>Total hot run time: 38920 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 022370cff963db542bb19ed42d827fcb221b1127, data reload: false
------ Round 1 ----------------------------------
q1 18044 5068 4987 4987
q2 2053 144 132 132
q3 10704 1172 1249 1172
q4 10274 796 806 796
q5 7853 3191 3161 3161
q6 201 126 125 125
q7 883 514 507 507
q8 9260 1946 2015 1946
q9 7370 6519 6497 6497
q10 8264 3105 3107 3105
q11 423 210 209 209
q12 365 197 198 197
q13 18127 3419 3421 3419
q14 245 217 211 211
q15 561 527 508 508
q16 445 390 382 382
q17 946 532 531 531
q18 7385 6679 6641 6641
q19 1592 1460 1423 1423
q20 565 303 308 303
q21 2831 2420 2358 2358
q22 347 310 310 310
Total cold run time: 108738 ms
Total hot run time: 38920 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4986 4988 4908 4908
q2 318 200 203 200
q3 3358 3297 3302 3297
q4 2241 2253 2256 2253
q5 5846 5792 5829 5792
q6 199 116 118 116
q7 2313 1873 1864 1864
q8 3460 3572 3579 3572
q9 8900 8895 8939 8895
q10 3860 3951 3944 3944
q11 574 463 442 442
q12 808 618 600 600
q13 4879 3187 3221 3187
q14 294 262 264 262
q15 569 508 512 508
q16 515 450 470 450
q17 2046 2020 2058 2020
q18 8770 8360 8321 8321
q19 1614 1602 1625 1602
q20 2175 1946 1919 1919
q21 6127 5757 5736 5736
q22 583 483 491 483
Total cold run time: 64435 ms
Total hot run time: 60371 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888709806
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888660383
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888741484
<details>
<summary>TPC-H: <b>Total hot run time: 38629 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5985b5b79d32ea25fd34bbf7b1097c2c1da2d2ff, data reload: false
------ Round 1 ----------------------------------
q1 17960 4976 4900 4900
q2 2035 139 135 135
q3 10689 1137 1159 1137
q4 10404 773 829 773
q5 7814 3103 3168 3103
q6 203 125 127 125
q7 886 497 493 493
q8 9246 1987 1998 1987
q9 7319 6454 6425 6425
q10 8236 3105 3071 3071
q11 414 207 220 207
q12 363 187 195 187
q13 18099 3441 3418 3418
q14 247 216 214 214
q15 553 521 508 508
q16 435 382 371 371
q17 927 582 514 514
q18 7272 6691 6676 6676
q19 1583 1366 1432 1366
q20 550 330 313 313
q21 2773 2407 2439 2407
q22 361 313 299 299
Total cold run time: 108369 ms
Total hot run time: 38629 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4936 4902 4961 4902
q2 309 200 200 200
q3 3331 3310 3288 3288
q4 2238 2249 2264 2249
q5 5820 5780 5779 5779
q6 191 116 119 116
q7 2307 1811 1819 1811
q8 3417 3548 3552 3548
q9 8837 8818 8789 8789
q10 3730 3788 3825 3788
q11 547 421 424 421
q12 790 611 602 602
q13 5585 3250 3229 3229
q14 283 256 277 256
q15 555 510 510 510
q16 493 462 454 454
q17 2042 2024 2020 2020
q18 8813 8410 8275 8275
q19 1596 1601 1608 1601
q20 2155 1918 1940 1918
q21 5970 5693 5677 5677
q22 551 471 491 471
Total cold run time: 64496 ms
Total hot run time: 59904 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring merged PR #29903:
URL: https://github.com/apache/doris/pull/29903
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improve](insert-into) add log in parse insert into values data [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888387505
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888551312
<details>
<summary>TPC-DS: <b>Total hot run time: 179385 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a217d3ba93b64acb355de2ddef9c3c755a7ff7fc, data reload: false
query1 927 337 330 330
query2 6718 1861 1928 1861
query3 6711 212 201 201
query4 27409 22157 22246 22157
query5 8953 552 592 552
query6 275 188 193 188
query7 4615 277 277 277
query8 223 196 189 189
query9 9162 2728 2775 2728
query10 661 242 238 238
query11 16321 15487 15216 15216
query12 127 78 72 72
query13 1770 389 387 387
query14 13316 7184 7261 7184
query15 237 190 193 190
query16 6320 246 243 243
query17 1941 486 481 481
query18 1970 266 263 263
query19 292 151 146 146
query20 74 77 72 72
query21 196 133 130 130
query22 5278 5164 5058 5058
query23 31860 30931 31033 30931
query24 11746 2840 2850 2840
query25 556 334 327 327
query26 1740 154 161 154
query27 2839 273 270 270
query28 7096 1863 1863 1863
query29 2090 700 655 655
query30 280 144 140 140
query31 966 761 775 761
query32 84 63 63 63
query33 720 273 255 255
query34 1060 471 468 468
query35 898 777 736 736
query36 1284 1239 1221 1221
query37 185 71 70 70
query38 3404 3311 3302 3302
query39 1330 1295 1298 1295
query40 316 108 95 95
query41 38 36 35 35
query42 101 99 99 99
query43 549 496 513 496
query44 1064 717 712 712
query45 213 187 186 186
query46 1057 665 662 662
query47 1672 1584 1580 1580
query48 403 323 323 323
query49 1268 315 311 311
query50 687 317 324 317
query51 5326 5220 5267 5220
query52 105 106 93 93
query53 361 295 289 289
query54 923 445 465 445
query55 96 91 87 87
query56 207 195 204 195
query57 1013 924 955 924
query58 221 193 194 193
query59 2786 2505 2534 2505
query60 254 231 213 213
query61 84 83 84 83
query62 615 391 375 375
query63 309 284 271 271
query64 5720 1653 1676 1653
query65 3358 3250 3281 3250
query66 1202 332 311 311
query67 15877 15538 15486 15486
query68 10713 540 521 521
query69 688 387 401 387
query70 1709 1533 1528 1528
query71 556 236 247 236
query72 4746 2816 2831 2816
query73 2217 313 315 313
query74 7113 6495 6351 6351
query75 4917 2316 2332 2316
query76 6317 1099 1146 1099
query77 862 285 281 281
query78 9952 8881 8852 8852
query79 1010 503 504 503
query80 605 331 332 331
query81 448 217 204 204
query82 234 89 106 89
query83 145 131 120 120
query84 277 76 80 76
query85 1015 345 346 345
query86 421 371 353 353
query87 3587 3397 3380 3380
query88 2728 2185 2204 2185
query89 455 373 386 373
query90 2004 197 206 197
query91 159 129 126 126
query92 62 54 58 54
query93 983 418 411 411
query94 1118 186 181 181
query95 537 494 492 492
query96 630 312 312 312
query97 4287 4170 4198 4170
query98 199 198 184 184
query99 988 676 754 676
Total cold run time: 299141 ms
Total hot run time: 179385 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improve](insert-into) add log in parse insert into values data [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888393543
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "HHoflittlefish777 (via GitHub)" <gi...@apache.org>.
HHoflittlefish777 commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888519684
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888539226
<details>
<summary>TPC-H: <b>Total hot run time: 39008 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a217d3ba93b64acb355de2ddef9c3c755a7ff7fc, data reload: false
------ Round 1 ----------------------------------
q1 17884 4955 5026 4955
q2 2052 150 139 139
q3 11302 1192 1185 1185
q4 10333 833 840 833
q5 8129 3287 3230 3230
q6 212 127 130 127
q7 910 533 514 514
q8 9631 2009 2029 2009
q9 7670 6505 6472 6472
q10 8247 3138 3119 3119
q11 425 215 204 204
q12 357 187 188 187
q13 18107 3454 3449 3449
q14 243 219 218 218
q15 565 522 506 506
q16 429 372 403 372
q17 952 512 531 512
q18 7371 6756 6701 6701
q19 1585 1347 1389 1347
q20 524 302 286 286
q21 2806 2349 2445 2349
q22 352 306 294 294
Total cold run time: 110086 ms
Total hot run time: 39008 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4948 4927 4941 4927
q2 307 206 203 203
q3 3355 3344 3337 3337
q4 2248 2251 2248 2248
q5 5832 5818 5839 5818
q6 194 118 120 118
q7 2311 1868 1867 1867
q8 3478 3538 3613 3538
q9 8881 8857 8818 8818
q10 3755 3853 3823 3823
q11 543 435 436 435
q12 797 605 622 605
q13 4015 3260 3234 3234
q14 293 255 267 255
q15 572 519 512 512
q16 504 464 449 449
q17 2076 2001 2014 2001
q18 8773 8274 8312 8274
q19 1626 1597 1628 1597
q20 2181 1919 1935 1919
q21 6011 5725 5780 5725
q22 569 445 491 445
Total cold run time: 63269 ms
Total hot run time: 60148 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "HHoflittlefish777 (via GitHub)" <gi...@apache.org>.
HHoflittlefish777 commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888672036
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1889153550
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 47.88 seconds
stream load tsv: 563 seconds loaded 74807831229 Bytes, about 126 MB/s
stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 22.0 seconds inserted 10000000 Rows, about 454K ops/s
storage size: 17183714627 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888702400
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888766466
TeamCity be ut coverage result:
Function Coverage: 36.71% (8649/23562)
Line Coverage: 28.72% (70437/245234)
Region Coverage: 27.64% (36417/131741)
Branch Coverage: 24.36% (18627/76460)
Coverage Report: http://coverage.selectdb-in.cc/coverage/5985b5b79d32ea25fd34bbf7b1097c2c1da2d2ff_5985b5b79d32ea25fd34bbf7b1097c2c1da2d2ff/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1889212460
<details>
<summary>TPC-DS: <b>Total hot run time: 179249 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 022370cff963db542bb19ed42d827fcb221b1127, data reload: false
query1 942 338 331 331
query2 6710 1948 1847 1847
query3 6714 206 208 206
query4 26267 22185 22079 22079
query5 7907 565 547 547
query6 275 180 179 179
query7 4630 278 267 267
query8 281 202 206 202
query9 9223 2870 2807 2807
query10 505 249 240 240
query11 16179 15504 15287 15287
query12 124 77 74 74
query13 1711 391 398 391
query14 12236 7243 7198 7198
query15 233 194 194 194
query16 6115 265 246 246
query17 1922 499 488 488
query18 1953 273 264 264
query19 288 152 145 145
query20 80 81 74 74
query21 189 134 133 133
query22 4928 4804 4854 4804
query23 31763 31126 30956 30956
query24 12308 2863 2808 2808
query25 563 338 327 327
query26 1705 160 155 155
query27 2888 285 279 279
query28 7122 1876 1873 1873
query29 2105 723 685 685
query30 286 135 143 135
query31 935 765 771 765
query32 96 64 59 59
query33 718 242 256 242
query34 1113 467 468 467
query35 912 787 745 745
query36 1438 1303 1207 1207
query37 185 65 71 65
query38 3417 3275 3269 3269
query39 1356 1302 1301 1301
query40 319 105 98 98
query41 40 36 34 34
query42 102 95 100 95
query43 577 514 516 514
query44 1093 721 732 721
query45 208 203 191 191
query46 1070 687 674 674
query47 1571 1602 1596 1596
query48 422 317 327 317
query49 1275 327 309 309
query50 707 320 324 320
query51 5315 5296 5226 5226
query52 101 90 90 90
query53 374 289 286 286
query54 917 461 454 454
query55 92 92 81 81
query56 205 202 199 199
query57 988 957 965 957
query58 200 195 191 191
query59 2801 2467 2505 2467
query60 235 221 232 221
query61 83 81 83 81
query62 663 412 394 394
query63 311 290 284 284
query64 5825 1699 1750 1699
query65 3364 3279 3265 3265
query66 1284 337 324 324
query67 15929 15241 15240 15240
query68 10962 536 529 529
query69 701 399 390 390
query70 1686 1611 1609 1609
query71 562 240 254 240
query72 5088 2839 2832 2832
query73 2126 317 322 317
query74 6898 6401 6460 6401
query75 5106 2348 2313 2313
query76 6410 1083 1103 1083
query77 879 271 299 271
query78 9879 8615 8637 8615
query79 1069 514 520 514
query80 601 363 364 363
query81 453 202 208 202
query82 217 94 96 94
query83 148 124 124 124
query84 277 79 75 75
query85 1039 354 324 324
query86 389 406 380 380
query87 3521 3413 3364 3364
query88 3837 2237 2224 2224
query89 457 390 406 390
query90 2007 210 203 203
query91 154 123 125 123
query92 65 61 54 54
query93 2242 451 449 449
query94 1412 189 179 179
query95 529 503 499 499
query96 633 314 321 314
query97 4314 4163 4239 4163
query98 214 195 195 195
query99 1064 752 747 747
Total cold run time: 299332 ms
Total hot run time: 179249 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888682731
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "HHoflittlefish777 (via GitHub)" <gi...@apache.org>.
HHoflittlefish777 commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888692567
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "HHoflittlefish777 (via GitHub)" <gi...@apache.org>.
HHoflittlefish777 commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888699777
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improve](insert-into) add log in parse insert into values data [doris]
Posted by "HHoflittlefish777 (via GitHub)" <gi...@apache.org>.
HHoflittlefish777 commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888382964
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improve](insert-into) add log in parse insert into values data [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888402773
TeamCity be ut coverage result:
Function Coverage: 36.72% (8652/23565)
Line Coverage: 28.73% (70470/245279)
Region Coverage: 27.65% (36414/131712)
Branch Coverage: 24.36% (18626/76474)
Coverage Report: http://coverage.selectdb-in.cc/coverage/70b88cd8becfbc951de68bef38bba44665976935_70b88cd8becfbc951de68bef38bba44665976935/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888557338
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 46.79 seconds
stream load tsv: 556 seconds loaded 74807831229 Bytes, about 128 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 33 seconds loaded 861443392 Bytes, about 24 MB/s
insert into select: 22.2 seconds inserted 10000000 Rows, about 450K ops/s
storage size: 17183679779 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1889226156
<details>
<summary>ClickBench: <b>Total hot run time: 30.76 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 022370cff963db542bb19ed42d827fcb221b1127, data reload: false
query1 0.07 0.05 0.06
query2 0.07 0.02 0.03
query3 0.26 0.11 0.11
query4 1.77 0.12 0.11
query5 0.52 0.52 0.52
query6 1.38 0.64 0.64
query7 0.01 0.01 0.01
query8 0.04 0.03 0.03
query9 0.55 0.51 0.52
query10 0.55 0.55 0.55
query11 0.13 0.08 0.09
query12 0.11 0.10 0.09
query13 0.60 0.60 0.59
query14 0.77 0.80 0.78
query15 0.82 0.81 0.79
query16 0.34 0.34 0.35
query17 1.00 1.01 0.99
query18 0.27 0.25 0.26
query19 1.80 1.71 1.78
query20 0.01 0.01 0.01
query21 15.54 0.56 0.58
query22 2.71 2.76 2.13
query23 17.49 0.76 0.84
query24 16.21 0.62 0.59
query25 2.17 0.15 0.16
query26 0.14 0.14 0.14
query27 0.15 0.15 0.15
query28 6.66 0.83 0.83
query29 12.62 3.13 3.20
query30 0.56 0.48 0.48
query31 2.79 0.34 0.37
query32 3.42 0.50 0.49
query33 3.20 3.25 3.24
query34 15.92 4.18 4.16
query35 4.16 4.16 4.15
query36 1.10 1.05 1.05
query37 0.06 0.04 0.04
query38 0.03 0.02 0.02
query39 0.02 0.01 0.02
query40 0.16 0.13 0.14
query41 0.07 0.02 0.01
query42 0.02 0.01 0.02
query43 0.02 0.01 0.02
Total cold run time: 116.29 s
Total hot run time: 30.76 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1888767553
<details>
<summary>ClickBench: <b>Total hot run time: 30.53 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5985b5b79d32ea25fd34bbf7b1097c2c1da2d2ff, data reload: false
query1 0.06 0.06 0.05
query2 0.06 0.02 0.02
query3 0.25 0.11 0.11
query4 1.78 0.11 0.11
query5 0.52 0.52 0.52
query6 1.38 0.66 0.63
query7 0.02 0.01 0.01
query8 0.04 0.03 0.02
query9 0.55 0.50 0.51
query10 0.56 0.54 0.55
query11 0.13 0.09 0.09
query12 0.11 0.10 0.10
query13 0.61 0.60 0.59
query14 0.78 0.79 0.79
query15 0.82 0.80 0.81
query16 0.34 0.34 0.34
query17 0.98 0.96 0.99
query18 0.25 0.25 0.26
query19 1.83 1.78 1.74
query20 0.01 0.01 0.01
query21 15.39 0.56 0.55
query22 2.43 2.78 1.95
query23 17.36 0.76 0.73
query24 16.16 0.57 0.58
query25 2.16 0.15 0.14
query26 0.14 0.14 0.14
query27 0.14 0.15 0.14
query28 5.72 0.84 0.85
query29 12.54 3.19 3.22
query30 0.52 0.49 0.48
query31 2.80 0.35 0.35
query32 3.39 0.49 0.49
query33 3.23 3.22 3.23
query34 15.86 4.14 4.18
query35 4.17 4.14 4.13
query36 1.10 1.05 1.04
query37 0.07 0.05 0.05
query38 0.03 0.03 0.02
query39 0.02 0.01 0.02
query40 0.16 0.13 0.13
query41 0.07 0.02 0.01
query42 0.03 0.01 0.01
query43 0.03 0.02 0.02
Total cold run time: 114.6 s
Total hot run time: 30.53 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [log](insert-into) add log in parse insert into values data [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29903:
URL: https://github.com/apache/doris/pull/29903#issuecomment-1889085493
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org