You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "BiteTheDDDDt (via GitHub)" <gi...@apache.org> on 2024/03/07 05:08:39 UTC
[PR] [Bug](load) fix wrong data in mv when routine load with function mapp… [doris]
BiteTheDDDDt opened a new pull request, #31912:
URL: https://github.com/apache/doris/pull/31912
…ing (#31787)
## Proposed changes
pick from #31787
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Bug](load) fix wrong data in mv when routine load with function mapp… [doris]
Posted by "BiteTheDDDDt (via GitHub)" <gi...@apache.org>.
BiteTheDDDDt commented on PR #31912:
URL: https://github.com/apache/doris/pull/31912#issuecomment-1982357394
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Bug](load) fix wrong data in mv when routine load with function mapp… [doris]
Posted by "BiteTheDDDDt (via GitHub)" <gi...@apache.org>.
BiteTheDDDDt commented on PR #31912:
URL: https://github.com/apache/doris/pull/31912#issuecomment-1982791250
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Bug](load) fix wrong data in mv when routine load with function mapp… [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31912:
URL: https://github.com/apache/doris/pull/31912#issuecomment-1983212950
<details>
<summary>TPC-DS: <b>Total hot run time: 204313 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit bd4c411be58dd4ed5da58dd101ef1677fab7de42, data reload: false
query1 911 384 379 379
query2 6515 2182 2117 2117
query3 6911 198 199 198
query4 21359 18020 17970 17970
query5 19730 6473 6519 6473
query6 296 210 237 210
query7 4147 289 299 289
query8 266 235 227 227
query9 3067 2639 2559 2559
query10 404 286 286 286
query11 11539 10916 10966 10916
query12 116 80 71 71
query13 5580 633 611 611
query14 17966 13241 13637 13241
query15 360 232 238 232
query16 6435 275 261 261
query17 1709 1457 875 875
query18 2318 401 392 392
query19 205 144 136 136
query20 67 73 77 73
query21 180 92 93 92
query22 5483 5241 5062 5062
query23 32312 31808 31802 31802
query24 6911 6442 6449 6442
query25 524 404 417 404
query26 518 154 151 151
query27 1924 294 284 284
query28 6118 2207 2193 2193
query29 2844 2870 2755 2755
query30 237 162 166 162
query31 899 710 711 710
query32 64 60 62 60
query33 386 236 249 236
query34 838 447 483 447
query35 1117 926 925 925
query36 1395 1653 1618 1618
query37 91 63 60 60
query38 3085 2942 2950 2942
query39 1347 1314 1321 1314
query40 198 90 90 90
query41 36 32 33 32
query42 84 78 91 78
query43 639 647 599 599
query44 1121 709 708 708
query45 240 227 225 225
query46 1228 981 970 970
query47 1835 1860 1699 1699
query48 966 673 651 651
query49 620 364 372 364
query50 864 658 613 613
query51 4789 4680 4667 4667
query52 83 92 80 80
query53 440 308 306 306
query54 2661 2452 2439 2439
query55 94 80 82 80
query56 210 194 215 194
query57 1172 1116 1208 1116
query58 202 180 184 180
query59 3615 3204 3175 3175
query60 214 195 200 195
query61 82 78 80 78
query62 757 486 499 486
query63 475 329 325 325
query64 2494 1477 1333 1333
query65 3598 3540 3549 3540
query66 745 368 359 359
query67 16683 17699 17670 17670
query68 6035 645 644 644
query69 560 342 324 324
query70 1957 1677 1731 1677
query71 407 293 309 293
query72 6330 3414 3423 3414
query73 710 312 311 311
query74 6399 5836 5936 5836
query75 4612 3750 3671 3671
query76 3793 1150 1198 1150
query77 542 249 260 249
query78 12725 11916 11780 11780
query79 6823 632 617 617
query80 2847 385 404 385
query81 519 233 228 228
query82 1386 102 94 94
query83 229 129 124 124
query84 255 69 68 68
query85 1354 280 274 274
query86 405 390 396 390
query87 3225 3003 3029 3003
query88 4755 2316 2289 2289
query89 333 277 268 268
query90 1711 210 196 196
query91 158 120 112 112
query92 60 48 50 48
query93 2340 590 541 541
query94 877 202 200 200
query95 1135 1061 1034 1034
query96 628 320 323 320
query97 6558 6315 6432 6315
query98 189 179 173 173
query99 3104 961 858 858
Total cold run time: 305280 ms
Total hot run time: 204313 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Bug](load) fix wrong data in mv when routine load with function mapp… [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31912:
URL: https://github.com/apache/doris/pull/31912#issuecomment-1983221983
<details>
<summary>ClickBench: <b>Total hot run time: 30.45 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit bd4c411be58dd4ed5da58dd101ef1677fab7de42, data reload: false
query1 0.02 0.03 0.02
query2 0.06 0.02 0.02
query3 0.24 0.04 0.04
query4 1.84 0.06 0.06
query5 0.52 0.53 0.51
query6 1.30 0.62 0.61
query7 0.02 0.01 0.01
query8 0.04 0.02 0.02
query9 0.53 0.48 0.49
query10 0.53 0.52 0.54
query11 0.11 0.08 0.08
query12 0.11 0.09 0.09
query13 0.62 0.62 0.62
query14 0.78 0.76 0.79
query15 0.79 0.75 0.75
query16 0.40 0.36 0.37
query17 0.96 1.01 1.02
query18 0.22 0.24 0.24
query19 1.91 1.86 1.87
query20 0.02 0.02 0.01
query21 15.47 0.56 0.54
query22 1.73 1.94 1.32
query23 17.18 0.99 1.11
query24 6.56 1.01 0.96
query25 0.37 0.10 0.05
query26 0.71 0.17 0.18
query27 0.05 0.03 0.04
query28 6.80 0.74 0.70
query29 12.61 2.31 2.38
query30 0.63 0.53 0.57
query31 2.85 0.38 0.37
query32 3.43 0.51 0.48
query33 3.06 3.07 3.08
query34 15.27 4.81 4.77
query35 4.88 4.85 4.83
query36 1.06 1.01 1.00
query37 0.06 0.04 0.05
query38 0.03 0.02 0.02
query39 0.01 0.02 0.02
query40 0.16 0.13 0.14
query41 0.07 0.02 0.01
query42 0.02 0.02 0.02
query43 0.02 0.02 0.02
Total cold run time: 104.05 s
Total hot run time: 30.45 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Bug](load) fix wrong data in mv when routine load with function mapp… [doris]
Posted by "BiteTheDDDDt (via GitHub)" <gi...@apache.org>.
BiteTheDDDDt commented on PR #31912:
URL: https://github.com/apache/doris/pull/31912#issuecomment-1983132356
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Bug](load) fix wrong data in mv when routine load with function mapp… [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31912:
URL: https://github.com/apache/doris/pull/31912#issuecomment-1982877860
<details>
<summary>TPC-H: <b>Total hot run time: 49691 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d03abb562c6303471de24a8c53caf9725113ba12, data reload: false
------ Round 1 ----------------------------------
q1 17754 4374 4330 4330
q2 2058 150 140 140
q3 10453 1879 1930 1879
q4 10329 1236 1276 1236
q5 9119 3940 3985 3940
q6 232 121 123 121
q7 2021 1564 1588 1564
q8 9277 2698 2709 2698
q9 10780 10543 10364 10364
q10 8659 3525 3535 3525
q11 423 240 241 240
q12 477 297 306 297
q13 18349 3963 4023 3963
q14 351 313 329 313
q15 507 458 457 457
q16 699 591 591 591
q17 1121 930 948 930
q18 7157 7010 6782 6782
q19 1682 1570 1584 1570
q20 537 320 301 301
q21 4500 4079 4053 4053
q22 505 397 417 397
Total cold run time: 116990 ms
Total hot run time: 49691 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4320 4294 4276 4276
q2 315 219 221 219
q3 4158 4178 4114 4114
q4 2761 2741 2776 2741
q5 7249 7176 7094 7094
q6 230 123 116 116
q7 3227 2789 2794 2789
q8 4317 4450 4450 4450
q9 17110 16965 16851 16851
q10 4200 4262 4240 4240
q11 760 677 685 677
q12 1023 850 840 840
q13 4408 3697 3730 3697
q14 454 419 432 419
q15 502 449 451 449
q16 760 699 715 699
q17 3843 3879 3863 3863
q18 8849 8671 8831 8671
q19 1720 1710 1672 1672
q20 2383 2141 2130 2130
q21 8536 8455 8445 8445
q22 1038 952 934 934
Total cold run time: 82163 ms
Total hot run time: 79386 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Bug](load) fix wrong data in mv when routine load with function mapp… [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31912:
URL: https://github.com/apache/doris/pull/31912#issuecomment-1982485852
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit d03abb562c6303471de24a8c53caf9725113ba12 with default session variables
Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 20.8 seconds inserted 10000000 Rows, about 480K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Bug](load) fix wrong data in mv when routine load with function mapp… [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31912:
URL: https://github.com/apache/doris/pull/31912#issuecomment-1983190991
<details>
<summary>TPC-H: <b>Total hot run time: 49784 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit bd4c411be58dd4ed5da58dd101ef1677fab7de42, data reload: false
------ Round 1 ----------------------------------
q1 18051 4391 4279 4279
q2 2031 143 143 143
q3 10499 1862 1891 1862
q4 10370 1218 1322 1218
q5 8870 3932 3930 3930
q6 224 119 120 119
q7 2009 1601 1586 1586
q8 9276 2680 2689 2680
q9 11204 10973 10568 10568
q10 8633 3543 3492 3492
q11 430 236 237 236
q12 466 294 295 294
q13 18357 3987 4001 3987
q14 352 324 329 324
q15 490 447 456 447
q16 689 581 594 581
q17 1108 949 961 949
q18 7269 6861 6844 6844
q19 1691 1562 1510 1510
q20 542 312 304 304
q21 4423 4046 4082 4046
q22 501 405 385 385
Total cold run time: 117485 ms
Total hot run time: 49784 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4310 4285 4267 4267
q2 315 222 219 219
q3 4107 4156 4124 4124
q4 2741 2736 2719 2719
q5 7315 7241 7273 7241
q6 234 119 117 117
q7 3218 2845 2892 2845
q8 4325 4418 4416 4416
q9 17509 17245 17172 17172
q10 4229 4260 4228 4228
q11 763 669 667 667
q12 1036 834 857 834
q13 6986 3746 3721 3721
q14 446 426 414 414
q15 505 448 443 443
q16 771 691 691 691
q17 3780 3837 3803 3803
q18 8773 8692 8762 8692
q19 1685 1688 1652 1652
q20 2386 2119 2056 2056
q21 8513 8480 8342 8342
q22 1053 954 936 936
Total cold run time: 85000 ms
Total hot run time: 79599 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Bug](load) fix wrong data in mv when routine load with function mapp… [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31912:
URL: https://github.com/apache/doris/pull/31912#issuecomment-1982948804
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit d03abb562c6303471de24a8c53caf9725113ba12 with default session variables
Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 20.9 seconds inserted 10000000 Rows, about 478K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Bug](load) fix wrong data in mv when routine load with function mapp… [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31912:
URL: https://github.com/apache/doris/pull/31912#issuecomment-1982422140
<details>
<summary>TPC-H: <b>Total hot run time: 49627 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d03abb562c6303471de24a8c53caf9725113ba12, data reload: false
------ Round 1 ----------------------------------
q1 17633 4396 4348 4348
q2 2053 145 140 140
q3 10528 1915 1914 1914
q4 10321 1233 1298 1233
q5 8418 3931 3994 3931
q6 229 119 122 119
q7 2033 1557 1605 1557
q8 9318 2698 2721 2698
q9 10675 10435 10329 10329
q10 8617 3458 3508 3458
q11 416 239 250 239
q12 452 294 310 294
q13 18366 3941 4050 3941
q14 349 320 319 319
q15 528 460 452 452
q16 703 579 590 579
q17 1116 938 919 919
q18 7213 6856 6948 6856
q19 1653 1570 1530 1530
q20 536 307 312 307
q21 4438 4157 4061 4061
q22 504 403 407 403
Total cold run time: 116099 ms
Total hot run time: 49627 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4311 4267 4256 4256
q2 319 221 219 219
q3 4173 4113 4129 4113
q4 2756 2740 2752 2740
q5 7262 7206 7177 7177
q6 232 117 115 115
q7 3238 2842 2825 2825
q8 4376 4521 4504 4504
q9 16972 16891 16839 16839
q10 4230 4233 4251 4233
q11 762 704 679 679
q12 1008 844 824 824
q13 6844 3749 3764 3749
q14 446 435 431 431
q15 494 459 452 452
q16 783 708 710 708
q17 3804 3829 3850 3829
q18 8753 8682 8746 8682
q19 1722 1689 1613 1613
q20 2366 2185 2162 2162
q21 8489 8611 8483 8483
q22 1013 995 942 942
Total cold run time: 84353 ms
Total hot run time: 79575 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Bug](load) fix wrong data in mv when routine load with function mapp… [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31912:
URL: https://github.com/apache/doris/pull/31912#issuecomment-1982937987
<details>
<summary>ClickBench: <b>Total hot run time: 30.26 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d03abb562c6303471de24a8c53caf9725113ba12, data reload: false
query1 0.03 0.02 0.02
query2 0.05 0.02 0.02
query3 0.24 0.04 0.05
query4 1.84 0.08 0.07
query5 0.53 0.52 0.52
query6 1.24 0.61 0.61
query7 0.02 0.00 0.01
query8 0.03 0.02 0.02
query9 0.52 0.47 0.48
query10 0.52 0.52 0.53
query11 0.11 0.09 0.08
query12 0.11 0.09 0.09
query13 0.62 0.62 0.61
query14 0.77 0.78 0.78
query15 0.77 0.75 0.75
query16 0.35 0.39 0.38
query17 1.01 0.96 1.00
query18 0.23 0.25 0.23
query19 1.86 1.85 1.85
query20 0.01 0.01 0.00
query21 15.46 0.57 0.56
query22 2.24 2.31 1.59
query23 17.89 1.09 0.91
query24 4.46 0.81 1.32
query25 0.42 0.07 0.05
query26 0.56 0.15 0.15
query27 0.05 0.04 0.03
query28 8.58 0.78 0.71
query29 12.62 2.35 2.16
query30 0.55 0.53 0.48
query31 2.82 0.38 0.36
query32 3.43 0.50 0.49
query33 3.10 3.06 3.07
query34 15.28 4.78 4.80
query35 4.87 4.85 4.84
query36 1.06 1.01 1.00
query37 0.05 0.05 0.05
query38 0.04 0.03 0.02
query39 0.02 0.01 0.02
query40 0.16 0.13 0.14
query41 0.07 0.02 0.02
query42 0.01 0.01 0.01
query43 0.03 0.02 0.02
Total cold run time: 104.63 s
Total hot run time: 30.26 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Bug](load) fix wrong data in mv when routine load with function mapp… [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31912:
URL: https://github.com/apache/doris/pull/31912#issuecomment-1982357198
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Bug](load) fix wrong data in mv when routine load with function mapp… [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31912:
URL: https://github.com/apache/doris/pull/31912#issuecomment-1982454950
<details>
<summary>TPC-DS: <b>Total hot run time: 202526 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d03abb562c6303471de24a8c53caf9725113ba12, data reload: false
query1 920 388 381 381
query2 6530 2232 2045 2045
query3 6911 198 192 192
query4 19994 17704 17998 17704
query5 19729 6461 6572 6461
query6 305 218 232 218
query7 4317 299 299 299
query8 263 233 231 231
query9 3173 2694 2617 2617
query10 422 284 311 284
query11 11201 10542 10736 10542
query12 116 82 69 69
query13 5577 629 644 629
query14 18397 13459 13844 13459
query15 358 231 248 231
query16 6434 277 260 260
query17 1492 1502 878 878
query18 2260 402 402 402
query19 206 146 146 146
query20 74 77 73 73
query21 180 98 95 95
query22 5327 5010 5096 5010
query23 32461 31763 32023 31763
query24 6751 6478 6543 6478
query25 507 425 405 405
query26 495 162 154 154
query27 1756 296 298 296
query28 6127 2252 2201 2201
query29 2900 2581 2673 2581
query30 243 163 161 161
query31 914 738 754 738
query32 66 52 56 52
query33 398 242 250 242
query34 831 479 489 479
query35 1129 881 890 881
query36 1736 1561 1622 1561
query37 88 59 57 57
query38 3067 2918 2947 2918
query39 1361 1328 1315 1315
query40 202 90 94 90
query41 35 34 32 32
query42 85 88 82 82
query43 612 575 592 575
query44 1150 731 734 731
query45 239 232 232 232
query46 1228 957 969 957
query47 1834 1947 1976 1947
query48 957 690 654 654
query49 608 369 365 365
query50 883 606 584 584
query51 4758 4701 4676 4676
query52 85 78 77 77
query53 452 315 317 315
query54 2649 2486 2476 2476
query55 87 81 80 80
query56 204 194 191 191
query57 1182 1192 1205 1192
query58 215 207 203 203
query59 3537 3376 3511 3376
query60 199 197 193 193
query61 85 80 80 80
query62 828 468 482 468
query63 468 344 347 344
query64 2454 1488 1453 1453
query65 3674 3554 3524 3524
query66 771 374 359 359
query67 15523 15602 15602 15602
query68 8226 670 646 646
query69 557 339 353 339
query70 1959 1730 1900 1730
query71 395 299 314 299
query72 6444 3493 3408 3408
query73 722 325 323 323
query74 6231 5775 5840 5775
query75 4524 3754 3676 3676
query76 4690 1168 1225 1168
query77 626 252 242 242
query78 12475 11780 12631 11780
query79 11043 649 672 649
query80 887 392 384 384
query81 460 228 235 228
query82 668 102 94 94
query83 162 132 126 126
query84 257 69 68 68
query85 834 279 272 272
query86 385 385 429 385
query87 3286 3014 3028 3014
query88 4129 2311 2314 2311
query89 476 315 299 299
query90 1942 210 205 205
query91 144 116 122 116
query92 57 52 49 49
query93 5644 614 593 593
query94 823 206 209 206
query95 1124 1066 1063 1063
query96 645 330 319 319
query97 6568 6307 6373 6307
query98 189 180 182 180
query99 2768 906 907 906
Total cold run time: 309360 ms
Total hot run time: 202526 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Bug](load) fix wrong data in mv when routine load with function mapp… [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31912:
URL: https://github.com/apache/doris/pull/31912#issuecomment-1982916173
<details>
<summary>TPC-DS: <b>Total hot run time: 202611 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d03abb562c6303471de24a8c53caf9725113ba12, data reload: false
query1 912 383 383 383
query2 6547 2164 2026 2026
query3 6917 200 197 197
query4 20061 18373 18441 18373
query5 19714 6539 6507 6507
query6 294 215 223 215
query7 4267 294 310 294
query8 243 238 250 238
query9 3197 2726 2619 2619
query10 427 292 318 292
query11 11371 10584 10665 10584
query12 121 75 70 70
query13 5577 664 635 635
query14 17523 13571 13635 13571
query15 353 230 233 230
query16 6430 263 259 259
query17 1498 1506 883 883
query18 2257 404 402 402
query19 195 146 153 146
query20 77 76 73 73
query21 188 96 93 93
query22 5302 5138 5165 5138
query23 32616 31829 31927 31829
query24 7014 6566 6585 6566
query25 512 436 399 399
query26 526 158 159 158
query27 1903 296 294 294
query28 6049 2242 2205 2205
query29 2883 2727 2781 2727
query30 233 162 159 159
query31 917 728 789 728
query32 67 59 53 53
query33 396 243 255 243
query34 844 474 486 474
query35 1125 891 918 891
query36 1465 1603 1634 1603
query37 92 57 54 54
query38 3124 2942 2944 2942
query39 1375 1343 1304 1304
query40 200 90 89 89
query41 35 32 31 31
query42 78 87 87 87
query43 638 552 553 552
query44 1131 729 720 720
query45 239 223 222 222
query46 1219 986 967 967
query47 1780 1781 1787 1781
query48 978 667 671 667
query49 620 366 368 366
query50 857 638 602 602
query51 4724 4691 4665 4665
query52 87 77 77 77
query53 438 317 314 314
query54 2630 2428 2473 2428
query55 85 79 72 72
query56 216 210 205 205
query57 1294 1069 1110 1069
query58 208 201 190 190
query59 3418 3323 3151 3151
query60 196 193 185 185
query61 80 79 78 78
query62 829 570 457 457
query63 476 339 333 333
query64 2330 1405 1426 1405
query65 3599 3575 3543 3543
query66 754 363 359 359
query67 16235 15556 15518 15518
query68 8854 659 678 659
query69 566 336 355 336
query70 2090 2101 1677 1677
query71 411 290 302 290
query72 6447 3452 3413 3413
query73 738 311 318 311
query74 6271 5800 5850 5800
query75 5231 3755 3604 3604
query76 5361 1141 1191 1141
query77 906 249 247 247
query78 12404 11667 11503 11503
query79 8557 639 636 636
query80 1243 384 382 382
query81 475 234 236 234
query82 1688 90 90 90
query83 156 123 124 123
query84 253 67 66 66
query85 846 276 274 274
query86 404 428 370 370
query87 3258 2971 2986 2971
query88 5112 2275 2307 2275
query89 381 283 288 283
query90 1945 208 206 206
query91 146 114 130 114
query92 58 50 52 50
query93 5446 541 574 541
query94 714 194 209 194
query95 1119 1069 1076 1069
query96 639 318 327 318
query97 6439 6358 6408 6358
query98 188 175 173 173
query99 2973 939 913 913
Total cold run time: 311305 ms
Total hot run time: 202611 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Bug](load) fix wrong data in mv when routine load with function mapp… [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31912:
URL: https://github.com/apache/doris/pull/31912#issuecomment-1982473150
<details>
<summary>ClickBench: <b>Total hot run time: 30.92 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d03abb562c6303471de24a8c53caf9725113ba12, data reload: false
query1 0.03 0.03 0.02
query2 0.05 0.02 0.02
query3 0.24 0.05 0.04
query4 1.83 0.07 0.06
query5 0.53 0.52 0.52
query6 1.34 0.64 0.62
query7 0.01 0.01 0.01
query8 0.03 0.02 0.02
query9 0.52 0.49 0.50
query10 0.53 0.54 0.54
query11 0.12 0.09 0.09
query12 0.11 0.09 0.10
query13 0.62 0.62 0.62
query14 0.81 0.79 0.80
query15 0.78 0.76 0.76
query16 0.37 0.39 0.36
query17 0.98 1.02 1.00
query18 0.25 0.26 0.24
query19 1.92 1.86 1.78
query20 0.01 0.01 0.01
query21 15.46 0.55 0.56
query22 1.97 2.41 1.49
query23 17.24 0.89 0.93
query24 4.25 1.32 1.74
query25 0.40 0.14 0.04
query26 0.59 0.14 0.15
query27 0.04 0.03 0.03
query28 7.91 0.75 0.73
query29 12.64 2.34 2.37
query30 0.57 0.51 0.57
query31 2.81 0.39 0.38
query32 3.43 0.51 0.49
query33 3.06 3.06 3.06
query34 15.27 4.80 4.81
query35 4.85 4.83 4.85
query36 1.04 1.00 1.01
query37 0.06 0.05 0.04
query38 0.04 0.02 0.02
query39 0.02 0.02 0.01
query40 0.16 0.14 0.14
query41 0.07 0.02 0.01
query42 0.01 0.01 0.01
query43 0.02 0.02 0.01
Total cold run time: 102.99 s
Total hot run time: 30.92 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Bug](load) fix wrong data in mv when routine load with function mapp… [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31912:
URL: https://github.com/apache/doris/pull/31912#issuecomment-1983227625
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit bd4c411be58dd4ed5da58dd101ef1677fab7de42 with default session variables
Stream load json: 21 seconds loaded 2358488459 Bytes, about 107 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 20.6 seconds inserted 10000000 Rows, about 485K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Bug](load) fix wrong data in mv when routine load with function mapping #31787 [doris]
Posted by "xiaokang (via GitHub)" <gi...@apache.org>.
xiaokang merged PR #31912:
URL: https://github.com/apache/doris/pull/31912
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org