You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "morningman (via GitHub)" <gi...@apache.org> on 2024/02/19 16:27:10 UTC
[PR] [opt](deps) reduce the size of FE dependencies (#31129) [doris]
morningman opened a new pull request, #31130:
URL: https://github.com/apache/doris/pull/31130
bp #31129
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](deps) reduce the size of FE dependencies (#31129) [doris]
Posted by "morningman (via GitHub)" <gi...@apache.org>.
morningman commented on PR #31130:
URL: https://github.com/apache/doris/pull/31130#issuecomment-1952821950
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](deps) reduce the size of FE dependencies (#31129) [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31130:
URL: https://github.com/apache/doris/pull/31130#issuecomment-1952821781
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](deps) reduce the size of FE dependencies (#31129) [doris]
Posted by "morningman (via GitHub)" <gi...@apache.org>.
morningman merged PR #31130:
URL: https://github.com/apache/doris/pull/31130
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](deps) reduce the size of FE dependencies (#31129) [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31130:
URL: https://github.com/apache/doris/pull/31130#issuecomment-1952913071
<details>
<summary>TPC-DS: <b>Total hot run time: 236669 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit aa0e62628ba9796b54a7701d075fa6f05c7d1ce1, data reload: false
query1 948 396 399 396
query2 6524 2372 2045 2045
query3 6922 207 203 203
query4 20519 17999 18054 17999
query5 19715 6469 6502 6469
query6 283 212 230 212
query7 4140 291 304 291
query8 236 247 236 236
query9 3136 2717 2652 2652
query10 404 296 301 296
query11 11256 10606 10691 10606
query12 118 76 66 66
query13 5582 650 620 620
query14 17386 13695 13464 13464
query15 360 232 225 225
query16 6433 260 259 259
query17 1724 1474 856 856
query18 2328 423 396 396
query19 197 141 143 141
query20 76 80 75 75
query21 186 98 94 94
query22 5331 5106 5218 5106
query23 32649 31811 32001 31811
query24 6956 6577 6480 6480
query25 522 422 402 402
query26 533 161 156 156
query27 1871 296 305 296
query28 6051 2206 2174 2174
query29 2952 2695 2765 2695
query30 246 163 158 158
query31 888 739 722 722
query32 64 58 57 57
query33 388 253 229 229
query34 844 452 486 452
query35 1101 920 927 920
query36 1479 1613 1881 1613
query37 83 59 59 59
query38 3013 2983 2961 2961
query39 1377 1318 1318 1318
query40 206 93 97 93
query41 35 36 32 32
query42 83 76 79 76
query43 641 624 555 555
query44 1147 711 709 709
query45 238 225 225 225
query46 1245 965 960 960
query47 1825 1613 1697 1613
query48 980 692 670 670
query49 604 364 360 360
query50 863 586 604 586
query51 5615 5438 5467 5438
query52 88 78 72 72
query53 447 314 324 314
query54 2640 2459 2418 2418
query55 92 77 87 77
query56 194 186 179 179
query57 1204 1099 1063 1063
query58 203 215 198 198
query59 3565 3408 3441 3408
query60 207 188 196 188
query61 82 82 80 80
query62 855 463 504 463
query63 478 332 338 332
query64 2473 1467 1438 1438
query65 3635 3580 3591 3580
query66 765 357 371 357
query67 15607 15275 15014 15014
query68 10402 639 666 639
query69 570 349 366 349
query70 2324 1905 1885 1885
query71 414 292 309 292
query72 6396 3411 3386 3386
query73 744 317 320 317
query74 6321 5772 5808 5772
query75 5626 3682 3645 3645
query76 6948 1153 1245 1153
query77 1197 253 246 246
query78 32362 49975 45630 45630
query79 16641 660 634 634
query80 5419 385 379 379
query81 572 232 237 232
query82 1117 95 95 95
query83 412 139 128 128
query84 264 71 68 68
query85 2648 279 269 269
query86 487 369 358 358
query87 3319 2992 3030 2992
query88 7059 2354 2371 2354
query89 484 311 276 276
query90 2508 216 200 200
query91 163 117 123 117
query92 61 57 50 50
query93 6917 587 604 587
query94 1849 211 201 201
query95 1133 1077 1066 1066
query96 638 333 329 329
query97 6495 6244 6366 6244
query98 181 175 176 175
query99 3948 893 938 893
Total cold run time: 356457 ms
Total hot run time: 236669 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](deps) reduce the size of FE dependencies (#31129) [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31130:
URL: https://github.com/apache/doris/pull/31130#issuecomment-1952892594
<details>
<summary>TPC-H: <b>Total hot run time: 49848 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit aa0e62628ba9796b54a7701d075fa6f05c7d1ce1, data reload: false
------ Round 1 ----------------------------------
q1 17674 4381 4362 4362
q2 2092 148 144 144
q3 10471 1876 1909 1876
q4 10314 1228 1297 1228
q5 8467 3996 3870 3870
q6 224 122 123 122
q7 2040 1619 1563 1563
q8 9526 2698 2703 2698
q9 13367 10443 10360 10360
q10 8634 3485 3507 3485
q11 420 243 242 242
q12 465 299 300 299
q13 18402 3970 4022 3970
q14 351 322 340 322
q15 513 458 453 453
q16 716 598 591 591
q17 1135 967 962 962
q18 7344 6921 7010 6921
q19 1691 1570 1568 1568
q20 540 316 315 315
q21 4431 4111 4099 4099
q22 509 398 402 398
Total cold run time: 119326 ms
Total hot run time: 49848 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4393 4370 4329 4329
q2 319 226 231 226
q3 4144 4175 4201 4175
q4 2760 2773 2762 2762
q5 7245 7223 7459 7223
q6 236 123 120 120
q7 3404 2959 2971 2959
q8 4537 4653 4603 4603
q9 17380 17054 16925 16925
q10 4241 4214 4312 4214
q11 774 677 690 677
q12 1034 850 854 850
q13 6947 3765 3724 3724
q14 445 425 423 423
q15 500 462 443 443
q16 774 694 688 688
q17 3827 3932 3930 3930
q18 8822 8716 8825 8716
q19 1702 1672 1620 1620
q20 2382 2148 2101 2101
q21 8577 8491 8484 8484
q22 1065 974 969 969
Total cold run time: 85508 ms
Total hot run time: 80161 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](deps) reduce the size of FE dependencies (#31129) [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31130:
URL: https://github.com/apache/doris/pull/31130#issuecomment-1952920750
<details>
<summary>ClickBench: <b>Total hot run time: 31.14 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit aa0e62628ba9796b54a7701d075fa6f05c7d1ce1, data reload: false
query1 0.02 0.01 0.02
query2 0.07 0.02 0.02
query3 0.25 0.05 0.05
query4 1.81 0.07 0.07
query5 0.53 0.52 0.52
query6 1.23 0.61 0.63
query7 0.02 0.01 0.02
query8 0.04 0.02 0.02
query9 0.52 0.47 0.48
query10 0.54 0.52 0.54
query11 0.12 0.08 0.09
query12 0.11 0.09 0.09
query13 0.61 0.62 0.62
query14 0.79 0.78 0.79
query15 0.78 0.77 0.76
query16 0.38 0.38 0.36
query17 0.99 1.02 1.03
query18 0.22 0.28 0.23
query19 1.96 1.83 1.85
query20 0.01 0.01 0.01
query21 15.46 0.55 0.55
query22 2.04 2.00 1.64
query23 17.29 0.93 0.95
query24 7.90 1.42 1.22
query25 1.59 0.12 0.11
query26 0.37 0.14 0.14
query27 0.11 0.12 0.10
query28 5.61 0.73 0.71
query29 12.68 2.35 2.37
query30 0.53 0.51 0.49
query31 2.81 0.38 0.39
query32 3.41 0.51 0.49
query33 3.09 3.06 3.09
query34 15.26 4.80 4.81
query35 4.85 4.87 4.83
query36 1.07 1.02 1.00
query37 0.06 0.05 0.05
query38 0.03 0.02 0.02
query39 0.01 0.02 0.02
query40 0.16 0.13 0.14
query41 0.07 0.01 0.01
query42 0.02 0.02 0.01
query43 0.02 0.02 0.02
Total cold run time: 105.44 s
Total hot run time: 31.14 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](deps) reduce the size of FE dependencies (#31129) [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31130:
URL: https://github.com/apache/doris/pull/31130#issuecomment-1952924772
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit aa0e62628ba9796b54a7701d075fa6f05c7d1ce1 with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 21.2 seconds inserted 10000000 Rows, about 471K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org