You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "airborne12 (via GitHub)" <gi...@apache.org> on 2024/07/29 12:42:37 UTC
[PR] [Pick 2.0](clucene) update clucene version [doris]
airborne12 opened a new pull request, #38495:
URL: https://github.com/apache/doris/pull/38495
## Proposed changes
backport #38482
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Pick 2.0](clucene) update clucene version [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #38495:
URL: https://github.com/apache/doris/pull/38495#issuecomment-2255966637
<details>
<summary>TPC-DS: <b>Total hot run time: 204433 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ec276e7ff986bc57ccb6bdc03e1b89c5d48da711, data reload: false
query1 924 419 377 377
query2 6550 2692 2812 2692
query3 6926 206 196 196
query4 20296 18020 18125 18020
query5 19712 6560 6535 6535
query6 294 221 227 221
query7 4164 296 303 296
query8 422 463 415 415
query9 3185 2726 2678 2678
query10 414 304 301 301
query11 11390 10689 10754 10689
query12 131 78 77 77
query13 5601 730 715 715
query14 17897 13496 13724 13496
query15 360 246 247 246
query16 6472 292 261 261
query17 1751 1450 881 881
query18 2318 425 408 408
query19 221 149 152 149
query20 84 81 77 77
query21 193 100 95 95
query22 5189 5056 4982 4982
query23 32673 31984 31962 31962
query24 6975 6582 6515 6515
query25 527 440 434 434
query26 513 172 167 167
query27 1767 299 295 295
query28 6224 2405 2370 2370
query29 2910 2677 2882 2677
query30 254 166 165 165
query31 909 783 738 738
query32 70 68 61 61
query33 407 253 260 253
query34 849 468 493 468
query35 1131 923 911 911
query36 1452 1253 1316 1253
query37 91 60 63 60
query38 3095 2912 2926 2912
query39 1372 1323 1322 1322
query40 204 97 95 95
query41 47 44 44 44
query42 88 84 87 84
query43 823 688 687 687
query44 1135 713 723 713
query45 247 243 242 242
query46 1213 952 989 952
query47 1865 1777 1728 1728
query48 1027 750 725 725
query49 637 374 363 363
query50 861 650 603 603
query51 4774 4729 4641 4641
query52 97 75 88 75
query53 450 330 319 319
query54 2642 2457 2461 2457
query55 96 80 87 80
query56 227 228 218 218
query57 1268 1135 1128 1128
query58 227 207 203 203
query59 4246 3791 3990 3791
query60 223 202 213 202
query61 98 93 96 93
query62 830 580 526 526
query63 493 345 355 345
query64 2494 1521 1513 1513
query65 3648 3592 3618 3592
query66 766 389 384 384
query67 17188 15604 16482 15604
query68 8145 661 659 659
query69 563 375 355 355
query70 1644 1302 1657 1302
query71 378 303 325 303
query72 6550 3464 3476 3464
query73 737 321 320 320
query74 6257 5855 5920 5855
query75 4626 3712 3704 3704
query76 4620 1160 1176 1160
query77 551 252 261 252
query78 12560 11549 11505 11505
query79 9194 637 642 637
query80 2851 406 401 401
query81 527 242 236 236
query82 1715 105 106 105
query83 190 132 133 132
query84 261 71 74 71
query85 1461 347 336 336
query86 367 298 301 298
query87 3232 3028 3046 3028
query88 5375 2321 2304 2304
query89 388 299 301 299
query90 1706 204 215 204
query91 174 157 153 153
query92 56 60 53 53
query93 5599 571 607 571
query94 886 213 214 213
query95 1135 1069 1089 1069
query96 634 328 320 320
query97 6422 6328 6334 6328
query98 180 168 173 168
query99 2946 851 974 851
Total cold run time: 315557 ms
Total hot run time: 204433 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Pick 2.0](clucene) update clucene version [doris]
Posted by "airborne12 (via GitHub)" <gi...@apache.org>.
airborne12 merged PR #38495:
URL: https://github.com/apache/doris/pull/38495
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Pick 2.0](clucene) update clucene version [doris]
Posted by "airborne12 (via GitHub)" <gi...@apache.org>.
airborne12 commented on PR #38495:
URL: https://github.com/apache/doris/pull/38495#issuecomment-2255832002
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Pick 2.0](clucene) update clucene version [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #38495:
URL: https://github.com/apache/doris/pull/38495#issuecomment-2255846196
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Pick 2.0](clucene) update clucene version [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #38495:
URL: https://github.com/apache/doris/pull/38495#issuecomment-2255986543
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit ec276e7ff986bc57ccb6bdc03e1b89c5d48da711 with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 21.9 seconds inserted 10000000 Rows, about 456K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Pick 2.0](clucene) update clucene version [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #38495:
URL: https://github.com/apache/doris/pull/38495#issuecomment-2255919921
TeamCity be ut coverage result:
Function Coverage: 37.82% (8120/21471)
Line Coverage: 29.48% (66600/225886)
Region Coverage: 28.97% (34336/118516)
Branch Coverage: 24.84% (17638/71002)
Coverage Report: http://coverage.selectdb-in.cc/coverage/ec276e7ff986bc57ccb6bdc03e1b89c5d48da711_ec276e7ff986bc57ccb6bdc03e1b89c5d48da711/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Pick 2.0](clucene) update clucene version [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #38495:
URL: https://github.com/apache/doris/pull/38495#issuecomment-2255831217
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website).
See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Pick 2.0](clucene) update clucene version [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #38495:
URL: https://github.com/apache/doris/pull/38495#issuecomment-2255979440
<details>
<summary>ClickBench: <b>Total hot run time: 31.39 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ec276e7ff986bc57ccb6bdc03e1b89c5d48da711, data reload: false
query1 0.03 0.03 0.02
query2 0.07 0.02 0.02
query3 0.25 0.04 0.03
query4 1.79 0.07 0.08
query5 0.54 0.53 0.52
query6 1.28 0.63 0.62
query7 0.01 0.01 0.01
query8 0.03 0.02 0.03
query9 0.52 0.49 0.46
query10 0.54 0.53 0.52
query11 0.12 0.09 0.09
query12 0.12 0.09 0.09
query13 0.62 0.61 0.61
query14 0.78 0.79 0.78
query15 0.79 0.77 0.78
query16 0.38 0.37 0.36
query17 1.02 1.00 1.01
query18 0.21 0.27 0.23
query19 1.93 1.87 1.90
query20 0.02 0.01 0.00
query21 15.47 0.56 0.57
query22 2.02 2.17 1.82
query23 17.05 1.22 0.99
query24 4.71 1.62 1.55
query25 0.32 0.11 0.07
query26 0.67 0.17 0.16
query27 0.05 0.04 0.04
query28 7.24 0.79 0.75
query29 12.70 2.35 2.07
query30 0.59 0.53 0.53
query31 2.80 0.39 0.37
query32 3.38 0.50 0.49
query33 3.06 3.04 3.11
query34 15.25 4.82 4.78
query35 4.84 4.84 4.87
query36 1.05 1.01 1.02
query37 0.06 0.04 0.05
query38 0.04 0.02 0.02
query39 0.02 0.02 0.01
query40 0.16 0.13 0.14
query41 0.07 0.02 0.01
query42 0.03 0.01 0.02
query43 0.02 0.01 0.02
Total cold run time: 102.65 s
Total hot run time: 31.39 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Pick 2.0](clucene) update clucene version [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #38495:
URL: https://github.com/apache/doris/pull/38495#issuecomment-2255932227
<details>
<summary>TPC-H: <b>Total hot run time: 49832 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ec276e7ff986bc57ccb6bdc03e1b89c5d48da711, data reload: false
------ Round 1 ----------------------------------
q1 17770 4357 4338 4338
q2 2078 153 152 152
q3 10447 1871 2118 1871
q4 10299 1251 1287 1251
q5 8520 3817 3918 3817
q6 253 144 125 125
q7 2045 1611 1570 1570
q8 9287 2728 2698 2698
q9 10545 10303 10275 10275
q10 8625 3502 3481 3481
q11 421 253 246 246
q12 467 298 301 298
q13 18348 3954 4035 3954
q14 368 345 337 337
q15 500 456 453 453
q16 716 579 602 579
q17 1138 957 947 947
q18 7360 6977 6945 6945
q19 1821 1670 1668 1668
q20 552 312 317 312
q21 4506 4076 4145 4076
q22 544 439 449 439
Total cold run time: 116610 ms
Total hot run time: 49832 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4359 4264 4288 4264
q2 322 222 219 219
q3 4130 4144 4131 4131
q4 2738 2740 2743 2740
q5 7132 7116 7141 7116
q6 239 122 122 122
q7 3219 2912 2861 2861
q8 4372 4479 4496 4479
q9 16773 16828 16806 16806
q10 4231 4263 4329 4263
q11 795 658 697 658
q12 1023 859 857 857
q13 7373 3735 3752 3735
q14 456 433 424 424
q15 501 454 456 454
q16 727 696 670 670
q17 3827 3875 3829 3829
q18 8779 8830 8775 8775
q19 1735 1698 1627 1627
q20 2378 2101 2132 2101
q21 8522 8559 8549 8549
q22 1032 981 986 981
Total cold run time: 84663 ms
Total hot run time: 79661 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org