You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "xiaokang (via GitHub)" <gi...@apache.org> on 2024/02/22 10:01:15 UTC
[PR] [fix](index) do not automatically change BITMAP index to INVERTED [doris]
xiaokang opened a new pull request, #31285:
URL: https://github.com/apache/doris/pull/31285
## Proposed changes
Issue Number: close #xxx
rollback some changes of #31003
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](index) do not automatically change BITMAP index to INVERTED [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31285:
URL: https://github.com/apache/doris/pull/31285#issuecomment-1959130089
<details>
<summary>TPC-H: <b>Total hot run time: 50332 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 38bf869765bd5a02c75d6d86efccb00fb3dc85e0, data reload: false
------ Round 1 ----------------------------------
q1 17527 4359 4320 4320
q2 2022 155 144 144
q3 10268 1914 1941 1914
q4 10094 1267 1304 1267
q5 8449 3944 3982 3944
q6 228 126 125 125
q7 2078 1591 1600 1591
q8 9320 2723 2716 2716
q9 10773 11177 10700 10700
q10 8641 3494 3535 3494
q11 418 243 241 241
q12 463 301 297 297
q13 18364 3970 4029 3970
q14 360 324 333 324
q15 515 454 456 454
q16 698 598 592 592
q17 1141 965 977 965
q18 7278 6986 6984 6984
q19 1677 1565 1501 1501
q20 490 299 329 299
q21 4439 4128 4089 4089
q22 507 405 401 401
Total cold run time: 115750 ms
Total hot run time: 50332 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4327 4307 4273 4273
q2 320 226 225 225
q3 4190 4171 4128 4128
q4 2756 2741 2775 2741
q5 7275 7226 7430 7226
q6 232 119 121 119
q7 3241 2847 2907 2847
q8 4349 4448 4484 4448
q9 17190 16979 16923 16923
q10 4229 4288 4283 4283
q11 764 697 681 681
q12 1028 859 853 853
q13 5375 3755 3738 3738
q14 443 420 437 420
q15 499 460 453 453
q16 767 714 699 699
q17 3761 3830 3771 3771
q18 8813 8781 8884 8781
q19 1693 1724 1638 1638
q20 2364 2166 2091 2091
q21 8681 8520 8483 8483
q22 1079 946 939 939
Total cold run time: 83376 ms
Total hot run time: 79760 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](index) do not automatically change BITMAP index to INVERTED [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31285:
URL: https://github.com/apache/doris/pull/31285#issuecomment-1959153343
<details>
<summary>TPC-DS: <b>Total hot run time: 201277 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 38bf869765bd5a02c75d6d86efccb00fb3dc85e0, data reload: false
query1 914 388 381 381
query2 6516 2245 2010 2010
query3 6914 193 194 193
query4 21081 18140 17926 17926
query5 19737 6568 6506 6506
query6 288 215 229 215
query7 4148 307 315 307
query8 260 231 240 231
query9 3109 2682 2640 2640
query10 430 297 290 290
query11 11317 10713 10850 10713
query12 118 78 71 71
query13 5599 643 620 620
query14 18056 13314 13369 13314
query15 365 230 242 230
query16 6448 262 266 262
query17 1729 1447 866 866
query18 2298 408 409 408
query19 208 148 148 148
query20 79 76 75 75
query21 187 93 89 89
query22 5363 5168 5258 5168
query23 32742 31862 31917 31862
query24 6952 6539 6498 6498
query25 512 428 422 422
query26 521 171 161 161
query27 1889 296 301 296
query28 6158 2220 2194 2194
query29 2919 2658 2693 2658
query30 240 162 161 161
query31 883 736 739 736
query32 68 60 56 56
query33 409 254 261 254
query34 848 478 486 478
query35 1089 881 889 881
query36 1668 1658 1459 1459
query37 91 64 60 60
query38 3142 2916 2913 2913
query39 1370 1326 1312 1312
query40 205 102 99 99
query41 37 37 37 37
query42 92 80 84 80
query43 647 646 577 577
query44 1150 711 713 711
query45 237 227 232 227
query46 1222 994 992 992
query47 1888 2017 1673 1673
query48 969 690 657 657
query49 608 366 376 366
query50 873 708 634 634
query51 4766 4701 4611 4611
query52 91 84 75 75
query53 445 312 315 312
query54 2640 2452 2479 2452
query55 92 73 79 73
query56 222 196 225 196
query57 1164 1099 1060 1060
query58 221 207 198 198
query59 3333 3278 3243 3243
query60 215 199 201 199
query61 86 93 86 86
query62 834 523 636 523
query63 463 337 337 337
query64 2495 1510 1371 1371
query65 3642 3569 3597 3569
query66 795 358 372 358
query67 16476 15785 14782 14782
query68 9477 685 677 677
query69 570 346 344 344
query70 2036 1607 1655 1607
query71 410 311 320 311
query72 6402 3419 3419 3419
query73 735 315 322 315
query74 6332 5953 5760 5760
query75 5651 3830 3650 3650
query76 6021 1155 1221 1155
query77 982 247 246 246
query78 12489 11480 11675 11480
query79 6765 638 667 638
query80 1043 406 402 402
query81 506 237 233 233
query82 1489 100 97 97
query83 176 132 134 132
query84 255 68 68 68
query85 859 286 279 279
query86 400 371 383 371
query87 3245 3056 3010 3010
query88 4709 2311 2308 2308
query89 371 305 291 291
query90 1950 214 214 214
query91 155 116 116 116
query92 56 56 52 52
query93 5187 537 567 537
query94 694 199 210 199
query95 1140 1076 1049 1049
query96 637 330 319 319
query97 6487 6351 6451 6351
query98 191 177 174 174
query99 2888 918 911 911
Total cold run time: 312881 ms
Total hot run time: 201277 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](index) do not automatically change BITMAP index to INVERTED [doris]
Posted by "xiaokang (via GitHub)" <gi...@apache.org>.
xiaokang commented on PR #31285:
URL: https://github.com/apache/doris/pull/31285#issuecomment-1959095514
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](index) do not automatically change BITMAP index to INVERTED [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31285:
URL: https://github.com/apache/doris/pull/31285#issuecomment-1959168830
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 38bf869765bd5a02c75d6d86efccb00fb3dc85e0 with default session variables
Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 21.2 seconds inserted 10000000 Rows, about 471K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](index) do not automatically change BITMAP index to INVERTED [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #31285:
URL: https://github.com/apache/doris/pull/31285#issuecomment-1959252185
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](index) do not automatically change BITMAP index to INVERTED [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31285:
URL: https://github.com/apache/doris/pull/31285#issuecomment-1959095146
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](index) do not automatically change BITMAP index to INVERTED [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31285:
URL: https://github.com/apache/doris/pull/31285#issuecomment-1959162937
<details>
<summary>ClickBench: <b>Total hot run time: 31.14 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 38bf869765bd5a02c75d6d86efccb00fb3dc85e0, data reload: false
query1 0.02 0.03 0.02
query2 0.05 0.02 0.02
query3 0.24 0.06 0.07
query4 1.80 0.11 0.11
query5 0.53 0.54 0.53
query6 1.29 0.67 0.62
query7 0.01 0.01 0.01
query8 0.03 0.02 0.03
query9 0.53 0.48 0.47
query10 0.54 0.54 0.55
query11 0.12 0.08 0.09
query12 0.11 0.09 0.10
query13 0.62 0.61 0.61
query14 0.79 0.77 0.81
query15 0.78 0.77 0.78
query16 0.36 0.35 0.37
query17 1.03 1.00 1.02
query18 0.23 0.25 0.24
query19 1.91 1.86 1.89
query20 0.01 0.01 0.01
query21 15.51 0.57 0.57
query22 1.96 1.80 1.22
query23 17.09 1.09 0.93
query24 3.66 4.01 1.64
query25 1.62 0.12 0.11
query26 0.36 0.15 0.14
query27 0.12 0.12 0.11
query28 5.71 0.80 0.71
query29 12.67 2.21 2.29
query30 0.54 0.53 0.51
query31 2.81 0.39 0.39
query32 3.39 0.49 0.50
query33 3.12 3.04 3.15
query34 15.24 4.82 4.78
query35 4.85 4.87 4.85
query36 1.06 1.01 1.02
query37 0.05 0.05 0.04
query38 0.03 0.03 0.02
query39 0.02 0.01 0.02
query40 0.16 0.13 0.14
query41 0.07 0.02 0.02
query42 0.02 0.01 0.01
query43 0.02 0.02 0.02
Total cold run time: 101.08 s
Total hot run time: 31.14 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](index) do not automatically change BITMAP index to INVERTED [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #31285:
URL: https://github.com/apache/doris/pull/31285#issuecomment-1959252276
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](index) do not automatically change BITMAP index to INVERTED [doris]
Posted by "xiaokang (via GitHub)" <gi...@apache.org>.
xiaokang merged PR #31285:
URL: https://github.com/apache/doris/pull/31285
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org