You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "csun5285 (via GitHub)" <gi...@apache.org> on 2024/10/25 10:02:07 UTC
[PR] [fix] (inverted index) fix the error result in the query when using count on index #42346 [doris]
csun5285 opened a new pull request, #42495:
URL: https://github.com/apache/doris/pull/42495
## Proposed changes
pick from master #42346
<!--Describe your changes.-->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix] (inverted index) fix the error result in the query when using count on index #42346 [doris]
Posted by "airborne12 (via GitHub)" <gi...@apache.org>.
airborne12 merged PR #42495:
URL: https://github.com/apache/doris/pull/42495
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix] (inverted index) fix the error result in the query when using count on index #42346 [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #42495:
URL: https://github.com/apache/doris/pull/42495#issuecomment-2437387380
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website).
See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix] (inverted index) fix the error result in the query when using count on index #42346 [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #42495:
URL: https://github.com/apache/doris/pull/42495#issuecomment-2440460306
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix] (inverted index) fix the error result in the query when using count on index #42346 [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #42495:
URL: https://github.com/apache/doris/pull/42495#issuecomment-2437468898
<details>
<summary>TPC-DS: <b>Total hot run time: 212714 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 05b8e5cca67722fe44da01f5b6821b238272b2f8, data reload: false
query1 925 399 412 399
query2 6557 2280 2109 2109
query3 6924 201 201 201
query4 23121 21449 21547 21449
query5 19745 6525 6518 6518
query6 406 218 239 218
query7 5048 302 308 302
query8 250 261 261 261
query9 3096 2655 2585 2585
query10 419 323 302 302
query11 15844 15282 15523 15282
query12 130 74 79 74
query13 1029 452 441 441
query14 18756 13620 13420 13420
query15 388 218 228 218
query16 6451 286 268 268
query17 1517 937 929 929
query18 899 318 325 318
query19 213 155 157 155
query20 99 96 98 96
query21 193 97 102 97
query22 5210 4869 5004 4869
query23 34267 33423 33452 33423
query24 6539 6305 6364 6305
query25 543 431 435 431
query26 800 165 160 160
query27 2315 304 302 302
query28 6084 2239 2205 2205
query29 2862 2784 2778 2778
query30 246 167 168 167
query31 961 752 743 743
query32 73 64 64 64
query33 444 263 270 263
query34 861 476 481 476
query35 1127 944 902 902
query36 1251 1221 1133 1133
query37 94 61 63 61
query38 3118 2955 2903 2903
query39 1362 1340 1341 1340
query40 212 98 97 97
query41 41 37 36 36
query42 101 91 82 82
query43 709 648 579 579
query44 1222 725 734 725
query45 245 227 231 227
query46 1226 967 957 957
query47 1928 1935 1835 1835
query48 531 422 415 415
query49 621 389 399 389
query50 882 609 578 578
query51 4804 4645 4707 4645
query52 95 73 96 73
query53 227 184 193 184
query54 2674 2500 2500 2500
query55 95 89 83 83
query56 235 201 217 201
query57 1212 1120 1204 1120
query58 213 223 229 223
query59 3663 3455 3404 3404
query60 222 224 215 215
query61 100 96 105 96
query62 875 463 471 463
query63 204 179 173 173
query64 3354 1596 1532 1532
query65 3624 3544 3578 3544
query66 747 445 400 400
query67 15380 16077 14982 14982
query68 9275 648 630 630
query69 515 278 265 265
query70 1625 1315 1482 1315
query71 409 307 310 307
query72 7018 4888 4869 4869
query73 744 322 323 322
query74 6305 5813 5889 5813
query75 5087 3715 3675 3675
query76 5050 1126 1182 1126
query77 738 257 257 257
query78 12850 12038 11575 11575
query79 7477 648 616 616
query80 1919 401 384 384
query81 485 241 237 237
query82 1681 106 101 101
query83 166 137 137 137
query84 260 72 71 71
query85 1020 319 318 318
query86 348 292 305 292
query87 3197 2977 3027 2977
query88 4685 2297 2276 2276
query89 378 281 286 281
query90 1860 214 208 208
query91 159 129 127 127
query92 57 51 50 50
query93 5874 543 564 543
query94 732 210 214 210
query95 2052 2051 2034 2034
query96 648 316 316 316
query97 6519 6394 6396 6394
query98 223 199 197 197
query99 2978 910 866 866
Total cold run time: 317943 ms
Total hot run time: 212714 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix] (inverted index) fix the error result in the query when using count on index #42346 [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #42495:
URL: https://github.com/apache/doris/pull/42495#issuecomment-2437445895
<details>
<summary>TPC-H: <b>Total hot run time: 49312 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 05b8e5cca67722fe44da01f5b6821b238272b2f8, data reload: false
------ Round 1 ----------------------------------
q1 17948 4437 4368 4368
q2 2057 161 145 145
q3 10436 1909 1921 1909
q4 10293 1239 1345 1239
q5 8416 3955 3949 3949
q6 240 127 125 125
q7 2065 1624 1597 1597
q8 9520 2743 2723 2723
q9 13104 9970 10095 9970
q10 8647 3527 3520 3520
q11 409 249 243 243
q12 460 300 310 300
q13 18350 4000 4039 4000
q14 356 340 325 325
q15 501 458 453 453
q16 542 469 450 450
q17 1145 958 930 930
q18 7252 6844 7005 6844
q19 1670 1518 1485 1485
q20 532 301 305 301
q21 4441 4176 4045 4045
q22 504 402 391 391
Total cold run time: 118888 ms
Total hot run time: 49312 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4358 4340 4278 4278
q2 322 226 226 226
q3 4210 4138 4140 4138
q4 2756 2772 2783 2772
q5 7268 7195 7134 7134
q6 239 122 121 121
q7 3271 2815 2853 2815
q8 4401 4513 4473 4473
q9 14310 13927 14003 13927
q10 4252 4311 4306 4306
q11 763 734 679 679
q12 1021 873 864 864
q13 7617 3868 3903 3868
q14 471 451 452 451
q15 500 466 468 466
q16 660 621 640 621
q17 3918 3902 3960 3902
q18 8975 8884 8969 8884
q19 1749 1662 1689 1662
q20 2447 2158 2134 2134
q21 8532 8482 8480 8480
q22 1042 962 966 962
Total cold run time: 83082 ms
Total hot run time: 77163 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix] (inverted index) fix the error result in the query when using count on index #42346 [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #42495:
URL: https://github.com/apache/doris/pull/42495#issuecomment-2437479370
<details>
<summary>ClickBench: <b>Total hot run time: 30.88 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 05b8e5cca67722fe44da01f5b6821b238272b2f8, data reload: false
query1 0.02 0.02 0.03
query2 0.06 0.02 0.02
query3 0.25 0.04 0.04
query4 1.81 0.07 0.05
query5 0.53 0.53 0.51
query6 1.23 0.60 0.61
query7 0.02 0.01 0.01
query8 0.04 0.02 0.03
query9 0.52 0.50 0.48
query10 0.54 0.54 0.53
query11 0.12 0.10 0.09
query12 0.11 0.09 0.09
query13 0.62 0.60 0.61
query14 0.79 0.79 0.80
query15 0.78 0.75 0.76
query16 0.36 0.36 0.36
query17 1.03 0.99 1.02
query18 0.22 0.24 0.24
query19 1.90 1.82 1.86
query20 0.02 0.01 0.01
query21 15.43 0.56 0.59
query22 2.21 2.70 1.65
query23 17.34 1.16 0.94
query24 6.74 1.10 1.78
query25 0.39 0.14 0.05
query26 0.73 0.15 0.16
query27 0.05 0.05 0.04
query28 5.59 0.74 0.72
query29 12.62 2.36 2.33
query30 0.60 0.53 0.55
query31 2.80 0.39 0.37
query32 3.37 0.49 0.48
query33 3.05 3.08 3.04
query34 15.25 4.82 4.79
query35 4.87 4.86 4.84
query36 1.08 1.02 1.02
query37 0.06 0.05 0.05
query38 0.04 0.02 0.03
query39 0.02 0.01 0.02
query40 0.16 0.14 0.14
query41 0.07 0.01 0.01
query42 0.02 0.02 0.01
query43 0.02 0.01 0.02
Total cold run time: 103.48 s
Total hot run time: 30.88 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix] (inverted index) fix the error result in the query when using count on index #42346 [doris]
Posted by "csun5285 (via GitHub)" <gi...@apache.org>.
csun5285 commented on PR #42495:
URL: https://github.com/apache/doris/pull/42495#issuecomment-2437387491
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix] (inverted index) fix the error result in the query when using count on index #42346 [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #42495:
URL: https://github.com/apache/doris/pull/42495#issuecomment-2440460271
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix] (inverted index) fix the error result in the query when using count on index #42346 [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #42495:
URL: https://github.com/apache/doris/pull/42495#issuecomment-2437484917
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 05b8e5cca67722fe44da01f5b6821b238272b2f8 with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 22.2 seconds inserted 10000000 Rows, about 450K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org