You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "eldenmoon (via GitHub)" <gi...@apache.org> on 2024/03/28 17:30:03 UTC
[PR] [Fix](Variant) forbit table with variant type doing segment compactio… [doris]
eldenmoon opened a new pull request, #33001:
URL: https://github.com/apache/doris/pull/33001
…n temporarily
TODO fix this corretly in later works
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](Variant) forbit table with variant type doing segment compactio… [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #33001:
URL: https://github.com/apache/doris/pull/33001#issuecomment-2025829474
<details>
<summary>TPC-DS: <b>Total hot run time: 182136 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit fe2592a1f0701a2ac2371fbd9b5749bd7a070b73, data reload: false
query1 924 368 346 346
query2 6324 2001 2105 2001
query3 6698 216 220 216
query4 31580 21309 21274 21274
query5 4282 398 419 398
query6 271 181 181 181
query7 4615 295 295 295
query8 234 172 174 172
query9 9086 2264 2255 2255
query10 429 253 250 250
query11 17119 14175 14237 14175
query12 136 91 88 88
query13 1644 422 399 399
query14 9724 7321 7538 7321
query15 255 185 181 181
query16 8174 276 262 262
query17 1938 581 559 559
query18 2089 292 287 287
query19 329 159 156 156
query20 96 87 90 87
query21 205 131 127 127
query22 5077 4822 4797 4797
query23 33484 32744 32879 32744
query24 11138 3028 2920 2920
query25 596 399 410 399
query26 1115 163 162 162
query27 3148 369 366 366
query28 7599 1950 1916 1916
query29 935 657 641 641
query30 313 163 156 156
query31 1033 761 764 761
query32 91 59 60 59
query33 746 273 281 273
query34 1181 512 517 512
query35 911 759 728 728
query36 1097 915 893 893
query37 137 69 71 69
query38 3781 3689 3597 3597
query39 1645 1621 1602 1602
query40 176 113 116 113
query41 55 48 48 48
query42 110 104 105 104
query43 485 466 445 445
query44 1169 756 769 756
query45 297 263 288 263
query46 1163 738 735 735
query47 2045 1962 1954 1954
query48 451 358 368 358
query49 962 356 357 356
query50 802 386 397 386
query51 6879 6826 6786 6786
query52 104 99 87 87
query53 347 295 284 284
query54 284 244 242 242
query55 85 80 87 80
query56 247 236 232 232
query57 1289 1232 1162 1162
query58 235 240 214 214
query59 3081 2710 2628 2628
query60 247 241 230 230
query61 92 90 89 89
query62 615 433 451 433
query63 295 283 270 270
query64 5192 4101 3987 3987
query65 3065 3012 2989 2989
query66 806 359 349 349
query67 15716 14908 15007 14908
query68 8904 545 540 540
query69 624 372 362 362
query70 1207 1116 1141 1116
query71 505 266 260 260
query72 6290 2536 2354 2354
query73 1306 320 325 320
query74 6931 6424 6434 6424
query75 3952 2157 2222 2157
query76 5297 865 840 840
query77 616 263 254 254
query78 11001 10188 10018 10018
query79 11165 521 530 521
query80 2135 399 372 372
query81 524 210 222 210
query82 781 88 85 85
query83 204 143 153 143
query84 290 75 74 74
query85 1344 327 302 302
query86 410 281 318 281
query87 3743 3550 3535 3535
query88 4628 2400 2380 2380
query89 497 373 367 367
query90 1915 178 174 174
query91 171 137 129 129
query92 59 46 46 46
query93 7038 482 481 481
query94 1074 185 172 172
query95 393 308 307 307
query96 601 270 269 269
query97 2678 2494 2487 2487
query98 223 224 209 209
query99 1154 834 858 834
Total cold run time: 314133 ms
Total hot run time: 182136 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](Variant) forbit table with variant type doing segment compaction temporarily [doris]
Posted by "xiaokang (via GitHub)" <gi...@apache.org>.
xiaokang merged PR #33001:
URL: https://github.com/apache/doris/pull/33001
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](Variant) forbit table with variant type doing segment compactio… [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #33001:
URL: https://github.com/apache/doris/pull/33001#issuecomment-2026545451
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](Variant) forbit table with variant type doing segment compactio… [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #33001:
URL: https://github.com/apache/doris/pull/33001#issuecomment-2025755508
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website).
See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](Variant) forbit table with variant type doing segment compactio… [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #33001:
URL: https://github.com/apache/doris/pull/33001#issuecomment-2026545425
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](Variant) forbit table with variant type doing segment compactio… [doris]
Posted by "eldenmoon (via GitHub)" <gi...@apache.org>.
eldenmoon commented on PR #33001:
URL: https://github.com/apache/doris/pull/33001#issuecomment-2025755523
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](Variant) forbit table with variant type doing segment compactio… [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #33001:
URL: https://github.com/apache/doris/pull/33001#issuecomment-2025765070
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](Variant) forbit table with variant type doing segment compactio… [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #33001:
URL: https://github.com/apache/doris/pull/33001#issuecomment-2025844761
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit fe2592a1f0701a2ac2371fbd9b5749bd7a070b73 with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 13.8 seconds inserted 10000000 Rows, about 724K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](Variant) forbit table with variant type doing segment compactio… [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #33001:
URL: https://github.com/apache/doris/pull/33001#issuecomment-2025809927
<details>
<summary>TPC-H: <b>Total hot run time: 37577 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit fe2592a1f0701a2ac2371fbd9b5749bd7a070b73, data reload: false
------ Round 1 ----------------------------------
q1 17616 4203 4102 4102
q2 2118 158 151 151
q3 10582 1110 1149 1110
q4 10231 780 778 778
q5 7456 2894 2890 2890
q6 204 123 122 122
q7 1024 581 571 571
q8 9338 1982 1976 1976
q9 6930 6354 6260 6260
q10 8428 3530 3608 3530
q11 432 224 216 216
q12 414 200 198 198
q13 17803 2848 2830 2830
q14 228 201 206 201
q15 512 467 462 462
q16 468 369 365 365
q17 946 606 572 572
q18 7096 6473 6378 6378
q19 4397 1436 1419 1419
q20 555 254 260 254
q21 3619 2920 2893 2893
q22 356 307 299 299
Total cold run time: 110753 ms
Total hot run time: 37577 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4287 4170 4169 4169
q2 326 239 247 239
q3 3067 2893 2830 2830
q4 1811 1560 1486 1486
q5 5184 5186 5224 5186
q6 203 116 116 116
q7 2187 1833 1816 1816
q8 3155 3261 3312 3261
q9 8411 8446 8410 8410
q10 3804 3870 4011 3870
q11 556 445 465 445
q12 748 594 564 564
q13 17189 3050 3046 3046
q14 318 273 295 273
q15 524 479 477 477
q16 508 443 447 443
q17 1763 1546 1545 1545
q18 7969 7673 7498 7498
q19 1694 1557 1459 1459
q20 2025 1835 1724 1724
q21 5005 4771 4906 4771
q22 536 453 447 447
Total cold run time: 71270 ms
Total hot run time: 54075 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](Variant) forbit table with variant type doing segment compactio… [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #33001:
URL: https://github.com/apache/doris/pull/33001#issuecomment-2025817200
TeamCity be ut coverage result:
Function Coverage: 35.61% (8836/24815)
Line Coverage: 27.32% (72403/265008)
Region Coverage: 26.55% (37549/141431)
Branch Coverage: 23.36% (19153/81996)
Coverage Report: http://coverage.selectdb-in.cc/coverage/fe2592a1f0701a2ac2371fbd9b5749bd7a070b73_fe2592a1f0701a2ac2371fbd9b5749bd7a070b73/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org