You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "zddr (via GitHub)" <gi...@apache.org> on 2024/02/02 01:57:57 UTC
[PR] [fix](mtmv)compatibility metadata without refreshsnapshot [doris]
zddr opened a new pull request, #30735:
URL: https://github.com/apache/doris/pull/30735
## Proposed changes
Issue Number: close #xxx
Previously created mtmv, refreshsnapshot is null
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](mtmv)compatibility metadata without refreshsnapshot [doris]
Posted by "yiguolei (via GitHub)" <gi...@apache.org>.
yiguolei merged PR #30735:
URL: https://github.com/apache/doris/pull/30735
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](mtmv)compatibility metadata without refreshsnapshot [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30735:
URL: https://github.com/apache/doris/pull/30735#issuecomment-1922684885
<details>
<summary>TPC-DS: <b>Total hot run time: 174300 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e6c6a80e832442c44d51e82ff492f8a68e52bfef, data reload: false
query1 937 342 324 324
query2 6551 1979 1891 1891
query3 6709 204 196 196
query4 31779 22074 22116 22074
query5 4469 422 423 422
query6 254 161 154 154
query7 4607 261 258 258
query8 252 179 175 175
query9 9405 2285 2285 2285
query10 413 230 211 211
query11 18281 15422 15618 15422
query12 120 70 71 70
query13 1630 377 376 376
query14 10066 7763 6945 6945
query15 261 183 191 183
query16 7527 264 251 251
query17 2000 494 461 461
query18 1944 265 251 251
query19 343 135 133 133
query20 78 71 70 70
query21 189 132 141 132
query22 4890 4602 4566 4566
query23 31049 30319 30393 30319
query24 6645 2754 2765 2754
query25 519 321 303 303
query26 708 137 138 137
query27 2073 279 289 279
query28 4582 1875 1846 1846
query29 927 614 603 603
query30 278 132 140 132
query31 929 695 721 695
query32 90 58 49 49
query33 436 220 217 217
query34 817 462 466 462
query35 866 749 747 747
query36 1018 928 919 919
query37 91 63 57 57
query38 3236 3190 3144 3144
query39 1315 1270 1263 1263
query40 196 89 86 86
query41 41 35 34 34
query42 88 82 86 82
query43 534 493 477 477
query44 1037 689 705 689
query45 193 181 173 173
query46 1056 644 639 639
query47 1540 1562 1513 1513
query48 404 313 321 313
query49 1082 295 283 283
query50 672 307 322 307
query51 5243 5183 5174 5174
query52 94 74 71 71
query53 322 265 260 260
query54 225 181 191 181
query55 80 80 79 79
query56 182 172 165 165
query57 975 880 895 880
query58 182 154 155 154
query59 2588 2404 2353 2353
query60 202 180 181 180
query61 84 83 83 83
query62 613 378 372 372
query63 276 254 264 254
query64 4489 3061 3432 3061
query65 3275 3241 3197 3197
query66 942 314 311 311
query67 14674 14151 14208 14151
query68 4284 512 497 497
query69 442 312 313 312
query70 1291 1240 1284 1240
query71 284 209 209 209
query72 5532 3104 2837 2837
query73 687 314 311 311
query74 6690 6185 6289 6185
query75 2996 2290 2329 2290
query76 2552 967 922 922
query77 365 230 228 228
query78 9155 8793 8607 8607
query79 2757 495 491 491
query80 2079 327 325 325
query81 550 196 198 196
query82 865 88 83 83
query83 250 119 115 115
query84 280 82 73 73
query85 2303 368 331 331
query86 493 300 292 292
query87 3454 3243 3262 3243
query88 3802 2183 2193 2183
query89 432 357 344 344
query90 1895 185 185 185
query91 150 113 142 113
query92 58 43 41 41
query93 3310 458 446 446
query94 1363 157 166 157
query95 499 457 444 444
query96 633 321 312 312
query97 4313 4116 4156 4116
query98 208 194 186 186
query99 1269 723 688 688
Total cold run time: 274814 ms
Total hot run time: 174300 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](mtmv)compatibility metadata without refreshsnapshot [doris]
Posted by "zddr (via GitHub)" <gi...@apache.org>.
zddr commented on PR #30735:
URL: https://github.com/apache/doris/pull/30735#issuecomment-1922648812
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](mtmv)compatibility metadata without refreshsnapshot [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30735:
URL: https://github.com/apache/doris/pull/30735#issuecomment-1922648628
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](mtmv)compatibility metadata without refreshsnapshot [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30735:
URL: https://github.com/apache/doris/pull/30735#issuecomment-1922674155
<details>
<summary>TPC-H: <b>Total hot run time: 36672 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e6c6a80e832442c44d51e82ff492f8a68e52bfef, data reload: false
------ Round 1 ----------------------------------
q1 17706 4451 4408 4408
q2 2036 141 129 129
q3 10605 926 930 926
q4 4655 703 719 703
q5 7671 2710 2748 2710
q6 183 124 119 119
q7 1156 724 700 700
q8 9268 1998 1978 1978
q9 7253 6318 6293 6293
q10 8070 2444 2411 2411
q11 407 213 202 202
q12 790 278 287 278
q13 18040 3307 3309 3307
q14 283 240 252 240
q15 515 491 492 491
q16 461 409 402 402
q17 923 490 467 467
q18 6726 5926 5867 5867
q19 1592 1380 1413 1380
q20 619 317 330 317
q21 6775 3152 3047 3047
q22 807 305 297 297
Total cold run time: 106541 ms
Total hot run time: 36672 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4484 4492 4452 4452
q2 335 237 235 235
q3 2979 2879 2811 2811
q4 1844 1622 1634 1622
q5 5139 5229 5218 5218
q6 188 114 118 114
q7 2123 1734 1797 1734
q8 3109 3204 3222 3204
q9 8244 8301 8235 8235
q10 5869 3521 3511 3511
q11 540 471 450 450
q12 731 567 561 561
q13 14568 3140 3127 3127
q14 276 249 253 249
q15 533 490 489 489
q16 498 482 484 482
q17 1796 1747 1730 1730
q18 7985 7700 7593 7593
q19 10555 1533 1550 1533
q20 2129 1901 1890 1890
q21 4735 4532 4732 4532
q22 529 433 456 433
Total cold run time: 79189 ms
Total hot run time: 54205 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](mtmv)compatibility metadata without refreshsnapshot [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30735:
URL: https://github.com/apache/doris/pull/30735#issuecomment-1922688889
<details>
<summary>ClickBench: <b>Total hot run time: 30.86 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e6c6a80e832442c44d51e82ff492f8a68e52bfef, data reload: false
query1 0.04 0.03 0.03
query2 0.05 0.02 0.02
query3 0.23 0.06 0.06
query4 1.68 0.10 0.10
query5 0.52 0.51 0.53
query6 1.23 0.64 0.63
query7 0.02 0.01 0.01
query8 0.03 0.03 0.03
query9 0.55 0.49 0.51
query10 0.56 0.55 0.55
query11 0.11 0.09 0.09
query12 0.11 0.09 0.10
query13 0.60 0.60 0.60
query14 0.78 0.81 0.79
query15 0.82 0.78 0.77
query16 0.40 0.38 0.39
query17 1.04 1.01 1.01
query18 0.23 0.27 0.24
query19 1.87 1.76 1.82
query20 0.01 0.01 0.01
query21 15.42 0.58 0.56
query22 3.04 2.43 1.79
query23 17.16 0.75 0.76
query24 2.49 1.12 0.89
query25 0.32 0.26 0.14
query26 0.52 0.14 0.14
query27 0.05 0.04 0.05
query28 11.69 0.84 0.84
query29 12.59 3.10 3.11
query30 0.62 0.55 0.53
query31 2.79 0.35 0.35
query32 3.35 0.49 0.47
query33 3.20 3.22 3.24
query34 15.82 4.25 4.28
query35 4.30 4.32 4.30
query36 1.13 1.07 1.06
query37 0.06 0.04 0.04
query38 0.04 0.03 0.03
query39 0.02 0.02 0.02
query40 0.16 0.13 0.13
query41 0.07 0.02 0.01
query42 0.02 0.01 0.02
query43 0.02 0.02 0.02
Total cold run time: 105.76 s
Total hot run time: 30.86 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](mtmv)compatibility metadata without refreshsnapshot [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30735:
URL: https://github.com/apache/doris/pull/30735#issuecomment-1922730344
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](mtmv)compatibility metadata without refreshsnapshot [doris]
Posted by "zddr (via GitHub)" <gi...@apache.org>.
zddr commented on PR #30735:
URL: https://github.com/apache/doris/pull/30735#issuecomment-1922719377
run pipelinex_p0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](mtmv)compatibility metadata without refreshsnapshot [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30735:
URL: https://github.com/apache/doris/pull/30735#issuecomment-1922730307
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](mtmv)compatibility metadata without refreshsnapshot [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30735:
URL: https://github.com/apache/doris/pull/30735#issuecomment-1922691003
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit e6c6a80e832442c44d51e82ff492f8a68e52bfef with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 14.4 seconds inserted 10000000 Rows, about 694K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org