You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "BiteTheDDDDt (via GitHub)" <gi...@apache.org> on 2024/01/24 08:06:23 UTC
[PR] [Feature](materialized-view) support create mv with count(*) [doris]
BiteTheDDDDt opened a new pull request, #30313:
URL: https://github.com/apache/doris/pull/30313
## Proposed changes
support create mv with count(*)
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Feature](materialized-view) support create mv with count(*) [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30313:
URL: https://github.com/apache/doris/pull/30313#issuecomment-1907727763
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Feature](materialized-view) support create mv with count(*) [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30313:
URL: https://github.com/apache/doris/pull/30313#issuecomment-1907665350
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 9922c4a7ca06e57e693c5be48241042b3cf65d49 with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 14.3 seconds inserted 10000000 Rows, about 699K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Feature](materialized-view) support create mv with count(*) [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30313:
URL: https://github.com/apache/doris/pull/30313#issuecomment-1907652267
<details>
<summary>TPC-DS: <b>Total hot run time: 186408 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9922c4a7ca06e57e693c5be48241042b3cf65d49, data reload: false
query1 935 335 334 334
query2 6545 2131 1931 1931
query3 6706 205 198 198
query4 32426 22190 22135 22135
query5 4452 438 354 354
query6 239 160 156 156
query7 4600 267 258 258
query8 229 175 174 174
query9 8363 2556 2522 2522
query10 430 225 230 225
query11 16625 15590 15538 15538
query12 117 67 67 67
query13 1683 370 377 370
query14 10543 6956 6925 6925
query15 204 176 184 176
query16 5785 259 250 250
query17 946 460 467 460
query18 1783 253 244 244
query19 174 130 132 130
query20 67 70 65 65
query21 187 139 130 130
query22 4885 4841 4849 4841
query23 31555 30990 30813 30813
query24 11850 2786 2733 2733
query25 563 313 314 313
query26 1394 147 146 146
query27 3196 285 288 285
query28 7145 1840 1827 1827
query29 1262 620 616 616
query30 281 135 142 135
query31 932 724 775 724
query32 83 51 48 48
query33 706 210 210 210
query34 1147 472 474 472
query35 905 734 777 734
query36 1348 1217 1168 1168
query37 92 57 60 57
query38 3342 3208 3215 3208
query39 1318 1281 1265 1265
query40 203 89 85 85
query41 37 34 34 34
query42 95 81 87 81
query43 532 489 482 482
query44 1067 685 688 685
query45 195 176 177 176
query46 1065 652 665 652
query47 1585 1522 1506 1506
query48 402 317 316 316
query49 1131 284 287 284
query50 672 307 303 303
query51 5355 5268 5184 5184
query52 85 91 80 80
query53 321 254 250 250
query54 239 188 196 188
query55 82 72 76 72
query56 193 168 165 165
query57 1018 934 936 934
query58 173 156 161 156
query59 2909 2707 2630 2630
query60 200 175 185 175
query61 79 85 81 81
query62 598 382 359 359
query63 279 255 257 255
query64 4939 1797 1743 1743
query65 3345 3269 3260 3260
query66 1175 323 316 316
query67 15824 15255 15080 15080
query68 10403 522 509 509
query69 592 292 301 292
query70 1750 1509 1538 1509
query71 10420 10198 10202 10198
query72 4821 2793 2817 2793
query73 2141 314 319 314
query74 7061 6464 6390 6390
query75 4537 2260 2263 2260
query76 6262 1022 1055 1022
query77 658 231 247 231
query78 8969 8886 8595 8595
query79 1021 507 509 507
query80 516 331 306 306
query81 469 202 204 202
query82 209 79 82 79
query83 137 116 117 116
query84 273 68 70 68
query85 1060 328 333 328
query86 409 375 371 371
query87 3486 3376 3280 3280
query88 3254 2214 2175 2175
query89 433 353 352 352
query90 1993 196 185 185
query91 166 125 119 119
query92 57 44 44 44
query93 2096 459 447 447
query94 1186 158 156 156
query95 496 449 450 449
query96 625 325 315 315
query97 4265 4140 4180 4140
query98 204 193 186 186
query99 960 701 707 701
Total cold run time: 299770 ms
Total hot run time: 186408 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Feature](materialized-view) support create mv with count(*) [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30313:
URL: https://github.com/apache/doris/pull/30313#issuecomment-1907727642
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Feature](materialized-view) support create mv with count(*) [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30313:
URL: https://github.com/apache/doris/pull/30313#issuecomment-1907660132
<details>
<summary>ClickBench: <b>Total hot run time: 30.43 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9922c4a7ca06e57e693c5be48241042b3cf65d49, data reload: false
query1 0.03 0.02 0.02
query2 0.06 0.03 0.02
query3 0.22 0.05 0.06
query4 1.69 0.08 0.08
query5 0.52 0.54 0.53
query6 1.32 0.63 0.63
query7 0.02 0.01 0.01
query8 0.04 0.02 0.02
query9 0.55 0.50 0.50
query10 0.56 0.56 0.54
query11 0.12 0.08 0.08
query12 0.10 0.10 0.09
query13 0.61 0.61 0.61
query14 0.79 0.82 0.80
query15 0.81 0.77 0.78
query16 0.39 0.39 0.37
query17 1.03 0.98 1.02
query18 0.24 0.26 0.22
query19 1.79 1.75 1.71
query20 0.02 0.01 0.01
query21 15.41 0.58 0.56
query22 2.54 2.32 2.56
query23 17.36 0.75 0.75
query24 2.53 1.65 0.12
query25 0.20 0.20 0.10
query26 0.59 0.14 0.14
query27 0.06 0.05 0.06
query28 12.17 0.75 0.77
query29 12.52 3.20 3.20
query30 0.54 0.48 0.49
query31 2.77 0.34 0.35
query32 3.43 0.47 0.48
query33 3.23 3.21 3.25
query34 15.75 4.29 4.30
query35 4.24 4.30 4.29
query36 1.10 1.07 1.07
query37 0.07 0.05 0.05
query38 0.04 0.02 0.02
query39 0.02 0.02 0.01
query40 0.16 0.14 0.13
query41 0.07 0.02 0.01
query42 0.02 0.01 0.02
query43 0.02 0.02 0.02
Total cold run time: 105.75 s
Total hot run time: 30.43 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Feature](materialized-view) support create mv with count(*) [doris]
Posted by "BiteTheDDDDt (via GitHub)" <gi...@apache.org>.
BiteTheDDDDt commented on PR #30313:
URL: https://github.com/apache/doris/pull/30313#issuecomment-1907598919
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Feature](materialized-view) support create mv with count(*) [doris]
Posted by "BiteTheDDDDt (via GitHub)" <gi...@apache.org>.
BiteTheDDDDt merged PR #30313:
URL: https://github.com/apache/doris/pull/30313
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Feature](materialized-view) support create mv with count(*) [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30313:
URL: https://github.com/apache/doris/pull/30313#issuecomment-1907633904
<details>
<summary>TPC-H: <b>Total hot run time: 39100 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9922c4a7ca06e57e693c5be48241042b3cf65d49, data reload: false
------ Round 1 ----------------------------------
q1 17608 5185 5245 5185
q2 2041 147 134 134
q3 10634 1201 1196 1196
q4 11158 796 827 796
q5 9015 3256 3236 3236
q6 201 123 124 123
q7 876 514 504 504
q8 9370 2005 1984 1984
q9 7333 6360 6389 6360
q10 8246 3033 3076 3033
q11 410 213 207 207
q12 370 188 190 188
q13 17975 3362 3331 3331
q14 238 221 212 212
q15 542 507 508 507
q16 427 366 383 366
q17 937 506 542 506
q18 7549 6979 6828 6828
q19 1531 1387 1442 1387
q20 615 333 310 310
q21 2751 2409 2426 2409
q22 370 298 303 298
Total cold run time: 110197 ms
Total hot run time: 39100 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5431 5262 5332 5262
q2 332 212 211 211
q3 3394 3296 3247 3247
q4 2112 2042 2077 2042
q5 6073 5980 5722 5722
q6 198 118 115 115
q7 2354 1897 1939 1897
q8 3206 3392 3402 3392
q9 9078 8876 8977 8876
q10 3844 3854 3779 3779
q11 587 450 461 450
q12 799 611 642 611
q13 16923 3163 3146 3146
q14 271 256 266 256
q15 544 497 501 497
q16 510 464 455 455
q17 1880 1812 1835 1812
q18 9546 20472 9757 9757
q19 23862 1552 1490 1490
q20 4647 1957 1924 1924
q21 14599 5376 5429 5376
q22 982 520 574 520
Total cold run time: 111172 ms
Total hot run time: 60837 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org