You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "seawinde (via GitHub)" <gi...@apache.org> on 2024/01/29 11:59:27 UTC
[PR] [Test](Nereids) Add SSB dataset to test materialized view rewrite [doris]
seawinde opened a new pull request, #30528:
URL: https://github.com/apache/doris/pull/30528
## Proposed changes
Add SSB dataset to test materialized view rewrite
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Test](Nereids) Add SSB dataset to test materialized view rewrite [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30528:
URL: https://github.com/apache/doris/pull/30528#issuecomment-1917131682
<details>
<summary>ClickBench: <b>Total hot run time: 30.85 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 85a84b6a87ad81d1b8fe511f8aaa5bcf13573fbc, data reload: false
query1 0.04 0.03 0.03
query2 0.06 0.02 0.02
query3 0.23 0.05 0.06
query4 1.66 0.10 0.10
query5 0.53 0.52 0.51
query6 1.21 0.63 0.63
query7 0.02 0.02 0.01
query8 0.04 0.02 0.02
query9 0.54 0.51 0.49
query10 0.55 0.55 0.56
query11 0.11 0.08 0.08
query12 0.11 0.09 0.09
query13 0.61 0.62 0.61
query14 0.80 0.80 0.80
query15 0.80 0.78 0.78
query16 0.38 0.38 0.37
query17 1.02 1.01 1.03
query18 0.22 0.25 0.27
query19 1.80 1.78 1.77
query20 0.01 0.01 0.01
query21 15.40 0.58 0.55
query22 2.53 1.92 1.68
query23 17.18 0.87 0.72
query24 2.42 1.04 1.39
query25 0.29 0.25 0.08
query26 0.60 0.14 0.13
query27 0.06 0.06 0.05
query28 10.86 0.85 0.87
query29 12.49 3.14 3.17
query30 0.59 0.53 0.54
query31 2.78 0.35 0.37
query32 3.32 0.48 0.48
query33 3.22 3.20 3.27
query34 15.87 4.31 4.29
query35 4.30 4.28 4.28
query36 1.11 1.05 1.05
query37 0.07 0.05 0.05
query38 0.04 0.03 0.02
query39 0.03 0.02 0.01
query40 0.15 0.13 0.13
query41 0.07 0.01 0.02
query42 0.02 0.01 0.02
query43 0.02 0.02 0.02
Total cold run time: 104.16 s
Total hot run time: 30.85 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Test](Nereids) Add SSB dataset to test materialized view rewrite [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30528:
URL: https://github.com/apache/doris/pull/30528#issuecomment-1916237796
<details>
<summary>TPC-H: <b>Total hot run time: 38129 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 85a84b6a87ad81d1b8fe511f8aaa5bcf13573fbc, data reload: false
------ Round 1 ----------------------------------
q1 17922 4602 4517 4517
q2 2167 150 140 140
q3 11479 967 928 928
q4 4952 791 751 751
q5 8028 3025 3035 3025
q6 189 119 119 119
q7 1112 728 714 714
q8 9351 2047 1988 1988
q9 7611 6424 6335 6335
q10 8143 2465 2473 2465
q11 412 202 214 202
q12 737 290 278 278
q13 19507 3594 3492 3492
q14 291 279 282 279
q15 541 497 510 497
q16 526 433 445 433
q17 954 534 601 534
q18 7402 6475 6378 6378
q19 2430 1338 1465 1338
q20 566 336 322 322
q21 6730 3094 3221 3094
q22 815 300 303 300
Total cold run time: 111865 ms
Total hot run time: 38129 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4496 4419 4362 4362
q2 332 227 229 227
q3 3019 2835 2867 2835
q4 1889 1694 1632 1632
q5 5201 5242 5252 5242
q6 190 113 114 113
q7 2175 1768 1766 1766
q8 3096 3235 3243 3235
q9 8371 8305 8255 8255
q10 6003 3612 3548 3548
q11 559 452 457 452
q12 734 585 577 577
q13 16671 3103 3144 3103
q14 275 246 247 246
q15 548 483 493 483
q16 514 473 473 473
q17 1848 1665 1694 1665
q18 7997 7751 7518 7518
q19 6790 1491 1534 1491
q20 2167 1924 1892 1892
q21 4812 4575 4592 4575
q22 546 459 476 459
Total cold run time: 78233 ms
Total hot run time: 54149 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Test](Nereids) Add SSB dataset to test materialized view rewrite [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30528:
URL: https://github.com/apache/doris/pull/30528#issuecomment-1916261797
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 85a84b6a87ad81d1b8fe511f8aaa5bcf13573fbc with default session variables
Stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 13.4 seconds inserted 10000000 Rows, about 746K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Test](Nereids) Add SSB dataset to test materialized view rewrite [doris]
Posted by "seawinde (via GitHub)" <gi...@apache.org>.
seawinde commented on PR #30528:
URL: https://github.com/apache/doris/pull/30528#issuecomment-1914789257
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Test](Nereids) Add SSB dataset to test materialized view rewrite [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30528:
URL: https://github.com/apache/doris/pull/30528#issuecomment-1917148855
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 85a84b6a87ad81d1b8fe511f8aaa5bcf13573fbc with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 13.7 seconds inserted 10000000 Rows, about 729K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Test](Nereids) Add SSB dataset to test materialized view rewrite [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30528:
URL: https://github.com/apache/doris/pull/30528#issuecomment-1914894453
<details>
<summary>ClickBench: <b>Total hot run time: 30.74 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a780277dc1371940de2752b6f377b26886bbecc5, data reload: false
query1 0.03 0.03 0.03
query2 0.05 0.02 0.02
query3 0.23 0.06 0.06
query4 1.68 0.10 0.09
query5 0.53 0.51 0.51
query6 1.23 0.62 0.62
query7 0.02 0.01 0.01
query8 0.04 0.03 0.03
query9 0.57 0.49 0.50
query10 0.54 0.56 0.55
query11 0.11 0.08 0.08
query12 0.11 0.09 0.10
query13 0.61 0.60 0.61
query14 0.79 0.83 0.79
query15 0.79 0.79 0.78
query16 0.39 0.37 0.38
query17 0.99 1.01 1.00
query18 0.23 0.25 0.26
query19 1.92 1.82 1.77
query20 0.01 0.00 0.00
query21 15.41 0.60 0.59
query22 2.74 1.54 2.23
query23 17.03 0.80 0.77
query24 2.91 1.06 0.89
query25 0.31 0.17 0.17
query26 0.62 0.15 0.14
query27 0.06 0.04 0.04
query28 11.36 0.83 0.82
query29 12.64 3.29 3.29
query30 0.64 0.53 0.54
query31 2.79 0.34 0.35
query32 3.37 0.49 0.48
query33 3.22 3.24 3.21
query34 15.72 4.22 4.30
query35 4.36 4.26 4.34
query36 1.10 1.06 1.06
query37 0.06 0.04 0.04
query38 0.04 0.03 0.04
query39 0.02 0.02 0.02
query40 0.16 0.13 0.12
query41 0.07 0.01 0.01
query42 0.02 0.01 0.01
query43 0.02 0.02 0.02
Total cold run time: 105.54 s
Total hot run time: 30.74 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Test](Nereids) Add SSB dataset to test materialized view rewrite [doris]
Posted by "yiguolei (via GitHub)" <gi...@apache.org>.
yiguolei merged PR #30528:
URL: https://github.com/apache/doris/pull/30528
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Test](Nereids) Add SSB dataset to test materialized view rewrite [doris]
Posted by "seawinde (via GitHub)" <gi...@apache.org>.
seawinde commented on PR #30528:
URL: https://github.com/apache/doris/pull/30528#issuecomment-1916987525
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Test](Nereids) Add SSB dataset to test materialized view rewrite [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30528:
URL: https://github.com/apache/doris/pull/30528#issuecomment-1920456655
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Test](Nereids) Add SSB dataset to test materialized view rewrite [doris]
Posted by "seawinde (via GitHub)" <gi...@apache.org>.
seawinde commented on PR #30528:
URL: https://github.com/apache/doris/pull/30528#issuecomment-1916213459
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Test](Nereids) Add SSB dataset to test materialized view rewrite [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30528:
URL: https://github.com/apache/doris/pull/30528#issuecomment-1916251166
<details>
<summary>TPC-DS: <b>Total hot run time: 172375 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 85a84b6a87ad81d1b8fe511f8aaa5bcf13573fbc, data reload: false
query1 947 332 326 326
query2 6548 1977 1878 1878
query3 6706 199 195 195
query4 27081 22080 22093 22080
query5 4456 348 424 348
query6 245 160 162 160
query7 4611 256 257 256
query8 242 174 174 174
query9 9001 2328 2289 2289
query10 408 212 197 197
query11 16444 15368 15511 15368
query12 128 69 62 62
query13 1673 360 362 360
query14 9292 6474 6513 6474
query15 214 181 184 181
query16 6441 250 246 246
query17 1905 470 458 458
query18 1935 259 245 245
query19 171 133 131 131
query20 75 69 69 69
query21 198 129 138 129
query22 4920 4627 4576 4576
query23 31353 30337 30350 30337
query24 12318 2756 2759 2756
query25 584 306 308 306
query26 1996 136 135 135
query27 2967 279 282 279
query28 7682 1847 1840 1840
query29 2202 621 631 621
query30 289 135 140 135
query31 909 701 720 701
query32 87 57 46 46
query33 709 206 204 204
query34 1075 453 456 453
query35 873 761 753 753
query36 1265 1181 1125 1125
query37 178 56 63 56
query38 3275 3147 3173 3147
query39 1321 1241 1239 1239
query40 325 86 82 82
query41 38 35 34 34
query42 88 82 80 80
query43 508 468 486 468
query44 1122 694 692 692
query45 191 182 174 174
query46 1027 637 638 637
query47 1570 1502 1513 1502
query48 384 309 312 309
query49 1272 276 280 276
query50 689 309 307 307
query51 5243 5127 5199 5127
query52 95 75 82 75
query53 323 270 251 251
query54 260 184 188 184
query55 79 75 68 68
query56 171 161 166 161
query57 1021 909 906 906
query58 184 151 160 151
query59 2389 2317 2391 2317
query60 203 178 176 176
query61 84 83 82 82
query62 599 350 351 350
query63 270 265 265 265
query64 5692 1773 1741 1741
query65 3313 3245 3220 3220
query66 1486 342 317 317
query67 14179 14256 13997 13997
query68 3942 516 511 511
query69 421 309 320 309
query70 1604 1490 1543 1490
query71 304 220 214 214
query72 3762 2835 2881 2835
query73 680 322 306 306
query74 6581 6222 6252 6222
query75 2832 2268 2326 2268
query76 2947 981 876 876
query77 441 233 220 220
query78 9039 8964 8551 8551
query79 2154 493 480 480
query80 1389 310 302 302
query81 532 190 193 190
query82 685 82 79 79
query83 213 126 110 110
query84 230 73 72 72
query85 2423 323 340 323
query86 521 383 367 367
query87 3461 3227 3277 3227
query88 3658 2193 2156 2156
query89 414 352 349 349
query90 2088 181 178 178
query91 150 116 113 113
query92 61 42 44 42
query93 2081 449 432 432
query94 1491 157 153 153
query95 494 449 440 440
query96 626 315 313 313
query97 4261 4098 4182 4098
query98 195 193 180 180
query99 1001 685 708 685
Total cold run time: 276210 ms
Total hot run time: 172375 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Test](Nereids) Add SSB dataset to test materialized view rewrite [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30528:
URL: https://github.com/apache/doris/pull/30528#issuecomment-1916257759
<details>
<summary>ClickBench: <b>Total hot run time: 30.94 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 85a84b6a87ad81d1b8fe511f8aaa5bcf13573fbc, data reload: false
query1 0.04 0.03 0.04
query2 0.06 0.02 0.03
query3 0.23 0.06 0.06
query4 1.66 0.09 0.10
query5 0.54 0.51 0.52
query6 1.18 0.64 0.64
query7 0.02 0.01 0.01
query8 0.04 0.02 0.02
query9 0.54 0.49 0.49
query10 0.55 0.56 0.57
query11 0.12 0.09 0.08
query12 0.10 0.08 0.09
query13 0.60 0.62 0.60
query14 0.78 0.80 0.79
query15 0.79 0.79 0.78
query16 0.40 0.39 0.39
query17 0.98 1.02 1.03
query18 0.25 0.23 0.25
query19 1.80 1.77 1.75
query20 0.01 0.01 0.01
query21 15.44 0.56 0.55
query22 2.22 2.45 1.71
query23 17.22 0.87 0.92
query24 2.55 0.99 1.50
query25 0.37 0.15 0.10
query26 0.58 0.15 0.14
query27 0.07 0.06 0.05
query28 11.43 0.89 0.83
query29 12.55 3.18 3.21
query30 0.67 0.54 0.53
query31 2.79 0.34 0.36
query32 3.34 0.48 0.48
query33 3.25 3.18 3.26
query34 16.26 4.29 4.29
query35 4.30 4.24 4.29
query36 1.07 1.08 1.05
query37 0.06 0.05 0.06
query38 0.03 0.02 0.02
query39 0.02 0.01 0.01
query40 0.19 0.13 0.15
query41 0.07 0.02 0.01
query42 0.02 0.02 0.01
query43 0.03 0.02 0.02
Total cold run time: 105.22 s
Total hot run time: 30.94 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Test](Nereids) Add SSB dataset to test materialized view rewrite [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30528:
URL: https://github.com/apache/doris/pull/30528#issuecomment-1914883266
<details>
<summary>TPC-DS: <b>Total hot run time: 173331 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a780277dc1371940de2752b6f377b26886bbecc5, data reload: false
query1 932 330 321 321
query2 6591 1881 1992 1881
query3 6692 197 197 197
query4 33416 22177 22076 22076
query5 4451 421 424 421
query6 246 171 168 168
query7 4617 275 255 255
query8 234 190 175 175
query9 8527 2278 2253 2253
query10 399 212 200 200
query11 17909 15470 15353 15353
query12 111 71 66 66
query13 1684 363 370 363
query14 9168 6485 6547 6485
query15 206 170 173 170
query16 5697 259 249 249
query17 943 476 460 460
query18 1788 251 255 251
query19 172 132 130 130
query20 71 79 69 69
query21 193 128 128 128
query22 4801 4695 4707 4695
query23 31556 30533 30348 30348
query24 7444 2832 2784 2784
query25 440 321 318 318
query26 818 137 134 134
query27 2787 281 277 277
query28 3982 1848 1829 1829
query29 911 616 610 610
query30 209 133 138 133
query31 895 719 724 719
query32 58 48 50 48
query33 417 218 208 208
query34 807 465 457 457
query35 830 741 788 741
query36 1275 1194 1222 1194
query37 89 57 56 56
query38 3284 3200 3186 3186
query39 1315 1253 1250 1250
query40 196 89 78 78
query41 39 35 34 34
query42 98 78 83 78
query43 508 490 479 479
query44 1037 693 683 683
query45 191 187 175 175
query46 1043 650 662 650
query47 1588 1540 1512 1512
query48 389 301 300 300
query49 620 280 279 279
query50 679 302 315 302
query51 5324 5177 5178 5177
query52 101 78 79 78
query53 329 248 261 248
query54 224 183 189 183
query55 80 79 76 76
query56 169 162 153 153
query57 953 905 918 905
query58 175 153 151 151
query59 2838 2710 2681 2681
query60 200 172 183 172
query61 87 81 80 80
query62 450 363 369 363
query63 290 267 270 267
query64 2758 1723 1721 1721
query65 3299 3221 3215 3215
query66 1151 317 309 309
query67 14455 14251 14153 14153
query68 3755 479 471 471
query69 439 302 297 297
query70 1548 1432 1444 1432
query71 255 217 208 208
query72 3680 2825 2832 2825
query73 679 310 311 310
query74 6619 6225 6254 6225
query75 2769 2295 2340 2295
query76 2649 997 987 987
query77 361 229 231 229
query78 9093 8805 8474 8474
query79 2773 483 483 483
query80 2069 314 306 306
query81 504 196 196 196
query82 706 84 79 79
query83 241 116 116 116
query84 277 73 76 73
query85 1963 343 331 331
query86 517 401 396 396
query87 3461 3271 3280 3271
query88 4338 2164 2183 2164
query89 422 351 364 351
query90 2022 186 184 184
query91 162 117 117 117
query92 56 44 41 41
query93 5144 446 427 427
query94 1345 157 155 155
query95 497 458 448 448
query96 624 307 317 307
query97 4237 4112 4167 4112
query98 210 194 188 188
query99 1014 746 673 673
Total cold run time: 269665 ms
Total hot run time: 173331 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Test](Nereids) Add SSB dataset to test materialized view rewrite [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30528:
URL: https://github.com/apache/doris/pull/30528#issuecomment-1920468903
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Test](Nereids) Add SSB dataset to test materialized view rewrite [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30528:
URL: https://github.com/apache/doris/pull/30528#issuecomment-1914860799
<details>
<summary>TPC-H: <b>Total hot run time: 37336 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a780277dc1371940de2752b6f377b26886bbecc5, data reload: false
------ Round 1 ----------------------------------
q1 17625 4848 4835 4835
q2 2041 143 128 128
q3 10713 946 905 905
q4 4721 710 733 710
q5 7690 2871 2891 2871
q6 182 120 116 116
q7 1079 710 710 710
q8 9412 2013 1992 1992
q9 7131 6305 6297 6297
q10 8120 2399 2386 2386
q11 419 203 213 203
q12 787 261 280 261
q13 17999 3316 3276 3276
q14 263 246 249 246
q15 520 485 490 485
q16 462 401 398 398
q17 929 464 584 464
q18 6822 6060 6014 6014
q19 1559 1426 1408 1408
q20 606 337 319 319
q21 6627 3072 3015 3015
q22 816 297 306 297
Total cold run time: 106523 ms
Total hot run time: 37336 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4957 5025 4970 4970
q2 354 239 261 239
q3 3018 2685 2683 2683
q4 1797 1589 1553 1553
q5 5282 5307 5396 5307
q6 193 115 114 114
q7 2141 1750 1760 1750
q8 3122 3188 3226 3188
q9 8610 8494 9994 8494
q10 5352 3467 3439 3439
q11 548 486 460 460
q12 761 606 610 606
q13 16934 3083 3065 3065
q14 267 256 260 256
q15 537 489 493 489
q16 518 483 460 460
q17 1925 1737 1748 1737
q18 8868 13352 8716 8716
q19 26422 1579 1523 1523
q20 4618 1940 1891 1891
q21 17331 4965 4606 4606
q22 1758 483 491 483
Total cold run time: 115313 ms
Total hot run time: 56029 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Test](Nereids) Add SSB dataset to test materialized view rewrite [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30528:
URL: https://github.com/apache/doris/pull/30528#issuecomment-1917073303
<details>
<summary>TPC-H: <b>Total hot run time: 37005 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 85a84b6a87ad81d1b8fe511f8aaa5bcf13573fbc, data reload: false
------ Round 1 ----------------------------------
q1 17804 4598 4573 4573
q2 2481 136 136 136
q3 11065 976 921 921
q4 4968 770 724 724
q5 8018 2914 2831 2831
q6 183 120 119 119
q7 1150 729 705 705
q8 9322 1981 2000 1981
q9 7156 6317 6321 6317
q10 8082 2413 2467 2413
q11 425 199 194 194
q12 745 289 278 278
q13 18007 3336 3272 3272
q14 274 252 242 242
q15 527 489 486 486
q16 452 394 417 394
q17 940 508 551 508
q18 6743 6041 5931 5931
q19 1572 1377 1335 1335
q20 575 314 321 314
q21 6771 3031 3119 3031
q22 807 308 300 300
Total cold run time: 108067 ms
Total hot run time: 37005 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4432 4333 4374 4333
q2 328 227 225 225
q3 3040 2825 2807 2807
q4 1847 1678 1622 1622
q5 5126 5241 5222 5222
q6 188 112 115 112
q7 2135 1771 1770 1770
q8 3080 3219 3239 3219
q9 8372 8293 8224 8224
q10 5842 3599 3540 3540
q11 517 467 443 443
q12 761 617 598 598
q13 13563 3069 3083 3069
q14 282 250 269 250
q15 541 487 490 487
q16 514 469 464 464
q17 1822 1661 1680 1661
q18 7949 7993 7494 7494
q19 7913 1524 1541 1524
q20 2114 1921 1902 1902
q21 4761 4499 4535 4499
q22 507 505 474 474
Total cold run time: 75634 ms
Total hot run time: 53939 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Test](Nereids) Add SSB dataset to test materialized view rewrite [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30528:
URL: https://github.com/apache/doris/pull/30528#issuecomment-1914901147
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit a780277dc1371940de2752b6f377b26886bbecc5 with default session variables
Stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 14.3 seconds inserted 10000000 Rows, about 699K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Test](Nereids) Add SSB dataset to test materialized view rewrite [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30528:
URL: https://github.com/apache/doris/pull/30528#issuecomment-1917106625
<details>
<summary>TPC-DS: <b>Total hot run time: 172369 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 85a84b6a87ad81d1b8fe511f8aaa5bcf13573fbc, data reload: false
query1 949 337 324 324
query2 6555 1980 1968 1968
query3 6701 210 209 209
query4 26656 22095 22007 22007
query5 4446 347 350 347
query6 246 154 153 153
query7 4644 263 265 263
query8 245 178 176 176
query9 9114 2241 2211 2211
query10 405 192 204 192
query11 16899 15424 15312 15312
query12 123 70 63 63
query13 1665 359 374 359
query14 9251 6491 6537 6491
query15 205 183 180 180
query16 6210 258 252 252
query17 1845 477 468 468
query18 1792 260 249 249
query19 180 125 131 125
query20 73 70 62 62
query21 191 140 131 131
query22 4691 4627 4860 4627
query23 31864 30034 30303 30034
query24 12383 2721 2740 2721
query25 612 313 299 299
query26 1934 132 131 131
query27 3015 275 285 275
query28 7587 1831 1816 1816
query29 1969 649 632 632
query30 279 136 138 136
query31 909 715 711 711
query32 89 53 49 49
query33 695 211 207 207
query34 1064 461 456 456
query35 874 768 743 743
query36 1307 1187 1217 1187
query37 94 58 57 57
query38 3292 3233 3154 3154
query39 1299 1253 1224 1224
query40 326 87 81 81
query41 37 35 35 35
query42 88 87 81 81
query43 529 475 501 475
query44 1127 674 676 674
query45 194 177 170 170
query46 1051 633 639 633
query47 1593 1513 1496 1496
query48 386 308 304 304
query49 1228 281 276 276
query50 674 309 310 309
query51 5362 5156 5128 5128
query52 98 77 82 77
query53 322 262 260 260
query54 253 176 193 176
query55 83 75 76 75
query56 177 162 162 162
query57 982 917 907 907
query58 188 156 158 156
query59 2344 2394 2378 2378
query60 198 178 175 175
query61 92 87 83 83
query62 650 341 353 341
query63 275 254 270 254
query64 5638 1752 1733 1733
query65 3265 3207 3207 3207
query66 1253 307 315 307
query67 14470 14207 14229 14207
query68 3961 486 483 483
query69 423 316 312 312
query70 1513 1520 1510 1510
query71 284 216 225 216
query72 3672 2836 2861 2836
query73 685 311 310 310
query74 6608 6266 6200 6200
query75 2821 2350 2222 2222
query76 2834 967 920 920
query77 381 235 225 225
query78 8983 8781 8479 8479
query79 2530 498 511 498
query80 2077 312 322 312
query81 540 194 201 194
query82 715 83 80 80
query83 256 123 123 123
query84 285 77 75 75
query85 2273 340 324 324
query86 521 384 381 381
query87 3464 3251 3318 3251
query88 4017 2265 2256 2256
query89 423 337 348 337
query90 1938 190 183 183
query91 145 120 117 117
query92 57 45 43 43
query93 2175 444 434 434
query94 1343 161 154 154
query95 491 450 437 437
query96 622 336 325 325
query97 4206 4163 4127 4127
query98 218 200 184 184
query99 1065 705 660 660
Total cold run time: 276761 ms
Total hot run time: 172369 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org