You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "jackwener (via GitHub)" <gi...@apache.org> on 2024/01/23 09:08:06 UTC
[PR] [minor](Nereids): enable PushDownTopNDistinctThroughJoin [doris]
jackwener opened a new pull request, #30275:
URL: https://github.com/apache/doris/pull/30275
## Proposed changes
enable PushDownTopNDistinctThroughJoin
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [minor](Nereids): enable PushDownTopNDistinctThroughJoin [doris]
Posted by "jackwener (via GitHub)" <gi...@apache.org>.
jackwener commented on PR #30275:
URL: https://github.com/apache/doris/pull/30275#issuecomment-1907944734
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [minor](Nereids): enable PushDownTopNDistinctThroughJoin [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30275:
URL: https://github.com/apache/doris/pull/30275#issuecomment-1907397388
<details>
<summary>TPC-H: <b>Total hot run time: 39275 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4323cc341276fa97c556ec6d7e1d387e7282448b, data reload: false
------ Round 1 ----------------------------------
q1 19369 5610 5456 5456
q2 2363 153 142 142
q3 11427 1248 1165 1165
q4 10262 760 820 760
q5 7724 3164 3147 3147
q6 200 121 120 120
q7 843 495 486 486
q8 9244 1906 1972 1906
q9 7305 6367 6419 6367
q10 8253 3088 3083 3083
q11 419 197 209 197
q12 352 193 195 193
q13 17970 3386 3375 3375
q14 243 213 207 207
q15 554 511 507 507
q16 443 387 384 384
q17 945 581 511 511
q18 7530 6854 6846 6846
q19 1555 1360 1431 1360
q20 557 323 341 323
q21 2833 2434 2487 2434
q22 373 310 306 306
Total cold run time: 110764 ms
Total hot run time: 39275 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5486 5329 5446 5329
q2 329 217 213 213
q3 3337 3228 3219 3219
q4 2056 2072 2044 2044
q5 6016 5953 5850 5850
q6 197 113 116 113
q7 2275 1857 1923 1857
q8 3212 3394 3404 3394
q9 9034 8816 8826 8816
q10 3957 3795 3843 3795
q11 563 460 470 460
q12 839 632 600 600
q13 16927 3182 3133 3133
q14 284 277 268 268
q15 565 500 499 499
q16 519 451 492 451
q17 2317 1846 1832 1832
q18 9598 18065 9690 9690
q19 23847 1567 1535 1535
q20 4605 1949 1911 1911
q21 14558 5306 5335 5306
q22 971 563 568 563
Total cold run time: 111492 ms
Total hot run time: 60878 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [minor](Nereids): enable PushDownTopNDistinctThroughUnion [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30275:
URL: https://github.com/apache/doris/pull/30275#issuecomment-1908027772
<details>
<summary>ClickBench: <b>Total hot run time: 30.57 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 2bb26137188722e1c824e12d8c87f8306f55045a, data reload: false
query1 0.04 0.03 0.03
query2 0.06 0.02 0.03
query3 0.23 0.05 0.05
query4 1.71 0.06 0.06
query5 0.53 0.53 0.52
query6 1.28 0.63 0.63
query7 0.02 0.02 0.01
query8 0.04 0.02 0.02
query9 0.55 0.50 0.49
query10 0.55 0.56 0.54
query11 0.11 0.08 0.08
query12 0.10 0.10 0.09
query13 0.62 0.61 0.60
query14 0.78 0.82 0.80
query15 0.79 0.78 0.77
query16 0.38 0.36 0.38
query17 1.03 1.03 0.99
query18 0.23 0.25 0.24
query19 1.86 1.73 1.70
query20 0.01 0.00 0.01
query21 15.40 0.59 0.57
query22 2.62 3.12 1.60
query23 17.10 0.94 0.91
query24 2.37 1.66 0.71
query25 0.39 0.17 0.24
query26 0.44 0.15 0.14
query27 0.05 0.06 0.06
query28 11.21 0.77 0.77
query29 12.54 3.17 3.29
query30 0.52 0.49 0.49
query31 2.78 0.35 0.34
query32 3.37 0.48 0.48
query33 3.22 3.22 3.24
query34 15.75 4.31 4.32
query35 4.35 4.31 4.32
query36 1.12 1.06 1.07
query37 0.07 0.05 0.05
query38 0.04 0.03 0.03
query39 0.02 0.02 0.01
query40 0.15 0.13 0.13
query41 0.07 0.01 0.01
query42 0.03 0.01 0.02
query43 0.02 0.02 0.02
Total cold run time: 104.55 s
Total hot run time: 30.57 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [minor](Nereids): enable PushDownTopNDistinctThroughJoin [doris]
Posted by "jackwener (via GitHub)" <gi...@apache.org>.
jackwener commented on PR #30275:
URL: https://github.com/apache/doris/pull/30275#issuecomment-1905626690
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [minor](Nereids): enable PushDownTopNDistinctThroughUnion [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30275:
URL: https://github.com/apache/doris/pull/30275#issuecomment-1908019779
<details>
<summary>TPC-DS: <b>Total hot run time: 186952 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2bb26137188722e1c824e12d8c87f8306f55045a, data reload: false
query1 936 340 334 334
query2 6549 1994 1949 1949
query3 6696 203 206 203
query4 31297 22261 22083 22083
query5 4460 453 382 382
query6 260 152 163 152
query7 4605 259 264 259
query8 218 173 184 173
query9 8342 2519 2507 2507
query10 410 228 247 228
query11 16541 15592 15583 15583
query12 118 67 68 67
query13 1696 372 387 372
query14 10608 6958 6934 6934
query15 212 184 186 184
query16 5790 255 248 248
query17 950 484 476 476
query18 1804 255 254 254
query19 176 135 139 135
query20 70 72 68 68
query21 184 129 139 129
query22 5045 4846 4904 4846
query23 31596 30932 30992 30932
query24 11491 2815 2777 2777
query25 579 317 312 312
query26 1601 142 151 142
query27 3227 297 292 292
query28 7105 1834 1827 1827
query29 1445 624 627 624
query30 286 139 148 139
query31 935 736 747 736
query32 78 49 50 49
query33 706 219 222 219
query34 1130 473 475 473
query35 890 749 747 747
query36 1354 1246 1235 1235
query37 94 59 57 57
query38 3348 3263 3217 3217
query39 1325 1263 1258 1258
query40 201 91 81 81
query41 39 37 34 34
query42 93 82 83 82
query43 520 484 482 482
query44 1096 687 696 687
query45 195 180 179 179
query46 1094 635 659 635
query47 1644 1531 1545 1531
query48 387 322 304 304
query49 1134 293 288 288
query50 685 309 319 309
query51 5354 5242 5171 5171
query52 90 80 76 76
query53 322 256 259 256
query54 246 179 183 179
query55 82 82 78 78
query56 181 175 172 172
query57 1015 897 925 897
query58 189 159 163 159
query59 2889 2668 2557 2557
query60 211 186 191 186
query61 83 88 81 81
query62 608 359 374 359
query63 285 262 264 262
query64 4913 1799 1758 1758
query65 3315 3283 3232 3232
query66 1301 322 315 315
query67 15540 15383 15297 15297
query68 12342 537 523 523
query69 586 295 299 295
query70 1703 1524 1462 1462
query71 10421 10208 10202 10202
query72 4965 2843 2848 2843
query73 2700 320 316 316
query74 6879 6338 6404 6338
query75 4775 2313 2339 2313
query76 6314 1055 1007 1007
query77 659 233 232 232
query78 9051 8900 8603 8603
query79 1833 506 506 506
query80 597 327 337 327
query81 487 205 202 202
query82 205 80 77 77
query83 139 117 121 117
query84 274 67 68 67
query85 1094 323 318 318
query86 396 380 418 380
query87 3496 3304 3329 3304
query88 3194 2210 2229 2210
query89 442 368 355 355
query90 1963 184 182 182
query91 156 128 126 126
query92 56 45 43 43
query93 2394 433 426 426
query94 1279 159 158 158
query95 510 453 445 445
query96 633 309 318 309
query97 4277 4126 4177 4126
query98 211 191 183 183
query99 1005 714 708 708
Total cold run time: 302905 ms
Total hot run time: 186952 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [minor](Nereids): enable PushDownTopNDistinctThroughJoin [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30275:
URL: https://github.com/apache/doris/pull/30275#issuecomment-1905716584
<details>
<summary>TPC-DS: <b>Total hot run time: 186328 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b43366769d8f1cf2ecabc4247c848d46feea4d4f, data reload: false
query1 930 339 328 328
query2 6557 2016 1894 1894
query3 7012 204 196 196
query4 32485 22470 22136 22136
query5 4462 376 370 370
query6 244 153 160 153
query7 4616 263 260 260
query8 221 175 178 175
query9 8318 2550 2509 2509
query10 433 227 234 227
query11 16389 15528 15569 15528
query12 125 70 71 70
query13 1681 370 373 370
query14 10427 7032 6944 6944
query15 209 182 195 182
query16 5788 255 254 254
query17 946 480 461 461
query18 1801 248 246 246
query19 173 132 131 131
query20 68 72 64 64
query21 187 136 128 128
query22 4868 4688 4665 4665
query23 31703 30870 30835 30835
query24 11544 2826 2802 2802
query25 566 314 310 310
query26 1649 140 148 140
query27 3210 291 290 290
query28 7425 1816 1805 1805
query29 1643 634 612 612
query30 275 136 137 136
query31 956 721 724 721
query32 74 51 50 50
query33 689 212 215 212
query34 1143 470 459 459
query35 880 772 742 742
query36 1377 1235 1218 1218
query37 92 62 60 60
query38 3347 3260 3261 3260
query39 1293 1257 1261 1257
query40 332 93 85 85
query41 35 35 34 34
query42 84 81 78 78
query43 507 496 484 484
query44 1058 683 681 681
query45 191 180 171 171
query46 1064 649 655 649
query47 1671 1505 1557 1505
query48 386 306 307 306
query49 1145 281 288 281
query50 685 306 312 306
query51 5376 5219 5231 5219
query52 95 80 80 80
query53 324 252 257 252
query54 242 182 182 182
query55 82 72 74 72
query56 176 160 162 160
query57 1024 934 947 934
query58 179 157 158 157
query59 2869 2798 2691 2691
query60 218 185 189 185
query61 84 81 82 81
query62 590 364 350 350
query63 280 258 260 258
query64 5447 1757 1756 1756
query65 3340 3260 3245 3245
query66 1283 319 317 317
query67 15408 14814 14904 14814
query68 12768 548 508 508
query69 639 298 288 288
query70 1672 1449 1540 1449
query71 10481 10190 10196 10190
query72 4869 2842 2839 2839
query73 2903 322 318 318
query74 7010 6443 6380 6380
query75 5142 2303 2282 2282
query76 6700 1033 1018 1018
query77 664 229 232 229
query78 9056 8669 8671 8669
query79 1970 504 500 500
query80 567 331 318 318
query81 448 202 204 202
query82 199 81 82 81
query83 140 119 116 116
query84 272 67 69 67
query85 1092 330 329 329
query86 397 357 412 357
query87 3545 3328 3312 3312
query88 3371 2224 2218 2218
query89 428 369 362 362
query90 1960 194 185 185
query91 159 127 121 121
query92 53 43 43 43
query93 1609 438 452 438
query94 1218 161 153 153
query95 500 453 447 447
query96 635 322 323 322
query97 4262 4158 4180 4158
query98 196 181 180 180
query99 1022 716 720 716
Total cold run time: 305928 ms
Total hot run time: 186328 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [minor](Nereids): enable PushDownTopNDistinctThroughJoin [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30275:
URL: https://github.com/apache/doris/pull/30275#issuecomment-1907413325
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 4323cc341276fa97c556ec6d7e1d387e7282448b with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 14.8 seconds inserted 10000000 Rows, about 675K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [minor](Nereids): enable PushDownTopNDistinctThroughUnion [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30275:
URL: https://github.com/apache/doris/pull/30275#issuecomment-1908113149
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [minor](Nereids): enable PushDownTopNDistinctThroughJoin [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30275:
URL: https://github.com/apache/doris/pull/30275#issuecomment-1907410876
<details>
<summary>ClickBench: <b>Total hot run time: 30.44 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4323cc341276fa97c556ec6d7e1d387e7282448b, data reload: false
query1 0.03 0.02 0.02
query2 0.06 0.02 0.02
query3 0.22 0.05 0.04
query4 1.70 0.06 0.06
query5 0.54 0.52 0.52
query6 1.24 0.63 0.63
query7 0.01 0.01 0.01
query8 0.03 0.02 0.02
query9 0.54 0.48 0.52
query10 0.56 0.56 0.55
query11 0.12 0.08 0.08
query12 0.10 0.10 0.09
query13 0.60 0.60 0.61
query14 0.78 0.82 0.80
query15 0.78 0.78 0.77
query16 0.36 0.38 0.36
query17 1.00 1.03 1.01
query18 0.24 0.24 0.23
query19 1.85 1.81 1.79
query20 0.01 0.02 0.02
query21 15.42 0.57 0.58
query22 2.38 2.34 1.82
query23 17.21 0.80 0.82
query24 2.49 1.64 0.51
query25 0.43 0.24 0.13
query26 0.48 0.14 0.14
query27 0.05 0.04 0.04
query28 11.01 0.77 0.75
query29 12.50 3.15 3.22
query30 0.52 0.52 0.52
query31 2.77 0.33 0.36
query32 3.38 0.49 0.48
query33 3.23 3.19 3.23
query34 15.65 4.27 4.31
query35 4.35 4.29 4.34
query36 1.11 1.07 1.08
query37 0.07 0.05 0.05
query38 0.04 0.03 0.03
query39 0.02 0.02 0.02
query40 0.16 0.13 0.13
query41 0.06 0.02 0.02
query42 0.02 0.02 0.01
query43 0.02 0.02 0.02
Total cold run time: 104.14 s
Total hot run time: 30.44 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [minor](Nereids): enable PushDownTopNDistinctThroughUnion [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30275:
URL: https://github.com/apache/doris/pull/30275#issuecomment-1908032099
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 2bb26137188722e1c824e12d8c87f8306f55045a with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 14.9 seconds inserted 10000000 Rows, about 671K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [minor](Nereids): enable PushDownTopNDistinctThroughJoin [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30275:
URL: https://github.com/apache/doris/pull/30275#issuecomment-1905730621
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit b43366769d8f1cf2ecabc4247c848d46feea4d4f with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 13.3 seconds inserted 10000000 Rows, about 751K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [minor](Nereids): enable PushDownTopNDistinctThroughUnion [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30275:
URL: https://github.com/apache/doris/pull/30275#issuecomment-1908002106
<details>
<summary>TPC-H: <b>Total hot run time: 38833 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2bb26137188722e1c824e12d8c87f8306f55045a, data reload: false
------ Round 1 ----------------------------------
q1 17690 5385 5321 5321
q2 2032 139 129 129
q3 10767 1162 1174 1162
q4 10329 780 797 780
q5 7729 3165 3146 3146
q6 195 120 118 118
q7 857 482 493 482
q8 9252 1918 1957 1918
q9 7218 6341 6301 6301
q10 8198 3007 3038 3007
q11 408 201 214 201
q12 355 190 191 190
q13 17994 3362 3335 3335
q14 245 211 207 207
q15 559 512 499 499
q16 442 369 368 368
q17 925 539 521 521
q18 7467 6994 6857 6857
q19 1571 1313 1396 1313
q20 597 294 298 294
q21 2766 2414 2387 2387
q22 363 297 303 297
Total cold run time: 107959 ms
Total hot run time: 38833 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5367 5352 5172 5172
q2 339 215 210 210
q3 3310 3207 3235 3207
q4 2108 2050 2004 2004
q5 5937 5872 5820 5820
q6 199 117 119 117
q7 2273 1909 1907 1907
q8 3238 3345 3400 3345
q9 9023 8862 8969 8862
q10 3905 3862 3830 3830
q11 543 447 463 447
q12 796 626 611 611
q13 16903 3183 3175 3175
q14 287 253 261 253
q15 562 503 501 501
q16 523 486 462 462
q17 1881 1872 1819 1819
q18 9608 19904 9844 9844
q19 24227 1603 1523 1523
q20 4581 1952 1919 1919
q21 14534 5485 5408 5408
q22 987 511 564 511
Total cold run time: 111131 ms
Total hot run time: 60947 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [minor](Nereids): enable PushDownTopNDistinctThroughJoin [doris]
Posted by "jackwener (via GitHub)" <gi...@apache.org>.
jackwener commented on PR #30275:
URL: https://github.com/apache/doris/pull/30275#issuecomment-1907378495
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [minor](Nereids): enable PushDownTopNDistinctThroughUnion [doris]
Posted by "jackwener (via GitHub)" <gi...@apache.org>.
jackwener merged PR #30275:
URL: https://github.com/apache/doris/pull/30275
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [minor](Nereids): enable PushDownTopNDistinctThroughJoin [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30275:
URL: https://github.com/apache/doris/pull/30275#issuecomment-1905694911
<details>
<summary>TPC-H: <b>Total hot run time: 39369 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b43366769d8f1cf2ecabc4247c848d46feea4d4f, data reload: false
------ Round 1 ----------------------------------
q1 19484 5452 5391 5391
q2 2298 148 136 136
q3 11376 1189 1196 1189
q4 10743 828 807 807
q5 7803 3302 3218 3218
q6 205 124 126 124
q7 890 517 487 487
q8 9228 1961 1985 1961
q9 7310 6406 6360 6360
q10 8218 3079 3090 3079
q11 441 217 229 217
q12 360 189 190 189
q13 18000 3355 3384 3355
q14 235 226 222 222
q15 550 515 516 515
q16 429 366 367 366
q17 946 504 574 504
q18 7526 6953 6871 6871
q19 1570 1458 1357 1357
q20 595 316 303 303
q21 2806 2422 2431 2422
q22 370 296 300 296
Total cold run time: 111383 ms
Total hot run time: 39369 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5479 5195 5237 5195
q2 325 222 211 211
q3 3326 3238 3220 3220
q4 2139 2077 2001 2001
q5 6016 5920 5909 5909
q6 196 131 120 120
q7 2380 1850 1882 1850
q8 3232 3380 3391 3380
q9 8983 8978 8917 8917
q10 3936 3832 3844 3832
q11 555 457 450 450
q12 770 618 630 618
q13 16913 3163 3159 3159
q14 284 264 265 264
q15 557 513 518 513
q16 534 473 469 469
q17 1879 1888 1879 1879
q18 9457 19180 9491 9491
q19 23874 1556 1550 1550
q20 4567 1949 1928 1928
q21 14492 5448 5402 5402
q22 988 530 542 530
Total cold run time: 110882 ms
Total hot run time: 60888 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [minor](Nereids): enable PushDownTopNDistinctThroughJoin [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30275:
URL: https://github.com/apache/doris/pull/30275#issuecomment-1907406877
<details>
<summary>TPC-DS: <b>Total hot run time: 185931 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4323cc341276fa97c556ec6d7e1d387e7282448b, data reload: false
query1 928 337 325 325
query2 6555 1969 1880 1880
query3 6720 206 198 198
query4 30813 22145 22120 22120
query5 4457 436 358 358
query6 237 165 149 149
query7 4642 261 260 260
query8 235 180 174 174
query9 8346 2545 2518 2518
query10 405 223 234 223
query11 16750 15539 15489 15489
query12 127 69 66 66
query13 1686 392 381 381
query14 10491 6878 6946 6878
query15 211 178 182 178
query16 5791 251 249 249
query17 958 476 470 470
query18 1791 253 253 253
query19 180 136 132 132
query20 70 71 71 71
query21 194 135 124 124
query22 4900 4774 4682 4682
query23 31606 30876 30622 30622
query24 12746 2775 2832 2775
query25 570 317 311 311
query26 1808 140 146 140
query27 3236 282 293 282
query28 7107 1822 1811 1811
query29 2153 631 614 614
query30 282 139 139 139
query31 926 735 742 735
query32 86 48 52 48
query33 698 225 214 214
query34 1133 452 470 452
query35 853 739 797 739
query36 1233 1164 1218 1164
query37 178 56 60 56
query38 3334 3209 3277 3209
query39 1325 1266 1273 1266
query40 343 89 87 87
query41 37 34 37 34
query42 92 78 86 78
query43 511 508 461 461
query44 1125 680 685 680
query45 203 180 176 176
query46 1074 658 664 658
query47 1667 1514 1631 1514
query48 379 304 310 304
query49 1221 289 290 289
query50 676 314 306 306
query51 5287 5236 5245 5236
query52 92 83 76 76
query53 317 255 257 255
query54 256 176 184 176
query55 80 75 77 75
query56 174 165 178 165
query57 1018 931 908 908
query58 194 154 161 154
query59 2769 2769 2754 2754
query60 212 198 185 185
query61 83 83 80 80
query62 609 374 341 341
query63 286 253 264 253
query64 6156 1816 1773 1773
query65 3329 3260 3263 3260
query66 1412 315 317 315
query67 15757 15021 15255 15021
query68 11681 521 533 521
query69 597 305 298 298
query70 1707 1454 1481 1454
query71 10472 10194 10197 10194
query72 4812 2831 2839 2831
query73 2232 314 306 306
query74 6902 6408 6336 6336
query75 4848 2329 2324 2324
query76 6718 1002 1009 1002
query77 637 231 233 231
query78 9038 8947 8590 8590
query79 1023 495 492 492
query80 524 320 320 320
query81 443 204 203 203
query82 202 80 78 78
query83 148 115 118 115
query84 278 67 68 67
query85 1069 333 332 332
query86 392 406 371 371
query87 3546 3323 3369 3323
query88 2756 2192 2178 2178
query89 443 372 354 354
query90 1996 188 185 185
query91 154 131 122 122
query92 52 43 43 43
query93 1108 440 420 420
query94 1234 158 163 158
query95 506 469 441 441
query96 604 316 320 316
query97 4277 4109 4199 4109
query98 193 191 185 185
query99 1014 701 663 663
Total cold run time: 302726 ms
Total hot run time: 185931 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [minor](Nereids): enable PushDownTopNDistinctThroughUnion [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30275:
URL: https://github.com/apache/doris/pull/30275#issuecomment-1908113084
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [minor](Nereids): enable PushDownTopNDistinctThroughJoin [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30275:
URL: https://github.com/apache/doris/pull/30275#issuecomment-1905725569
<details>
<summary>ClickBench: <b>Total hot run time: 30.98 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b43366769d8f1cf2ecabc4247c848d46feea4d4f, data reload: false
query1 0.03 0.02 0.02
query2 0.06 0.03 0.02
query3 0.22 0.05 0.05
query4 1.69 0.06 0.07
query5 0.54 0.52 0.52
query6 1.31 0.63 0.64
query7 0.02 0.01 0.01
query8 0.04 0.03 0.02
query9 0.53 0.50 0.49
query10 0.57 0.56 0.57
query11 0.12 0.09 0.09
query12 0.11 0.09 0.09
query13 0.61 0.62 0.60
query14 0.80 0.81 0.81
query15 0.80 0.77 0.77
query16 0.39 0.40 0.39
query17 1.02 1.00 1.01
query18 0.23 0.24 0.26
query19 1.84 1.82 1.78
query20 0.01 0.01 0.01
query21 15.46 0.57 0.56
query22 2.73 2.23 2.02
query23 17.41 0.81 0.75
query24 2.54 1.21 0.90
query25 0.36 0.33 0.08
query26 0.58 0.15 0.14
query27 0.06 0.06 0.06
query28 11.15 0.80 0.77
query29 12.51 3.08 3.12
query30 0.48 0.48 0.52
query31 2.78 0.36 0.35
query32 3.40 0.49 0.48
query33 3.26 3.24 3.25
query34 15.89 4.31 4.28
query35 4.36 4.35 4.31
query36 1.11 1.07 1.08
query37 0.06 0.05 0.06
query38 0.04 0.03 0.03
query39 0.02 0.02 0.01
query40 0.17 0.13 0.13
query41 0.07 0.02 0.01
query42 0.02 0.04 0.01
query43 0.02 0.01 0.02
Total cold run time: 105.42 s
Total hot run time: 30.98 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org