You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "xiedeyantu (via GitHub)" <gi...@apache.org> on 2024/03/24 05:48:53 UTC
[PR] [Enhancement] extends show data skew [doris]
xiedeyantu opened a new pull request, #32732:
URL: https://github.com/apache/doris/pull/32732
## Proposed changes
Issue Number: close #32575
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Enhancement] extends show data skew [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32732:
URL: https://github.com/apache/doris/pull/32732#issuecomment-2019911324
<details>
<summary>TPC-DS: <b>Total hot run time: 181941 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 164d0d1ec9a68541d3b8cb2b711dfac45b00ed0e, data reload: false
query1 943 370 352 352
query2 6520 2016 1908 1908
query3 6700 224 221 221
query4 31746 21276 21382 21276
query5 4303 393 412 393
query6 272 185 179 179
query7 4640 297 298 297
query8 234 171 177 171
query9 9022 2264 2281 2264
query10 556 253 269 253
query11 17218 14308 14231 14231
query12 140 92 84 84
query13 1634 430 423 423
query14 9348 8021 8030 8021
query15 268 214 201 201
query16 8219 274 259 259
query17 1976 588 567 567
query18 2065 285 290 285
query19 343 157 156 156
query20 96 83 92 83
query21 202 125 128 125
query22 5040 4891 4763 4763
query23 33601 32655 32985 32655
query24 11589 2906 2863 2863
query25 635 388 412 388
query26 1704 155 160 155
query27 2964 361 349 349
query28 7470 1894 1833 1833
query29 1015 656 626 626
query30 306 149 151 149
query31 957 762 737 737
query32 98 67 57 57
query33 765 260 254 254
query34 1035 483 501 483
query35 847 624 608 608
query36 1039 896 913 896
query37 126 71 66 66
query38 3582 3425 3467 3425
query39 1465 1441 1440 1440
query40 298 113 114 113
query41 56 47 47 47
query42 111 100 99 99
query43 479 434 461 434
query44 1232 749 752 749
query45 270 268 261 261
query46 1119 722 722 722
query47 1902 1827 1856 1827
query48 451 361 350 350
query49 1193 348 334 334
query50 760 375 383 375
query51 6582 6675 6595 6595
query52 104 92 97 92
query53 353 295 279 279
query54 336 243 243 243
query55 84 82 81 81
query56 249 226 237 226
query57 1224 1147 1125 1125
query58 236 209 216 209
query59 2852 2620 2610 2610
query60 274 247 261 247
query61 115 113 114 113
query62 670 453 471 453
query63 307 284 290 284
query64 6991 3992 3949 3949
query65 3084 3061 3083 3061
query66 1426 370 360 360
query67 15479 14809 14778 14778
query68 8643 531 529 529
query69 615 382 386 382
query70 1259 1165 1119 1119
query71 503 260 266 260
query72 6531 2732 2537 2537
query73 739 317 313 313
query74 8077 6516 6360 6360
query75 3933 2166 2222 2166
query76 5129 934 898 898
query77 652 272 259 259
query78 10848 10144 10065 10065
query79 10188 535 533 533
query80 1635 387 374 374
query81 506 214 218 214
query82 242 85 83 83
query83 221 147 150 147
query84 287 83 81 81
query85 1134 325 320 320
query86 387 309 319 309
query87 3806 3530 3559 3530
query88 5103 2376 2381 2376
query89 491 367 373 367
query90 2079 179 178 178
query91 179 139 155 139
query92 61 47 49 47
query93 6206 498 495 495
query94 1356 179 177 177
query95 436 331 332 331
query96 607 274 269 269
query97 2653 2509 2471 2471
query98 236 216 211 211
query99 1189 889 925 889
Total cold run time: 314851 ms
Total hot run time: 181941 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Enhancement] extends show data skew [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32732:
URL: https://github.com/apache/doris/pull/32732#issuecomment-2016702989
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website).
See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Enhancement] extends show data skew [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32732:
URL: https://github.com/apache/doris/pull/32732#issuecomment-2017315120
<details>
<summary>TPC-H: <b>Total hot run time: 37647 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3fe6fe4a9446e38aac5c38d5692b562ea8d1a96d, data reload: false
------ Round 1 ----------------------------------
q1 17664 4193 4077 4077
q2 2110 165 153 153
q3 10572 1130 1147 1130
q4 10220 821 716 716
q5 7514 2991 2954 2954
q6 203 125 122 122
q7 1010 575 566 566
q8 9319 1986 1974 1974
q9 7167 6614 6558 6558
q10 8407 3430 3592 3430
q11 432 217 221 217
q12 429 197 192 192
q13 17782 2870 2843 2843
q14 227 202 204 202
q15 503 457 446 446
q16 502 372 367 367
q17 946 608 540 540
q18 7156 6391 6463 6391
q19 1899 1400 1443 1400
q20 536 247 243 243
q21 3516 2847 2984 2847
q22 327 279 292 279
Total cold run time: 108441 ms
Total hot run time: 37647 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4142 4044 4031 4031
q2 319 229 231 229
q3 2952 2884 2805 2805
q4 1807 1571 1528 1528
q5 5239 5324 5306 5306
q6 193 113 113 113
q7 2212 1857 1843 1843
q8 3115 3262 3243 3243
q9 8635 8637 8675 8637
q10 3786 3761 3772 3761
q11 536 444 448 444
q12 715 563 578 563
q13 16913 2825 2848 2825
q14 277 254 252 252
q15 495 452 458 452
q16 477 423 417 417
q17 1708 1483 1459 1459
q18 7458 7164 7049 7049
q19 1627 1552 1522 1522
q20 1913 1721 1703 1703
q21 4815 4707 4710 4707
q22 499 461 447 447
Total cold run time: 69833 ms
Total hot run time: 53336 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Enhancement] extends show data skew [doris]
Posted by "xiedeyantu (via GitHub)" <gi...@apache.org>.
xiedeyantu commented on PR #32732:
URL: https://github.com/apache/doris/pull/32732#issuecomment-2019836012
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Enhancement] extends show data skew [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32732:
URL: https://github.com/apache/doris/pull/32732#issuecomment-2016712129
<details>
<summary>TPC-DS: <b>Total hot run time: 186341 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ae7f21e32ffb3647e2518f0e7329d2a266ce38eb, data reload: false
query1 918 369 353 353
query2 7403 1964 1967 1964
query3 6709 210 214 210
query4 32070 21271 21218 21218
query5 4285 411 409 409
query6 270 176 166 166
query7 4632 296 290 290
query8 234 167 176 167
query9 9551 2251 2250 2250
query10 570 249 270 249
query11 17429 14557 14636 14557
query12 142 88 86 86
query13 1639 415 402 402
query14 11797 10647 11410 10647
query15 258 212 187 187
query16 8241 260 254 254
query17 1989 576 548 548
query18 2109 291 285 285
query19 366 163 151 151
query20 93 91 92 91
query21 209 128 128 128
query22 5009 4831 4814 4814
query23 33455 32792 32808 32792
query24 10683 2910 2851 2851
query25 626 388 401 388
query26 1193 156 162 156
query27 2421 344 348 344
query28 7395 1868 1854 1854
query29 884 648 618 618
query30 298 149 149 149
query31 1021 729 746 729
query32 94 59 60 59
query33 773 250 250 250
query34 1064 492 495 492
query35 820 628 598 598
query36 1047 884 909 884
query37 125 81 77 77
query38 3543 3455 3495 3455
query39 1517 1448 1433 1433
query40 211 112 110 110
query41 52 47 47 47
query42 106 97 94 94
query43 489 447 455 447
query44 1172 728 724 724
query45 286 257 259 257
query46 1103 714 688 688
query47 1934 1831 1843 1831
query48 459 351 366 351
query49 1110 341 351 341
query50 773 369 372 369
query51 6686 6659 6602 6602
query52 115 88 93 88
query53 348 273 281 273
query54 313 261 250 250
query55 89 76 77 76
query56 247 240 250 240
query57 1219 1135 1156 1135
query58 246 207 210 207
query59 2738 2575 2565 2565
query60 271 253 256 253
query61 113 111 110 110
query62 678 454 463 454
query63 303 278 273 273
query64 5816 4067 4138 4067
query65 3086 3039 3033 3033
query66 906 383 371 371
query67 15483 14804 14643 14643
query68 8881 517 519 517
query69 619 380 380 380
query70 1372 1205 1091 1091
query71 515 276 280 276
query72 6437 2725 2523 2523
query73 1448 318 317 317
query74 8112 6680 6678 6678
query75 4612 2925 3003 2925
query76 5522 893 848 848
query77 660 266 259 259
query78 10935 10131 10178 10131
query79 10496 523 510 510
query80 1875 385 389 385
query81 518 211 220 211
query82 378 206 201 201
query83 211 152 152 152
query84 286 82 78 78
query85 1092 316 314 314
query86 364 275 307 275
query87 3781 3568 3561 3561
query88 4501 2273 2278 2273
query89 499 382 382 382
query90 2086 178 177 177
query91 164 135 137 135
query92 58 50 49 49
query93 6702 507 476 476
query94 1328 176 177 176
query95 451 328 332 328
query96 620 271 273 271
query97 3064 2900 2878 2878
query98 238 223 202 202
query99 1177 908 921 908
Total cold run time: 318236 ms
Total hot run time: 186341 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Enhancement] extends show data skew [doris]
Posted by "rohitrs1983 (via GitHub)" <gi...@apache.org>.
rohitrs1983 commented on code in PR #32732:
URL: https://github.com/apache/doris/pull/32732#discussion_r1537094466
##########
fe/fe-core/src/main/java/org/apache/doris/analysis/ShowDataSkewStmt.java:
##########
@@ -58,9 +63,23 @@ public void analyze(Analyzer analyzer) throws UserException {
ConnectContext.get().getRemoteIP(),
tblRef.getName().getDb() + "." + tblRef.getName().getTbl());
}
+
+ Optional<DatabaseIf> db = Env.getCurrentEnv().getCurrentCatalog().getDb(tblRef.getName().getDb());
+ if (!db.isPresent()) {
+ throw new AnalysisException("Can not find db: " + tblRef.getName().getDb());
+ }
+ Optional<TableIf> tbl = db.get().getTable(tblRef.getName().getTbl());
+ if (!tbl.isPresent()) {
+ throw new AnalysisException("Can not find table: " + tblRef.getName().getDb() + "."
+ + tblRef.getName().getTbl());
+ }
+
PartitionNames partitionNames = tblRef.getPartitionNames();
- if (partitionNames == null || partitionNames.getPartitionNames().size() != 1) {
- throw new AnalysisException("Should specify one and only one partition");
+ if (partitionNames == null) {
+ if (tbl.get().getPartitionNames().isEmpty()) {
+ throw new AnalysisException("Can not find any partition");
+ }
+ tblRef.setPartitionNames(new PartitionNames(false, new ArrayList<>(tbl.get().getPartitionNames())));
Review Comment:
do you think we should we also show tempPartitions? getPartitionNames() does not handle tempPartitions.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Enhancement] extends show data skew [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring merged PR #32732:
URL: https://github.com/apache/doris/pull/32732
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Enhancement] extends show data skew [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32732:
URL: https://github.com/apache/doris/pull/32732#issuecomment-2017161388
<details>
<summary>TPC-H: <b>Total hot run time: 38161 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c02e5ac1b5275ec1fda21b3699b41e1fcd38f3db, data reload: false
------ Round 1 ----------------------------------
q1 17679 4326 4123 4123
q2 2113 161 151 151
q3 10818 1131 1216 1131
q4 10679 821 794 794
q5 7457 3086 3061 3061
q6 207 128 126 126
q7 1073 599 599 599
q8 9455 2083 1964 1964
q9 7239 6630 6612 6612
q10 8397 3482 3573 3482
q11 421 234 222 222
q12 382 205 200 200
q13 17808 2850 2849 2849
q14 238 202 203 202
q15 524 463 447 447
q16 465 378 375 375
q17 945 638 547 547
q18 7285 6546 6469 6469
q19 2871 1424 1458 1424
q20 564 279 263 263
q21 3582 2957 2824 2824
q22 354 302 296 296
Total cold run time: 110556 ms
Total hot run time: 38161 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4128 4060 4087 4060
q2 333 235 231 231
q3 2994 2901 2873 2873
q4 1862 1575 1550 1550
q5 5313 5350 5374 5350
q6 203 118 120 118
q7 2261 1876 1869 1869
q8 3153 3309 3282 3282
q9 8761 8712 8724 8712
q10 3788 3753 3733 3733
q11 534 447 434 434
q12 718 558 554 554
q13 16948 2837 2854 2837
q14 279 243 251 243
q15 498 447 456 447
q16 459 432 429 429
q17 1761 1474 1470 1470
q18 7519 7290 7117 7117
q19 1623 1575 1483 1483
q20 1891 1724 1725 1724
q21 4857 4720 4677 4677
q22 523 442 451 442
Total cold run time: 70406 ms
Total hot run time: 53635 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Enhancement] extends show data skew [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #32732:
URL: https://github.com/apache/doris/pull/32732#issuecomment-2020510783
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Enhancement] extends show data skew [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32732:
URL: https://github.com/apache/doris/pull/32732#issuecomment-2017231956
<details>
<summary>TPC-H: <b>Total hot run time: 37753 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9242d03f2c80885950702f38318adee8f00cab89, data reload: false
------ Round 1 ----------------------------------
q1 17660 4183 4085 4085
q2 2123 157 150 150
q3 10584 1118 1166 1118
q4 10228 797 744 744
q5 7451 3004 3007 3004
q6 199 126 124 124
q7 1014 574 572 572
q8 9336 2003 1950 1950
q9 7174 6556 6506 6506
q10 8455 3450 3555 3450
q11 435 219 218 218
q12 406 200 194 194
q13 17795 2859 2841 2841
q14 230 202 204 202
q15 506 461 450 450
q16 504 373 366 366
q17 933 599 579 579
q18 7089 6438 6415 6415
q19 2982 1374 1445 1374
q20 552 261 265 261
q21 3536 2850 2997 2850
q22 348 300 307 300
Total cold run time: 109540 ms
Total hot run time: 37753 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4083 4088 4082 4082
q2 328 228 229 228
q3 2919 2827 2828 2827
q4 1840 1576 1564 1564
q5 5291 5326 5300 5300
q6 200 119 121 119
q7 2204 1840 1866 1840
q8 3145 3270 3264 3264
q9 8710 8667 8662 8662
q10 3779 3761 3782 3761
q11 548 433 457 433
q12 724 517 543 517
q13 16944 2850 2835 2835
q14 288 254 243 243
q15 497 464 454 454
q16 461 413 423 413
q17 1723 1488 1484 1484
q18 7405 7047 7005 7005
q19 1640 1475 1490 1475
q20 1926 1723 1688 1688
q21 4860 4832 4581 4581
q22 524 452 516 452
Total cold run time: 70039 ms
Total hot run time: 53227 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Enhancement] extends show data skew [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32732:
URL: https://github.com/apache/doris/pull/32732#issuecomment-2019885480
<details>
<summary>TPC-H: <b>Total hot run time: 38595 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 164d0d1ec9a68541d3b8cb2b711dfac45b00ed0e, data reload: false
------ Round 1 ----------------------------------
q1 17641 4502 4170 4170
q2 2118 156 153 153
q3 11282 1227 1211 1211
q4 10648 812 802 802
q5 7542 3086 3016 3016
q6 207 129 127 127
q7 1092 631 595 595
q8 9723 2073 2014 2014
q9 7409 6750 6735 6735
q10 8962 3588 3662 3588
q11 531 221 223 221
q12 392 212 206 206
q13 19691 2845 2863 2845
q14 223 205 210 205
q15 512 470 457 457
q16 500 377 370 370
q17 970 573 566 566
q18 7285 6608 6428 6428
q19 2558 1456 1492 1456
q20 546 250 250 250
q21 3608 2907 2885 2885
q22 351 296 295 295
Total cold run time: 113791 ms
Total hot run time: 38595 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4206 4129 4091 4091
q2 336 240 233 233
q3 2976 2892 2823 2823
q4 1894 1520 1566 1520
q5 5337 5370 5389 5370
q6 201 118 121 118
q7 2248 1867 1851 1851
q8 3173 3309 3293 3293
q9 8709 8720 8739 8720
q10 3798 3755 3804 3755
q11 545 438 439 438
q12 716 566 523 523
q13 17132 2979 2851 2851
q14 279 250 249 249
q15 495 459 459 459
q16 471 430 434 430
q17 1749 1498 1481 1481
q18 7535 7242 7077 7077
q19 1607 1478 1517 1478
q20 1923 1714 1702 1702
q21 4881 4819 4615 4615
q22 518 442 452 442
Total cold run time: 70729 ms
Total hot run time: 53519 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Enhancement] extends show data skew [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32732:
URL: https://github.com/apache/doris/pull/32732#issuecomment-2017244247
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 9242d03f2c80885950702f38318adee8f00cab89 with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 21.3 seconds inserted 10000000 Rows, about 469K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Enhancement] extends show data skew [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32732:
URL: https://github.com/apache/doris/pull/32732#issuecomment-2017329742
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 3fe6fe4a9446e38aac5c38d5692b562ea8d1a96d with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 33 seconds loaded 861443392 Bytes, about 24 MB/s
Insert into select: 20.1 seconds inserted 10000000 Rows, about 497K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Enhancement] extends show data skew [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32732:
URL: https://github.com/apache/doris/pull/32732#issuecomment-2016710191
<details>
<summary>TPC-H: <b>Total hot run time: 37810 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ae7f21e32ffb3647e2518f0e7329d2a266ce38eb, data reload: false
------ Round 1 ----------------------------------
q1 17676 4202 4103 4103
q2 2103 158 152 152
q3 10581 1171 1166 1166
q4 10230 822 782 782
q5 7465 2988 2986 2986
q6 203 122 122 122
q7 1044 590 568 568
q8 9331 1975 1959 1959
q9 7249 6612 6586 6586
q10 8480 3447 3534 3447
q11 432 218 217 217
q12 410 202 195 195
q13 17796 2848 2842 2842
q14 236 205 205 205
q15 511 459 455 455
q16 497 372 362 362
q17 953 626 558 558
q18 7057 6450 6373 6373
q19 3591 1401 1438 1401
q20 544 245 244 244
q21 3540 2803 3005 2803
q22 341 284 295 284
Total cold run time: 110270 ms
Total hot run time: 37810 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4150 4074 4065 4065
q2 338 230 232 230
q3 2999 2830 2809 2809
q4 1826 1519 1528 1519
q5 5277 5353 5300 5300
q6 192 116 118 116
q7 2219 1859 1828 1828
q8 3142 3287 3278 3278
q9 8656 8647 8686 8647
q10 3804 3792 3734 3734
q11 548 447 438 438
q12 708 551 554 551
q13 16912 2851 2828 2828
q14 294 252 254 252
q15 503 464 448 448
q16 470 417 403 403
q17 1734 1495 1468 1468
q18 7368 7078 7148 7078
q19 1638 1559 1571 1559
q20 1903 1726 1689 1689
q21 4741 4549 4572 4549
q22 529 445 480 445
Total cold run time: 69951 ms
Total hot run time: 53234 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Enhancement] extends show data skew [doris]
Posted by "xiedeyantu (via GitHub)" <gi...@apache.org>.
xiedeyantu commented on PR #32732:
URL: https://github.com/apache/doris/pull/32732#issuecomment-2017149327
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Enhancement] extends show data skew [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32732:
URL: https://github.com/apache/doris/pull/32732#issuecomment-2017171047
<details>
<summary>TPC-DS: <b>Total hot run time: 186633 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c02e5ac1b5275ec1fda21b3699b41e1fcd38f3db, data reload: false
query1 935 377 357 357
query2 7386 2041 1933 1933
query3 6722 220 215 215
query4 31891 21290 21422 21290
query5 4361 422 426 422
query6 274 185 177 177
query7 4627 306 301 301
query8 235 175 183 175
query9 9286 2280 2297 2280
query10 573 249 256 249
query11 15720 14494 14431 14431
query12 143 91 92 91
query13 1624 422 426 422
query14 12248 11263 11172 11172
query15 265 213 196 196
query16 8178 267 257 257
query17 1957 588 552 552
query18 2115 290 278 278
query19 344 163 161 161
query20 101 94 91 91
query21 204 126 135 126
query22 4987 4807 4794 4794
query23 33695 32995 32656 32656
query24 10570 2849 2854 2849
query25 618 390 396 390
query26 1188 158 160 158
query27 2842 362 351 351
query28 7526 1865 1842 1842
query29 897 657 627 627
query30 301 149 151 149
query31 975 732 740 732
query32 98 61 60 60
query33 776 264 263 263
query34 1049 467 484 467
query35 853 621 633 621
query36 998 900 902 900
query37 113 75 76 75
query38 3569 3447 3414 3414
query39 1486 1459 1412 1412
query40 218 114 113 113
query41 50 50 49 49
query42 106 95 101 95
query43 488 444 443 443
query44 1159 721 719 719
query45 277 258 262 258
query46 1119 706 700 700
query47 1924 1867 1880 1867
query48 454 356 363 356
query49 1219 337 341 337
query50 764 376 373 373
query51 6689 6621 6633 6621
query52 103 92 86 86
query53 347 275 280 275
query54 307 254 262 254
query55 85 77 79 77
query56 254 235 239 235
query57 1202 1168 1153 1153
query58 242 206 212 206
query59 2761 2504 2702 2504
query60 281 254 259 254
query61 119 115 119 115
query62 689 459 464 459
query63 308 287 282 282
query64 5837 4005 4016 4005
query65 3060 3028 3024 3024
query66 867 364 371 364
query67 15878 14858 14701 14701
query68 9019 531 534 531
query69 633 384 369 369
query70 1276 1164 1173 1164
query71 523 289 279 279
query72 6523 2707 2547 2547
query73 1516 308 313 308
query74 8633 6610 6653 6610
query75 4462 2834 2825 2825
query76 5475 892 904 892
query77 669 262 267 262
query78 10884 10140 10114 10114
query79 11254 518 521 518
query80 1657 397 380 380
query81 507 210 218 210
query82 361 198 211 198
query83 227 142 150 142
query84 283 82 73 73
query85 1226 338 318 318
query86 356 298 308 298
query87 3757 3540 3500 3500
query88 5240 2254 2255 2254
query89 482 371 370 370
query90 2046 174 170 170
query91 174 140 135 135
query92 58 51 48 48
query93 6100 493 485 485
query94 1328 181 178 178
query95 438 335 330 330
query96 591 270 268 268
query97 3040 2884 2910 2884
query98 226 215 208 208
query99 1074 904 907 904
Total cold run time: 318575 ms
Total hot run time: 186633 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Enhancement] extends show data skew [doris]
Posted by "xiedeyantu (via GitHub)" <gi...@apache.org>.
xiedeyantu commented on PR #32732:
URL: https://github.com/apache/doris/pull/32732#issuecomment-2017193560
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Enhancement] extends show data skew [doris]
Posted by "xiedeyantu (via GitHub)" <gi...@apache.org>.
xiedeyantu commented on PR #32732:
URL: https://github.com/apache/doris/pull/32732#issuecomment-2017277439
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Enhancement] extends show data skew [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32732:
URL: https://github.com/apache/doris/pull/32732#issuecomment-2017326686
<details>
<summary>TPC-DS: <b>Total hot run time: 186244 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3fe6fe4a9446e38aac5c38d5692b562ea8d1a96d, data reload: false
query1 928 359 355 355
query2 7340 1974 1876 1876
query3 6821 207 207 207
query4 32095 21319 21229 21229
query5 4402 504 402 402
query6 286 177 170 170
query7 4625 277 291 277
query8 226 173 175 173
query9 9001 2258 2222 2222
query10 556 242 247 242
query11 17314 14277 14346 14277
query12 134 89 86 86
query13 1622 404 396 396
query14 11446 11323 11235 11235
query15 294 208 197 197
query16 8260 262 256 256
query17 1996 593 546 546
query18 2102 296 282 282
query19 362 155 162 155
query20 93 90 93 90
query21 202 127 129 127
query22 5054 4861 4854 4854
query23 33956 32885 32656 32656
query24 10893 2868 2838 2838
query25 596 381 408 381
query26 750 154 155 154
query27 2232 348 357 348
query28 5979 1829 1865 1829
query29 874 650 626 626
query30 304 151 151 151
query31 997 740 757 740
query32 103 59 58 58
query33 769 263 261 261
query34 1048 468 489 468
query35 835 624 636 624
query36 1037 880 891 880
query37 121 81 76 76
query38 3599 3510 3530 3510
query39 1462 1476 1444 1444
query40 207 112 107 107
query41 47 45 45 45
query42 104 95 91 91
query43 458 430 437 430
query44 1172 727 702 702
query45 271 260 240 240
query46 1099 690 674 674
query47 1932 1835 1888 1835
query48 442 367 365 365
query49 1068 324 325 324
query50 761 360 359 359
query51 6682 6691 6580 6580
query52 111 89 86 86
query53 340 269 276 269
query54 306 238 242 238
query55 84 76 78 76
query56 248 220 218 218
query57 1206 1152 1142 1142
query58 219 199 197 197
query59 2760 2466 2552 2466
query60 276 232 244 232
query61 99 97 97 97
query62 666 438 446 438
query63 302 273 268 268
query64 5625 3963 4014 3963
query65 3049 2993 3004 2993
query66 893 395 356 356
query67 15053 14835 14995 14835
query68 5350 505 506 505
query69 555 371 379 371
query70 1252 1194 1163 1163
query71 438 279 279 279
query72 6661 2894 2683 2683
query73 690 325 306 306
query74 7057 6741 6682 6682
query75 3593 2832 2857 2832
query76 3584 903 842 842
query77 494 272 269 269
query78 10937 10128 10269 10128
query79 9158 524 516 516
query80 2161 417 398 398
query81 559 217 230 217
query82 1535 205 209 205
query83 288 151 150 150
query84 295 81 92 81
query85 1813 329 313 313
query86 496 278 294 278
query87 3765 3607 3491 3491
query88 5092 2274 2251 2251
query89 556 366 362 362
query90 1982 172 173 172
query91 172 140 138 138
query92 60 49 46 46
query93 7051 500 481 481
query94 1225 174 177 174
query95 426 329 339 329
query96 599 264 276 264
query97 3070 2892 2900 2892
query98 226 219 206 206
query99 1231 925 896 896
Total cold run time: 308565 ms
Total hot run time: 186244 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Enhancement] extends show data skew [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #32732:
URL: https://github.com/apache/doris/pull/32732#issuecomment-2019353332
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Enhancement] extends show data skew [doris]
Posted by "xiedeyantu (via GitHub)" <gi...@apache.org>.
xiedeyantu commented on PR #32732:
URL: https://github.com/apache/doris/pull/32732#issuecomment-2019396730
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Enhancement] extends show data skew [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32732:
URL: https://github.com/apache/doris/pull/32732#issuecomment-2016712640
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit ae7f21e32ffb3647e2518f0e7329d2a266ce38eb with default session variables
Stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 20.4 seconds inserted 10000000 Rows, about 490K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Enhancement] extends show data skew [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32732:
URL: https://github.com/apache/doris/pull/32732#issuecomment-2017173599
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit c02e5ac1b5275ec1fda21b3699b41e1fcd38f3db with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 21.6 seconds inserted 10000000 Rows, about 462K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Enhancement] extends show data skew [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32732:
URL: https://github.com/apache/doris/pull/32732#issuecomment-2017241493
<details>
<summary>TPC-DS: <b>Total hot run time: 185432 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9242d03f2c80885950702f38318adee8f00cab89, data reload: false
query1 924 358 352 352
query2 7387 1994 1955 1955
query3 6705 207 219 207
query4 31373 21078 21351 21078
query5 4344 437 395 395
query6 270 191 176 176
query7 4635 290 286 286
query8 224 179 166 166
query9 9141 2245 2257 2245
query10 557 239 245 239
query11 15472 14216 14313 14216
query12 134 91 81 81
query13 1644 409 396 396
query14 11814 11575 11332 11332
query15 331 211 194 194
query16 8239 263 260 260
query17 2025 577 556 556
query18 2103 289 277 277
query19 345 151 161 151
query20 96 90 87 87
query21 210 128 133 128
query22 4988 4705 4810 4705
query23 33431 32457 32616 32457
query24 10561 2874 2855 2855
query25 640 384 381 381
query26 1187 151 158 151
query27 2449 345 356 345
query28 7034 1846 1834 1834
query29 895 629 633 629
query30 304 147 153 147
query31 994 748 728 728
query32 107 59 59 59
query33 772 265 342 265
query34 942 466 480 466
query35 825 610 589 589
query36 1015 900 889 889
query37 121 79 79 79
query38 3541 3447 3410 3410
query39 1474 1450 1401 1401
query40 219 111 110 110
query41 52 46 47 46
query42 103 99 99 99
query43 472 439 447 439
query44 1186 716 708 708
query45 279 279 268 268
query46 1099 686 694 686
query47 1876 1835 1835 1835
query48 440 343 352 343
query49 1076 335 330 330
query50 753 369 364 364
query51 6721 6658 6456 6456
query52 99 88 84 84
query53 336 275 274 274
query54 311 230 228 228
query55 78 82 76 76
query56 251 224 217 217
query57 1189 1135 1131 1131
query58 226 210 201 201
query59 2706 2567 2648 2567
query60 260 252 251 251
query61 111 94 94 94
query62 669 469 450 450
query63 305 274 272 272
query64 5465 3967 3889 3889
query65 3027 3062 3019 3019
query66 887 368 348 348
query67 15009 14794 14748 14748
query68 6504 506 513 506
query69 592 371 371 371
query70 1237 1178 1157 1157
query71 492 272 269 269
query72 6369 2854 2683 2683
query73 711 318 320 318
query74 7105 6749 6630 6630
query75 3925 2897 2808 2808
query76 4376 855 890 855
query77 625 281 275 275
query78 11020 9986 10142 9986
query79 8401 510 523 510
query80 2041 420 414 414
query81 559 225 222 222
query82 1640 198 199 198
query83 335 150 147 147
query84 292 82 80 80
query85 1694 402 316 316
query86 492 292 287 287
query87 3726 3512 3522 3512
query88 4952 2298 2291 2291
query89 526 365 358 358
query90 1944 174 176 174
query91 170 150 137 137
query92 59 53 48 48
query93 7137 488 484 484
query94 1217 174 177 174
query95 442 324 324 324
query96 586 269 270 269
query97 3046 2856 2856 2856
query98 223 214 203 203
query99 1205 908 870 870
Total cold run time: 308101 ms
Total hot run time: 185432 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Enhancement] extends show data skew [doris]
Posted by "xiedeyantu (via GitHub)" <gi...@apache.org>.
xiedeyantu commented on code in PR #32732:
URL: https://github.com/apache/doris/pull/32732#discussion_r1537109887
##########
fe/fe-core/src/main/java/org/apache/doris/analysis/ShowDataSkewStmt.java:
##########
@@ -58,9 +63,23 @@ public void analyze(Analyzer analyzer) throws UserException {
ConnectContext.get().getRemoteIP(),
tblRef.getName().getDb() + "." + tblRef.getName().getTbl());
}
+
+ Optional<DatabaseIf> db = Env.getCurrentEnv().getCurrentCatalog().getDb(tblRef.getName().getDb());
+ if (!db.isPresent()) {
+ throw new AnalysisException("Can not find db: " + tblRef.getName().getDb());
+ }
+ Optional<TableIf> tbl = db.get().getTable(tblRef.getName().getTbl());
+ if (!tbl.isPresent()) {
+ throw new AnalysisException("Can not find table: " + tblRef.getName().getDb() + "."
+ + tblRef.getName().getTbl());
+ }
+
PartitionNames partitionNames = tblRef.getPartitionNames();
- if (partitionNames == null || partitionNames.getPartitionNames().size() != 1) {
- throw new AnalysisException("Should specify one and only one partition");
+ if (partitionNames == null) {
+ if (tbl.get().getPartitionNames().isEmpty()) {
+ throw new AnalysisException("Can not find any partition");
+ }
+ tblRef.setPartitionNames(new PartitionNames(false, new ArrayList<>(tbl.get().getPartitionNames())));
Review Comment:
> do you think we should we also show tempPartitions? getPartitionNames() does not handle tempPartitions.
@rohitrs1983 OK, I will add both later.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Enhancement] extends show data skew [doris]
Posted by "xiedeyantu (via GitHub)" <gi...@apache.org>.
xiedeyantu commented on PR #32732:
URL: https://github.com/apache/doris/pull/32732#issuecomment-2016703486
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Enhancement] extends show data skew [doris]
Posted by "xiedeyantu (via GitHub)" <gi...@apache.org>.
xiedeyantu commented on PR #32732:
URL: https://github.com/apache/doris/pull/32732#issuecomment-2019350177
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Enhancement] extends show data skew [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32732:
URL: https://github.com/apache/doris/pull/32732#issuecomment-2019917856
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 164d0d1ec9a68541d3b8cb2b711dfac45b00ed0e with default session variables
Stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 20.7 seconds inserted 10000000 Rows, about 483K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org