You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "morrySnow (via GitHub)" <gi...@apache.org> on 2024/02/04 12:25:42 UTC
[PR] [fix](Nereids) physical property deriver on some node is not right [doris]
morrySnow opened a new pull request, #30819:
URL: https://github.com/apache/doris/pull/30819
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Nereids) physical property deriver on some node is not right [doris]
Posted by "morrySnow (via GitHub)" <gi...@apache.org>.
morrySnow merged PR #30819:
URL: https://github.com/apache/doris/pull/30819
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Nereids) physical property deriver on some node is not right [doris]
Posted by "morrySnow (via GitHub)" <gi...@apache.org>.
morrySnow commented on PR #30819:
URL: https://github.com/apache/doris/pull/30819#issuecomment-1926170424
run pipelinex_p0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Nereids) physical property deriver on some node is not right [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30819:
URL: https://github.com/apache/doris/pull/30819#issuecomment-1926246034
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Nereids) physical property deriver on some node is not right [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30819:
URL: https://github.com/apache/doris/pull/30819#issuecomment-1926290507
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Nereids) physical property deriver on some node is not right [doris]
Posted by "morrySnow (via GitHub)" <gi...@apache.org>.
morrySnow commented on PR #30819:
URL: https://github.com/apache/doris/pull/30819#issuecomment-1926064133
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Nereids) physical property deriver on some node is not right [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30819:
URL: https://github.com/apache/doris/pull/30819#issuecomment-1926084774
<details>
<summary>TPC-H: <b>Total hot run time: 36629 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 860eb4c5fc18dccbf84996b5091b01ee96e3cfd8, data reload: false
------ Round 1 ----------------------------------
q1 17673 4393 4377 4377
q2 2038 142 131 131
q3 10599 905 954 905
q4 4648 690 679 679
q5 7693 2846 2721 2721
q6 182 119 120 119
q7 1120 732 719 719
q8 9276 1996 1991 1991
q9 7213 6335 6364 6335
q10 8095 2445 2425 2425
q11 423 207 205 205
q12 660 278 265 265
q13 18031 3311 3290 3290
q14 271 254 233 233
q15 522 495 489 489
q16 471 424 407 407
q17 921 525 499 499
q18 6759 5856 5942 5856
q19 1553 1337 1357 1337
q20 593 330 348 330
q21 7000 3020 3067 3020
q22 815 296 296 296
Total cold run time: 106556 ms
Total hot run time: 36629 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4501 4375 4493 4375
q2 328 234 226 226
q3 2971 2837 2791 2791
q4 1841 1652 1657 1652
q5 5168 5162 5191 5162
q6 191 114 115 114
q7 2117 1784 1759 1759
q8 3092 3199 3202 3199
q9 8305 8268 8269 8268
q10 5892 3587 3587 3587
q11 540 453 450 450
q12 752 588 571 571
q13 12290 3141 3079 3079
q14 269 247 261 247
q15 520 493 490 490
q16 505 481 469 469
q17 1831 1662 1738 1662
q18 7961 7648 7581 7581
q19 8288 1521 1518 1518
q20 2157 1905 1909 1905
q21 4938 4747 4581 4581
q22 565 493 468 468
Total cold run time: 75022 ms
Total hot run time: 54154 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Nereids) physical property deriver on some node is not right [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30819:
URL: https://github.com/apache/doris/pull/30819#issuecomment-1926095513
<details>
<summary>TPC-DS: <b>Total hot run time: 173687 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 860eb4c5fc18dccbf84996b5091b01ee96e3cfd8, data reload: false
query1 932 341 328 328
query2 6534 1912 1799 1799
query3 6703 206 202 202
query4 31996 22028 21971 21971
query5 4267 424 361 361
query6 249 170 171 170
query7 4614 283 277 277
query8 258 169 185 169
query9 9029 2318 2301 2301
query10 425 205 224 205
query11 17924 15325 15487 15325
query12 134 78 74 74
query13 1643 432 422 422
query14 8986 6899 7084 6899
query15 312 182 182 182
query16 8156 249 243 243
query17 2032 544 504 504
query18 2109 266 261 261
query19 373 137 141 137
query20 80 81 76 76
query21 197 134 120 120
query22 4613 4712 4550 4550
query23 31316 29943 29989 29943
query24 10656 2716 2756 2716
query25 535 355 353 353
query26 710 143 149 143
query27 2188 299 297 297
query28 5756 1883 1886 1883
query29 858 622 591 591
query30 285 132 141 132
query31 913 694 704 694
query32 91 61 53 53
query33 657 214 225 214
query34 1058 447 477 447
query35 875 809 736 736
query36 1022 931 912 912
query37 98 59 55 55
query38 3197 3093 3109 3093
query39 1299 1252 1245 1245
query40 181 95 91 91
query41 39 34 34 34
query42 97 88 93 88
query43 514 500 493 493
query44 1026 687 705 687
query45 192 177 175 175
query46 1020 653 621 621
query47 1588 1535 1522 1522
query48 434 351 343 343
query49 1045 293 280 280
query50 755 382 364 364
query51 5307 5163 5090 5090
query52 103 83 93 83
query53 351 267 272 267
query54 279 209 225 209
query55 87 74 73 73
query56 223 201 191 191
query57 977 893 910 893
query58 202 179 184 179
query59 2343 2327 2310 2310
query60 242 205 214 205
query61 89 84 81 81
query62 667 373 334 334
query63 290 264 271 264
query64 4961 3650 3599 3599
query65 3245 3221 3211 3211
query66 815 320 307 307
query67 14293 14163 13838 13838
query68 4052 532 521 521
query69 460 318 320 318
query70 1258 1188 1138 1138
query71 338 242 251 242
query72 5993 2874 2660 2660
query73 709 315 311 311
query74 6738 6196 6276 6196
query75 3024 2338 2297 2297
query76 2592 943 969 943
query77 342 228 226 226
query78 9128 8785 8554 8554
query79 2217 512 514 512
query80 1282 351 348 348
query81 535 198 192 192
query82 792 82 78 78
query83 225 123 118 118
query84 226 85 85 85
query85 2054 340 330 330
query86 489 301 305 301
query87 3364 3185 3182 3182
query88 3809 2296 2291 2291
query89 447 351 358 351
query90 2007 163 160 160
query91 150 125 122 122
query92 53 44 41 41
query93 2324 502 491 491
query94 1264 176 174 174
query95 8169 354 7941 354
query96 588 266 268 266
query97 4227 4088 4142 4088
query98 214 199 197 197
query99 997 685 721 685
Total cold run time: 284512 ms
Total hot run time: 173687 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Nereids) physical property deriver on some node is not right [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30819:
URL: https://github.com/apache/doris/pull/30819#issuecomment-1926099555
<details>
<summary>ClickBench: <b>Total hot run time: 30.63 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 860eb4c5fc18dccbf84996b5091b01ee96e3cfd8, data reload: false
query1 0.04 0.03 0.03
query2 0.05 0.02 0.02
query3 0.23 0.06 0.06
query4 1.67 0.10 0.10
query5 0.52 0.51 0.51
query6 1.21 0.66 0.64
query7 0.02 0.01 0.01
query8 0.04 0.02 0.03
query9 0.53 0.50 0.50
query10 0.56 0.56 0.55
query11 0.12 0.09 0.08
query12 0.10 0.08 0.09
query13 0.60 0.61 0.60
query14 0.78 0.81 0.79
query15 0.81 0.78 0.77
query16 0.39 0.39 0.39
query17 1.03 1.04 1.03
query18 0.21 0.27 0.25
query19 1.89 1.78 1.76
query20 0.01 0.01 0.01
query21 15.46 0.57 0.57
query22 2.79 2.22 1.56
query23 17.60 0.82 0.68
query24 2.32 1.18 0.91
query25 0.36 0.32 0.13
query26 0.44 0.14 0.14
query27 0.05 0.04 0.04
query28 12.36 0.84 0.84
query29 12.55 3.16 3.21
query30 0.60 0.53 0.54
query31 2.80 0.34 0.36
query32 3.35 0.48 0.49
query33 3.21 3.23 3.20
query34 15.70 4.28 4.30
query35 4.30 4.28 4.28
query36 1.11 1.04 1.05
query37 0.06 0.05 0.05
query38 0.03 0.02 0.02
query39 0.02 0.02 0.01
query40 0.16 0.14 0.13
query41 0.07 0.02 0.01
query42 0.02 0.02 0.01
query43 0.02 0.02 0.02
Total cold run time: 106.19 s
Total hot run time: 30.63 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Nereids) physical property deriver on some node is not right [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30819:
URL: https://github.com/apache/doris/pull/30819#issuecomment-1926101987
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 860eb4c5fc18dccbf84996b5091b01ee96e3cfd8 with default session variables
Stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 13.8 seconds inserted 10000000 Rows, about 724K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Nereids) physical property deriver on some node is not right [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30819:
URL: https://github.com/apache/doris/pull/30819#issuecomment-1925731858
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org