You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "starocean999 (via GitHub)" <gi...@apache.org> on 2023/11/27 10:46:39 UTC
[PR] [test](nereids)add fe ut for SimplifyArithmeticComparisonRule [doris]
starocean999 opened a new pull request, #27644:
URL: https://github.com/apache/doris/pull/27644
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [test](nereids)add fe ut for SimplifyArithmeticComparisonRule [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27644:
URL: https://github.com/apache/doris/pull/27644#issuecomment-1911668066
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 48c21bd50a74197b11e25a6cc980a11e7397b74e with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 13.6 seconds inserted 10000000 Rows, about 735K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [test](nereids)add fe ut for SimplifyArithmeticComparisonRule [doris]
Posted by "starocean999 (via GitHub)" <gi...@apache.org>.
starocean999 commented on PR #27644:
URL: https://github.com/apache/doris/pull/27644#issuecomment-1911620555
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [test](nereids)add fe ut for SimplifyArithmeticComparisonRule [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27644:
URL: https://github.com/apache/doris/pull/27644#issuecomment-1911645148
<details>
<summary>TPC-H: <b>Total hot run time: 39171 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 48c21bd50a74197b11e25a6cc980a11e7397b74e, data reload: false
------ Round 1 ----------------------------------
q1 18286 5308 5525 5308
q2 2604 144 135 135
q3 11058 1251 1188 1188
q4 10669 813 815 813
q5 7803 3238 3229 3229
q6 202 124 126 124
q7 890 518 498 498
q8 9460 1962 1947 1947
q9 7263 6363 6345 6345
q10 8231 3117 3082 3082
q11 421 215 213 213
q12 356 188 188 188
q13 17989 3382 3337 3337
q14 254 217 205 205
q15 551 509 505 505
q16 426 374 372 372
q17 958 498 511 498
q18 7569 7183 6807 6807
q19 1558 1374 1367 1367
q20 566 299 288 288
q21 2741 2441 2421 2421
q22 371 306 301 301
Total cold run time: 110226 ms
Total hot run time: 39171 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5399 5259 5348 5259
q2 324 213 210 210
q3 3320 3227 3271 3227
q4 2130 2042 2087 2042
q5 6054 5873 5942 5873
q6 198 113 119 113
q7 2297 1851 1874 1851
q8 3231 3371 3412 3371
q9 8987 8877 8793 8793
q10 3934 3894 3926 3894
q11 553 452 457 452
q12 774 631 625 625
q13 16939 3171 3150 3150
q14 292 266 263 263
q15 560 498 503 498
q16 511 474 482 474
q17 2677 1901 1837 1837
q18 9485 9341 9192 9192
q19 19373 1556 1508 1508
q20 4565 1941 1925 1925
q21 14198 5231 5405 5231
q22 997 545 548 545
Total cold run time: 106798 ms
Total hot run time: 60333 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [test](nereids)add fe ut for SimplifyArithmeticComparisonRule [doris]
Posted by "starocean999 (via GitHub)" <gi...@apache.org>.
starocean999 commented on PR #27644:
URL: https://github.com/apache/doris/pull/27644#issuecomment-1831368759
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [test](nereids)add fe ut for SimplifyArithmeticComparisonRule [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27644:
URL: https://github.com/apache/doris/pull/27644#issuecomment-1827776683
<details>
<summary>TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
Tpch sf100 test result on commit 86021c7365fed0a24107ebf744c47ec952887b98, data reload: false
run tpch-sf100 query with default conf and session variables
q1 4893 4685 4661 4661
q2 358 165 157 157
q3 2064 1927 1901 1901
q4 1397 1286 1272 1272
q5 4005 3939 4048 3939
q6 255 135 132 132
q7 1426 885 880 880
q8 2814 2804 2786 2786
q9 10039 10058 9680 9680
q10 3445 3545 3526 3526
q11 383 246 258 246
q12 441 286 288 286
q13 4572 3792 3830 3792
q14 313 305 295 295
q15 580 537 521 521
q16 662 578 590 578
q17 1139 952 959 952
q18 7879 7475 7589 7475
q19 1663 1707 1683 1683
q20 578 290 307 290
q21 4467 4029 4054 4029
q22 482 376 384 376
Total cold run time: 53855 ms
Total hot run time: 49457 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4591 4625 4572 4572
q2 375 223 247 223
q3 4046 4034 4042 4034
q4 2745 2713 2710 2710
q5 9868 9871 9755 9755
q6 245 125 124 124
q7 3039 2490 2487 2487
q8 4458 4482 4445 4445
q9 13344 13286 13264 13264
q10 4116 4170 4158 4158
q11 797 660 638 638
q12 972 800 815 800
q13 4297 3575 3557 3557
q14 382 353 355 353
q15 576 520 506 506
q16 729 685 684 684
q17 3885 3883 3862 3862
q18 9648 9211 9177 9177
q19 1815 1776 1789 1776
q20 2384 2061 2071 2061
q21 8859 8458 8656 8458
q22 877 795 850 795
Total cold run time: 82048 ms
Total hot run time: 78439 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [test](nereids)add fe ut for SimplifyArithmeticComparisonRule [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27644:
URL: https://github.com/apache/doris/pull/27644#issuecomment-1827769918
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 45.83 seconds
stream load tsv: 564 seconds loaded 74807831229 Bytes, about 126 MB/s
stream load json: 24 seconds loaded 2358488459 Bytes, about 93 MB/s
stream load orc: 72 seconds loaded 1101869774 Bytes, about 14 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.8 seconds inserted 10000000 Rows, about 347K ops/s
storage size: 17097927636 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [test](nereids)add fe ut for SimplifyArithmeticComparisonRule [doris]
Posted by "starocean999 (via GitHub)" <gi...@apache.org>.
starocean999 merged PR #27644:
URL: https://github.com/apache/doris/pull/27644
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [test](nereids)add fe ut for SimplifyArithmeticComparisonRule [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #27644:
URL: https://github.com/apache/doris/pull/27644#issuecomment-1911621832
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [test](nereids)add fe ut for SimplifyArithmeticComparisonRule [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27644:
URL: https://github.com/apache/doris/pull/27644#issuecomment-1831537906
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 43.39 seconds
stream load tsv: 582 seconds loaded 74807831229 Bytes, about 122 MB/s
stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.6 seconds inserted 10000000 Rows, about 349K ops/s
storage size: 17099906316 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [test](nereids)add fe ut for SimplifyArithmeticComparisonRule [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27644:
URL: https://github.com/apache/doris/pull/27644#issuecomment-1911664565
<details>
<summary>ClickBench: <b>Total hot run time: 30.68 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 48c21bd50a74197b11e25a6cc980a11e7397b74e, data reload: false
query1 0.04 0.03 0.02
query2 0.06 0.02 0.02
query3 0.22 0.04 0.05
query4 1.70 0.06 0.06
query5 0.54 0.52 0.53
query6 1.29 0.63 0.61
query7 0.02 0.02 0.01
query8 0.04 0.03 0.02
query9 0.54 0.49 0.50
query10 0.55 0.56 0.55
query11 0.11 0.08 0.08
query12 0.11 0.10 0.08
query13 0.61 0.62 0.60
query14 0.80 0.81 0.78
query15 0.81 0.78 0.79
query16 0.37 0.38 0.37
query17 1.00 0.97 1.04
query18 0.26 0.23 0.23
query19 1.83 1.80 1.78
query20 0.01 0.01 0.01
query21 15.41 0.56 0.54
query22 2.68 2.54 1.47
query23 16.74 1.01 0.79
query24 2.65 1.64 1.10
query25 0.41 0.18 0.22
query26 0.56 0.14 0.13
query27 0.05 0.06 0.06
query28 11.21 0.79 0.77
query29 12.49 3.30 3.25
query30 0.61 0.51 0.52
query31 2.77 0.35 0.34
query32 3.38 0.48 0.48
query33 3.19 3.26 3.23
query34 15.78 4.36 4.26
query35 4.39 4.31 4.24
query36 1.12 1.07 1.06
query37 0.06 0.05 0.05
query38 0.03 0.02 0.03
query39 0.02 0.02 0.02
query40 0.15 0.14 0.13
query41 0.07 0.02 0.01
query42 0.02 0.02 0.01
query43 0.03 0.01 0.02
Total cold run time: 104.73 s
Total hot run time: 30.68 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [test](nereids)add fe ut for SimplifyArithmeticComparisonRule [doris]
Posted by "starocean999 (via GitHub)" <gi...@apache.org>.
starocean999 commented on PR #27644:
URL: https://github.com/apache/doris/pull/27644#issuecomment-1827588080
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [test](nereids)add fe ut for SimplifyArithmeticComparisonRule [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #27644:
URL: https://github.com/apache/doris/pull/27644#issuecomment-1911621864
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [test](nereids)add fe ut for SimplifyArithmeticComparisonRule [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27644:
URL: https://github.com/apache/doris/pull/27644#issuecomment-1911658510
<details>
<summary>TPC-DS: <b>Total hot run time: 186835 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 48c21bd50a74197b11e25a6cc980a11e7397b74e, data reload: false
query1 938 331 327 327
query2 6561 2012 1847 1847
query3 6711 205 199 199
query4 31464 22195 22247 22195
query5 4452 374 384 374
query6 235 152 149 149
query7 4609 258 266 258
query8 231 165 174 165
query9 8378 2605 2625 2605
query10 423 225 231 225
query11 17265 15605 15501 15501
query12 116 69 67 67
query13 1698 372 370 370
query14 10509 6795 6863 6795
query15 215 189 182 182
query16 5788 264 251 251
query17 945 476 464 464
query18 1790 259 244 244
query19 179 129 134 129
query20 67 69 70 69
query21 190 132 122 122
query22 5129 5016 5117 5016
query23 31548 30862 30867 30862
query24 12565 2833 2825 2825
query25 577 306 304 304
query26 1835 144 148 144
query27 3212 288 291 288
query28 7328 1850 1818 1818
query29 2178 629 615 615
query30 280 134 140 134
query31 921 744 740 740
query32 88 50 46 46
query33 709 206 205 205
query34 1198 455 475 455
query35 886 762 783 762
query36 1313 1242 1146 1146
query37 92 59 61 59
query38 3345 3238 3259 3238
query39 1327 1256 1257 1256
query40 343 85 79 79
query41 35 37 34 34
query42 85 85 80 80
query43 486 512 479 479
query44 1110 695 692 692
query45 197 174 170 170
query46 1065 671 679 671
query47 1641 1451 1583 1451
query48 387 297 322 297
query49 1228 303 292 292
query50 696 311 310 310
query51 5313 5199 5210 5199
query52 89 77 71 71
query53 318 256 254 254
query54 240 183 181 181
query55 75 72 76 72
query56 167 177 170 170
query57 1001 938 952 938
query58 189 150 151 150
query59 2815 2815 2740 2740
query60 205 180 186 180
query61 80 84 81 81
query62 657 360 361 360
query63 270 259 272 259
query64 6145 1798 1791 1791
query65 3345 3252 3229 3229
query66 1416 321 305 305
query67 15965 15412 15091 15091
query68 12729 534 523 523
query69 632 301 283 283
query70 1782 1541 1583 1541
query71 10479 10198 10204 10198
query72 5294 2822 2819 2819
query73 2864 321 317 317
query74 7056 6381 6367 6367
query75 5267 2337 2277 2277
query76 6731 1028 976 976
query77 733 226 223 223
query78 9961 8754 8706 8706
query79 1229 522 522 522
query80 542 324 310 310
query81 449 199 203 199
query82 208 75 79 75
query83 192 116 115 115
query84 272 67 68 67
query85 1107 331 311 311
query86 394 372 420 372
query87 3554 3378 3306 3306
query88 3091 2193 2190 2190
query89 429 376 348 348
query90 2047 188 185 185
query91 164 128 135 128
query92 54 43 42 42
query93 1340 443 422 422
query94 1263 159 157 157
query95 494 460 461 460
query96 626 315 323 315
query97 4243 4138 4123 4123
query98 207 190 190 190
query99 1014 691 715 691
Total cold run time: 309305 ms
Total hot run time: 186835 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org