You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "zy-kkk (via GitHub)" <gi...@apache.org> on 2024/02/02 13:48:25 UTC
[PR] [pick][improvement](catalog) fix jdbc mysql catalog to_date fun pushdown [doris]
zy-kkk opened a new pull request, #30778:
URL: https://github.com/apache/doris/pull/30778
## Proposed changes
Issue Number: close #xxx
pick #29900
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pick][improvement](catalog) fix jdbc mysql catalog to_date fun pushdown [doris]
Posted by "zy-kkk (via GitHub)" <gi...@apache.org>.
zy-kkk merged PR #30778:
URL: https://github.com/apache/doris/pull/30778
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pick][improvement](catalog) fix jdbc mysql catalog to_date fun pushdown [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30778:
URL: https://github.com/apache/doris/pull/30778#issuecomment-1924018871
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit b671aa2ac3a6838c8b157de4e91f229c80ff98af with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 21.2 seconds inserted 10000000 Rows, about 471K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pick][improvement](catalog) fix jdbc mysql catalog to_date fun pushdown [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30778:
URL: https://github.com/apache/doris/pull/30778#issuecomment-1924013541
<details>
<summary>ClickBench: <b>Total hot run time: 30.78 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b671aa2ac3a6838c8b157de4e91f229c80ff98af, data reload: false
query1 0.03 0.02 0.02
query2 0.06 0.02 0.02
query3 0.25 0.04 0.04
query4 1.83 0.11 0.10
query5 0.52 0.52 0.52
query6 1.26 0.62 0.61
query7 0.01 0.01 0.01
query8 0.03 0.03 0.03
query9 0.52 0.48 0.47
query10 0.54 0.53 0.52
query11 0.11 0.09 0.08
query12 0.12 0.09 0.09
query13 0.61 0.62 0.62
query14 0.77 0.79 0.79
query15 0.77 0.77 0.76
query16 0.37 0.38 0.36
query17 1.02 1.01 1.02
query18 0.23 0.25 0.25
query19 1.94 1.83 1.87
query20 0.01 0.01 0.01
query21 15.47 0.55 0.53
query22 2.02 2.24 1.87
query23 17.41 1.02 1.02
query24 6.93 0.68 0.70
query25 1.58 0.12 0.11
query26 0.35 0.15 0.13
query27 0.11 0.11 0.10
query28 6.75 0.73 0.70
query29 12.68 2.29 2.22
query30 0.56 0.52 0.52
query31 2.83 0.37 0.38
query32 3.41 0.49 0.48
query33 3.06 3.06 3.05
query34 15.28 4.79 4.77
query35 4.82 4.86 4.85
query36 1.06 1.02 1.01
query37 0.05 0.05 0.04
query38 0.04 0.02 0.02
query39 0.02 0.01 0.01
query40 0.15 0.14 0.13
query41 0.06 0.01 0.01
query42 0.02 0.01 0.01
query43 0.02 0.02 0.01
Total cold run time: 105.68 s
Total hot run time: 30.78 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pick][improvement](catalog) fix jdbc mysql catalog to_date fun pushdown [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30778:
URL: https://github.com/apache/doris/pull/30778#issuecomment-1924004369
<details>
<summary>TPC-DS: <b>Total hot run time: 242072 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b671aa2ac3a6838c8b157de4e91f229c80ff98af, data reload: false
query1 923 378 379 378
query2 6556 2207 2257 2207
query3 6912 208 204 204
query4 20008 18017 17988 17988
query5 19728 6207 6179 6179
query6 276 219 215 215
query7 4150 301 289 289
query8 249 246 230 230
query9 3042 2651 2578 2578
query10 404 295 292 292
query11 11275 10734 10744 10734
query12 122 74 70 70
query13 5640 648 645 645
query14 17284 13504 13295 13295
query15 364 221 238 221
query16 6451 256 267 256
query17 3253 869 873 869
query18 2260 396 401 396
query19 208 139 147 139
query20 74 73 72 72
query21 191 97 94 94
query22 5265 5083 5089 5083
query23 32429 31949 32119 31949
query24 6921 6436 6427 6427
query25 516 418 429 418
query26 521 161 152 152
query27 1879 284 287 284
query28 6090 2226 2179 2179
query29 2814 2646 2616 2616
query30 245 161 157 157
query31 915 736 750 736
query32 64 57 58 57
query33 398 238 254 238
query34 845 469 484 469
query35 1117 911 961 911
query36 1587 1367 1519 1367
query37 87 64 56 56
query38 3068 2913 2912 2912
query39 1364 1306 1329 1306
query40 204 84 90 84
query41 34 32 34 32
query42 90 82 93 82
query43 673 578 653 578
query44 1100 698 702 698
query45 230 222 226 222
query46 1223 974 988 974
query47 1879 1872 1819 1819
query48 972 690 661 661
query49 615 364 363 363
query50 870 620 600 600
query51 5575 5400 5465 5400
query52 81 69 74 69
query53 438 308 310 308
query54 2445 2251 2231 2231
query55 84 74 82 74
query56 208 197 194 194
query57 1254 1132 1068 1068
query58 205 195 204 195
query59 3442 3311 3219 3219
query60 201 196 194 194
query61 83 84 81 81
query62 799 490 468 468
query63 467 336 327 327
query64 1999 1296 1292 1292
query65 3689 3612 3617 3612
query66 818 369 356 356
query67 17039 16605 15214 15214
query68 8552 631 656 631
query69 562 354 333 333
query70 2173 1896 1909 1896
query71 403 296 303 296
query72 4396 3306 3348 3306
query73 728 318 321 318
query74 6365 5884 5852 5852
query75 4745 3484 3564 3484
query76 5244 1197 1227 1197
query77 830 267 253 253
query78 32011 52223 51791 51791
query79 16345 636 634 634
query80 5330 376 382 376
query81 559 233 230 230
query82 1336 96 92 92
query83 420 130 129 129
query84 256 68 68 68
query85 2613 280 277 277
query86 482 434 380 380
query87 3269 3007 3040 3007
query88 7230 2340 2330 2330
query89 472 270 281 270
query90 2540 198 203 198
query91 158 126 113 113
query92 64 49 53 49
query93 7159 549 600 549
query94 1846 208 204 204
query95 1118 1049 1024 1024
query96 658 331 325 325
query97 6383 6305 6418 6305
query98 196 183 171 171
query99 3930 901 969 901
Total cold run time: 350585 ms
Total hot run time: 242072 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pick][improvement](catalog) fix jdbc mysql catalog to_date fun pushdown [doris]
Posted by "zy-kkk (via GitHub)" <gi...@apache.org>.
zy-kkk commented on PR #30778:
URL: https://github.com/apache/doris/pull/30778#issuecomment-1923842172
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pick][improvement](catalog) fix jdbc mysql catalog to_date fun pushdown [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30778:
URL: https://github.com/apache/doris/pull/30778#issuecomment-1923969069
<details>
<summary>TPC-H: <b>Total hot run time: 49526 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b671aa2ac3a6838c8b157de4e91f229c80ff98af, data reload: false
------ Round 1 ----------------------------------
q1 18066 4347 4304 4304
q2 2028 148 140 140
q3 10284 1862 1956 1862
q4 10373 1203 1300 1203
q5 8420 3944 3970 3944
q6 228 126 122 122
q7 2077 1653 1646 1646
q8 9285 2678 2690 2678
q9 10811 10311 10495 10311
q10 8627 3518 3506 3506
q11 417 241 251 241
q12 455 291 295 291
q13 18338 3938 3964 3938
q14 370 334 317 317
q15 512 447 457 447
q16 668 600 582 582
q17 1104 965 952 952
q18 7240 6778 6881 6778
q19 1641 1601 1528 1528
q20 522 321 302 302
q21 4439 4089 4051 4051
q22 491 383 390 383
Total cold run time: 116396 ms
Total hot run time: 49526 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4329 4292 4293 4292
q2 316 222 215 215
q3 4136 4104 4134 4104
q4 2726 2741 2743 2741
q5 7284 7124 7117 7117
q6 232 117 120 117
q7 3177 2787 2828 2787
q8 4301 4427 4426 4426
q9 17018 16926 16803 16803
q10 4221 4196 4214 4196
q11 737 659 677 659
q12 1021 831 845 831
q13 7244 3714 3722 3714
q14 446 419 425 419
q15 498 456 451 451
q16 758 702 704 702
q17 3769 3809 3848 3809
q18 8787 8575 8815 8575
q19 1715 1690 1660 1660
q20 2410 2134 2121 2121
q21 8469 8548 8424 8424
q22 1030 959 911 911
Total cold run time: 84624 ms
Total hot run time: 79074 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pick][improvement](catalog) fix jdbc mysql catalog to_date fun pushdown [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30778:
URL: https://github.com/apache/doris/pull/30778#issuecomment-1923842010
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org