You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "jackwener (via GitHub)" <gi...@apache.org> on 2023/12/14 14:44:34 UTC
[PR] [fix](Planner): parse more Punctuation Date/DateTime [doris]
jackwener opened a new pull request, #28432:
URL: https://github.com/apache/doris/pull/28432
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Planner): parse more Punctuation Date/DateTime [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28432:
URL: https://github.com/apache/doris/pull/28432#issuecomment-1857234898
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 44.73 seconds
stream load tsv: 583 seconds loaded 74807831229 Bytes, about 122 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.8 seconds inserted 10000000 Rows, about 347K ops/s
storage size: 17219669159 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Planner): parse more Punctuation Date/DateTime [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28432:
URL: https://github.com/apache/doris/pull/28432#issuecomment-1856030446
<details>
<summary>TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
Tpch sf100 test result on commit ba79dc939279e0686755a1d72bc694b7612a8249, data reload: false
run tpch-sf100 query with default conf and session variables
q1 4711 4442 4466 4442
q2 366 149 158 149
q3 1455 1269 1238 1238
q4 1103 922 884 884
q5 3178 3162 3153 3153
q6 248 128 127 127
q7 1005 492 484 484
q8 2207 2212 2188 2188
q9 6698 6655 6666 6655
q10 3224 3268 3250 3250
q11 326 209 198 198
q12 350 201 205 201
q13 4543 3816 3800 3800
q14 244 211 214 211
q15 568 531 518 518
q16 439 383 385 383
q17 995 592 551 551
q18 7173 6871 6986 6871
q19 1513 1335 1451 1335
q20 513 308 300 300
q21 3060 2579 2647 2579
q22 344 274 284 274
Total cold run time: 44263 ms
Total hot run time: 39791 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4391 4389 4345 4345
q2 265 165 175 165
q3 3534 3525 3523 3523
q4 2378 2366 2356 2356
q5 5731 5721 5739 5721
q6 241 124 121 121
q7 2384 1861 1860 1860
q8 3519 3526 3530 3526
q9 9043 8995 9003 8995
q10 3900 4012 3988 3988
q11 501 365 373 365
q12 766 588 604 588
q13 4288 3551 3552 3551
q14 281 252 253 252
q15 573 525 522 522
q16 499 444 472 444
q17 1877 1868 1846 1846
q18 8664 8288 8373 8288
q19 1734 1740 1736 1736
q20 2254 1948 1930 1930
q21 6521 6167 6126 6126
q22 503 433 429 429
Total cold run time: 63847 ms
Total hot run time: 60677 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Planner): parse more Punctuation Date/DateTime [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28432:
URL: https://github.com/apache/doris/pull/28432#issuecomment-1857331023
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Planner): parse more Punctuation Date/DateTime [doris]
Posted by "jackwener (via GitHub)" <gi...@apache.org>.
jackwener commented on PR #28432:
URL: https://github.com/apache/doris/pull/28432#issuecomment-1857176252
run clickbench
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Planner): parse more Punctuation Date/DateTime [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28432:
URL: https://github.com/apache/doris/pull/28432#issuecomment-1857196826
<details>
<summary>TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
Tpch sf100 test result on commit f2fdbf413f8d439470e21ea4de79533a5ef2fc61, data reload: false
run tpch-sf100 query with default conf and session variables
q1 4738 4444 4487 4444
q2 367 149 157 149
q3 1458 1228 1278 1228
q4 1110 887 847 847
q5 3168 3129 3192 3129
q6 249 130 129 129
q7 1002 493 488 488
q8 2216 2245 2178 2178
q9 6704 6682 6657 6657
q10 3225 3241 3264 3241
q11 326 208 201 201
q12 347 211 211 211
q13 4579 3806 3816 3806
q14 252 217 214 214
q15 570 531 535 531
q16 438 388 391 388
q17 1011 559 514 514
q18 7164 7034 6879 6879
q19 1505 1398 1453 1398
q20 535 299 309 299
q21 3098 2711 2683 2683
q22 355 282 284 282
Total cold run time: 44417 ms
Total hot run time: 39896 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4421 4422 4418 4418
q2 269 163 173 163
q3 3557 3519 3526 3519
q4 2382 2370 2366 2366
q5 5766 5724 5765 5724
q6 242 120 120 120
q7 2372 1874 1865 1865
q8 3523 3522 3518 3518
q9 9066 9031 8979 8979
q10 3913 3988 3985 3985
q11 517 401 383 383
q12 767 601 596 596
q13 4344 3581 3585 3581
q14 287 259 255 255
q15 582 517 515 515
q16 502 452 464 452
q17 1878 1849 1861 1849
q18 8707 8281 8235 8235
q19 1734 1754 1729 1729
q20 2283 1947 1929 1929
q21 6488 6184 6147 6147
q22 487 420 439 420
Total cold run time: 64087 ms
Total hot run time: 60748 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Planner): parse more Punctuation Date/DateTime [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28432:
URL: https://github.com/apache/doris/pull/28432#issuecomment-1857279622
<details>
<summary>TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
Tpch sf100 test result on commit f2fdbf413f8d439470e21ea4de79533a5ef2fc61, data reload: false
run tpch-sf100 query with default conf and session variables
q1 4739 4464 4500 4464
q2 363 162 166 162
q3 1474 1272 1226 1226
q4 1096 898 904 898
q5 3177 3195 3191 3191
q6 248 129 132 129
q7 998 488 481 481
q8 2202 2193 2205 2193
q9 6700 6657 6671 6657
q10 3213 3268 3271 3268
q11 320 207 205 205
q12 351 209 210 209
q13 4557 3821 3830 3821
q14 248 216 222 216
q15 569 526 528 526
q16 443 399 391 391
q17 1030 669 585 585
q18 7041 6863 6947 6863
q19 1541 1469 1375 1375
q20 563 326 290 290
q21 3067 2630 2659 2630
q22 348 278 286 278
Total cold run time: 44288 ms
Total hot run time: 40058 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4446 4416 4416 4416
q2 272 164 169 164
q3 3520 3511 3503 3503
q4 2393 2380 2376 2376
q5 5743 5729 5734 5729
q6 235 123 118 118
q7 2394 1879 1833 1833
q8 3525 3545 3528 3528
q9 9046 9025 8973 8973
q10 3915 3997 4035 3997
q11 513 396 398 396
q12 775 597 608 597
q13 4296 3578 3577 3577
q14 290 262 251 251
q15 571 521 520 520
q16 512 466 484 466
q17 1885 1890 1859 1859
q18 8551 8049 8077 8049
q19 1719 1758 1724 1724
q20 2239 1935 1945 1935
q21 6500 6154 6148 6148
q22 490 434 411 411
Total cold run time: 63830 ms
Total hot run time: 60570 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Planner): parse more Punctuation Date/DateTime [doris]
Posted by "jackwener (via GitHub)" <gi...@apache.org>.
jackwener merged PR #28432:
URL: https://github.com/apache/doris/pull/28432
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Planner): parse more Punctuation Date/DateTime [doris]
Posted by "jackwener (via GitHub)" <gi...@apache.org>.
jackwener commented on PR #28432:
URL: https://github.com/apache/doris/pull/28432#issuecomment-1855988733
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Planner): parse more Punctuation Date/DateTime [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28432:
URL: https://github.com/apache/doris/pull/28432#issuecomment-1856229762
<details>
<summary>TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
Tpch sf100 test result on commit f2fdbf413f8d439470e21ea4de79533a5ef2fc61, data reload: false
run tpch-sf100 query with default conf and session variables
q1 4768 4464 4475 4464
q2 367 147 159 147
q3 1450 1237 1224 1224
q4 1101 896 907 896
q5 3134 3164 3149 3149
q6 253 128 125 125
q7 973 499 483 483
q8 2184 2209 2171 2171
q9 6653 6660 6660 6660
q10 3209 3267 3282 3267
q11 312 207 202 202
q12 346 206 200 200
q13 4576 3816 3824 3816
q14 245 209 207 207
q15 561 527 523 523
q16 445 385 385 385
q17 1003 596 558 558
q18 7264 7062 6916 6916
q19 1524 1369 1428 1369
q20 509 315 287 287
q21 3060 2635 2632 2632
q22 352 275 283 275
Total cold run time: 44289 ms
Total hot run time: 39956 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4411 4431 4403 4403
q2 267 168 177 168
q3 3548 3535 3524 3524
q4 2382 2367 2369 2367
q5 5724 5729 5752 5729
q6 243 119 121 119
q7 2370 1852 1861 1852
q8 3514 3523 3517 3517
q9 9030 9050 9046 9046
q10 3891 3998 3985 3985
q11 514 391 407 391
q12 763 588 601 588
q13 4289 3587 3559 3559
q14 285 253 252 252
q15 576 525 520 520
q16 502 443 457 443
q17 1862 1858 1820 1820
q18 8801 8282 8263 8263
q19 1711 1711 1742 1711
q20 2254 1964 1946 1946
q21 6485 6164 6164 6164
q22 522 434 440 434
Total cold run time: 63944 ms
Total hot run time: 60801 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Planner): parse more Punctuation Date/DateTime [doris]
Posted by "jackwener (via GitHub)" <gi...@apache.org>.
jackwener commented on PR #28432:
URL: https://github.com/apache/doris/pull/28432#issuecomment-1856110478
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Planner): parse more Punctuation Date/DateTime [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28432:
URL: https://github.com/apache/doris/pull/28432#issuecomment-1857370252
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org