You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "w41ter (via GitHub)" <gi...@apache.org> on 2024/01/30 06:32:40 UTC
[PR] [feature](merge-cloud) Set txn expiration fields for cloud load [doris]
w41ter opened a new pull request, #30561:
URL: https://github.com/apache/doris/pull/30561
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Set txn expiration fields for cloud load [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30561:
URL: https://github.com/apache/doris/pull/30561#issuecomment-1916236206
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Set txn expiration fields for cloud load [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring merged PR #30561:
URL: https://github.com/apache/doris/pull/30561
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Set txn expiration fields for cloud load [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30561:
URL: https://github.com/apache/doris/pull/30561#issuecomment-1916175912
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Set txn expiration fields for cloud load [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30561:
URL: https://github.com/apache/doris/pull/30561#issuecomment-1916472201
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Set txn expiration fields for cloud load [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30561:
URL: https://github.com/apache/doris/pull/30561#issuecomment-1916569189
<details>
<summary>TPC-DS: <b>Total hot run time: 172427 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5e554786108c59198dbebad36175b6c03a1ca8c6, data reload: false
query1 929 334 325 325
query2 6568 1959 1866 1866
query3 6697 211 205 205
query4 26564 21957 21951 21951
query5 4444 353 385 353
query6 243 178 150 150
query7 4592 261 251 251
query8 238 175 178 175
query9 9119 2242 2214 2214
query10 404 197 211 197
query11 16869 15400 15329 15329
query12 120 68 58 58
query13 1706 388 377 377
query14 9293 6541 6405 6405
query15 207 174 191 174
query16 6252 258 249 249
query17 1862 470 464 464
query18 1875 263 249 249
query19 175 130 130 130
query20 71 70 71 70
query21 193 119 127 119
query22 4877 4788 4725 4725
query23 31160 30291 30393 30291
query24 9159 2761 2760 2760
query25 545 311 303 303
query26 858 134 138 134
query27 2785 285 283 283
query28 6095 1836 1830 1830
query29 923 604 622 604
query30 282 135 136 135
query31 895 695 718 695
query32 87 48 47 47
query33 485 212 205 205
query34 825 455 457 455
query35 853 759 772 759
query36 1310 1126 1206 1126
query37 95 55 58 55
query38 3280 3213 3165 3165
query39 1291 1277 1243 1243
query40 198 90 82 82
query41 35 36 36 36
query42 92 83 82 82
query43 518 491 502 491
query44 1060 678 680 678
query45 193 177 172 172
query46 1052 638 639 638
query47 1586 1433 1527 1433
query48 374 301 309 301
query49 1107 278 273 273
query50 674 308 314 308
query51 5321 5133 5168 5133
query52 96 78 79 78
query53 333 258 253 253
query54 218 191 185 185
query55 81 79 80 79
query56 175 159 164 159
query57 970 898 897 897
query58 176 156 155 155
query59 2495 2461 2254 2254
query60 193 180 179 179
query61 82 84 81 81
query62 578 364 348 348
query63 277 252 271 252
query64 4049 1752 1781 1752
query65 3298 3243 3214 3214
query66 1132 316 310 310
query67 14413 14181 14175 14175
query68 4076 494 494 494
query69 446 295 310 295
query70 1523 1440 1482 1440
query71 272 209 212 209
query72 3734 2826 2841 2826
query73 681 319 327 319
query74 6563 6193 6305 6193
query75 2800 2262 2250 2250
query76 2974 961 929 929
query77 363 231 231 231
query78 9036 8781 8629 8629
query79 2188 498 502 498
query80 1297 323 313 313
query81 538 198 197 197
query82 668 86 74 74
query83 219 116 115 115
query84 231 72 73 72
query85 1971 335 327 327
query86 514 420 396 396
query87 3350 3316 3246 3246
query88 3761 2261 2268 2261
query89 422 361 346 346
query90 1900 190 185 185
query91 144 133 117 117
query92 55 42 42 42
query93 2166 448 404 404
query94 1383 157 158 157
query95 504 457 443 443
query96 640 327 328 327
query97 4250 4085 4089 4085
query98 215 189 178 178
query99 1051 705 777 705
Total cold run time: 264937 ms
Total hot run time: 172427 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Set txn expiration fields for cloud load [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30561:
URL: https://github.com/apache/doris/pull/30561#issuecomment-1916550334
<details>
<summary>TPC-H: <b>Total hot run time: 37156 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5e554786108c59198dbebad36175b6c03a1ca8c6, data reload: false
------ Round 1 ----------------------------------
q1 17693 4846 4613 4613
q2 2036 140 126 126
q3 10965 929 924 924
q4 4676 774 696 696
q5 7667 2809 2797 2797
q6 187 121 118 118
q7 1143 717 702 702
q8 9380 2066 2030 2030
q9 7259 6360 6348 6348
q10 8079 2445 2446 2445
q11 407 205 200 200
q12 810 282 284 282
q13 18009 3334 3378 3334
q14 265 259 248 248
q15 527 492 485 485
q16 460 419 417 417
q17 946 566 498 498
q18 6867 5978 5926 5926
q19 1570 1375 1383 1375
q20 579 349 320 320
q21 7016 3149 2988 2988
q22 804 328 284 284
Total cold run time: 107345 ms
Total hot run time: 37156 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4521 4501 4460 4460
q2 327 227 230 227
q3 3025 2783 2871 2783
q4 1837 1697 1702 1697
q5 5265 5214 5279 5214
q6 190 114 115 114
q7 2215 1785 1747 1747
q8 3069 3255 3339 3255
q9 8374 8383 8254 8254
q10 5806 3574 3545 3545
q11 538 475 451 451
q12 765 557 570 557
q13 12200 3084 3089 3084
q14 283 259 265 259
q15 532 483 491 483
q16 504 448 464 448
q17 1823 1733 1725 1725
q18 7924 7733 7546 7546
q19 8795 1516 1484 1484
q20 2139 1902 1903 1902
q21 4776 4731 4473 4473
q22 542 484 499 484
Total cold run time: 75450 ms
Total hot run time: 54192 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Set txn expiration fields for cloud load [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30561:
URL: https://github.com/apache/doris/pull/30561#issuecomment-1916180702
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Set txn expiration fields for cloud load [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30561:
URL: https://github.com/apache/doris/pull/30561#issuecomment-1916394772
<details>
<summary>TPC-H: <b>Total hot run time: 37146 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 30ba83d18fb1c9895a7b38090108b4c3b09e518d, data reload: false
------ Round 1 ----------------------------------
q1 17917 4791 4571 4571
q2 2396 155 137 137
q3 11807 962 930 930
q4 4961 803 719 719
q5 7693 2843 2806 2806
q6 188 119 120 119
q7 1148 740 706 706
q8 9298 2020 2028 2020
q9 7195 6320 6341 6320
q10 8095 2435 2498 2435
q11 405 198 202 198
q12 730 274 265 265
q13 18011 3298 3304 3298
q14 284 245 254 245
q15 526 493 491 491
q16 468 407 432 407
q17 953 562 509 509
q18 6883 6034 5957 5957
q19 1583 1340 1397 1340
q20 625 324 335 324
q21 6678 3059 3082 3059
q22 803 313 290 290
Total cold run time: 108647 ms
Total hot run time: 37146 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4516 4444 4535 4444
q2 342 234 238 234
q3 3001 2844 2843 2843
q4 1864 1699 1728 1699
q5 5274 5314 5302 5302
q6 192 110 115 110
q7 2147 1775 1759 1759
q8 3142 3228 3288 3228
q9 8395 8356 8357 8356
q10 5924 3573 3599 3573
q11 535 467 456 456
q12 740 569 582 569
q13 6646 3136 3099 3099
q14 285 238 251 238
q15 545 498 492 492
q16 506 484 452 452
q17 1871 1687 1688 1687
q18 7952 7745 7683 7683
q19 10341 1569 1534 1534
q20 2150 1922 1911 1911
q21 4892 4507 4684 4507
q22 561 500 469 469
Total cold run time: 71821 ms
Total hot run time: 54645 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Set txn expiration fields for cloud load [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30561:
URL: https://github.com/apache/doris/pull/30561#issuecomment-1916577539
TeamCity be ut coverage result:
Function Coverage: 36.19% (8626/23835)
Line Coverage: 28.25% (70534/249698)
Region Coverage: 27.25% (36399/133592)
Branch Coverage: 24.03% (18638/77572)
Coverage Report: http://coverage.selectdb-in.cc/coverage/5e554786108c59198dbebad36175b6c03a1ca8c6_5e554786108c59198dbebad36175b6c03a1ca8c6/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Set txn expiration fields for cloud load [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring commented on PR #30561:
URL: https://github.com/apache/doris/pull/30561#issuecomment-1916338544
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Set txn expiration fields for cloud load [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30561:
URL: https://github.com/apache/doris/pull/30561#issuecomment-1916390402
TeamCity be ut coverage result:
Function Coverage: 36.20% (8625/23827)
Line Coverage: 28.25% (70532/249636)
Region Coverage: 27.25% (36393/133558)
Branch Coverage: 24.04% (18645/77564)
Coverage Report: http://coverage.selectdb-in.cc/coverage/30ba83d18fb1c9895a7b38090108b4c3b09e518d_30ba83d18fb1c9895a7b38090108b4c3b09e518d/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Set txn expiration fields for cloud load [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30561:
URL: https://github.com/apache/doris/pull/30561#issuecomment-1916432786
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 30ba83d18fb1c9895a7b38090108b4c3b09e518d with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 13.6 seconds inserted 10000000 Rows, about 735K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Set txn expiration fields for cloud load [doris]
Posted by "w41ter (via GitHub)" <gi...@apache.org>.
w41ter commented on PR #30561:
URL: https://github.com/apache/doris/pull/30561#issuecomment-1916166838
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Set txn expiration fields for cloud load [doris]
Posted by "w41ter (via GitHub)" <gi...@apache.org>.
w41ter commented on PR #30561:
URL: https://github.com/apache/doris/pull/30561#issuecomment-1916455171
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Set txn expiration fields for cloud load [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30561:
URL: https://github.com/apache/doris/pull/30561#issuecomment-1916416719
<details>
<summary>TPC-DS: <b>Total hot run time: 173036 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 30ba83d18fb1c9895a7b38090108b4c3b09e518d, data reload: false
query1 938 332 328 328
query2 6544 2126 1844 1844
query3 6722 204 196 196
query4 27328 22049 22021 22021
query5 4448 354 356 354
query6 249 157 156 156
query7 4625 266 252 252
query8 238 177 176 176
query9 9106 2291 2274 2274
query10 419 208 192 192
query11 16652 15487 15500 15487
query12 123 68 67 67
query13 1685 380 386 380
query14 9313 6515 6559 6515
query15 217 174 185 174
query16 6532 260 249 249
query17 1888 469 456 456
query18 1939 252 246 246
query19 175 129 128 128
query20 71 75 68 68
query21 193 130 132 130
query22 5019 4744 4751 4744
query23 31380 30296 30376 30296
query24 11441 2734 2780 2734
query25 599 307 311 307
query26 1813 135 136 135
query27 2970 283 284 283
query28 7452 1840 1826 1826
query29 1638 643 620 620
query30 280 135 133 133
query31 921 716 742 716
query32 89 51 47 47
query33 702 207 212 207
query34 1068 452 464 452
query35 868 753 745 745
query36 1336 1182 1257 1182
query37 94 57 59 57
query38 3284 3194 3151 3151
query39 1289 1267 1242 1242
query40 194 86 80 80
query41 37 35 35 35
query42 84 80 82 80
query43 503 496 505 496
query44 1157 682 673 673
query45 198 176 177 176
query46 1024 635 633 633
query47 1592 1530 1445 1445
query48 382 304 295 295
query49 1152 292 286 286
query50 691 313 306 306
query51 5181 5124 5172 5124
query52 100 73 82 73
query53 330 254 261 254
query54 256 198 203 198
query55 80 75 79 75
query56 186 162 166 162
query57 981 916 914 914
query58 184 152 159 152
query59 2429 2380 2410 2380
query60 200 182 186 182
query61 85 87 86 86
query62 622 359 370 359
query63 276 250 261 250
query64 4755 1766 1757 1757
query65 3312 3253 3218 3218
query66 1266 314 314 314
query67 14477 14358 13948 13948
query68 4093 512 491 491
query69 440 309 308 308
query70 1545 1529 1554 1529
query71 310 213 215 213
query72 3780 2843 2858 2843
query73 677 314 311 311
query74 6694 6208 6331 6208
query75 2846 2274 2286 2274
query76 2928 952 925 925
query77 377 242 232 232
query78 9083 8776 8700 8700
query79 2454 498 492 492
query80 1380 329 308 308
query81 526 196 201 196
query82 777 86 85 85
query83 209 125 121 121
query84 234 84 82 82
query85 1416 356 334 334
query86 507 414 380 380
query87 3478 3301 3265 3265
query88 3901 2219 2219 2219
query89 424 393 357 357
query90 2031 186 185 185
query91 154 134 121 121
query92 59 41 46 41
query93 1795 426 438 426
query94 1290 164 162 162
query95 517 468 444 444
query96 622 316 316 316
query97 4247 4134 4087 4087
query98 214 194 194 194
query99 985 667 666 666
Total cold run time: 273375 ms
Total hot run time: 173036 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Set txn expiration fields for cloud load [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30561:
URL: https://github.com/apache/doris/pull/30561#issuecomment-1916579505
<details>
<summary>ClickBench: <b>Total hot run time: 31.09 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5e554786108c59198dbebad36175b6c03a1ca8c6, data reload: false
query1 0.04 0.04 0.03
query2 0.06 0.03 0.02
query3 0.22 0.06 0.06
query4 1.68 0.10 0.09
query5 0.52 0.51 0.52
query6 1.17 0.63 0.62
query7 0.01 0.01 0.01
query8 0.04 0.03 0.02
query9 0.56 0.50 0.49
query10 0.56 0.56 0.56
query11 0.12 0.09 0.08
query12 0.11 0.09 0.08
query13 0.60 0.62 0.61
query14 0.80 0.78 0.81
query15 0.80 0.78 0.78
query16 0.38 0.36 0.39
query17 1.02 1.05 0.98
query18 0.21 0.29 0.22
query19 1.80 1.80 1.80
query20 0.02 0.01 0.01
query21 15.41 0.58 0.56
query22 2.43 2.04 1.91
query23 17.17 0.92 0.72
query24 2.49 1.28 1.09
query25 0.42 0.18 0.14
query26 0.51 0.15 0.14
query27 0.07 0.05 0.04
query28 11.30 0.88 0.83
query29 12.50 3.11 3.22
query30 0.66 0.55 0.54
query31 2.79 0.35 0.35
query32 3.37 0.50 0.48
query33 3.23 3.21 3.22
query34 15.73 4.28 4.30
query35 4.27 4.28 4.37
query36 1.09 1.04 1.06
query37 0.07 0.05 0.05
query38 0.04 0.03 0.03
query39 0.02 0.01 0.02
query40 0.17 0.13 0.13
query41 0.08 0.01 0.02
query42 0.03 0.01 0.01
query43 0.02 0.02 0.02
Total cold run time: 104.59 s
Total hot run time: 31.09 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Set txn expiration fields for cloud load [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30561:
URL: https://github.com/apache/doris/pull/30561#issuecomment-1916236266
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Set txn expiration fields for cloud load [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30561:
URL: https://github.com/apache/doris/pull/30561#issuecomment-1916427215
<details>
<summary>ClickBench: <b>Total hot run time: 30.05 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 30ba83d18fb1c9895a7b38090108b4c3b09e518d, data reload: false
query1 0.04 0.03 0.03
query2 0.06 0.03 0.02
query3 0.24 0.06 0.06
query4 1.67 0.10 0.09
query5 0.53 0.52 0.52
query6 1.29 0.65 0.63
query7 0.02 0.01 0.01
query8 0.04 0.03 0.03
query9 0.57 0.50 0.53
query10 0.57 0.56 0.57
query11 0.11 0.08 0.08
query12 0.12 0.09 0.10
query13 0.60 0.62 0.60
query14 0.77 0.82 0.79
query15 0.80 0.79 0.77
query16 0.38 0.39 0.36
query17 1.05 0.98 1.03
query18 0.23 0.26 0.26
query19 1.92 1.76 1.79
query20 0.01 0.00 0.01
query21 15.41 0.56 0.55
query22 2.45 2.70 1.44
query23 17.30 0.79 0.89
query24 2.63 1.58 0.44
query25 0.27 0.08 0.26
query26 0.47 0.14 0.14
query27 0.05 0.06 0.06
query28 11.91 0.85 0.83
query29 12.70 3.30 3.17
query30 0.65 0.54 0.51
query31 2.79 0.34 0.36
query32 3.34 0.47 0.49
query33 3.23 3.21 3.24
query34 15.77 4.34 4.25
query35 4.33 4.30 4.30
query36 1.11 1.07 1.06
query37 0.07 0.05 0.05
query38 0.04 0.03 0.03
query39 0.02 0.02 0.02
query40 0.16 0.13 0.13
query41 0.08 0.01 0.01
query42 0.02 0.01 0.02
query43 0.03 0.02 0.02
Total cold run time: 105.85 s
Total hot run time: 30.05 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Set txn expiration fields for cloud load [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30561:
URL: https://github.com/apache/doris/pull/30561#issuecomment-1916584941
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 5e554786108c59198dbebad36175b6c03a1ca8c6 with default session variables
Stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 13.5 seconds inserted 10000000 Rows, about 740K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org