You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "w41ter (via GitHub)" <gi...@apache.org> on 2024/01/11 08:06:59 UTC
[PR] [feature](merge-cloud) Add fe cloud storage module [doris]
w41ter opened a new pull request, #29857:
URL: https://github.com/apache/doris/pull/29857
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Add fe cloud storage module [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29857:
URL: https://github.com/apache/doris/pull/29857#issuecomment-1887128566
<details>
<summary>ClickBench: <b>Total hot run time: 30.1 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3d785df24fbb9a982bd82326558a3e8a3fd39d08, data reload: false
query1 0.06 0.06 0.06
query2 0.06 0.02 0.02
query3 0.26 0.10 0.10
query4 1.78 0.11 0.11
query5 0.53 0.52 0.51
query6 1.36 0.63 0.63
query7 0.02 0.01 0.01
query8 0.04 0.03 0.03
query9 0.55 0.50 0.49
query10 0.54 0.55 0.56
query11 0.13 0.09 0.08
query12 0.11 0.10 0.09
query13 0.61 0.61 0.60
query14 0.77 0.79 0.79
query15 0.82 0.80 0.80
query16 0.35 0.35 0.35
query17 1.01 0.98 0.96
query18 0.26 0.26 0.23
query19 1.85 1.71 1.77
query20 0.01 0.01 0.00
query21 15.39 0.60 0.57
query22 2.90 2.68 1.70
query23 16.96 0.73 0.70
query24 16.11 0.57 0.59
query25 2.14 0.15 0.15
query26 0.13 0.13 0.13
query27 0.14 0.15 0.15
query28 5.78 0.83 0.82
query29 12.64 3.20 3.15
query30 0.57 0.49 0.47
query31 2.78 0.35 0.36
query32 3.38 0.48 0.49
query33 3.20 3.16 3.20
query34 15.73 4.16 4.14
query35 4.16 4.13 4.17
query36 1.10 1.06 1.05
query37 0.06 0.05 0.05
query38 0.04 0.03 0.03
query39 0.02 0.01 0.01
query40 0.16 0.14 0.13
query41 0.06 0.02 0.01
query42 0.02 0.01 0.02
query43 0.02 0.02 0.02
Total cold run time: 114.61 s
Total hot run time: 30.1 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Add fe cloud storage module [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29857:
URL: https://github.com/apache/doris/pull/29857#issuecomment-1886605828
<details>
<summary>TPC-H: <b>Total hot run time: 39109 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1e40fad4ee0d622a18b4ada55facbd78a4e62a3c, data reload: false
------ Round 1 ----------------------------------
q1 17899 4999 5028 4999
q2 2045 155 144 144
q3 10779 1151 1210 1151
q4 11064 753 846 753
q5 8152 3262 3261 3261
q6 208 129 128 128
q7 922 527 507 507
q8 9796 2002 2028 2002
q9 7926 6636 6586 6586
q10 8356 3114 3087 3087
q11 431 215 211 211
q12 359 189 198 189
q13 18135 3405 3449 3405
q14 244 222 215 215
q15 550 514 510 510
q16 473 375 376 375
q17 959 517 537 517
q18 7347 6698 6659 6659
q19 1571 1422 1416 1416
q20 482 303 321 303
q21 2778 2383 2434 2383
q22 353 310 308 308
Total cold run time: 110829 ms
Total hot run time: 39109 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4983 4978 5010 4978
q2 311 198 198 198
q3 3343 3311 3303 3303
q4 2241 2253 2251 2251
q5 5830 5811 5813 5811
q6 192 117 119 117
q7 2320 1823 1882 1823
q8 3455 3578 3607 3578
q9 8889 8851 8825 8825
q10 3755 3813 3807 3807
q11 556 438 425 425
q12 775 593 602 593
q13 3860 3204 3201 3201
q14 292 260 267 260
q15 587 509 511 509
q16 525 473 464 464
q17 2091 2038 2053 2038
q18 8732 8304 8411 8304
q19 1619 1597 1621 1597
q20 2179 1947 1933 1933
q21 6016 5802 5742 5742
q22 559 469 468 468
Total cold run time: 63110 ms
Total hot run time: 60225 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Add fe cloud storage module [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29857:
URL: https://github.com/apache/doris/pull/29857#issuecomment-1887110622
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 48.21 seconds
stream load tsv: 574 seconds loaded 74807831229 Bytes, about 124 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 21.8 seconds inserted 10000000 Rows, about 458K ops/s
storage size: 17184153006 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Add fe cloud storage module [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring merged PR #29857:
URL: https://github.com/apache/doris/pull/29857
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Add fe cloud storage module [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29857:
URL: https://github.com/apache/doris/pull/29857#issuecomment-1886623819
<details>
<summary>TPC-DS: <b>Total hot run time: 177730 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1e40fad4ee0d622a18b4ada55facbd78a4e62a3c, data reload: false
query1 937 351 335 335
query2 6698 1808 1880 1808
query3 6715 215 209 209
query4 26925 22143 22355 22143
query5 5543 494 499 494
query6 276 186 190 186
query7 4615 280 287 280
query8 232 222 192 192
query9 9165 2812 2827 2812
query10 560 239 242 239
query11 16284 15386 15366 15366
query12 130 88 83 83
query13 1624 328 338 328
query14 12065 7377 7197 7197
query15 233 188 193 188
query16 6440 298 285 285
query17 1841 483 474 474
query18 1940 280 270 270
query19 288 150 142 142
query20 83 85 78 78
query21 191 97 91 91
query22 5102 4854 4818 4818
query23 31867 30919 30846 30846
query24 12350 2824 2776 2776
query25 561 331 353 331
query26 1771 155 156 155
query27 2869 285 281 281
query28 7085 1923 1884 1884
query29 2060 380 395 380
query30 289 150 149 149
query31 1007 772 776 772
query32 97 64 69 64
query33 746 278 274 274
query34 1065 450 449 449
query35 879 766 719 719
query36 1404 1231 1282 1231
query37 179 67 72 67
query38 3418 3294 3293 3293
query39 1338 1277 1272 1272
query40 321 102 89 89
query41 40 35 36 35
query42 101 99 99 99
query43 546 510 523 510
query44 1091 725 740 725
query45 210 192 185 185
query46 1045 664 690 664
query47 1660 1588 1522 1522
query48 395 324 327 324
query49 1281 315 320 315
query50 732 335 359 335
query51 5393 5188 5217 5188
query52 94 84 82 82
query53 222 151 152 151
query54 1421 576 606 576
query55 102 86 93 86
query56 214 197 199 197
query57 979 931 953 931
query58 231 213 222 213
query59 2643 2495 2477 2477
query60 253 222 242 222
query61 81 81 80 80
query62 593 418 407 407
query63 168 160 155 155
query64 5859 1749 1694 1694
query65 3330 3256 3261 3256
query66 1326 340 322 322
query67 15319 14937 14909 14909
query68 12931 566 539 539
query69 562 279 278 278
query70 1859 1540 1552 1540
query71 510 224 216 216
query72 4821 2872 2828 2828
query73 3274 324 319 319
query74 6995 6432 6396 6396
query75 5257 2251 2278 2251
query76 6425 1111 1065 1065
query77 699 291 279 279
query78 9950 8564 8538 8538
query79 1230 514 516 514
query80 547 354 363 354
query81 455 214 211 211
query82 210 88 94 88
query83 190 145 137 137
query84 260 57 58 57
query85 978 289 277 277
query86 388 420 408 408
query87 3529 3414 3365 3365
query88 3093 2247 2244 2244
query89 329 256 265 256
query90 1904 200 196 196
query91 180 129 149 129
query92 70 57 53 53
query93 1301 490 484 484
query94 820 189 191 189
query95 499 419 430 419
query96 621 326 313 313
query97 4308 4148 4187 4148
query98 210 196 184 184
query99 972 753 745 745
Total cold run time: 297899 ms
Total hot run time: 177730 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Add fe cloud storage module [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29857:
URL: https://github.com/apache/doris/pull/29857#issuecomment-1886636838
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 1e40fad4ee0d622a18b4ada55facbd78a4e62a3c with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 13.7 seconds inserted 10000000 Rows, about 729K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Add fe cloud storage module [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring commented on PR #29857:
URL: https://github.com/apache/doris/pull/29857#issuecomment-1887045056
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Add fe cloud storage module [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29857:
URL: https://github.com/apache/doris/pull/29857#issuecomment-1888338446
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Add fe cloud storage module [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29857:
URL: https://github.com/apache/doris/pull/29857#issuecomment-1886755019
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Add fe cloud storage module [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29857:
URL: https://github.com/apache/doris/pull/29857#issuecomment-1887119126
<details>
<summary>TPC-DS: <b>Total hot run time: 180262 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3d785df24fbb9a982bd82326558a3e8a3fd39d08, data reload: false
query1 933 335 328 328
query2 6719 1885 1871 1871
query3 6729 207 203 203
query4 26032 22108 22295 22108
query5 5340 519 494 494
query6 268 188 188 188
query7 4626 279 276 276
query8 228 204 199 199
query9 9153 2747 2853 2747
query10 468 239 248 239
query11 16172 15299 15287 15287
query12 124 76 73 73
query13 1719 396 396 396
query14 11681 7291 7231 7231
query15 237 193 193 193
query16 6424 253 239 239
query17 1920 488 482 482
query18 1923 278 257 257
query19 283 149 149 149
query20 77 75 72 72
query21 197 126 119 119
query22 4971 4813 4848 4813
query23 31620 31026 30942 30942
query24 11012 2856 2808 2808
query25 523 330 326 326
query26 851 153 153 153
query27 2514 278 297 278
query28 6268 1854 1849 1849
query29 1029 668 673 668
query30 277 137 148 137
query31 984 782 767 767
query32 93 60 59 59
query33 712 261 246 246
query34 1020 458 464 458
query35 915 726 728 726
query36 1292 1250 1246 1246
query37 103 68 64 64
query38 3447 3309 3294 3294
query39 1341 1286 1300 1286
query40 219 94 96 94
query41 36 34 35 34
query42 100 99 99 99
query43 528 512 533 512
query44 1108 713 729 713
query45 205 188 183 183
query46 1068 667 639 639
query47 1678 1648 1620 1620
query48 416 336 337 336
query49 1146 322 324 322
query50 697 327 319 319
query51 5338 5258 5179 5179
query52 95 91 97 91
query53 351 284 299 284
query54 2074 1598 1605 1598
query55 97 91 87 87
query56 217 201 195 195
query57 1036 993 981 981
query58 214 202 203 202
query59 2992 2676 2639 2639
query60 244 211 228 211
query61 82 81 79 79
query62 577 400 401 400
query63 317 282 287 282
query64 4476 1676 1639 1639
query65 3359 3262 3294 3262
query66 1058 331 323 323
query67 15653 15346 15245 15245
query68 9877 528 550 528
query69 637 396 390 390
query70 1742 1539 1534 1534
query71 453 246 234 234
query72 4752 2826 2824 2824
query73 1915 323 319 319
query74 7006 6522 6469 6469
query75 4618 2289 2351 2289
query76 6072 1094 1093 1093
query77 673 281 288 281
query78 9562 8561 8535 8535
query79 1043 499 513 499
query80 540 342 334 334
query81 467 206 212 206
query82 188 94 95 94
query83 139 118 120 118
query84 276 75 77 75
query85 1015 328 334 328
query86 382 378 365 365
query87 3518 3455 3480 3455
query88 3168 2245 2248 2245
query89 471 384 398 384
query90 1827 204 200 200
query91 152 129 127 127
query92 62 55 55 55
query93 952 442 417 417
query94 1123 184 183 183
query95 538 489 477 477
query96 632 322 321 321
query97 4257 4138 4229 4138
query98 213 191 186 186
query99 1011 753 720 720
Total cold run time: 284887 ms
Total hot run time: 180262 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Add fe cloud storage module [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29857:
URL: https://github.com/apache/doris/pull/29857#issuecomment-1886650127
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 46.6 seconds
stream load tsv: 558 seconds loaded 74807831229 Bytes, about 127 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 20.8 seconds inserted 10000000 Rows, about 480K ops/s
storage size: 17183919524 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Add fe cloud storage module [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29857:
URL: https://github.com/apache/doris/pull/29857#issuecomment-1886754950
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Add fe cloud storage module [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29857:
URL: https://github.com/apache/doris/pull/29857#issuecomment-1887098991
<details>
<summary>TPC-H: <b>Total hot run time: 38675 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3d785df24fbb9a982bd82326558a3e8a3fd39d08, data reload: false
------ Round 1 ----------------------------------
q1 17969 5056 4999 4999
q2 2026 136 130 130
q3 10793 1120 1251 1120
q4 10564 756 827 756
q5 7798 3145 3142 3142
q6 203 123 122 122
q7 884 507 503 503
q8 9254 1977 1988 1977
q9 7345 6476 6458 6458
q10 8257 3082 3079 3079
q11 412 202 213 202
q12 361 191 201 191
q13 18114 3407 3395 3395
q14 245 214 212 212
q15 548 515 505 505
q16 429 374 379 374
q17 943 486 546 486
q18 7272 6675 6659 6659
q19 1574 1411 1400 1400
q20 523 300 292 292
q21 2788 2380 2395 2380
q22 356 303 293 293
Total cold run time: 108658 ms
Total hot run time: 38675 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5038 4954 4972 4954
q2 316 208 197 197
q3 3339 3306 3288 3288
q4 2233 2240 2249 2240
q5 5812 5796 5826 5796
q6 193 115 115 115
q7 2313 1838 1847 1838
q8 3436 3570 3569 3569
q9 8860 8827 8837 8827
q10 3708 3826 3813 3813
q11 547 432 414 414
q12 790 605 614 605
q13 4916 3185 3207 3185
q14 289 266 260 260
q15 577 522 511 511
q16 501 461 453 453
q17 2055 2014 2025 2014
q18 8776 8344 8314 8314
q19 1606 1618 1602 1602
q20 2182 1918 1919 1918
q21 6057 5708 5712 5708
q22 563 440 484 440
Total cold run time: 64107 ms
Total hot run time: 60061 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Add fe cloud storage module [doris]
Posted by "w41ter (via GitHub)" <gi...@apache.org>.
w41ter commented on PR #29857:
URL: https://github.com/apache/doris/pull/29857#issuecomment-1886579497
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Add fe cloud storage module [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29857:
URL: https://github.com/apache/doris/pull/29857#issuecomment-1886632597
<details>
<summary>ClickBench: <b>Total hot run time: 30.56 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 1e40fad4ee0d622a18b4ada55facbd78a4e62a3c, data reload: false
query1 0.06 0.06 0.05
query2 0.06 0.03 0.02
query3 0.25 0.12 0.11
query4 1.76 0.12 0.11
query5 0.51 0.51 0.52
query6 1.32 0.63 0.64
query7 0.02 0.01 0.01
query8 0.03 0.02 0.02
query9 0.56 0.50 0.50
query10 0.56 0.55 0.55
query11 0.13 0.10 0.09
query12 0.11 0.09 0.08
query13 0.63 0.60 0.59
query14 0.77 0.81 0.78
query15 0.82 0.81 0.81
query16 0.36 0.36 0.35
query17 0.97 0.95 0.98
query18 0.26 0.26 0.25
query19 1.83 1.79 1.74
query20 0.02 0.01 0.01
query21 15.40 0.57 0.56
query22 2.59 1.99 2.50
query23 17.19 0.85 0.81
query24 16.17 0.60 0.59
query25 2.16 0.15 0.15
query26 0.13 0.14 0.13
query27 0.14 0.14 0.15
query28 6.34 0.80 0.79
query29 12.57 3.27 3.15
query30 0.52 0.49 0.48
query31 2.80 0.36 0.36
query32 3.37 0.48 0.48
query33 3.20 3.20 3.26
query34 15.91 4.15 4.12
query35 4.15 4.17 4.17
query36 1.11 1.05 1.03
query37 0.06 0.04 0.04
query38 0.04 0.03 0.03
query39 0.03 0.01 0.01
query40 0.16 0.14 0.13
query41 0.06 0.01 0.02
query42 0.02 0.02 0.01
query43 0.02 0.02 0.02
Total cold run time: 115.17 s
Total hot run time: 30.56 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Add fe cloud storage module [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29857:
URL: https://github.com/apache/doris/pull/29857#issuecomment-1887134185
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 3d785df24fbb9a982bd82326558a3e8a3fd39d08 with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 12.3 seconds inserted 10000000 Rows, about 813K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org