You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "HappenLee (via GitHub)" <gi...@apache.org> on 2023/12/29 09:12:59 UTC
[PR] [thirdparty](lib) Add streamvbyte thirdparty lib [doris]
HappenLee opened a new pull request, #29308:
URL: https://github.com/apache/doris/pull/29308
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [thirdparty](lib) Add streamvbyte thirdparty lib [doris]
Posted by "HappenLee (via GitHub)" <gi...@apache.org>.
HappenLee commented on PR #29308:
URL: https://github.com/apache/doris/pull/29308#issuecomment-1871863078
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [thirdparty](lib) Add streamvbyte thirdparty lib [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29308:
URL: https://github.com/apache/doris/pull/29308#issuecomment-1871892129
TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools
```
Tpch sf100 test result on commit a77c3168173fb21d1dfb8b63f392e5e8937fbe2c, data reload: false
run tpch-sf100 query with default conf and session variables
q1 5625 5204 5149 5149
q2 395 167 160 160
q3 1490 1196 1207 1196
q4 1117 880 844 844
q5 3150 3013 3183 3013
q6 233 143 139 139
q7 989 604 519 519
q8 2181 2262 2263 2262
q9 6764 6698 6725 6698
q10 3227 3212 3163 3163
q11 336 226 229 226
q12 404 247 243 243
q13 4411 3652 3669 3652
q14 262 230 216 216
q15 635 564 567 564
q16 456 419 412 412
q17 1061 537 564 537
q18 7097 6828 7217 6828
q19 1696 1568 1494 1494
q20 817 345 352 345
q21 2911 2518 2549 2518
q22 401 323 322 322
Total cold run time: 45658 ms
Total hot run time: 40500 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 5189 5092 5128 5092
q2 334 259 259 259
q3 3432 3327 3354 3327
q4 2184 2071 2057 2057
q5 5957 5947 5915 5915
q6 237 135 133 133
q7 2380 1949 1944 1944
q8 3558 3665 3708 3665
q9 9107 9051 9059 9051
q10 3884 3975 3940 3940
q11 594 504 485 485
q12 813 630 643 630
q13 3897 3224 3190 3190
q14 317 273 280 273
q15 628 574 558 558
q16 563 495 553 495
q17 2041 1854 1814 1814
q18 8792 8388 8354 8354
q19 1792 1722 1733 1722
q20 2296 2028 2004 2004
q21 5794 5424 5381 5381
q22 581 533 524 524
Total cold run time: 64370 ms
Total hot run time: 60813 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [thirdparty](lib) Add streamvbyte thirdparty lib [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29308:
URL: https://github.com/apache/doris/pull/29308#issuecomment-1871892166
TPC-DS test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpcds-tools
```
TPC-DS sf100 test result on commit a77c3168173fb21d1dfb8b63f392e5e8937fbe2c, data reload: false
run tpcds-sf100 query with default conf and session variables
query1 921 360 344 344
query2 3338 1966 2024 1966
query3 6646 228 224 224
query4 27648 22511 22530 22511
query5 4676 577 602 577
query6 275 196 187 187
query7 4576 274 287 274
query8 227 206 201 201
query9 8154 2696 2698 2696
query10 335 276 247 247
query11 16318 15554 15601 15554
query12 146 84 79 79
query13 1680 343 338 338
query14 10837 7315 7338 7315
query15 221 193 192 192
query16 5236 292 294 292
query17 1669 504 496 496
query18 1919 264 266 264
query19 255 139 137 137
query20 86 79 80 79
query21 184 97 96 96
query22 5084 4793 4666 4666
query23 32426 31452 31313 31313
query24 11916 2877 2821 2821
query25 586 360 342 342
query26 1501 148 146 146
query27 2892 288 281 281
query28 7071 1997 1978 1978
query29 1989 412 395 395
query30 288 145 143 143
query31 967 761 792 761
query32 95 68 62 62
query33 723 284 282 282
query34 890 464 463 463
query35 910 790 758 758
query36 1393 1298 1262 1262
query37 200 86 88 86
query38 3400 3311 3269 3269
query39 1332 1286 1282 1282
query40 302 98 94 94
query41 39 35 35 35
query42 104 93 98 93
query43 566 499 503 499
query44 1111 756 769 756
query45 204 192 188 188
query46 1101 666 682 666
query47 1666 1640 1582 1582
query48 346 266 259 259
query49 1209 336 344 336
query50 754 342 338 338
query51 5431 5269 5243 5243
query52 102 86 92 86
query53 215 162 148 148
query54 1521 609 636 609
query55 109 88 89 88
query56 222 203 199 199
query57 1024 961 985 961
query58 237 213 212 212
query59 2893 2698 2708 2698
query60 261 231 230 230
query61 81 89 80 80
query62 693 476 475 475
query63 163 156 156 156
query64 5309 1747 1701 1701
query65 3340 3255 3268 3255
query66 1387 340 335 335
query67 15401 15618 15093 15093
query68 14336 535 526 526
query69 621 261 250 250
query70 1705 1559 1553 1553
query71 574 235 231 231
query72 5879 3520 3528 3520
query73 2942 337 321 321
query74 6931 6440 6437 6437
query75 6412 2300 2300 2300
query76 6457 1136 1114 1114
query77 908 310 251 251
query78 9057 8636 8696 8636
query79 3446 521 512 512
query80 1110 376 369 369
query81 495 213 214 213
query82 234 120 120 120
query83 386 139 142 139
query84 265 54 53 53
query85 927 276 273 273
query86 399 379 406 379
query87 3586 3353 3349 3349
query88 3026 2421 2427 2421
query89 346 264 267 264
query90 1849 255 257 255
query91 120 89 95 89
query92 72 58 57 57
query93 2494 447 445 445
query94 828 214 214 214
query95 504 473 457 457
query96 647 340 335 335
query97 4290 4161 4233 4161
query98 217 193 191 191
query99 1071 797 846 797
Total cold run time: 296935 ms
Total hot run time: 181026 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [thirdparty](lib) Add streamvbyte thirdparty lib [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29308:
URL: https://github.com/apache/doris/pull/29308#issuecomment-1871884045
TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools
```
Tpch sf100 test result on commit a77c3168173fb21d1dfb8b63f392e5e8937fbe2c, data reload: false
------ Round 1 ----------------------------------
q1 17626 5630 5119 5119
q2 2017 169 155 155
q3 10515 1143 1244 1143
q4 10195 833 815 815
q5 7816 2975 3009 2975
q6 216 136 138 136
q7 928 527 565 527
q8 9299 2056 2054 2054
q9 6851 6423 6419 6419
q10 8247 3097 3055 3055
q11 438 219 228 219
q12 393 237 238 237
q13 17994 3648 3651 3648
q14 253 220 219 219
q15 593 560 548 548
q16 458 401 416 401
q17 990 492 469 469
q18 7486 6838 6724 6724
q19 1586 1434 1251 1251
q20 747 389 368 368
q21 2858 2417 2492 2417
q22 387 329 338 329
Total cold run time: 107893 ms
Total hot run time: 39228 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5165 5055 5071 5055
q2 342 232 271 232
q3 3319 3305 3305 3305
q4 2160 2010 2012 2010
q5 5820 5830 5792 5792
q6 221 130 130 130
q7 2331 1915 1914 1914
q8 3373 3474 3472 3472
q9 8926 8859 8882 8859
q10 3825 3879 3872 3872
q11 581 495 486 486
q12 807 631 658 631
q13 10421 3187 3187 3187
q14 297 270 274 270
q15 613 542 549 542
q16 551 487 517 487
q17 1948 1785 1775 1775
q18 8784 8364 8329 8329
q19 1653 1639 1599 1599
q20 2205 1979 1958 1958
q21 5605 5399 5253 5253
q22 527 501 450 450
Total cold run time: 69474 ms
Total hot run time: 59608 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [thirdparty](lib) Add streamvbyte thirdparty lib [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29308:
URL: https://github.com/apache/doris/pull/29308#issuecomment-1871883127
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [thirdparty](lib) Add streamvbyte thirdparty lib [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29308:
URL: https://github.com/apache/doris/pull/29308#issuecomment-1871889030
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 47.72 seconds
stream load tsv: 575 seconds loaded 74807831229 Bytes, about 124 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.3 seconds inserted 10000000 Rows, about 353K ops/s
storage size: 17183840410 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [thirdparty](lib) Add streamvbyte thirdparty lib [doris]
Posted by "yiguolei (via GitHub)" <gi...@apache.org>.
yiguolei merged PR #29308:
URL: https://github.com/apache/doris/pull/29308
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [thirdparty](lib) Add streamvbyte thirdparty lib [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29308:
URL: https://github.com/apache/doris/pull/29308#issuecomment-1871877456
TeamCity be ut coverage result:
Function Coverage: 36.62% (8606/23504)
Line Coverage: 28.67% (69962/243993)
Region Coverage: 27.67% (36199/130830)
Branch Coverage: 24.38% (18500/75888)
Coverage Report: http://coverage.selectdb-in.cc/coverage/a77c3168173fb21d1dfb8b63f392e5e8937fbe2c_a77c3168173fb21d1dfb8b63f392e5e8937fbe2c/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [thirdparty](lib) Add streamvbyte thirdparty lib [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29308:
URL: https://github.com/apache/doris/pull/29308#issuecomment-1871883092
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org