You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "wsjz (via GitHub)" <gi...@apache.org> on 2024/03/24 10:11:03 UTC
[PR] [fix](insert)fix doris to hive type [doris]
wsjz opened a new pull request, #32735:
URL: https://github.com/apache/doris/pull/32735
## Proposed changes
fix doris to hive type, use primitiveType to check doris type.
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](insert)fix conversion of doris primitiveType to hive primitiveType [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32735:
URL: https://github.com/apache/doris/pull/32735#issuecomment-2016767588
<details>
<summary>TPC-DS: <b>Total hot run time: 187843 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ab6bb3439cd6eff202a388d708d34ac33ba88fc1, data reload: false
query1 955 369 356 356
query2 7458 2142 2084 2084
query3 6712 215 214 214
query4 31553 21480 21351 21351
query5 4320 502 399 399
query6 274 174 173 173
query7 4625 295 291 291
query8 234 170 177 170
query9 9294 2306 2280 2280
query10 567 252 278 252
query11 14892 14508 14383 14383
query12 136 92 85 85
query13 1640 421 408 408
query14 13340 11391 11502 11391
query15 289 201 200 200
query16 8093 258 261 258
query17 1961 592 553 553
query18 1500 295 289 289
query19 354 154 162 154
query20 95 90 90 90
query21 210 132 131 131
query22 5041 4808 4818 4808
query23 33749 33147 32889 32889
query24 10810 2874 2895 2874
query25 613 384 407 384
query26 1291 153 168 153
query27 2927 344 352 344
query28 7626 1842 1861 1842
query29 881 667 648 648
query30 312 150 149 149
query31 981 748 741 741
query32 94 58 57 57
query33 775 254 280 254
query34 1022 473 482 473
query35 830 619 605 605
query36 1029 910 884 884
query37 118 80 77 77
query38 3527 3424 3422 3422
query39 1475 1449 1444 1444
query40 208 123 121 121
query41 51 49 49 49
query42 102 100 96 96
query43 491 469 462 462
query44 1203 736 715 715
query45 293 265 235 235
query46 1120 687 699 687
query47 1937 1858 1836 1836
query48 459 352 358 352
query49 1150 339 337 337
query50 765 377 367 367
query51 6662 6631 6706 6631
query52 113 94 90 90
query53 346 280 280 280
query54 322 257 245 245
query55 87 79 78 78
query56 253 233 232 232
query57 1226 1135 1148 1135
query58 260 209 211 209
query59 3137 2810 2749 2749
query60 279 244 260 244
query61 105 108 94 94
query62 675 466 459 459
query63 304 279 283 279
query64 6770 4124 3987 3987
query65 3089 3044 3096 3044
query66 1219 364 360 360
query67 15683 15112 14976 14976
query68 8202 514 522 514
query69 624 365 374 365
query70 1226 1167 1152 1152
query71 517 276 280 276
query72 6610 2718 2520 2520
query73 751 322 316 316
query74 7152 6641 6738 6641
query75 4152 2921 2963 2921
query76 5035 894 865 865
query77 669 266 259 259
query78 10899 10182 10207 10182
query79 9957 516 504 504
query80 1607 392 390 390
query81 508 211 217 211
query82 886 204 207 204
query83 218 142 143 142
query84 285 77 80 77
query85 1494 328 312 312
query86 428 292 268 268
query87 3794 3536 3559 3536
query88 4897 2289 2265 2265
query89 510 372 369 369
query90 1995 178 176 176
query91 179 148 151 148
query92 60 51 49 49
query93 6852 497 474 474
query94 1161 183 180 180
query95 437 335 336 335
query96 603 277 272 272
query97 3072 2904 2910 2904
query98 236 219 215 215
query99 1279 892 914 892
Total cold run time: 316207 ms
Total hot run time: 187843 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](insert)fix conversion of doris type to hive type [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32735:
URL: https://github.com/apache/doris/pull/32735#issuecomment-2017789512
<details>
<summary>TPC-DS: <b>Total hot run time: 187164 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6cd70939c9db660df93f08b0f3a57d3f00ecae4c, data reload: false
query1 950 372 356 356
query2 6559 1914 1933 1914
query3 6712 210 215 210
query4 31916 21549 21313 21313
query5 4370 403 403 403
query6 263 180 182 180
query7 4636 291 303 291
query8 223 172 171 171
query9 9185 2278 2286 2278
query10 572 257 264 257
query11 17045 14272 14291 14272
query12 143 96 94 94
query13 1634 431 417 417
query14 12976 11725 11637 11637
query15 267 204 197 197
query16 8237 264 265 264
query17 1961 606 564 564
query18 2123 329 284 284
query19 347 160 166 160
query20 95 88 88 88
query21 208 130 128 128
query22 4928 4801 4851 4801
query23 33118 32707 32873 32707
query24 11611 2878 2876 2876
query25 636 387 399 387
query26 1751 167 163 163
query27 2932 364 354 354
query28 7491 1895 1857 1857
query29 993 660 594 594
query30 305 147 148 147
query31 951 733 726 726
query32 95 59 56 56
query33 762 246 244 244
query34 1068 480 493 480
query35 843 616 602 602
query36 1020 897 897 897
query37 138 78 77 77
query38 3559 3425 3434 3425
query39 1584 1462 1417 1417
query40 280 108 105 105
query41 49 48 46 46
query42 106 94 96 94
query43 482 459 468 459
query44 1186 730 711 711
query45 281 266 274 266
query46 1113 697 707 697
query47 1906 1818 1821 1818
query48 461 353 349 349
query49 1193 338 336 336
query50 765 366 382 366
query51 6636 6500 6521 6500
query52 104 88 89 88
query53 345 274 285 274
query54 304 229 237 229
query55 100 87 84 84
query56 236 218 223 218
query57 1194 1146 1127 1127
query58 233 205 208 205
query59 2927 2659 2577 2577
query60 262 236 245 236
query61 98 97 97 97
query62 676 463 454 454
query63 311 275 280 275
query64 6368 4088 4163 4088
query65 3138 3092 3064 3064
query66 1434 384 373 373
query67 15162 14757 14742 14742
query68 6872 527 539 527
query69 618 388 398 388
query70 1223 1181 1170 1170
query71 527 274 263 263
query72 6685 2869 2721 2721
query73 730 318 322 318
query74 6840 6395 6387 6387
query75 4082 2898 2863 2863
query76 4858 875 910 875
query77 636 262 257 257
query78 11014 10319 10302 10302
query79 8212 519 515 515
query80 1457 376 365 365
query81 523 210 222 210
query82 1157 207 196 196
query83 215 148 145 145
query84 284 81 76 76
query85 1497 320 320 320
query86 467 297 300 297
query87 3712 3540 3529 3529
query88 4830 2299 2297 2297
query89 528 377 373 373
query90 1955 175 175 175
query91 166 139 147 139
query92 61 52 46 46
query93 6852 503 481 481
query94 1149 175 180 175
query95 419 327 322 322
query96 620 273 277 273
query97 3042 2903 2898 2898
query98 240 222 208 208
query99 1243 925 887 887
Total cold run time: 314271 ms
Total hot run time: 187164 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](insert)fix conversion of doris type to hive type [doris]
Posted by "wsjz (via GitHub)" <gi...@apache.org>.
wsjz commented on PR #32735:
URL: https://github.com/apache/doris/pull/32735#issuecomment-2017107998
run p0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](insert)fix conversion of doris primitiveType to hive primitiveType [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32735:
URL: https://github.com/apache/doris/pull/32735#issuecomment-2016768350
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit ab6bb3439cd6eff202a388d708d34ac33ba88fc1 with default session variables
Stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 23.2 seconds inserted 10000000 Rows, about 431K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](insert)fix conversion of doris type to hive type [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32735:
URL: https://github.com/apache/doris/pull/32735#issuecomment-2016860530
<details>
<summary>TPC-DS: <b>Total hot run time: 185611 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 020331daa6acc6efe910c508dd9c76e8aec964bb, data reload: false
query1 939 374 356 356
query2 7455 2132 1989 1989
query3 6718 211 206 206
query4 31660 21416 21304 21304
query5 4325 422 400 400
query6 276 176 185 176
query7 4633 297 283 283
query8 234 169 175 169
query9 9130 2285 2254 2254
query10 568 256 272 256
query11 17475 14425 14471 14425
query12 147 93 84 84
query13 1645 426 417 417
query14 14447 11262 10798 10798
query15 274 212 195 195
query16 8242 260 256 256
query17 1989 587 548 548
query18 2105 289 288 288
query19 363 163 156 156
query20 94 91 88 88
query21 203 133 130 130
query22 4948 4812 4799 4799
query23 33292 32907 32686 32686
query24 11058 2822 2927 2822
query25 626 388 391 388
query26 1149 164 160 160
query27 2976 343 357 343
query28 7481 1874 1875 1874
query29 897 695 640 640
query30 305 149 152 149
query31 1004 763 731 731
query32 95 58 58 58
query33 763 342 259 259
query34 894 468 477 468
query35 839 616 606 606
query36 1034 863 856 856
query37 124 83 80 80
query38 3620 3464 3375 3375
query39 1501 1453 1408 1408
query40 214 118 114 114
query41 54 48 48 48
query42 104 94 101 94
query43 474 449 447 447
query44 1138 706 734 706
query45 276 257 258 257
query46 1106 705 694 694
query47 1890 1830 1809 1809
query48 443 353 353 353
query49 1116 340 340 340
query50 784 373 378 373
query51 6669 6556 6568 6556
query52 100 99 90 90
query53 353 278 281 278
query54 300 247 252 247
query55 98 78 81 78
query56 261 236 236 236
query57 1207 1117 1138 1117
query58 240 221 208 208
query59 2849 2583 2606 2583
query60 277 259 270 259
query61 120 116 118 116
query62 678 451 470 451
query63 323 279 277 277
query64 5855 4044 3845 3845
query65 3050 3061 3048 3048
query66 864 365 359 359
query67 15370 14584 14657 14584
query68 8856 515 514 514
query69 633 393 383 383
query70 1214 1136 1102 1102
query71 519 282 276 276
query72 6795 2700 2547 2547
query73 807 316 314 314
query74 8421 6678 6591 6591
query75 4493 2840 2817 2817
query76 5482 833 884 833
query77 646 265 256 256
query78 10937 10280 10088 10088
query79 11659 506 519 506
query80 1888 397 377 377
query81 526 217 210 210
query82 710 196 198 196
query83 214 146 146 146
query84 280 81 79 79
query85 1240 326 310 310
query86 369 300 287 287
query87 3771 3562 3553 3553
query88 4945 2285 2271 2271
query89 503 379 370 370
query90 2055 173 173 173
query91 182 137 138 137
query92 62 48 54 48
query93 7133 483 464 464
query94 1288 178 171 171
query95 428 324 329 324
query96 612 260 264 260
query97 3038 2871 2861 2861
query98 232 219 202 202
query99 1175 898 929 898
Total cold run time: 322854 ms
Total hot run time: 185611 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](insert)fix conversion of doris type to hive type [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32735:
URL: https://github.com/apache/doris/pull/32735#issuecomment-2017111841
<details>
<summary>TPC-H: <b>Total hot run time: 37645 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1b50148d4fd04faae5935525b05dc6f904f49f8f, data reload: false
------ Round 1 ----------------------------------
q1 17638 4271 4079 4079
q2 2105 155 154 154
q3 10590 1110 1206 1110
q4 10223 818 727 727
q5 7461 3007 2995 2995
q6 199 123 127 123
q7 1030 608 577 577
q8 9341 2012 1936 1936
q9 7178 6580 6572 6572
q10 8401 3534 3566 3534
q11 433 230 222 222
q12 404 199 193 193
q13 17801 2835 2855 2835
q14 229 200 207 200
q15 501 451 458 451
q16 490 370 369 369
q17 940 601 503 503
q18 7166 6405 6389 6389
q19 1582 1319 1438 1319
q20 540 252 240 240
q21 3569 2872 2828 2828
q22 351 289 304 289
Total cold run time: 108172 ms
Total hot run time: 37645 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4099 4080 4063 4063
q2 329 224 229 224
q3 2934 2824 2847 2824
q4 1863 1523 1526 1523
q5 5293 5335 5302 5302
q6 197 116 118 116
q7 2227 1822 1819 1819
q8 3126 3248 3259 3248
q9 8665 8699 8652 8652
q10 3782 3741 3729 3729
q11 545 441 429 429
q12 741 534 543 534
q13 16926 2864 2820 2820
q14 295 256 260 256
q15 494 454 450 450
q16 467 412 426 412
q17 1710 1515 1450 1450
q18 7382 7228 7242 7228
q19 3476 1517 1477 1477
q20 1903 1742 1675 1675
q21 4828 4775 4538 4538
q22 490 439 439 439
Total cold run time: 71772 ms
Total hot run time: 53208 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](insert)fix conversion of doris type to hive type [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32735:
URL: https://github.com/apache/doris/pull/32735#issuecomment-2017767565
<details>
<summary>TPC-H: <b>Total hot run time: 38468 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6cd70939c9db660df93f08b0f3a57d3f00ecae4c, data reload: false
------ Round 1 ----------------------------------
q1 17612 4433 4151 4151
q2 2121 170 148 148
q3 10997 1166 1229 1166
q4 10768 797 890 797
q5 7720 3089 3072 3072
q6 204 130 124 124
q7 1072 627 646 627
q8 9992 2060 2025 2025
q9 7374 6812 6733 6733
q10 9451 3508 3577 3508
q11 432 230 216 216
q12 369 199 203 199
q13 17799 2833 2888 2833
q14 247 200 200 200
q15 502 462 450 450
q16 501 372 378 372
q17 971 614 515 515
q18 7344 6481 6494 6481
q19 1573 1418 1471 1418
q20 544 259 261 259
q21 3630 2890 3033 2890
q22 364 284 289 284
Total cold run time: 111587 ms
Total hot run time: 38468 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4129 4069 4093 4069
q2 332 229 230 229
q3 2988 2879 2851 2851
q4 1846 1562 1580 1562
q5 5343 5363 5345 5345
q6 202 117 119 117
q7 2242 1856 1859 1856
q8 3182 3296 3285 3285
q9 8770 8753 8914 8753
q10 3899 3765 3715 3715
q11 570 440 441 440
q12 727 530 546 530
q13 16902 2833 2858 2833
q14 294 252 243 243
q15 494 452 463 452
q16 476 423 430 423
q17 1726 1495 1454 1454
q18 7509 7224 7141 7141
q19 1646 1538 1538 1538
q20 1898 1704 1711 1704
q21 4962 4694 4695 4694
q22 535 440 424 424
Total cold run time: 70672 ms
Total hot run time: 53658 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](insert)fix conversion of doris type to hive type [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32735:
URL: https://github.com/apache/doris/pull/32735#issuecomment-2016861334
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 020331daa6acc6efe910c508dd9c76e8aec964bb with default session variables
Stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 21.7 seconds inserted 10000000 Rows, about 460K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](insert)fix conversion of doris type to hive type [doris]
Posted by "wsjz (via GitHub)" <gi...@apache.org>.
wsjz commented on PR #32735:
URL: https://github.com/apache/doris/pull/32735#issuecomment-2017726873
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](insert)fix conversion of doris type to hive type [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32735:
URL: https://github.com/apache/doris/pull/32735#issuecomment-2017121009
<details>
<summary>TPC-DS: <b>Total hot run time: 186585 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1b50148d4fd04faae5935525b05dc6f904f49f8f, data reload: false
query1 923 369 351 351
query2 7422 2023 1973 1973
query3 6709 206 209 206
query4 31578 21214 21490 21214
query5 4347 404 492 404
query6 264 178 165 165
query7 4623 291 293 291
query8 225 173 171 171
query9 9045 2266 2261 2261
query10 561 245 258 245
query11 17284 14438 14494 14438
query12 138 97 84 84
query13 1622 415 425 415
query14 12130 11248 11299 11248
query15 292 206 186 186
query16 8209 251 252 251
query17 1982 563 537 537
query18 2057 281 279 279
query19 354 149 157 149
query20 93 85 88 85
query21 199 130 122 122
query22 4949 4848 4811 4811
query23 33162 32770 32728 32728
query24 10346 2873 2833 2833
query25 584 378 367 367
query26 731 156 156 156
query27 2207 340 349 340
query28 5823 1839 1850 1839
query29 863 639 602 602
query30 300 150 144 144
query31 961 741 715 715
query32 92 55 58 55
query33 661 244 242 242
query34 890 496 490 490
query35 818 605 603 603
query36 1003 883 875 875
query37 112 79 77 77
query38 3505 3430 3396 3396
query39 1484 1448 1433 1433
query40 203 115 108 108
query41 50 44 44 44
query42 100 95 93 93
query43 486 451 458 451
query44 1087 718 720 718
query45 281 267 268 267
query46 1082 691 693 691
query47 1924 1832 1836 1832
query48 431 358 356 356
query49 1072 348 345 345
query50 762 377 381 377
query51 6660 6621 6518 6518
query52 102 101 88 88
query53 346 276 285 276
query54 311 247 238 238
query55 92 78 79 78
query56 259 229 236 229
query57 1201 1136 1145 1136
query58 230 210 210 210
query59 2733 2694 2547 2547
query60 276 264 253 253
query61 115 114 118 114
query62 658 452 448 448
query63 313 292 274 274
query64 5459 4084 4003 4003
query65 3093 3018 3043 3018
query66 878 382 375 375
query67 15084 14857 14683 14683
query68 5497 519 517 517
query69 592 378 367 367
query70 1187 1155 1149 1149
query71 390 297 281 281
query72 6517 2881 2665 2665
query73 707 324 314 314
query74 6966 6729 6601 6601
query75 3537 2957 2900 2900
query76 3537 896 841 841
query77 614 254 266 254
query78 10878 10114 10172 10114
query79 9144 543 532 532
query80 1907 405 391 391
query81 555 216 217 216
query82 1589 211 203 203
query83 228 150 147 147
query84 292 78 80 78
query85 1452 326 331 326
query86 484 314 309 309
query87 3747 3549 3561 3549
query88 5056 2290 2278 2278
query89 535 391 389 389
query90 1931 178 180 178
query91 167 153 138 138
query92 66 48 48 48
query93 7054 502 488 488
query94 1223 174 176 174
query95 447 333 330 330
query96 618 276 270 270
query97 3157 2904 2897 2897
query98 236 208 213 208
query99 1232 906 882 882
Total cold run time: 305378 ms
Total hot run time: 186585 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](insert)fix conversion of doris type to hive type [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32735:
URL: https://github.com/apache/doris/pull/32735#issuecomment-2016857225
<details>
<summary>TPC-H: <b>Total hot run time: 38135 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 020331daa6acc6efe910c508dd9c76e8aec964bb, data reload: false
------ Round 1 ----------------------------------
q1 4641 4211 4235 4211
q2 1647 162 163 162
q3 8948 1120 1149 1120
q4 10631 775 769 769
q5 7481 3038 3030 3030
q6 205 124 126 124
q7 1042 580 572 572
q8 9348 1994 2030 1994
q9 7327 6622 6582 6582
q10 8446 3440 3591 3440
q11 436 234 227 227
q12 380 206 200 200
q13 17791 2874 2859 2859
q14 248 205 203 203
q15 500 469 466 466
q16 467 381 382 381
q17 972 545 514 514
q18 7264 6711 6377 6377
q19 5792 1479 1505 1479
q20 536 266 254 254
q21 3673 2898 2874 2874
q22 354 297 301 297
Total cold run time: 98129 ms
Total hot run time: 38135 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4167 4055 4058 4055
q2 320 229 226 226
q3 2999 2823 2841 2823
q4 1862 1597 1548 1548
q5 5270 5357 5332 5332
q6 195 117 119 117
q7 2235 1883 1811 1811
q8 3185 3329 3282 3282
q9 8711 8736 8722 8722
q10 3794 3752 3795 3752
q11 550 437 444 437
q12 730 552 572 552
q13 16927 2845 2862 2845
q14 285 255 245 245
q15 502 470 461 461
q16 486 416 418 416
q17 1743 1523 1479 1479
q18 7437 7348 7176 7176
q19 1635 1523 1561 1523
q20 1917 1710 1719 1710
q21 4933 4827 4776 4776
q22 532 444 476 444
Total cold run time: 70415 ms
Total hot run time: 53732 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](insert)fix conversion of doris type to hive type [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #32735:
URL: https://github.com/apache/doris/pull/32735#issuecomment-2018377199
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](insert)fix conversion of doris type to hive type [doris]
Posted by "wsjz (via GitHub)" <gi...@apache.org>.
wsjz commented on PR #32735:
URL: https://github.com/apache/doris/pull/32735#issuecomment-2017075429
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](insert)fix conversion of doris type to hive type [doris]
Posted by "wsjz (via GitHub)" <gi...@apache.org>.
wsjz commented on PR #32735:
URL: https://github.com/apache/doris/pull/32735#issuecomment-2016852065
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](insert)fix conversion of doris type to hive type [doris]
Posted by "morningman (via GitHub)" <gi...@apache.org>.
morningman merged PR #32735:
URL: https://github.com/apache/doris/pull/32735
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](insert)fix conversion of doris type to hive type [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32735:
URL: https://github.com/apache/doris/pull/32735#issuecomment-2017794631
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 6cd70939c9db660df93f08b0f3a57d3f00ecae4c with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 20.6 seconds inserted 10000000 Rows, about 485K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](insert)fix doris to hive type [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32735:
URL: https://github.com/apache/doris/pull/32735#issuecomment-2016759531
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website).
See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](insert)fix conversion of doris primitiveType to hive primitiveType [doris]
Posted by "wsjz (via GitHub)" <gi...@apache.org>.
wsjz commented on PR #32735:
URL: https://github.com/apache/doris/pull/32735#issuecomment-2016760494
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](insert)fix conversion of doris type to hive type [doris]
Posted by "wsjz (via GitHub)" <gi...@apache.org>.
wsjz commented on PR #32735:
URL: https://github.com/apache/doris/pull/32735#issuecomment-2017082169
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](insert)fix conversion of doris type to hive type [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32735:
URL: https://github.com/apache/doris/pull/32735#issuecomment-2017123310
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 1b50148d4fd04faae5935525b05dc6f904f49f8f with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 21.6 seconds inserted 10000000 Rows, about 462K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](insert)fix conversion of doris type to hive type [doris]
Posted by "wsjz (via GitHub)" <gi...@apache.org>.
wsjz commented on PR #32735:
URL: https://github.com/apache/doris/pull/32735#issuecomment-2016842797
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](insert)fix conversion of doris type to hive type [doris]
Posted by "wsjz (via GitHub)" <gi...@apache.org>.
wsjz commented on PR #32735:
URL: https://github.com/apache/doris/pull/32735#issuecomment-2016862914
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](insert)fix conversion of doris type to hive type [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #32735:
URL: https://github.com/apache/doris/pull/32735#issuecomment-2018377276
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](insert)fix conversion of doris primitiveType to hive primitiveType [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32735:
URL: https://github.com/apache/doris/pull/32735#issuecomment-2016764563
<details>
<summary>TPC-H: <b>Total hot run time: 38357 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ab6bb3439cd6eff202a388d708d34ac33ba88fc1, data reload: false
------ Round 1 ----------------------------------
q1 17647 4409 4113 4113
q2 2112 166 150 150
q3 10711 1160 1200 1160
q4 10682 788 784 784
q5 7459 3105 3071 3071
q6 207 130 125 125
q7 1097 606 608 606
q8 9874 2063 2069 2063
q9 7388 6760 6660 6660
q10 8414 3438 3585 3438
q11 441 229 214 214
q12 377 201 194 194
q13 17794 2851 2864 2851
q14 233 197 198 197
q15 502 455 462 455
q16 494 380 388 380
q17 973 596 569 569
q18 7377 6500 6588 6500
q19 2943 1410 1490 1410
q20 543 246 253 246
q21 3631 2949 2883 2883
q22 352 288 293 288
Total cold run time: 111251 ms
Total hot run time: 38357 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4153 4082 4058 4058
q2 334 235 230 230
q3 3017 2917 2890 2890
q4 1858 1544 1585 1544
q5 5351 5377 5378 5377
q6 196 116 118 116
q7 2282 1885 1882 1882
q8 3182 3319 3295 3295
q9 8786 8758 8752 8752
q10 3788 3770 3798 3770
q11 566 462 434 434
q12 743 570 543 543
q13 16912 2918 2858 2858
q14 296 237 261 237
q15 498 454 472 454
q16 481 427 415 415
q17 1741 1492 1476 1476
q18 7486 7360 7149 7149
q19 1631 1586 1501 1501
q20 1954 1740 1690 1690
q21 4816 4707 4687 4687
q22 522 446 461 446
Total cold run time: 70593 ms
Total hot run time: 53804 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org