You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "zy-kkk (via GitHub)" <gi...@apache.org> on 2023/11/16 06:19:21 UTC
[PR] Revert "[feature-wip](catalog) support deltalake catalog step1-metadata (#22493)" [doris]
zy-kkk opened a new pull request, #27095:
URL: https://github.com/apache/doris/pull/27095
This reverts commit 5b641ebd40fff71e632ee9be4ede58b744b602b9.
## Proposed changes
Currently, Deltalake Catalog is not a usable feature. We will continue to implement it in the datalake plug-in system in the future, so we will delete it from the FE code for now.
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] Revert "[feature-wip](catalog) support deltalake catalog step1-metadata (#22493)" [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27095:
URL: https://github.com/apache/doris/pull/27095#issuecomment-1814028430
<details>
<summary>TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
Tpch sf100 test result on commit acd8d7d2d75fadc7de38dffbc4fbee05ed007910, data reload: false
run tpch-sf100 query with default conf and session variables
q1 4925 4691 4650 4650
q2 370 147 167 147
q3 2046 1908 1933 1908
q4 1390 1283 1237 1237
q5 4007 3968 4035 3968
q6 242 129 131 129
q7 1412 885 884 884
q8 2773 2800 2773 2773
q9 9682 9519 9441 9441
q10 3481 3528 3536 3528
q11 377 239 232 232
q12 435 292 297 292
q13 4562 3823 3765 3765
q14 312 284 283 283
q15 581 541 517 517
q16 675 581 583 581
q17 1138 976 937 937
q18 7813 7427 7477 7427
q19 1678 1703 1684 1684
q20 529 299 282 282
q21 4395 4002 3990 3990
q22 488 377 382 377
Total cold run time: 53311 ms
Total hot run time: 49032 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4599 4583 4591 4583
q2 335 229 267 229
q3 4023 4014 3988 3988
q4 2713 2683 2697 2683
q5 9645 9676 9632 9632
q6 248 120 124 120
q7 2998 2458 2472 2458
q8 4465 4471 4487 4471
q9 12931 12800 12745 12745
q10 4094 4207 4216 4207
q11 795 639 668 639
q12 984 832 827 827
q13 4270 3560 3585 3560
q14 381 347 345 345
q15 562 515 520 515
q16 721 678 677 677
q17 3810 3889 3919 3889
q18 9719 9078 9129 9078
q19 1810 1796 1798 1796
q20 2400 2056 2062 2056
q21 8830 8623 8468 8468
q22 938 876 799 799
Total cold run time: 81271 ms
Total hot run time: 77765 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] Revert "[feature-wip](catalog) support deltalake catalog step1-metadata (#22493)" [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27095:
URL: https://github.com/apache/doris/pull/27095#issuecomment-1813988763
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 45.05 seconds
stream load tsv: 564 seconds loaded 74807831229 Bytes, about 126 MB/s
stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.7 seconds inserted 10000000 Rows, about 348K ops/s
storage size: 17098689259 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] Revert "[feature-wip](catalog) support deltalake catalog step1-metadata (#22493)" [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #27095:
URL: https://github.com/apache/doris/pull/27095#issuecomment-1818376796
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] Revert "[feature-wip](catalog) support deltalake catalog step1-metadata (#22493)" [doris]
Posted by "zy-kkk (via GitHub)" <gi...@apache.org>.
zy-kkk merged PR #27095:
URL: https://github.com/apache/doris/pull/27095
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] Revert "[feature-wip](catalog) support deltalake catalog step1-metadata (#22493)" [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27095:
URL: https://github.com/apache/doris/pull/27095#issuecomment-1814731014
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 44.46 seconds
stream load tsv: 568 seconds loaded 74807831229 Bytes, about 125 MB/s
stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.4 seconds inserted 10000000 Rows, about 352K ops/s
storage size: 17100619851 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] Revert "[feature-wip](catalog) support deltalake catalog step1-metadata (#22493)" [doris]
Posted by "zy-kkk (via GitHub)" <gi...@apache.org>.
zy-kkk commented on PR #27095:
URL: https://github.com/apache/doris/pull/27095#issuecomment-1813852560
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] Revert "[feature-wip](catalog) support deltalake catalog step1-metadata (#22493)" [doris]
Posted by "zy-kkk (via GitHub)" <gi...@apache.org>.
zy-kkk commented on PR #27095:
URL: https://github.com/apache/doris/pull/27095#issuecomment-1813947872
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] Revert "[feature-wip](catalog) support deltalake catalog step1-metadata (#22493)" [doris]
Posted by "zy-kkk (via GitHub)" <gi...@apache.org>.
zy-kkk commented on PR #27095:
URL: https://github.com/apache/doris/pull/27095#issuecomment-1814463700
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] Revert "[feature-wip](catalog) support deltalake catalog step1-metadata (#22493)" [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27095:
URL: https://github.com/apache/doris/pull/27095#issuecomment-1814705086
<details>
<summary>TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
Tpch sf100 test result on commit acd8d7d2d75fadc7de38dffbc4fbee05ed007910, data reload: false
run tpch-sf100 query with default conf and session variables
q1 4953 4680 4678 4678
q2 381 153 159 153
q3 2046 1954 1968 1954
q4 1387 1283 1234 1234
q5 3969 3914 3977 3914
q6 265 145 132 132
q7 1423 872 882 872
q8 2756 2802 2790 2790
q9 9788 9597 9573 9573
q10 3472 3533 3502 3502
q11 376 242 242 242
q12 442 293 296 293
q13 4549 3792 3785 3785
q14 319 281 297 281
q15 584 535 521 521
q16 678 585 579 579
q17 1139 981 928 928
q18 7772 7422 7441 7422
q19 1694 1673 1683 1673
q20 521 299 305 299
q21 4416 3968 3946 3946
q22 482 381 374 374
Total cold run time: 53412 ms
Total hot run time: 49145 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4601 4565 4614 4565
q2 333 227 267 227
q3 4017 4009 4010 4009
q4 2691 2699 2680 2680
q5 9691 9674 9717 9674
q6 247 123 125 123
q7 2598 2311 2245 2245
q8 4458 4460 4463 4460
q9 13229 13149 13112 13112
q10 4113 4198 4184 4184
q11 827 700 639 639
q12 980 826 830 826
q13 4298 3557 3552 3552
q14 372 347 352 347
q15 582 520 536 520
q16 737 671 689 671
q17 3876 3871 3884 3871
q18 9730 8869 9124 8869
q19 1852 1789 1776 1776
q20 2382 2052 2032 2032
q21 8714 8425 8541 8425
q22 879 820 772 772
Total cold run time: 81207 ms
Total hot run time: 77579 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] Revert "[feature-wip](catalog) support deltalake catalog step1-metadata (#22493)" [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #27095:
URL: https://github.com/apache/doris/pull/27095#issuecomment-1813859863
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] Revert "[feature-wip](catalog) support deltalake catalog step1-metadata (#22493)" [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #27095:
URL: https://github.com/apache/doris/pull/27095#issuecomment-1813859915
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org