You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2022/05/28 11:59:42 UTC
[GitHub] [incubator-doris] hello-stephen opened a new pull request, #9827: [tools][doc]add ssb flat tools, and update performance doc
hello-stephen opened a new pull request, #9827:
URL: https://github.com/apache/incubator-doris/pull/9827
# Proposed changes
Issue Number: close #xxx
## Problem Summary:
add some scripts for SSB flat test and update the performance doc, which is in order to make the test more easily.
## Checklist(Required)
1. Does it affect the original behavior: (No)
2. Has unit tests been added: (No)
3. Has document been added or modified: (Yes)
4. Does it need to update dependencies: (No)
5. Are there any changes that cannot be rolled back: (No)
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] hf200012 commented on pull request #9827: [tools][doc]add ssb flat tools, and update performance doc
Posted by GitBox <gi...@apache.org>.
hf200012 commented on PR #9827:
URL: https://github.com/apache/incubator-doris/pull/9827#issuecomment-1140867035
@morningman @EmmyMiao87 I have already told @hello-stephen about this compilation error. After passing it, I will merge it in, and I will improve this document. There are still some places to be modified and the English document to be improved.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9827: [tools][doc]add ssb flat tools, and update performance doc
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on PR #9827:
URL: https://github.com/apache/incubator-doris/pull/9827#issuecomment-1140861752
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] EmmyMiao87 commented on a diff in pull request #9827: [tools][doc]add ssb flat tools, and update performance doc
Posted by GitBox <gi...@apache.org>.
EmmyMiao87 commented on code in PR #9827:
URL: https://github.com/apache/incubator-doris/pull/9827#discussion_r884259433
##########
docs/zh-CN/benchmark/ssb-and-flat.md:
##########
@@ -0,0 +1,233 @@
+---
Review Comment:
Please add this doc in sidebar
##########
docs/zh-CN/benchmark/ssb-and-flat.md:
##########
@@ -0,0 +1,233 @@
+---
+{
+ "title": "Star-Schema-Benchmark 测试",
+ "language": "zh-CN"
Review Comment:
Why do Chinese and English SSB test documents not correspond?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9827: [tools][doc]add ssb flat tools, and update performance doc
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on PR #9827:
URL: https://github.com/apache/incubator-doris/pull/9827#issuecomment-1141184680
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9827: [tools][doc]add ssb flat tools, and update performance doc
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on PR #9827:
URL: https://github.com/apache/incubator-doris/pull/9827#issuecomment-1142069973
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9827: [tools][doc]add ssb flat tools, and update performance doc
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on PR #9827:
URL: https://github.com/apache/incubator-doris/pull/9827#issuecomment-1140873141
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] yiguolei merged pull request #9827: [tools][doc]add ssb flat tools, and update performance doc
Posted by GitBox <gi...@apache.org>.
yiguolei merged PR #9827:
URL: https://github.com/apache/incubator-doris/pull/9827
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] hello-stephen commented on a diff in pull request #9827: [tools][doc]add ssb flat tools, and update performance doc
Posted by GitBox <gi...@apache.org>.
hello-stephen commented on code in PR #9827:
URL: https://github.com/apache/incubator-doris/pull/9827#discussion_r884432498
##########
docs/zh-CN/benchmark/ssb-and-flat.md:
##########
@@ -0,0 +1,233 @@
+---
+{
+ "title": "Star-Schema-Benchmark 测试",
+ "language": "zh-CN"
Review Comment:
I just provide a basic version, and Jiafeng will improve the documentation next. This document may be displayed to users, and Jiafeng is better at writing documents.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9827: [tools][doc]add ssb flat tools, and update performance doc
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on PR #9827:
URL: https://github.com/apache/incubator-doris/pull/9827#issuecomment-1140861796
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] hf200012 commented on a diff in pull request #9827: [tools][doc]add ssb flat tools, and update performance doc
Posted by GitBox <gi...@apache.org>.
hf200012 commented on code in PR #9827:
URL: https://github.com/apache/incubator-doris/pull/9827#discussion_r884853602
##########
docs/en/benchmark/ssb.md:
##########
@@ -26,173 +26,363 @@ under the License.
# Star Schema Benchmark
-[Star Schema Benchmark(SSB)](https://www.cs.umb.edu/~poneil/StarSchemaB.PDF) is a lightweight data warehouse scenario performance test set. Based on [TPC-H](http://www.tpc.org/tpch/), SSB provides a simplified version of the star model data set, which is mainly used to test the performance of multi-table association queries under the star model.
+[Star Schema Benchmark(SSB)](https://www.cs.umb.edu/~poneil/StarSchemaB.PDF) is a performance test set in a lightweight data warehouse scenario. Based on [TPC-H](http://www.tpc.org/tpch/), SSB provides a simplified version of the star schema dataset, which is mainly used to test the performance of multi-table association queries under the star schema. . In addition, the industry usually flattens SSB as a wide table model (hereinafter referred to as: SSB flat) to test the performance of the query engine, refer to [Clickhouse](https://clickhouse.com/docs/zh/getting-started /example-datasets/star-schema).
-This document mainly introduces how to pass the preliminary performance test of the SSB process in Doris.
+This document mainly introduces the performance of Doris on the SSB test set.
-> Note 1: The standard test set including SSB is usually far from the actual business scenario, and some tests will perform parameter tuning for the test set. Therefore, the test results of the standard test set can only reflect the performance of the database in a specific scenario. It is recommended that users use actual business data for further testing.
+> Note 1: The standard test set including SSB is usually far from the actual business scenario, and some tests will perform parameter tuning for the test set. Therefore, the test results of the standard test set can only reflect the performance of the database in specific scenarios. Users are advised to conduct further testing with actual business data.
>
-> Note 2: The operations involved in this document are all performed in the CentOS 7 environment.
+> Note 2: The operations involved in this document are all performed in the Ubuntu Server 20.04 environment, and CentOS 7 can also be tested.
-## Environmental preparation
+On 13 queries on the SSB standard test dataset, we tested the upcoming Doris 1.1 version and Doris 0.15.3 version peer-to-peer, and the overall performance improved by 2-3 times.
-Please refer to the [official document](../install/install-deploy.md) to install and deploy Doris to obtain a normal running Doris cluster ( Contain at least 1 FE, 1 BE).
+
Review Comment:
```suggestion
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org