You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2021/08/20 10:01:06 UTC
[GitHub] [incubator-doris] EmmyMiao87 opened a new issue #6483: New Optimizer
EmmyMiao87 opened a new issue #6483:
URL: https://github.com/apache/incubator-doris/issues/6483
# Background
Problems with existing optimizers:
1. The degree of cohesion is not high enough, and there are certain limitations on scalability.
2. Forming from the bottom to the top at one time, instead of dynamic planning, the estimation of multiple plans is selected.
3. The optimization strategy is based on heuristics, and the optimization strategy related to data dependence is not handled well.
# New Optimizer
1. Build the New Optimizer architecture based on the Cascades theory, with clear layers and support for dynamic planning. Solve poor scalability and support best plan in search space.
2. CBO, an optimizer based on cost, can filter out the best plan through statistical information. Manual gear changes to automatic gear. Solve data-dependent optimization.
# Participation
1. Call for a name for New Optimizer
Requirements: Can highlight certain characteristics of New Optimizer, such as the fastest and most accurate ability to locate the best plan.
2. We sincerely invite enthusiastic young people who have ideas about New Optimizer to work together.
Requirements: Have a strong passion for optimizer technology. Understand Cascades theory, or have other open source product optimizer development experience.
Novice task: Find an operator at random, such as AGG node, determine the main data amount and cost (memory, etc.) when executing this operator, and further compare the cost model of Greenplum and Postgres System.
# Contact me
1. Leave your thoughts under this ISSUE
2. Give to subscribe and send email to dev@doris.apache.org
3. Email me: emmymiao87@gmail.com
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] EmmyMiao87 commented on issue #6483: New Optimizer
Posted by GitBox <gi...@apache.org>.
EmmyMiao87 commented on issue #6483:
URL: https://github.com/apache/incubator-doris/issues/6483#issuecomment-904604676
> 1.给 New Optimizer 征集一个名字
>
> **Hawk**（猎鹰）
>
> 缘由：
> 1.Apache很多组件都是动物名
> 2.名词指鹰，象征着敏锐准确的洞察；动词指鹰般的捕捉
> 3.历史：词起源于德语，以严谨文明的国家；在古埃及，猎鹰和眼镜蛇是法老的两大守护神，这里指Doris的守护神
> 4.本来更喜欢hawkeye的，不过Hawkeye和腾讯云某监控组件重名了，和漫威英雄也重名了
eagle 还是 Hawk 厉害？感觉寓意挺好的，精确的从众多plan 中找到 best
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] EmmyMiao87 commented on issue #6483: New Optimizer
Posted by GitBox <gi...@apache.org>.
EmmyMiao87 commented on issue #6483:
URL: https://github.com/apache/incubator-doris/issues/6483#issuecomment-905116301
> astrolabe
来来解析一下~，星盘嘛？
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] EmmyMiao87 commented on issue #6483: New Optimizer
Posted by GitBox <gi...@apache.org>.
EmmyMiao87 commented on issue #6483:
URL: https://github.com/apache/incubator-doris/issues/6483#issuecomment-902586002
# 背景
当前优化器存在的一些问题：
1. 内聚程度不够高，可拓展性存在一定限制。
2. 自低向上一次成型，不是动态规划，缺乏多个 plan 的预估选取。
3. 优化策略以启发式为主，对于数据依赖相关的优化策略处理不好。
# New Optimizer
1. 基于 Cascades 理论搭建 New Optimizer 架构，分层明确，支持动态规划，精准定位 best plan。
2. CBO，基于 cost 的优化器，可通过统计信息辅助筛选出 best plan。
# 参与方式
1. 给 New Optimizer 征集一个名字
要求：能凸现 New Optimizer 的某种特质，比如最快，最精确的定位 best plan 的能力。
2. 诚招对 New Optimizer 有想法的热血青年，一起合作。
要求： 对 Optimizer 技术有强烈热情，如果理解 Cascades 理论，或者有其他开源产品优化器开发经验更好。
新手任务：随便找一个算子，比如 agg node，确定在执行这个算子时，主要数据量和开销（memory等），进一步对比其他 gp， postgres 算子开销 cost model。
# 联系我
1. 在 ISSUE 下留下你的想法
2. 订阅 并 给 dev@doris.apache.org
3. 给我发邮件 emmymiao87@gmail.com
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] EmmyMiao87 edited a comment on issue #6483: New Optimizer
Posted by GitBox <gi...@apache.org>.
EmmyMiao87 edited a comment on issue #6483:
URL: https://github.com/apache/incubator-doris/issues/6483#issuecomment-902586002
# 背景
当前优化器存在的一些问题：
1. 内聚程度不够高，可拓展性存在一定限制。
2. 自低向上一次成型，不是动态规划，缺乏多个 plan 的预估选取。
3. 优化策略以启发式为主，对于数据依赖相关的优化策略处理不好。
# New Optimizer
1. 基于 Cascades 理论搭建 New Optimizer 架构，分层明确，支持动态规划，精准定位 best plan。
2. CBO，基于 cost 的优化器，可通过统计信息辅助筛选出 best plan。
# 参与方式
1. 给 New Optimizer 征集一个名字
要求：一个单词，或词即可。名称尽量简单，易于传播，能凸现 New Optimizer 的某种特质，比如最快，最精确。
2. 诚招对 New Optimizer 有想法的热血青年，一起合作。
要求： 对 Optimizer 技术有强烈热情，如果理解 Cascades 理论，或者有其他开源产品优化器开发经验更好。
新手任务：随便找一个算子，比如 agg node，确定在执行这个算子时，主要数据量和开销（memory等），进一步对比其他 gp， postgres 算子开销 cost model。
# 联系我
1. 在 ISSUE 下留下你的想法
2. 订阅并给 dev@doris.apache.org 发邮件
3. 给我发邮件 emmymiao87@gmail.com
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] stalary removed a comment on issue #6483: New Optimizer
Posted by GitBox <gi...@apache.org>.
stalary removed a comment on issue #6483:
URL: https://github.com/apache/incubator-doris/issues/6483#issuecomment-905144825
> > astrolabe
>
> 来来解析一下~，星盘嘛？
星盘(旧时用于测量天体高度等)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] EmmyMiao87 edited a comment on issue #6483: New Optimizer
Posted by GitBox <gi...@apache.org>.
EmmyMiao87 edited a comment on issue #6483:
URL: https://github.com/apache/incubator-doris/issues/6483#issuecomment-902586002
# 背景
当前优化器存在的一些问题：
1. 内聚程度不够高，可拓展性存在一定限制。
2. 自低向上一次成型，不是动态规划，缺乏多个 plan 的预估选取。
3. 优化策略以启发式为主，对于数据依赖相关的优化策略处理不好。
# New Optimizer
1. 基于 Cascades 理论搭建 New Optimizer 架构，分层明确，支持动态规划，精准定位 best plan。
2. CBO，基于 cost 的优化器，可通过统计信息辅助筛选出 best plan。
# 参与方式
1. 给 New Optimizer 征集一个名字
要求：能凸现 New Optimizer 的某种特质，比如最快，最精确的定位 best plan 的能力。
2. 诚招对 New Optimizer 有想法的热血青年，一起合作。
要求： 对 Optimizer 技术有强烈热情，如果理解 Cascades 理论，或者有其他开源产品优化器开发经验更好。
新手任务：随便找一个算子，比如 agg node，确定在执行这个算子时，主要数据量和开销（memory等），进一步对比其他 gp， postgres 算子开销 cost model。
# 联系我
1. 在 ISSUE 下留下你的想法
2. 订阅并给 dev@doris.apache.org 发邮件
3. 给我发邮件 emmymiao87@gmail.com
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] leafgodgood commented on issue #6483: New Optimizer
Posted by GitBox <gi...@apache.org>.
leafgodgood commented on issue #6483:
URL: https://github.com/apache/incubator-doris/issues/6483#issuecomment-908509707
【英文缩写】 3R
【词性类别】 生物科学
【英文全称】 Reduction Refinement Replacement
【中文解释】 减少、优化和替代
【缩写简介】 在对待实验动物问题上，国际上目前推崇的“3R法则”。减少，即可能减少实验中所用动物的数量，提高实验动物的利用率核试验的精确度；优化，即减少动物的精神紧张和痛苦；替代，即不再利用活体动物进行试验。而是以单细胞生物、微生物或细胞、组织、器官甚至电脑模拟来加以替代。
借鉴生物学科界的”3R法则“，建议一个名字：3R优化器（3R-Optimizer）
缘由:1、简单、易记、有意义
2、优化器主要也是来减少、优化、替代一些算子或执行计划等来实现优化的目的
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] stalary commented on issue #6483: New Optimizer
Posted by GitBox <gi...@apache.org>.
stalary commented on issue #6483:
URL: https://github.com/apache/incubator-doris/issues/6483#issuecomment-905144825
> > astrolabe
>
> 来来解析一下~，星盘嘛？
星盘(旧时用于测量天体高度等)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] leafgodgood removed a comment on issue #6483: New Optimizer
Posted by GitBox <gi...@apache.org>.
leafgodgood removed a comment on issue #6483:
URL: https://github.com/apache/incubator-doris/issues/6483#issuecomment-908509707
【英文缩写】 3R
【词性类别】 生物科学
【英文全称】 Reduction Refinement Replacement
【中文解释】 减少、优化和替代
【缩写简介】 在对待实验动物问题上，国际上目前推崇的“3R法则”。减少，即可能减少实验中所用动物的数量，提高实验动物的利用率核试验的精确度；优化，即减少动物的精神紧张和痛苦；替代，即不再利用活体动物进行试验。而是以单细胞生物、微生物或细胞、组织、器官甚至电脑模拟来加以替代。
借鉴生物学科界的”3R法则“，建议一个名字：3R优化器（3R-Optimizer）
缘由:1、简单、易记、有意义
2、优化器主要也是来减少、优化、替代一些算子或执行计划等来实现优化的目的
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] zbtzbtzbt commented on issue #6483: New Optimizer
Posted by GitBox <gi...@apache.org>.
zbtzbtzbt commented on issue #6483:
URL: https://github.com/apache/incubator-doris/issues/6483#issuecomment-904603095
1.给 New Optimizer 征集一个名字
**Hawk**（猎鹰）
缘由：
1.Apache很多组件都是动物名
2.名词指鹰，象征着敏锐准确的洞察；动词指鹰般的捕捉
3.历史：词起源于德语，以严谨文明的国家；在古埃及，猎鹰和眼镜蛇是法老的两大守护神，这里指Doris的守护神
4.本来更喜欢hawkeye的，不过Hawkeye和腾讯云某监控组件重名了，和漫威英雄也重名了
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] leafgodgood commented on issue #6483: New Optimizer
Posted by GitBox <gi...@apache.org>.
leafgodgood commented on issue #6483:
URL: https://github.com/apache/incubator-doris/issues/6483#issuecomment-908509707
【英文缩写】 3R
【词性类别】 生物科学
【英文全称】 Reduction Refinement Replacement
【中文解释】 减少、优化和替代
【缩写简介】 在对待实验动物问题上，国际上目前推崇的“3R法则”。减少，即可能减少实验中所用动物的数量，提高实验动物的利用率核试验的精确度；优化，即减少动物的精神紧张和痛苦；替代，即不再利用活体动物进行试验。而是以单细胞生物、微生物或细胞、组织、器官甚至电脑模拟来加以替代。
借鉴生物学科界的”3R法则“，建议一个名字：3R优化器（3R-Optimizer）
缘由:1、简单、易记、有意义
2、优化器主要也是来减少、优化、替代一些算子或执行计划等来实现优化的目的
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] EmmyMiao87 edited a comment on issue #6483: New Optimizer
Posted by GitBox <gi...@apache.org>.
EmmyMiao87 edited a comment on issue #6483:
URL: https://github.com/apache/incubator-doris/issues/6483#issuecomment-905237714
以下为开源开发者提供线索：
Mamba(树眼镜蛇)
B-Mamba(黑曼巴)
缘由:
1. 联系:Apache很多组件都是动物名。
2. 名词:指黑曼巴蛇，是世界上速度最快及攻击性最强的蛇类(没有之一)。其短距离的移动时速可达16- 20公里，拥有惊人的闪电般的速度。
3. 情怀:伟大的前美国职业男子篮球联赛(NBA)洛杉矶湖人队的球星科比·布莱恩特有个绰号叫“黑曼 巴”，那是非洲草原上毒性最烈的一种蛇，而科比的精神，也被称为“曼巴精神”，“永不言弃”是科比自己 给予这种精神的定义。总的来说，曼巴精神，就是从不退却，从不放弃，从不逃遁，忍辱负重，在困难 中创造奇迹。
Doris Optimizer功能类比:面对成千上亿的复杂数据查询等DML操作，优化器总是迎难而上，从不放 弃，在努力探索着最优查询路径，经过层层复杂的优化探索，最终决策出最优的执行方案。另一方面也 是代表我们的开发工程师经历了重重困难，最后创造出了doris这款优秀的产品。
4. 精髓:“科比认为黑曼巴是地球上最致命的掠食者之一，”Avar说道:“这也是他在每场球赛中的取胜之 道——精准且快速。” 找一种动物来比喻科比，会选择什么?科比本人毫不犹豫地答道:“Black Mamba!(黑曼巴)”黑曼巴蛇是非洲毒蛇中体形最长、速度最快、攻击性最强的，它的杀手天性，勇 猛好斗，以及猎食技术高超，这一切都与在篮球场上的科比惊人地相似。
科比经常在比赛中上演绝杀的好戏，那些精彩的表现就像是猎杀猎物时候的黑曼巴蛇一样，冷酷无情， 一击致命。
5. 历史:在古埃及，猎鹰和眼镜蛇是法老的两大守护神，这里指Doris的守护神。
6. 传奇文化:黑曼巴蛇之所以能有很大的名气，其中一个原因是它含了很大的传奇色彩。在非洲，很多 人们都有听过黑曼巴蛇的传奇故事:有人说黑曼巴蛇能追上一匹正在奔跑的马;也有人说，一条黑曼巴 蛇在短短1分钟内，杀死了13个围捕它的人;更有人说看见了一条黑曼巴蛇扑到了汽车的玻璃上!
非常感谢这位社区的同学提供的名字及如此详细的解析~
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] stalary commented on issue #6483: New Optimizer
Posted by GitBox <gi...@apache.org>.
stalary commented on issue #6483:
URL: https://github.com/apache/incubator-doris/issues/6483#issuecomment-905145076
> > astrolabe
>
> 来来解析一下~，星盘嘛？
星盘(旧时用于测量天体高度等)，有测量查找最优解的含义
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] EmmyMiao87 commented on issue #6483: New Optimizer
Posted by GitBox <gi...@apache.org>.
EmmyMiao87 commented on issue #6483:
URL: https://github.com/apache/incubator-doris/issues/6483#issuecomment-912211919
> 【英文缩写】 3R
>
> 【词性类别】 生物科学
>
> 【英文全称】 Reduction Refinement Replacement
>
> 【中文解释】 减少、优化和替代
>
> 【缩写简介】 在对待实验动物问题上，国际上目前推崇的“3R法则”。减少，即可能减少实验中所用动物的数量，提高实验动物的利用率核试验的精确度；优化，即减少动物的精神紧张和痛苦；替代，即不再利用活体动物进行试验。而是以单细胞生物、微生物或细胞、组织、器官甚至电脑模拟来加以替代。
>
> 借鉴生物学科界的”3R法则“，建议一个名字：3R优化器（3R-Optimizer）
> 缘由:1、简单、易记、有意义
> 2、优化器主要也是来减少、优化、替代一些算子或执行计划等来实现优化的目的
弱弱问一句，你是学生物的嘛~
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] JusticeGong commented on issue #6483: New Optimizer
Posted by GitBox <gi...@apache.org>.
JusticeGong commented on issue #6483:
URL: https://github.com/apache/incubator-doris/issues/6483#issuecomment-906152248
1.给 New Optimizer 征集一个名字
**Piu**
缘由：
1.拟声词，不但从视觉上，而且从听觉上也给人一种又快又精准的感觉，贴合New Optimizer的特点
2.简单好记且又不是现成的单词，搜索时容易命中
3.全称Process Instruction Unit，指令处理单元，贴合New Optimizer的角色
4.Più作为音乐术语表示”更..."，常用的乐谱标记为più mosso，表示“更快”
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] stalary commented on issue #6483: New Optimizer
Posted by GitBox <gi...@apache.org>.
stalary commented on issue #6483:
URL: https://github.com/apache/incubator-doris/issues/6483#issuecomment-904657362
astrolabe
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] EmmyMiao87 edited a comment on issue #6483: New Optimizer
Posted by GitBox <gi...@apache.org>.
EmmyMiao87 edited a comment on issue #6483:
URL: https://github.com/apache/incubator-doris/issues/6483#issuecomment-902586002
# 背景
当前优化器存在的一些问题：
1. 内聚程度不够高，可拓展性存在一定限制。
2. 自低向上一次成型，不是动态规划，缺乏多个 plan 的预估选取。
3. 优化策略以启发式为主，对于数据依赖相关的优化策略处理不好。
# New Optimizer
1. 基于 Cascades 理论搭建 New Optimizer 架构，分层明确，支持动态规划，精准定位 best plan。
2. CBO，基于 cost 的优化器，可通过统计信息辅助筛选出 best plan。
# 参与方式
1. 给 New Optimizer 征集一个名字
要求：一个单词，或词组即可。名称尽量简单，易于传播，能凸现 New Optimizer 的某种特质，比如最快，最精确。
2. 诚招对 New Optimizer 有想法的热血青年，一起合作。
要求： 对 Optimizer 技术有强烈热情，如果理解 Cascades 理论，或者有其他开源产品优化器开发经验更好。
新手任务：随便找一个算子，比如 agg node，确定在执行这个算子时，主要数据量和开销（memory等），进一步对比其他 gp， postgres 算子开销 cost model。
# 联系我
1. 在 ISSUE 下留下你的想法
2. 订阅并给 dev@doris.apache.org 发邮件
3. 给我发邮件 emmymiao87@gmail.com
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] zbtzbtzbt commented on issue #6483: New Optimizer
Posted by GitBox <gi...@apache.org>.
zbtzbtzbt commented on issue #6483:
URL: https://github.com/apache/incubator-doris/issues/6483#issuecomment-904613898
eagle更大一点，有猛禽的感觉，hawk一般是指鹰，大小可以搭在人肩上的那种。厉害的话eagle厉害一些，毕竟能叼走小孩哈哈
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] EmmyMiao87 commented on issue #6483: New Optimizer
Posted by GitBox <gi...@apache.org>.
EmmyMiao87 commented on issue #6483:
URL: https://github.com/apache/incubator-doris/issues/6483#issuecomment-905237714
以下为开源开发者提供线索：
Mamba(树眼镜蛇)
B-Mamba(黑曼巴)
缘由:
1.联系:Apache很多组件都是动物名。
2.名词:指黑曼巴蛇，是世界上速度最快及攻击性最强的蛇类(没有之一)。其短距离的移动时速可达16- 20公里，拥有惊人的闪电般的速度。
3.情怀:伟大的前美国职业男子篮球联赛(NBA)洛杉矶湖人队的球星科比·布莱恩特有个绰号叫“黑曼 巴”，那是非洲草原上毒性最烈的一种蛇，而科比的精神，也被称为“曼巴精神”，“永不言弃”是科比自己 给予这种精神的定义。总的来说，曼巴精神，就是从不退却，从不放弃，从不逃遁，忍辱负重，在困难 中创造奇迹。
Doris Optimizer功能类比:面对成千上亿的复杂数据查询等DML操作，优化器总是迎难而上，从不放 弃，在努力探索着最优查询路径，经过层层复杂的优化探索，最终决策出最优的执行方案。另一方面也 是代表我们的开发工程师经历了重重困难，最后创造出了doris这款优秀的产品。
4.精髓:“科比认为黑曼巴是地球上最致命的掠食者之一，”Avar说道:“这也是他在每场球赛中的取胜之 道——精准且快速。” 找一种动物来比喻科比，会选择什么?科比本人毫不犹豫地答道:“Black Mamba!(黑曼巴)”黑曼巴蛇是非洲毒蛇中体形最长、速度最快、攻击性最强的，它的杀手天性，勇 猛好斗，以及猎食技术高超，这一切都与在篮球场上的科比惊人地相似。
科比经常在比赛中上演绝杀的好戏，那些精彩的表现就像是猎杀猎物时候的黑曼巴蛇一样，冷酷无情， 一击致命。
5.历史:在古埃及，猎鹰和眼镜蛇是法老的两大守护神，这里指Doris的守护神。
6.传奇文化:黑曼巴蛇之所以能有很大的名气，其中一个原因是它含了很大的传奇色彩。在非洲，很多 人们都有听过黑曼巴蛇的传奇故事:有人说黑曼巴蛇能追上一匹正在奔跑的马;也有人说，一条黑曼巴 蛇在短短1分钟内，杀死了13个围捕它的人;更有人说看见了一条黑曼巴蛇扑到了汽车的玻璃上!
非常感谢这位社区的同学提供的名字及如此详细的解析~
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org