You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2020/04/11 10:39:10 UTC
[GitHub] [incubator-doris] wuyunfeng opened a new issue #3306: [Doris On ES]
2020 roadmap
wuyunfeng opened a new issue #3306: [Doris On ES] 2020 roadmap
URL: https://github.com/apache/incubator-doris/issues/3306
- 1. 过滤条件转换从BE 上推至 FE，BE只负责扫描数据，FE处理过滤条件
将查询层 和 执行层完全分离，这样很多需求都可以直接在FE中更方便处理了，另外降低社区用户开发成本
- 2. 增加对CastExpr过滤条件的处理
例： k 是float类型，如果 k > 2.0 这时候Doris On ES就没办法下推这个过滤条件了
- 3. 对分词类型的字段增加 `QueryStringQuery`, 将逐步废弃`es_query`
- 4. 为FE查询引擎提供更多的ES 外表统计信息，在多表join的时候能够更好的规划
- 5. 增加对 `object` 和 `nested` 字段类型的过滤以及扫描
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] wuyunfeng commented on issue #3306: [Doris On
Elasticsearch] 2020 Develop Roadmap
Posted by GitBox <gi...@apache.org>.
wuyunfeng commented on issue #3306: [Doris On Elasticsearch] 2020 Develop Roadmap
URL: https://github.com/apache/incubator-doris/issues/3306#issuecomment-612444094
@stalary OK
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] wuyunfeng commented on issue #3306: [Doris On ES]
2020 Develop Roadmap
Posted by GitBox <gi...@apache.org>.
wuyunfeng commented on issue #3306: [Doris On ES] 2020 Develop Roadmap
URL: https://github.com/apache/incubator-doris/issues/3306#issuecomment-612390154
https://github.com/apache/incubator-doris/issues/3249
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] blackfox1983 commented on issue #3306: [Doris On
Elasticsearch] 2020 Develop Roadmap
Posted by GitBox <gi...@apache.org>.
blackfox1983 commented on issue #3306: [Doris On Elasticsearch] 2020 Develop Roadmap
URL: https://github.com/apache/incubator-doris/issues/3306#issuecomment-612393825
简直就是业务线同学福音！！！！！
非常期待这些feature的上线。也希望有机会一起开发。
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] wuyunfeng commented on issue #3306: [Doris On
Elasticsearch] 2020 Develop Roadmap
Posted by GitBox <gi...@apache.org>.
wuyunfeng commented on issue #3306: [Doris On Elasticsearch] 2020 Develop Roadmap
URL: https://github.com/apache/incubator-doris/issues/3306#issuecomment-614396728
https://github.com/apache/incubator-doris/issues/3327
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] wuyunfeng commented on issue #3306: [Doris On
Elasticsearch] 2020 Develop Roadmap
Posted by GitBox <gi...@apache.org>.
wuyunfeng commented on issue #3306: [Doris On Elasticsearch] 2020 Develop Roadmap
URL: https://github.com/apache/incubator-doris/issues/3306#issuecomment-616023600
https://github.com/apache/incubator-doris/pull/3351 for `增加对CastExpr过滤条件的处理`
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] stalary commented on issue #3306: [Doris On
Elasticsearch] 2020 Develop Roadmap
Posted by GitBox <gi...@apache.org>.
stalary commented on issue #3306: [Doris On Elasticsearch] 2020 Develop Roadmap
URL: https://github.com/apache/incubator-doris/issues/3306#issuecomment-612443072
`index mapping和shard location的检测分成两个阶段`
这个我来搞下
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] imay commented on issue #3306: [Doris On
Elasticsearch] 2020 Develop Roadmap
Posted by GitBox <gi...@apache.org>.
imay commented on issue #3306: [Doris On Elasticsearch] 2020 Develop Roadmap
URL: https://github.com/apache/incubator-doris/issues/3306#issuecomment-612954531
> `index mapping和shard location的检测分成两个阶段`
> 这个我来搞下
@stalary
You can create another issue to track it
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] wuyunfeng commented on issue #3306: [Doris On Elasticsearch] 2020 Develop Roadmap
Posted by GitBox <gi...@apache.org>.
wuyunfeng commented on issue #3306:
URL: https://github.com/apache/incubator-doris/issues/3306#issuecomment-630555113
> 支持对Elasticsearch外表的alter操作这个我处理下
👌， cool
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] wuyunfeng commented on issue #3306: [Doris On Elasticsearch] 2020 Develop Roadmap
Posted by GitBox <gi...@apache.org>.
wuyunfeng commented on issue #3306:
URL: https://github.com/apache/incubator-doris/issues/3306#issuecomment-656621078
@ColinVon 更新下Doris的代码，现在已经完全支持 sometable-* 了
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] wuyunfeng commented on issue #3306: [Doris On Elasticsearch] 2020 Develop Roadmap
Posted by GitBox <gi...@apache.org>.
wuyunfeng commented on issue #3306:
URL: https://github.com/apache/incubator-doris/issues/3306#issuecomment-650870551
https://github.com/apache/incubator-doris/issues/3967
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] ColinVon commented on issue #3306: [Doris On Elasticsearch] 2020 Develop Roadmap
Posted by GitBox <gi...@apache.org>.
ColinVon commented on issue #3306:
URL: https://github.com/apache/incubator-doris/issues/3306#issuecomment-642378114
@wuyunfeng
add ability for processing wildcard index ?
由于涉及中文字段的长度加工与计算（char_length, strleft与strright）的使用，近期将Doris升级到最新版本（2020-06-11 Git Clone），但造成了通配符指定index的Table无法查询，提示错误信息如下：
`
fetch es table [sometable] metadata failure: index[sometable-*] not found for the Elasticsearch Cluster'
`
旧版本中，这个功能是正常使用的，请问是重构后引入问题吗？有什么办法能支持使用通配么？
在此感谢Doris各位开发者的无私奉献 :)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] blackfox1983 edited a comment on issue #3306: [Doris On Elasticsearch] Develop Roadmap
Posted by GitBox <gi...@apache.org>.
blackfox1983 edited a comment on issue #3306:
URL: https://github.com/apache/incubator-doris/issues/3306#issuecomment-643028949
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] wuyunfeng edited a comment on issue #3306: [Doris On Elasticsearch] 2020 Develop Roadmap
Posted by GitBox <gi...@apache.org>.
wuyunfeng edited a comment on issue #3306:
URL: https://github.com/apache/incubator-doris/issues/3306#issuecomment-630555113
> 支持对Elasticsearch外表的alter操作这个我处理下
👌cool
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] wuyunfeng commented on issue #3306: [Doris On Elasticsearch] 2020 Develop Roadmap
Posted by GitBox <gi...@apache.org>.
wuyunfeng commented on issue #3306:
URL: https://github.com/apache/incubator-doris/issues/3306#issuecomment-650877905
add ability for processing wildcard and alias index: https://github.com/apache/incubator-doris/pull/3968
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] wuyunfeng edited a comment on issue #3306: [Doris On Elasticsearch] 2020 Develop Roadmap
Posted by GitBox <gi...@apache.org>.
wuyunfeng edited a comment on issue #3306:
URL: https://github.com/apache/incubator-doris/issues/3306#issuecomment-656621078
@ColinVon 更新下Doris的代码，现在已经完全支持 sometable-* 了，支持alias和wildcard两种
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] ColinVon commented on issue #3306: [Doris On Elasticsearch] 2020 Develop Roadmap
Posted by GitBox <gi...@apache.org>.
ColinVon commented on issue #3306:
URL: https://github.com/apache/incubator-doris/issues/3306#issuecomment-675237113
> @ColinVon 更新下Doris的代码，现在已经完全支持 sometable-* 了，支持alias和wildcard两种
>
> 参考下这个：#3968
非常感谢，我试试看
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] wuyunfeng commented on issue #3306: [Doris On Elasticsearch] 2020 Develop Roadmap
Posted by GitBox <gi...@apache.org>.
wuyunfeng commented on issue #3306:
URL: https://github.com/apache/incubator-doris/issues/3306#issuecomment-655877657
https://github.com/apache/incubator-doris/pull/4055
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] wuyunfeng commented on issue #3306: [Doris On Elasticsearch] 2020 Develop Roadmap
Posted by GitBox <gi...@apache.org>.
wuyunfeng commented on issue #3306:
URL: https://github.com/apache/incubator-doris/issues/3306#issuecomment-637973779
https://github.com/apache/incubator-doris/issues/3759
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] LinhaoZhu commented on issue #3306: [Doris On Elasticsearch] Develop Roadmap
Posted by GitBox <gi...@apache.org>.
LinhaoZhu commented on issue #3306:
URL: https://github.com/apache/incubator-doris/issues/3306#issuecomment-871238118
> * Support ES partition to meet the demand of auto-deleting some data out of data in ES
@wuyunfeng @blackfox1983 Is there a tracking number for this issues?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] wuyunfeng edited a comment on issue #3306: [Doris On Elasticsearch] 2020 Develop Roadmap
Posted by GitBox <gi...@apache.org>.
wuyunfeng edited a comment on issue #3306:
URL: https://github.com/apache/incubator-doris/issues/3306#issuecomment-656621078
@ColinVon 更新下Doris的代码，现在已经完全支持 sometable-* 了，支持alias和wildcard两种
参考下这个：https://github.com/apache/incubator-doris/pull/3968
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] wuyunfeng commented on issue #3306: [Doris On Elasticsearch] 2020 Develop Roadmap
Posted by GitBox <gi...@apache.org>.
wuyunfeng commented on issue #3306:
URL: https://github.com/apache/incubator-doris/issues/3306#issuecomment-642380906
@ColinVon 目前重构的部分还没有合入，此前的版本也是不支持sometable-*匹配的。因为一旦涉及到多个index，目前的分区拆分会有问题 。你提到的 `add ability for processing wildcard index ` 目前还没有做。
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] blackfox1983 commented on issue #3306: [Doris On Elasticsearch] 2020 Develop Roadmap
Posted by GitBox <gi...@apache.org>.
blackfox1983 commented on issue #3306:
URL: https://github.com/apache/incubator-doris/issues/3306#issuecomment-643028949
- [ ] Support ES partition to meet the demand of auto-deleting some data out of data in ES
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] stalary commented on issue #3306: [Doris On Elasticsearch] 2020 Develop Roadmap
Posted by GitBox <gi...@apache.org>.
stalary commented on issue #3306:
URL: https://github.com/apache/incubator-doris/issues/3306#issuecomment-630234678
支持对Elasticsearch外表的alter操作这个我处理下
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] wuyunfeng commented on issue #3306: [Doris On Elasticsearch] 2020 Develop Roadmap
Posted by GitBox <gi...@apache.org>.
wuyunfeng commented on issue #3306:
URL: https://github.com/apache/incubator-doris/issues/3306#issuecomment-706505942
https://github.com/apache/incubator-doris/pull/4699 support alter operation for ES table
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org