You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@doris.apache.org by Kai Jiang <ai...@gmail.com> on 2023/01/09 03:45:29 UTC
Re: Re: [Discuss][DSIP] Inverted index
As part of Inverted Index DSIP
<https://cwiki.apache.org/confluence/display/DORIS/DSIP-023%3A+Add+inverted+index+for+full+text+search>
steps,
we'd like to contribute our inverted index implementations step by step.
First of all we need to introduce clucene to doris thirdparty libs, because
inverted index implementations are based on lucence API and index file
format, also we add our features and performance improvements base on
clucene, so we need to maintain the repo ourselves.
As clucene is dual licensing, we choose it's Apache2.0 Licence.
Mingyu Chen <mo...@163.com> 于2022年9月30日周五 22:00写道：
> Hi Kang,
> Glad to see this feature.
> I have created a DSIP for it:
> https://cwiki.apache.org/confluence/display/DORIS/DSIP-023%3A+Add+inverted+index+for+full+text+search
>
>
>
>
> --
>
> 此致！Best Regards
> 陈明雨 Mingyu Chen
>
> Email:
> morningman@apache.org
>
>
>
>
>
> At 2022-09-30 11:35:50, "Kang" <kx...@gmail.com> wrote:
> >Yes, we're working on the design doc.
> >
> >@morningman, Could you help to create a DSIP wiki page for it?
> >
> >On Thu, Sep 29, 2022 at 11:08 AM Gabriel Lee <ga...@gmail.com>
> >wrote:
> >
> >> Hi Kang,
> >>
> >> It's a really practical feature. Any design docs for this?
> >>
> >> Best,
> >> Gabriel
> >>
> >> On Thu, 29 Sept 2022 at 10:17, Kang <kx...@gmail.com> wrote:
> >>
> >> > Hi All,
> >> >
> >> > I'd like to propose adding inverted index for doris.
> >> >
> >> > Inverted index is important for high performance point queries. It
> will
> >> > support fulltext search like elasticsearch, which is especially useful
> >> for
> >> > text logs.
> >> >
> >> >
> >> > --
> >> >
> >> >
> >> > Best Regards!
> >> >
> >> > Kang <kx...@gmail.com>
> >> >
> >>
> >
> >
> >--
> >
> >
> >Best Regards!
> >
> >Kang <kx...@gmail.com>
>
--
姜凯
哈尔滨工业大学 计算机科学与技术学院
Harbin Institute of Technology CS&T
Re:Re: Re: [Discuss][DSIP] Inverted index
Posted by Mingyu Chen <mo...@163.com>.
Thanks for your contribution.
Please also update this file `https://github.com/apache/doris-thirdparty/blob/main/README.md ` to add CLucece.
--
此致！Best Regards
陈明雨 Mingyu Chen
Email:
morningman@apache.org
在 2023-01-09 11:45:29，"Kai Jiang" <ai...@gmail.com> 写道：
>As part of Inverted Index DSIP
><https://cwiki.apache.org/confluence/display/DORIS/DSIP-023%3A+Add+inverted+index+for+full+text+search>
>steps,
>we'd like to contribute our inverted index implementations step by step.
>First of all we need to introduce clucene to doris thirdparty libs, because
>inverted index implementations are based on lucence API and index file
>format, also we add our features and performance improvements base on
>clucene, so we need to maintain the repo ourselves.
>As clucene is dual licensing, we choose it's Apache2.0 Licence.
>
>Mingyu Chen <mo...@163.com> 于2022年9月30日周五 22:00写道：
>
>> Hi Kang,
>> Glad to see this feature.
>> I have created a DSIP for it:
>> https://cwiki.apache.org/confluence/display/DORIS/DSIP-023%3A+Add+inverted+index+for+full+text+search
>>
>>
>>
>>
>> --
>>
>> 此致！Best Regards
>> 陈明雨 Mingyu Chen
>>
>> Email:
>> morningman@apache.org
>>
>>
>>
>>
>>
>> At 2022-09-30 11:35:50, "Kang" <kx...@gmail.com> wrote:
>> >Yes, we're working on the design doc.
>> >
>> >@morningman, Could you help to create a DSIP wiki page for it?
>> >
>> >On Thu, Sep 29, 2022 at 11:08 AM Gabriel Lee <ga...@gmail.com>
>> >wrote:
>> >
>> >> Hi Kang,
>> >>
>> >> It's a really practical feature. Any design docs for this?
>> >>
>> >> Best,
>> >> Gabriel
>> >>
>> >> On Thu, 29 Sept 2022 at 10:17, Kang <kx...@gmail.com> wrote:
>> >>
>> >> > Hi All,
>> >> >
>> >> > I'd like to propose adding inverted index for doris.
>> >> >
>> >> > Inverted index is important for high performance point queries. It
>> will
>> >> > support fulltext search like elasticsearch, which is especially useful
>> >> for
>> >> > text logs.
>> >> >
>> >> >
>> >> > --
>> >> >
>> >> >
>> >> > Best Regards!
>> >> >
>> >> > Kang <kx...@gmail.com>
>> >> >
>> >>
>> >
>> >
>> >--
>> >
>> >
>> >Best Regards!
>> >
>> >Kang <kx...@gmail.com>
>>
>
>
>--
>姜凯
>哈尔滨工业大学 计算机科学与技术学院
>Harbin Institute of Technology CS&T