You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by onmstester onmstester <on...@zoho.com> on 2018/07/31 14:45:53 UTC
full text search on some text columns
I need to do a full text search (like) on one of my clustering keys and one of partition keys (it use text as data type). The input rate is high so only Cassandra could handle it, Is there any open source version project which help using cassandra+ solr or cassandra + elastic? Any Recommendation on doing this with home-made solutions would be appreciated? Sent using Zoho Mail
Re: [EXTERNAL] full text search on some text columns
Posted by Hannu Kröger <hk...@gmail.com>.
Does someone know if you can do online upgrade of elassandra? With lucene plugin you cannot really because you need to drop and recreate indexes if lucene has been updated.
Hannu
> Octavian Rinciog <oc...@gmail.com> kirjoitti 1.8.2018 kello 12.49:
>
> Hello!
>
> Maybe this will work? https://github.com/strapdata/elassandra (I haven't tested this plugin)
>
> 2018-08-01 12:17 GMT+03:00 Hannu Kröger <hk...@gmail.com>:
>> 3.11.1 plugin works with 3.11.2. But yes, original maintainer is not maintaining the project anymore. At least not actively.
>>
>> Hannu
>>
>>> Ben Slater <be...@instaclustr.com> kirjoitti 1.8.2018 kello 7.16:
>>>
>>> We (Instaclustr) will be submitting a PR for 3.11.3 support for cassandra-lucene-index once 3.11.3 is officially released as we offer it as part of our service and have customers using it.
>>>
>>> Cheers
>>> Ben
>>>
>>>> On Wed, 1 Aug 2018 at 14:06 onmstester onmstester <on...@zoho.com> wrote:
>>>> It seems to be an interesting project but sort of abandoned. No update in last 8 Months and not supporting Cassandra 3.11.2 (the version i currently use)
>>>>
>>>> Sent using Zoho Mail
>>>>
>>>>
>>>>
>>>> ============ Forwarded message ============
>>>> From : Andrzej Śliwiński <an...@gmail.com>
>>>> To : <us...@cassandra.apache.org>
>>>> Date : Wed, 01 Aug 2018 08:16:06 +0430
>>>> Subject : Re: [EXTERNAL] full text search on some text columns
>>>> ============ Forwarded message ============
>>>>
>>>> Maybe this plugin could do the job: https://github.com/Stratio/cassandra-lucene-index
>>>>
>>>> On Tue, 31 Jul 2018 at 22:37, onmstester onmstester <on...@zoho.com> wrote:
>>>>
>>>>
>>> --
>>> Ben Slater
>>> Chief Product Officer
>>>
>>>
>>> Read our latest technical blog posts here.
>>> This email has been sent on behalf of Instaclustr Pty. Limited (Australia) and Instaclustr Inc (USA).
>>> This email and any attachments may contain confidential and legally privileged information. If you are not the intended recipient, do not copy or disclose its content, but please reply to this email immediately and highlight the error to the sender and then immediately delete the message.
>
>
>
> --
> Octavian Rinciog
Re: [EXTERNAL] full text search on some text columns
Posted by Octavian Rinciog <oc...@gmail.com>.
Hello!
Maybe this will work? https://github.com/strapdata/elassandra (I haven't
tested this plugin)
2018-08-01 12:17 GMT+03:00 Hannu Kröger <hk...@gmail.com>:
> 3.11.1 plugin works with 3.11.2. But yes, original maintainer is not
> maintaining the project anymore. At least not actively.
>
> Hannu
>
> Ben Slater <be...@instaclustr.com> kirjoitti 1.8.2018 kello 7.16:
>
> We (Instaclustr) will be submitting a PR for 3.11.3 support for
> cassandra-lucene-index once 3.11.3 is officially released as we offer it as
> part of our service and have customers using it.
>
> Cheers
> Ben
>
> On Wed, 1 Aug 2018 at 14:06 onmstester onmstester <on...@zoho.com>
> wrote:
>
>> It seems to be an interesting project but sort of abandoned. No update in
>> last 8 Months and not supporting Cassandra 3.11.2 (the version i currently
>> use)
>>
>> Sent using Zoho Mail <https://www.zoho.com/mail/>
>>
>>
>> ============ Forwarded message ============
>> From : Andrzej Śliwiński <an...@gmail.com>
>> To : <us...@cassandra.apache.org>
>> Date : Wed, 01 Aug 2018 08:16:06 +0430
>> Subject : Re: [EXTERNAL] full text search on some text columns
>> ============ Forwarded message ============
>>
>> Maybe this plugin could do the job: https://github.com/
>> Stratio/cassandra-lucene-index
>>
>> On Tue, 31 Jul 2018 at 22:37, onmstester onmstester <on...@zoho.com>
>> wrote:
>>
>>
>> --
>
>
> *Ben Slater*
>
> *Chief Product Officer <https://www.instaclustr.com/>*
>
> <https://www.facebook.com/instaclustr> <https://twitter.com/instaclustr>
> <https://www.linkedin.com/company/instaclustr>
>
> Read our latest technical blog posts here
> <https://www.instaclustr.com/blog/>.
>
> This email has been sent on behalf of Instaclustr Pty. Limited (Australia)
> and Instaclustr Inc (USA).
>
> This email and any attachments may contain confidential and legally
> privileged information. If you are not the intended recipient, do not copy
> or disclose its content, but please reply to this email immediately and
> highlight the error to the sender and then immediately delete the message.
>
>
--
Octavian Rinciog
Re: [EXTERNAL] full text search on some text columns
Posted by Hannu Kröger <hk...@gmail.com>.
3.11.1 plugin works with 3.11.2. But yes, original maintainer is not maintaining the project anymore. At least not actively.
Hannu
> Ben Slater <be...@instaclustr.com> kirjoitti 1.8.2018 kello 7.16:
>
> We (Instaclustr) will be submitting a PR for 3.11.3 support for cassandra-lucene-index once 3.11.3 is officially released as we offer it as part of our service and have customers using it.
>
> Cheers
> Ben
>
>> On Wed, 1 Aug 2018 at 14:06 onmstester onmstester <on...@zoho.com> wrote:
>> It seems to be an interesting project but sort of abandoned. No update in last 8 Months and not supporting Cassandra 3.11.2 (the version i currently use)
>>
>> Sent using Zoho Mail
>>
>>
>>
>> ============ Forwarded message ============
>> From : Andrzej Śliwiński <an...@gmail.com>
>> To : <us...@cassandra.apache.org>
>> Date : Wed, 01 Aug 2018 08:16:06 +0430
>> Subject : Re: [EXTERNAL] full text search on some text columns
>> ============ Forwarded message ============
>>
>> Maybe this plugin could do the job: https://github.com/Stratio/cassandra-lucene-index
>>
>> On Tue, 31 Jul 2018 at 22:37, onmstester onmstester <on...@zoho.com> wrote:
>>
>>
> --
> Ben Slater
> Chief Product Officer
>
>
> Read our latest technical blog posts here.
> This email has been sent on behalf of Instaclustr Pty. Limited (Australia) and Instaclustr Inc (USA).
> This email and any attachments may contain confidential and legally privileged information. If you are not the intended recipient, do not copy or disclose its content, but please reply to this email immediately and highlight the error to the sender and then immediately delete the message.
Re: Re: [EXTERNAL] full text search on some text columns
Posted by Ben Slater <be...@instaclustr.com>.
We (Instaclustr) will be submitting a PR for 3.11.3 support for
cassandra-lucene-index once 3.11.3 is officially released as we offer it as
part of our service and have customers using it.
Cheers
Ben
On Wed, 1 Aug 2018 at 14:06 onmstester onmstester <on...@zoho.com>
wrote:
> It seems to be an interesting project but sort of abandoned. No update in
> last 8 Months and not supporting Cassandra 3.11.2 (the version i currently
> use)
>
> Sent using Zoho Mail <https://www.zoho.com/mail/>
>
>
> ============ Forwarded message ============
> From : Andrzej Śliwiński <an...@gmail.com>
> To : <us...@cassandra.apache.org>
> Date : Wed, 01 Aug 2018 08:16:06 +0430
> Subject : Re: [EXTERNAL] full text search on some text columns
> ============ Forwarded message ============
>
> Maybe this plugin could do the job:
> https://github.com/Stratio/cassandra-lucene-index
>
> On Tue, 31 Jul 2018 at 22:37, onmstester onmstester <on...@zoho.com>
> wrote:
>
>
> --
*Ben Slater*
*Chief Product Officer <https://www.instaclustr.com/>*
<https://www.facebook.com/instaclustr> <https://twitter.com/instaclustr>
<https://www.linkedin.com/company/instaclustr>
Read our latest technical blog posts here
<https://www.instaclustr.com/blog/>.
This email has been sent on behalf of Instaclustr Pty. Limited (Australia)
and Instaclustr Inc (USA).
This email and any attachments may contain confidential and legally
privileged information. If you are not the intended recipient, do not copy
or disclose its content, but please reply to this email immediately and
highlight the error to the sender and then immediately delete the message.
Fwd: Re: [EXTERNAL] full text search on some text columns
Posted by onmstester onmstester <on...@zoho.com>.
It seems to be an interesting project but sort of abandoned. No update in last 8 Months and not supporting Cassandra 3.11.2 (the version i currently use) Sent using Zoho Mail ============ Forwarded message ============ From : Andrzej Śliwiński <an...@gmail.com> To : <us...@cassandra.apache.org> Date : Wed, 01 Aug 2018 08:16:06 +0430 Subject : Re: [EXTERNAL] full text search on some text columns ============ Forwarded message ============ Maybe this plugin could do the job: https://github.com/Stratio/cassandra-lucene-index On Tue, 31 Jul 2018 at 22:37, onmstester onmstester <on...@zoho.com> wrote:
Re: [EXTERNAL] full text search on some text columns
Posted by Andrzej Śliwiński <an...@gmail.com>.
Maybe this plugin could do the job:
https://github.com/Stratio/cassandra-lucene-index
On Tue, 31 Jul 2018 at 22:37, onmstester onmstester <on...@zoho.com>
wrote:
> Actually we can't afford buying DataStax Search
>
> Sent using Zoho Mail <https://www.zoho.com/mail/>
>
>
> ---- On Tue, 31 Jul 2018 19:38:28 +0430 *Durity, Sean R
> <SEAN_R_DURITY@homedepot.com <SE...@homedepot.com>>* wrote ----
>
> That sounds like a problem tailor-made for the DataStax Search (embedded
> SOLR) solution. I think that would be the fastest path to success.
>
>
>
>
>
> Sean Durity
>
>
>
> *From:* onmstester onmstester <on...@zoho.com>
> *Sent:* Tuesday, July 31, 2018 10:46 AM
> *To:* user <us...@cassandra.apache.org>
> *Subject:* [EXTERNAL] full text search on some text columns
>
>
>
> I need to do a full text search (like) on one of my clustering keys and
> one of partition keys (it use text as data type). The input rate is high so
> only Cassandra could handle it, Is there any open source version project
> which help using cassandra+ solr or cassandra + elastic?
>
> Any Recommendation on doing this with home-made solutions would be
> appreciated?
>
>
>
> Sent using Zoho Mail
> <https://urldefense.proofpoint.com/v2/url?u=https-3A__www.zoho.com_mail_&d=DwMCaQ&c=MtgQEAMQGqekjTjiAhkudQ&r=aC_gxC6z_4f9GLlbWiKzHm1vucZTtVYWDDvyLkh8IaQ&m=UBaju60JDLVhH7F7spCpDXFDBHek3FhzpQwQx9rupDQ&s=CAZxnYcVYthtRXA0895OqcIfD97V7N8xU_QGW2c4zRw&e=>
>
>
>
>
>
> ------------------------------
>
> The information in this Internet Email is confidential and may be legally
> privileged. It is intended solely for the addressee. Access to this Email
> by anyone else is unauthorized. If you are not the intended recipient, any
> disclosure, copying, distribution or any action taken or omitted to be
> taken in reliance on it, is prohibited and may be unlawful. When addressed
> to our clients any opinions or advice contained in this Email are subject
> to the terms and conditions expressed in any applicable governing The Home
> Depot terms of business or client engagement letter. The Home Depot
> disclaims all responsibility and liability for the accuracy and content of
> this attachment and for any damages or losses arising from any
> inaccuracies, errors, viruses, e.g., worms, trojan horses, etc., or other
> items of a destructive nature, which may be contained in this attachment
> and shall not be liable for direct, indirect, consequential or special
> damages in connection with this e-mail message or its attachment.
>
>
>
>
RE: [EXTERNAL] full text search on some text columns
Posted by onmstester onmstester <on...@zoho.com>.
Actually we can't afford buying DataStax Search Sent using Zoho Mail ---- On Tue, 31 Jul 2018 19:38:28 +0430 Durity, Sean R <SE...@homedepot.com> wrote ---- That sounds like a problem tailor-made for the DataStax Search (embedded SOLR) solution. I think that would be the fastest path to success. Sean Durity From: onmstester onmstester <on...@zoho.com> Sent: Tuesday, July 31, 2018 10:46 AM To: user <us...@cassandra.apache.org> Subject: [EXTERNAL] full text search on some text columns I need to do a full text search (like) on one of my clustering keys and one of partition keys (it use text as data type). The input rate is high so only Cassandra could handle it, Is there any open source version project which help using cassandra+ solr or cassandra + elastic? Any Recommendation on doing this with home-made solutions would be appreciated? Sent using Zoho Mail The information in this Internet Email is confidential and may be legally privileged. It is intended solely for the addressee. Access to this Email by anyone else is unauthorized. If you are not the intended recipient, any disclosure, copying, distribution or any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. When addressed to our clients any opinions or advice contained in this Email are subject to the terms and conditions expressed in any applicable governing The Home Depot terms of business or client engagement letter. The Home Depot disclaims all responsibility and liability for the accuracy and content of this attachment and for any damages or losses arising from any inaccuracies, errors, viruses, e.g., worms, trojan horses, etc., or other items of a destructive nature, which may be contained in this attachment and shall not be liable for direct, indirect, consequential or special damages in connection with this e-mail message or its attachment.
RE: [EXTERNAL] full text search on some text columns
Posted by "Durity, Sean R" <SE...@homedepot.com>.
That sounds like a problem tailor-made for the DataStax Search (embedded SOLR) solution. I think that would be the fastest path to success.
Sean Durity
From: onmstester onmstester <on...@zoho.com>
Sent: Tuesday, July 31, 2018 10:46 AM
To: user <us...@cassandra.apache.org>
Subject: [EXTERNAL] full text search on some text columns
I need to do a full text search (like) on one of my clustering keys and one of partition keys (it use text as data type). The input rate is high so only Cassandra could handle it, Is there any open source version project which help using cassandra+ solr or cassandra + elastic?
Any Recommendation on doing this with home-made solutions would be appreciated?
Sent using Zoho Mail<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.zoho.com_mail_&d=DwMCaQ&c=MtgQEAMQGqekjTjiAhkudQ&r=aC_gxC6z_4f9GLlbWiKzHm1vucZTtVYWDDvyLkh8IaQ&m=UBaju60JDLVhH7F7spCpDXFDBHek3FhzpQwQx9rupDQ&s=CAZxnYcVYthtRXA0895OqcIfD97V7N8xU_QGW2c4zRw&e=>
________________________________
The information in this Internet Email is confidential and may be legally privileged. It is intended solely for the addressee. Access to this Email by anyone else is unauthorized. If you are not the intended recipient, any disclosure, copying, distribution or any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. When addressed to our clients any opinions or advice contained in this Email are subject to the terms and conditions expressed in any applicable governing The Home Depot terms of business or client engagement letter. The Home Depot disclaims all responsibility and liability for the accuracy and content of this attachment and for any damages or losses arising from any inaccuracies, errors, viruses, e.g., worms, trojan horses, etc., or other items of a destructive nature, which may be contained in this attachment and shall not be liable for direct, indirect, consequential or special damages in connection with this e-mail message or its attachment.
Re: full text search on some text columns
Posted by onmstester onmstester <on...@zoho.com>.
Thanks Jordan, There would be millions of rows per day, is SASI capable of standing such a rate? Sent using Zoho Mail ---- On Tue, 31 Jul 2018 19:47:55 +0430 Jordan West <jo...@gmail.com> wrote ---- On Tue, Jul 31, 2018 at 7:45 AM, onmstester onmstester <on...@zoho.com> wrote: I need to do a full text search (like) on one of my clustering keys and one of partition keys (it use text as data type). For simple LIKE queries on existing columns you could give SASI (https://docs.datastax.com/en/dse/5.1/cql/cql/cql_using/useSASIIndex.html) a try without having to stand up a separate piece of software. Its relatively new and isn’t as battle tested as other parts of Cassandra but it has been used in production. There are some performance issues with wider-CQL partitions if you have those (https://issues.apache.org/jira/browse/CASSANDRA-11990). I hope to address that for 4.0, time permitted. Full disclosure, I was one of the original SASI authors. The input rate is high so only Cassandra could handle it, Is there any open source version project which help using cassandra+ solr or cassandra + elastic? Any Recommendation on doing this with home-made solutions would be appreciated? Sent using Zoho Mail
Re: full text search on some text columns
Posted by DuyHai Doan <do...@gmail.com>.
I had SASI in mind before stopping myself from replying to this thread.
Actually the OP needs to index clustering column and partition key, and as
far as I remember, I've myself opened a JIRA and pushed a patch for SASI to
support indexing composite partition key but there are some issues so far
preventing this to be merged into trunk
https://issues.apache.org/jira/browse/CASSANDRA-11734
https://issues.apache.org/jira/browse/CASSANDRA-13228
On Tue, Jul 31, 2018 at 5:17 PM, Jordan West <jo...@gmail.com> wrote:
>
>
> On Tue, Jul 31, 2018 at 7:45 AM, onmstester onmstester <
> onmstester@zoho.com> wrote:
>
>> I need to do a full text search (like) on one of my clustering keys and
>> one of partition keys (it use text as data type).
>>
>
> For simple LIKE queries on existing columns you could give SASI (
> https://docs.datastax.com/en/dse/5.1/cql/cql/cql_using/useSASIIndex.html)
> a try without having to stand up a separate piece of software. Its
> relatively new and isn’t as battle tested as other parts of Cassandra but
> it has been used in production. There are some performance issues with
> wider-CQL partitions if you have those (https://issues.apache.org/
> jira/browse/CASSANDRA-11990). I hope to address that for 4.0, time
> permitted.
>
> Full disclosure, I was one of the original SASI authors.
>
>
>> The input rate is high so only Cassandra could handle it, Is there any
>> open source version project which help using cassandra+ solr or cassandra +
>> elastic?
>> Any Recommendation on doing this with home-made solutions would be
>> appreciated?
>>
>> Sent using Zoho Mail <https://www.zoho.com/mail/>
>>
>>
>
>
>
Re: full text search on some text columns
Posted by Jordan West <jo...@gmail.com>.
On Tue, Jul 31, 2018 at 7:45 AM, onmstester onmstester <on...@zoho.com>
wrote:
> I need to do a full text search (like) on one of my clustering keys and
> one of partition keys (it use text as data type).
>
For simple LIKE queries on existing columns you could give SASI (
https://docs.datastax.com/en/dse/5.1/cql/cql/cql_using/useSASIIndex.html) a
try without having to stand up a separate piece of software. Its relatively
new and isn’t as battle tested as other parts of Cassandra but it has been
used in production. There are some performance issues with wider-CQL
partitions if you have those (
https://issues.apache.org/jira/browse/CASSANDRA-11990). I hope to address
that for 4.0, time permitted.
Full disclosure, I was one of the original SASI authors.
> The input rate is high so only Cassandra could handle it, Is there any
> open source version project which help using cassandra+ solr or cassandra +
> elastic?
> Any Recommendation on doing this with home-made solutions would be
> appreciated?
>
> Sent using Zoho Mail <https://www.zoho.com/mail/>
>
>