You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Hans Zhou <Ha...@wgsn.com> on 2017/02/01 17:53:38 UTC

Do long auto commit times interfere with delete?

We have a solr cloud with a pretty long auto commit time (30 seconds for a hard commit, 180 seconds for a soft commit).

We’re also doing lots of delete-then-insert operations.
i.e. Each document has a product.id, and to update a product, we do an update request with

{
"delete": {
"query": "product.id:(33624518)"
},
"add": [
{
"id": "product.33624518”,
//… etc etc
}
]
}

If we do multiple back-to-back index operations inside an auto-commit time window, will the delete query fail to pick up the previously indexed documents?

________________________________

WGSN is a global foresight business. Our experts provide deep insight and analysis of consumer, fashion and design trends. We inspire our clients to plan and trade their range with unparalleled confidence and accuracy. Together, we Create Tomorrow.

WGSN<http://www.wgsn.com/> is part of WGSN Limited, comprising of market-leading products including WGSN.com<http://www.wgsn.com>, WGSN Lifestyle & Interiors<http://www.wgsn.com/en/lifestyle-interiors>, WGSN INstock<http://www.wgsninstock.com/>, WGSN StyleTrial<http://www.wgsn.com/en/styletrial/> and WGSN Mindset<http://www.wgsn.com/en/services/consultancy/>, our bespoke consultancy services.

The information in or attached to this email is confidential and may be legally privileged. If you are not the intended recipient of this message, any use, disclosure, copying, distribution or any action taken in reliance on it is prohibited and may be unlawful. If you have received this message in error, please notify the sender immediately by return email and delete this message and any copies from your computer and network. WGSN does not warrant that this email and any attachments are free from viruses and accepts no liability for any loss resulting from infected email transmissions.

WGSN reserves the right to monitor all email through its networks. Any views expressed may be those of the originator and not necessarily of WGSN. WGSN is powered by Ascential plc<http://www.ascential.com>, which transforms knowledge businesses to deliver exceptional performance.

Please be advised all phone calls may be recorded for training and quality purposes and by accepting and/or making calls from and/or to us you acknowledge and agree to calls being recorded.

WGSN Limited, Company number 4858491

registered address:

Ascential plc, The Prow, 1 Wilder Walk, London W1B 5AP

WGSN Inc., tax ID 04-3851246, registered office c/o National Registered Agents, Inc., 160 Greentree Drive, Suite 101, Dover DE 19904, United States

4C Serviços de Informação Ltda., CNPJ/MF (Taxpayer's Register): 15.536.968/0001-04, Address: Avenida Cidade Jardim, 377, 7˚ andar CEP 01453-000, Itaim Bibi, São Paulo

4C Business Information Consulting (Shanghai) Co., Ltd, 富新商务信息咨询(上海)有限公司, registered address Unit 4810/4811, 48/F Tower 1, Grand Gateway, 1 Hong Qiao Road, Xuhui District, Shanghai

Re: Do long auto commit times interfere with delete?

Posted by Erick Erickson <er...@gmail.com>.
This should work fine. There is no requirement that a commit happen
between updates and deletes for the same document. That said, this can
be tricky so if you have a demonstrable case where this isn't so let
us know.

Best,
Erick


On Wed, Feb 1, 2017 at 9:53 AM, Hans Zhou <Ha...@wgsn.com> wrote:
> We have a solr cloud with a pretty long auto commit time (30 seconds for a hard commit, 180 seconds for a soft commit).
>
> We’re also doing lots of delete-then-insert operations.
> i.e. Each document has a product.id, and to update a product, we do an update request with
>
> {
> "delete": {
> "query": "product.id:(33624518)"
> },
> "add": [
> {
> "id": "product.33624518”,
> //… etc etc
> }
> ]
> }
>
> If we do multiple back-to-back index operations inside an auto-commit time window, will the delete query fail to pick up the previously indexed documents?
>
> ________________________________
>
> WGSN is a global foresight business. Our experts provide deep insight and analysis of consumer, fashion and design trends. We inspire our clients to plan and trade their range with unparalleled confidence and accuracy. Together, we Create Tomorrow.
>
> WGSN<http://www.wgsn.com/> is part of WGSN Limited, comprising of market-leading products including WGSN.com<http://www.wgsn.com>, WGSN Lifestyle & Interiors<http://www.wgsn.com/en/lifestyle-interiors>, WGSN INstock<http://www.wgsninstock.com/>, WGSN StyleTrial<http://www.wgsn.com/en/styletrial/> and WGSN Mindset<http://www.wgsn.com/en/services/consultancy/>, our bespoke consultancy services.
>
> The information in or attached to this email is confidential and may be legally privileged. If you are not the intended recipient of this message, any use, disclosure, copying, distribution or any action taken in reliance on it is prohibited and may be unlawful. If you have received this message in error, please notify the sender immediately by return email and delete this message and any copies from your computer and network. WGSN does not warrant that this email and any attachments are free from viruses and accepts no liability for any loss resulting from infected email transmissions.
>
> WGSN reserves the right to monitor all email through its networks. Any views expressed may be those of the originator and not necessarily of WGSN. WGSN is powered by Ascential plc<http://www.ascential.com>, which transforms knowledge businesses to deliver exceptional performance.
>
> Please be advised all phone calls may be recorded for training and quality purposes and by accepting and/or making calls from and/or to us you acknowledge and agree to calls being recorded.
>
> WGSN Limited, Company number 4858491
>
> registered address:
>
> Ascential plc, The Prow, 1 Wilder Walk, London W1B 5AP
>
> WGSN Inc., tax ID 04-3851246, registered office c/o National Registered Agents, Inc., 160 Greentree Drive, Suite 101, Dover DE 19904, United States
>
> 4C Serviços de Informação Ltda., CNPJ/MF (Taxpayer's Register): 15.536.968/0001-04, Address: Avenida Cidade Jardim, 377, 7˚ andar CEP 01453-000, Itaim Bibi, São Paulo
>
> 4C Business Information Consulting (Shanghai) Co., Ltd, 富新商务信息咨询(上海)有限公司, registered address Unit 4810/4811, 48/F Tower 1, Grand Gateway, 1 Hong Qiao Road, Xuhui District, Shanghai