You are viewing a plain text version of this content. The canonical link for it is here.

Posted to solr-user@lucene.apache.org by Miguel <mi...@juntadeandalucia.es> on 2013/02/19 18:10:48 UTC

get content is put in the index queue but is not committed

Hi everybody

  Anybody know how-to get content is put in the index queue but is not 
committed?
I am developing a custom UpdateRequestProcessorFactory and in the ADD 
Event I see the documents, and I would need to access this same 
documents in the Commit event. When the add event has implicit commit I 
can access to the data, but when the commit event is alone after add 
event I don't see like I have to do.

Any ideas?
Thanks.

Re: Solr UIMA

Posted by Alexandre Rafalovitch <ar...@gmail.com>.

Why not just reindex? I could think of a couple of ugly hacks, but reindex
is better first option.

Regards,
    Alex
On 20 Feb 2013 15:43, "jazz" <ja...@me.com> wrote:

> Hi,
>
> I managed to get Solr and UIMA work together. When I send a document to
> Solr it annotates the field "contents" and adds the result of the UIMA
> annotations to e.g. a field "location". My question is: how do I annotate
> the contents of an already existing solr database without triggering an
> /update ? My UIMA processor defaults for an /update command.
> I was thinking about exporting the contents and re-importing it but that
> seems too complex using the DIH. Is there a smarter way?
>
> Regards Bart

Re: Solr UIMA

Posted by Chris Hostetter <ho...@fucit.org>.

: Subject: Solr UIMA
: References: <51...@juntadeandalucia.es>
: In-reply-to: <51...@juntadeandalucia.es>

https://people.apache.org/~hossman/#threadhijack
Thread Hijacking on Mailing Lists

When starting a new discussion on a mailing list, please do not reply to 
an existing message, instead start a fresh email.  Even if you change the 
subject line of your email, other mail headers still track which thread 
you replied to and your question is "hidden" in that thread and gets less 
attention.   It makes following discussions in the mailing list archives 
particularly difficult.


-Hoss

Re: Solr UIMA

Posted by Tommaso Teofili <to...@gmail.com>.

Hi Bart,

I think the only way you can do that is by reindexing, or maybe by just
doing a dummy atomic update [1] to each of the documents (e.g. adding or
changing a field of type 'ignored' or something like that) that weren't
"tagged" by UIMA before.

Regards,
Tommaso

[1] : http://wiki.apache.org/solr/Atomic_Updates


2013/2/21 jazzsalsa <ja...@me.com>

> Reposted because I did not arrive at the list (I didn't see it)
>
>
> On Feb 20, 2013, at 12:42 PM, jazz <ja...@me.com> wrote:
>
> Hi,
>
> I managed to get Solr and UIMA work together. When I send a document to
> Solr it annotates the field "contents" and adds the result of the UIMA
> annotations to e.g. a field "location". My question is: how do I annotate
> the contents of an already existing solr database without triggering an
> /update ? My UIMA processor defaults for an /update command.
> I was thinking about exporting the contents and re-importing it but that
> seems too complex using the DIH. Is there a smarter way?
>
> Regards Bart
>
>

Solr UIMA

Posted by jazzsalsa <ja...@me.com>.

Reposted because I did not arrive at the list (I didn't see it)

On Feb 20, 2013, at 12:42 PM, jazz <ja...@me.com> wrote:

Hi,

I managed to get Solr and UIMA work together. When I send a document to Solr it annotates the field "contents" and adds the result of the UIMA annotations to e.g. a field "location". My question is: how do I annotate the contents of an already existing solr database without triggering an /update ? My UIMA processor defaults for an /update command. 
I was thinking about exporting the contents and re-importing it but that seems too complex using the DIH. Is there a smarter way?

Regards Bart

Solr UIMA

Posted by jazz <ja...@me.com>.

Hi,

I managed to get Solr and UIMA work together. When I send a document to Solr it annotates the field "contents" and adds the result of the UIMA annotations to e.g. a field "location". My question is: how do I annotate the contents of an already existing solr database without triggering an /update ? My UIMA processor defaults for an /update command. 
I was thinking about exporting the contents and re-importing it but that seems too complex using the DIH. Is there a smarter way?

Regards Bart

Re: get content is put in the index queue but is not committed

Posted by Miguel <mi...@juntadeandalucia.es>.

Thanks Cris

     I'm going to see both UpdateLog and RealTimeGetComponent classes, 
but I not sure if I could use them because I'm working with apache solr 
version 1.4.1, (I know is older).
Anyway I'll tell you my problem. I am developing a custom class extend 
from UpdateRequestProcessorFactory. This class must save in database all 
modifications from Solr server (Add, Update and Delete actions), but  
save in database must happen, always, when commit event was done.
My problem is, clients of solr server do explicit commit, so I receive 
first update event and after commit event and in this last I have to 
recovered docs from update event, and I wanted to know if it was possible.

At the least, I am going to go another way and I will use a status field 
in database. Status field allow save docs in database at update event 
and my other process do not use them until I change value of status 
field on commit event.

thanks very much
I am learning much Solr in this list

El 21/02/2013 19:34, Chris Hostetter escribió:
> :  Anybody know how-to get content is put in the index queue but is not
> : committed?
>
> i'm guessing you are refering to uncommited documents in the transaction
> log?  Take a look at the UpdateLog class, and how it's used by the
> RealTimeGetComponent.
>
> If you provide more details as to what you end goal is, we might be able
> to provide more specific (or alternative) suggestions on how to achieve
> your goal...
>
>
> https://people.apache.org/~hossman/#xyproblem
> XY Problem
>
> Your question appears to be an "XY Problem" ... that is: you are dealing
> with "X", you are assuming "Y" will help you, and you are asking about "Y"
> without giving more details about the "X" so that we can understand the
> full issue.  Perhaps the best solution doesn't involve "Y" at all?
> See Also: http://www.perlmonks.org/index.pl?node_id=542341
>
>
> -Hoss
>

Re: get content is put in the index queue but is not committed

Posted by Chris Hostetter <ho...@fucit.org>.

:  Anybody know how-to get content is put in the index queue but is not
: committed?

i'm guessing you are refering to uncommited documents in the transaction 
log?  Take a look at the UpdateLog class, and how it's used by the 
RealTimeGetComponent.

If you provide more details as to what you end goal is, we might be able 
to provide more specific (or alternative) suggestions on how to achieve 
your goal...


https://people.apache.org/~hossman/#xyproblem
XY Problem

Your question appears to be an "XY Problem" ... that is: you are dealing
with "X", you are assuming "Y" will help you, and you are asking about "Y"
without giving more details about the "X" so that we can understand the
full issue.  Perhaps the best solution doesn't involve "Y" at all?
See Also: http://www.perlmonks.org/index.pl?node_id=542341


-Hoss