You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Alejandro Rivas Martinez <al...@gmail.com> on 2017/05/26 02:57:28 UTC
A way to tell DIH (IF id already exist in current index THEN SKIP to
next file)
Hello! My name is Alejandro and I need your help ASAP!.
I'm new at SOlr and I have a situation with data import handler.
Some Context Inform...
I'm using a multi-core Solr in which each core index different kinds of
files(one core to Audios, other to Softwares...). I'm using DIH to
automatically index thousands of files from an ftp servers and extracts
metadata with tika entity processor and it works Just Fine (absoluteUrlPath
as unique id).
I'm using a social networking approach, so users can modify metadata of any
kind in a Front-end Asp.Net MVC webapp and I'm using SolrNet to communicate
Solr with .Net. When users finish to edit metadata I update the index with
the users changes, Commit and So far so good.
THE TROUBLE-----> When I run again data import handler to detect new
documents in the ftp server, it changes again all the values to default DIH
config files and the user modification, get lost.
So Am I doing something wrong, is there a way to tell Data Import Handler
something like IF id already exist THEN SKIP to next file. Any suggestion
or information that I need to know to make that requirement happen.
Thank U so much for your time And so Sorry about my english (It is not my
native language).
Re: A way to tell DIH (IF id already exist in current index THEN SKIP
to next file)
Posted by Alejandro Rivas Martinez <al...@gmail.com>.
Sorry man. Thanks 4 Ur help!
El 25 may. 2017 23:36, "David Smiley" <da...@gmail.com> escribió:
> Hello,
> You've reached the wrong list. This is the dev list; you should use the
> solr-user list.
> ~ David
>
> On Thu, May 25, 2017 at 10:57 PM Alejandro Rivas Martinez <
> alex.rivasm90@gmail.com> wrote:
>
>> Hello! My name is Alejandro and I need your help ASAP!.
>> I'm new at SOlr and I have a situation with data import handler.
>> Some Context Inform...
>> I'm using a multi-core Solr in which each core index different kinds of
>> files(one core to Audios, other to Softwares...). I'm using DIH to
>> automatically index thousands of files from an ftp servers and extracts
>> metadata with tika entity processor and it works Just Fine (absoluteUrlPath
>> as unique id).
>> I'm using a social networking approach, so users can modify metadata of
>> any kind in a Front-end Asp.Net MVC webapp and I'm using SolrNet to
>> communicate Solr with .Net. When users finish to edit metadata I update the
>> index with the users changes, Commit and So far so good.
>> THE TROUBLE-----> When I run again data import handler to detect new
>> documents in the ftp server, it changes again all the values to default DIH
>> config files and the user modification, get lost.
>> So Am I doing something wrong, is there a way to tell Data Import Handler
>> something like IF id already exist THEN SKIP to next file. Any suggestion
>> or information that I need to know to make that requirement happen.
>> Thank U so much for your time And so Sorry about my english (It is not my
>> native language).
>>
> --
> Lucene/Solr Search Committer, Consultant, Developer, Author, Speaker
> LinkedIn: http://linkedin.com/in/davidwsmiley | Book: http://www.
> solrenterprisesearchserver.com
>
Re: A way to tell DIH (IF id already exist in current index THEN SKIP
to next file)
Posted by David Smiley <da...@gmail.com>.
Hello,
You've reached the wrong list. This is the dev list; you should use the
solr-user list.
~ David
On Thu, May 25, 2017 at 10:57 PM Alejandro Rivas Martinez <
alex.rivasm90@gmail.com> wrote:
> Hello! My name is Alejandro and I need your help ASAP!.
> I'm new at SOlr and I have a situation with data import handler.
> Some Context Inform...
> I'm using a multi-core Solr in which each core index different kinds of
> files(one core to Audios, other to Softwares...). I'm using DIH to
> automatically index thousands of files from an ftp servers and extracts
> metadata with tika entity processor and it works Just Fine (absoluteUrlPath
> as unique id).
> I'm using a social networking approach, so users can modify metadata of
> any kind in a Front-end Asp.Net MVC webapp and I'm using SolrNet to
> communicate Solr with .Net. When users finish to edit metadata I update the
> index with the users changes, Commit and So far so good.
> THE TROUBLE-----> When I run again data import handler to detect new
> documents in the ftp server, it changes again all the values to default DIH
> config files and the user modification, get lost.
> So Am I doing something wrong, is there a way to tell Data Import Handler
> something like IF id already exist THEN SKIP to next file. Any suggestion
> or information that I need to know to make that requirement happen.
> Thank U so much for your time And so Sorry about my english (It is not my
> native language).
>
--
Lucene/Solr Search Committer, Consultant, Developer, Author, Speaker
LinkedIn: http://linkedin.com/in/davidwsmiley | Book:
http://www.solrenterprisesearchserver.com