You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by "Miller, William K - Norman, OK - Contractor" <Wi...@usps.gov.INVALID> on 2017/06/07 16:46:00 UTC
Re-Index is not working
Hello, I am new to this mailing list and I am having a problem with re-indexing. I will run an index on an xml file using the DataImportHandler and it will index the file. Then I delete the index using the <delete><query>*:*</query><delete>, <commit/>, and <optimize/> commands. Then I attempt to re-index the same file with the same configuration in my dataConfig file for the DIH, but it fails to index the file. If I make a change to the xml file that is being indexed and re-index it works.
I don't understand why this is happening. Any help with this will be appreciated.
~~~~~~~~~~~~~~~~~~~~~~~
William Kevin Miller
[ecsLogo]
ECS Federal, Inc.
USPS/MTSC
(405) 573-2158
Re: Re-Index is not working
Posted by Erick Erickson <er...@gmail.com>.
Thanks for bring closure to that.
Erick
On Thu, Jun 8, 2017 at 9:12 AM, Miller, William K - Norman, OK -
Contractor <Wi...@usps.gov.invalid> wrote:
> I figured out why it was not re-indexing without changing the timestamp even on the full import. In my DIH I had a parameter in my top level entity that was checking for the last indexed time.
>
>
>
>
> ~~~~~~~~~~~~~~~~~~~~~~~
> William Kevin Miller
>
> ECS Federal, Inc.
> USPS/MTSC
> (405) 573-2158
>
>
> -----Original Message-----
> From: Miller, William K - Norman, OK - Contractor
> Sent: Thursday, June 08, 2017 10:12 AM
> To: 'solr-user@lucene.apache.org'
> Subject: RE: Re-Index is not working
>
> Sorry I did not give enough information.
>
> "doesn't work" does mean that the documents are not getting indexed. I am using a full import. I did discover that if I used the Linux touch command that the document would re-index. I don't have any of the logs as I have been able to get the documents to index. You mentioned that the delta import would need the timestamp to change to index the documents again, but does the full import need this change as well?
>
>
>
>
> ~~~~~~~~~~~~~~~~~~~~~~~
> William Kevin Miller
>
> ECS Federal, Inc.
> USPS/MTSC
> (405) 573-2158
>
>
> -----Original Message-----
> From: Erick Erickson [mailto:erickerickson@gmail.com]
> Sent: Wednesday, June 07, 2017 11:06 PM
> To: solr-user
> Subject: Re: Re-Index is not working
>
> What does "doesn't work" mean? No documents get indexed? Are you doing a full import or a delta import? If the latter, the timestamp not having changed is probably causing the doc to be skipped. What does the Solr log say?
>
> Best,
> Erick
>
> On Wed, Jun 7, 2017 at 9:46 AM, Miller, William K - Norman, OK - Contractor <Wi...@usps.gov.invalid> wrote:
>
>> Hello, I am new to this mailing list and I am having a problem with
>> re-indexing. I will run an index on an xml file using the
>> DataImportHandler and it will index the file. Then I delete the index
>> using the <delete><query>*:*</query><delete>, <commit/>, and
>> <optimize/> commands. Then I attempt to re-index the same file with
>> the same configuration in my dataConfig file for the DIH, but it fails
>> to index the file. If I make a change to the xml file that is being
>> indexed and re-index it works.
>>
>>
>>
>> I don’t understand why this is happening. Any help with this will be
>> appreciated.
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> ~~~~~~~~~~~~~~~~~~~~~~~
>>
>> William Kevin Miller
>>
>> [image: ecsLogo]
>>
>> ECS Federal, Inc.
>>
>> USPS/MTSC
>>
>> (405) 573-2158
>>
>>
>>
RE: Re-Index is not working
Posted by "Miller, William K - Norman, OK - Contractor" <Wi...@usps.gov.INVALID>.
I figured out why it was not re-indexing without changing the timestamp even on the full import. In my DIH I had a parameter in my top level entity that was checking for the last indexed time.
~~~~~~~~~~~~~~~~~~~~~~~
William Kevin Miller
ECS Federal, Inc.
USPS/MTSC
(405) 573-2158
-----Original Message-----
From: Miller, William K - Norman, OK - Contractor
Sent: Thursday, June 08, 2017 10:12 AM
To: 'solr-user@lucene.apache.org'
Subject: RE: Re-Index is not working
Sorry I did not give enough information.
"doesn't work" does mean that the documents are not getting indexed. I am using a full import. I did discover that if I used the Linux touch command that the document would re-index. I don't have any of the logs as I have been able to get the documents to index. You mentioned that the delta import would need the timestamp to change to index the documents again, but does the full import need this change as well?
~~~~~~~~~~~~~~~~~~~~~~~
William Kevin Miller
ECS Federal, Inc.
USPS/MTSC
(405) 573-2158
-----Original Message-----
From: Erick Erickson [mailto:erickerickson@gmail.com]
Sent: Wednesday, June 07, 2017 11:06 PM
To: solr-user
Subject: Re: Re-Index is not working
What does "doesn't work" mean? No documents get indexed? Are you doing a full import or a delta import? If the latter, the timestamp not having changed is probably causing the doc to be skipped. What does the Solr log say?
Best,
Erick
On Wed, Jun 7, 2017 at 9:46 AM, Miller, William K - Norman, OK - Contractor <Wi...@usps.gov.invalid> wrote:
> Hello, I am new to this mailing list and I am having a problem with
> re-indexing. I will run an index on an xml file using the
> DataImportHandler and it will index the file. Then I delete the index
> using the <delete><query>*:*</query><delete>, <commit/>, and
> <optimize/> commands. Then I attempt to re-index the same file with
> the same configuration in my dataConfig file for the DIH, but it fails
> to index the file. If I make a change to the xml file that is being
> indexed and re-index it works.
>
>
>
> I don’t understand why this is happening. Any help with this will be
> appreciated.
>
>
>
>
>
>
>
>
>
>
>
> ~~~~~~~~~~~~~~~~~~~~~~~
>
> William Kevin Miller
>
> [image: ecsLogo]
>
> ECS Federal, Inc.
>
> USPS/MTSC
>
> (405) 573-2158
>
>
>
RE: Re-Index is not working
Posted by "Miller, William K - Norman, OK - Contractor" <Wi...@usps.gov.INVALID>.
Sorry I did not give enough information.
"doesn't work" does mean that the documents are not getting indexed. I am using a full import. I did discover that if I used the Linux touch command that the document would re-index. I don't have any of the logs as I have been able to get the documents to index. You mentioned that the delta import would need the timestamp to change to index the documents again, but does the full import need this change as well?
~~~~~~~~~~~~~~~~~~~~~~~
William Kevin Miller
ECS Federal, Inc.
USPS/MTSC
(405) 573-2158
-----Original Message-----
From: Erick Erickson [mailto:erickerickson@gmail.com]
Sent: Wednesday, June 07, 2017 11:06 PM
To: solr-user
Subject: Re: Re-Index is not working
What does "doesn't work" mean? No documents get indexed? Are you doing a full import or a delta import? If the latter, the timestamp not having changed is probably causing the doc to be skipped. What does the Solr log say?
Best,
Erick
On Wed, Jun 7, 2017 at 9:46 AM, Miller, William K - Norman, OK - Contractor <Wi...@usps.gov.invalid> wrote:
> Hello, I am new to this mailing list and I am having a problem with
> re-indexing. I will run an index on an xml file using the
> DataImportHandler and it will index the file. Then I delete the index
> using the <delete><query>*:*</query><delete>, <commit/>, and
> <optimize/> commands. Then I attempt to re-index the same file with
> the same configuration in my dataConfig file for the DIH, but it fails
> to index the file. If I make a change to the xml file that is being
> indexed and re-index it works.
>
>
>
> I don’t understand why this is happening. Any help with this will be
> appreciated.
>
>
>
>
>
>
>
>
>
>
>
> ~~~~~~~~~~~~~~~~~~~~~~~
>
> William Kevin Miller
>
> [image: ecsLogo]
>
> ECS Federal, Inc.
>
> USPS/MTSC
>
> (405) 573-2158
>
>
>
Re: Re-Index is not working
Posted by Erick Erickson <er...@gmail.com>.
What does "doesn't work" mean? No documents get indexed? Are you doing a
full import or a delta import? If the latter, the timestamp not having
changed is probably causing the doc to be skipped. What does the Solr log
say?
Best,
Erick
On Wed, Jun 7, 2017 at 9:46 AM, Miller, William K - Norman, OK - Contractor
<Wi...@usps.gov.invalid> wrote:
> Hello, I am new to this mailing list and I am having a problem with
> re-indexing. I will run an index on an xml file using the
> DataImportHandler and it will index the file. Then I delete the index
> using the <delete><query>*:*</query><delete>, <commit/>, and <optimize/>
> commands. Then I attempt to re-index the same file with the same
> configuration in my dataConfig file for the DIH, but it fails to index the
> file. If I make a change to the xml file that is being indexed and
> re-index it works.
>
>
>
> I don’t understand why this is happening. Any help with this will be
> appreciated.
>
>
>
>
>
>
>
>
>
>
>
> ~~~~~~~~~~~~~~~~~~~~~~~
>
> William Kevin Miller
>
> [image: ecsLogo]
>
> ECS Federal, Inc.
>
> USPS/MTSC
>
> (405) 573-2158
>
>
>