You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-dev@lucene.apache.org by "kiran sugana (JIRA)" <ji...@apache.org> on 2009/08/21 03:24:14 UTC
[jira] Created: (SOLR-1376) invalid links to solr indexes after a
new index is created
invalid links to solr indexes after a new index is created
----------------------------------------------------------
Key: SOLR-1376
URL: https://issues.apache.org/jira/browse/SOLR-1376
Project: Solr
Issue Type: Bug
Components: clients - java
Affects Versions: 1.3
Reporter: kiran sugana
Fix For: 1.4
After new index is created, it does not delete the links to the old indexes,
To recreate the issue,
1) do a incremental indexing
2) cd /proc/[java pid/fd
3) ls -la
{code}
lr-x------ 1 solr roleusers 64 Jul 23 17:31 75 -> /home/..../solrhome/data/index/_kja.fdx (deleted)
lr-x------ 1 solr roleusers 64 Jul 23 17:31 76 -> /home/...../solrhome/data/index/_kk4.tis (deleted)
lr-x------ 1 solr roleusers 64 Jul 23 17:31 78 -> /home/..../solrhome/data/index/_kk4.frq (deleted)
lr-x------ 1 solr roleusers 64 Jul 23 17:31 79 -> /home/..../solrhome/data/index/_kk4.prx (deleted)
{code}
This is creating performance issues, (search slows down significantly)
Temp Resolution:
---- Restart solr
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (SOLR-1376) invalid links to solr indexes after a
new index is created
Posted by "kiran sugana (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12746035#action_12746035 ]
kiran sugana commented on SOLR-1376:
------------------------------------
Hi Hoss,
By incremental indexing I meant commits,I do not know for sure list of deleted files grows over the time. we noticed the issue when solr became slow or unresponsive on the machine, which solr has not been restarted for a while. I will investigate if the deleted files list is growing.
Kiran
> invalid links to solr indexes after a new index is created
> ----------------------------------------------------------
>
> Key: SOLR-1376
> URL: https://issues.apache.org/jira/browse/SOLR-1376
> Project: Solr
> Issue Type: Bug
> Components: clients - java
> Affects Versions: 1.3
> Reporter: kiran sugana
> Fix For: 1.4
>
>
> After new index is created, it does not delete the links to the old indexes,
> To recreate the issue,
> 1) do a incremental indexing
> 2) cd /proc/[JAVA_PID]/fd
> 3) ls -la
> {code}
> lr-x------ 1 solr roleusers 64 Jul 23 17:31 75 -> /home/..../solrhome/data/index/_kja.fdx (deleted)
> lr-x------ 1 solr roleusers 64 Jul 23 17:31 76 -> /home/...../solrhome/data/index/_kk4.tis (deleted)
> lr-x------ 1 solr roleusers 64 Jul 23 17:31 78 -> /home/..../solrhome/data/index/_kk4.frq (deleted)
> lr-x------ 1 solr roleusers 64 Jul 23 17:31 79 -> /home/..../solrhome/data/index/_kk4.prx (deleted)
> {code}
> This is creating performance issues, (search slows down significantly)
> Temp Resolution:
> ---- Restart solr
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (SOLR-1376) invalid links to solr indexes after a
new index is created
Posted by "Hoss Man (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12745766#action_12745766 ]
Hoss Man commented on SOLR-1376:
--------------------------------
w/o more info, there is no actual evidence of a bug.
Lucene/Solr keeps open refrences to deleted files all the time as part of normal searching -- that's how a consistent view of the index is presented to all users of an IndexSearcher while background updates (which may result in merged segments, which results in deleted files) are taking place.
triggering a commit closes the old searcher and opens a new one, when the old searcher closes the handles to the (deleted) files are closed.
you didn't mention wether you were doing any commits -- if you have evidence that the list of open but deleted files grows over time even as commits happen then there's a potential problem, but since i can't reproduce that we'll need more specifics about your environment, and what exactly you mean by "do a incremental indexing"
> invalid links to solr indexes after a new index is created
> ----------------------------------------------------------
>
> Key: SOLR-1376
> URL: https://issues.apache.org/jira/browse/SOLR-1376
> Project: Solr
> Issue Type: Bug
> Components: clients - java
> Affects Versions: 1.3
> Reporter: kiran sugana
> Fix For: 1.4
>
>
> After new index is created, it does not delete the links to the old indexes,
> To recreate the issue,
> 1) do a incremental indexing
> 2) cd /proc/[JAVA_PID]/fd
> 3) ls -la
> {code}
> lr-x------ 1 solr roleusers 64 Jul 23 17:31 75 -> /home/..../solrhome/data/index/_kja.fdx (deleted)
> lr-x------ 1 solr roleusers 64 Jul 23 17:31 76 -> /home/...../solrhome/data/index/_kk4.tis (deleted)
> lr-x------ 1 solr roleusers 64 Jul 23 17:31 78 -> /home/..../solrhome/data/index/_kk4.frq (deleted)
> lr-x------ 1 solr roleusers 64 Jul 23 17:31 79 -> /home/..../solrhome/data/index/_kk4.prx (deleted)
> {code}
> This is creating performance issues, (search slows down significantly)
> Temp Resolution:
> ---- Restart solr
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (SOLR-1376) invalid links to solr indexes after a
new index is created
Posted by "Hoss Man (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hoss Man resolved SOLR-1376.
----------------------------
Resolution: Cannot Reproduce
no evidence presented of an actual problem .. can be reopened if reproducible test case is provided.
> invalid links to solr indexes after a new index is created
> ----------------------------------------------------------
>
> Key: SOLR-1376
> URL: https://issues.apache.org/jira/browse/SOLR-1376
> Project: Solr
> Issue Type: Bug
> Components: clients - java
> Affects Versions: 1.3
> Reporter: kiran sugana
> Fix For: 1.4
>
>
> After new index is created, it does not delete the links to the old indexes,
> To recreate the issue,
> 1) do a incremental indexing
> 2) cd /proc/[JAVA_PID]/fd
> 3) ls -la
> {code}
> lr-x------ 1 solr roleusers 64 Jul 23 17:31 75 -> /home/..../solrhome/data/index/_kja.fdx (deleted)
> lr-x------ 1 solr roleusers 64 Jul 23 17:31 76 -> /home/...../solrhome/data/index/_kk4.tis (deleted)
> lr-x------ 1 solr roleusers 64 Jul 23 17:31 78 -> /home/..../solrhome/data/index/_kk4.frq (deleted)
> lr-x------ 1 solr roleusers 64 Jul 23 17:31 79 -> /home/..../solrhome/data/index/_kk4.prx (deleted)
> {code}
> This is creating performance issues, (search slows down significantly)
> Temp Resolution:
> ---- Restart solr
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (SOLR-1376) invalid links to solr indexes after a
new index is created
Posted by "kiran sugana (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
kiran sugana updated SOLR-1376:
-------------------------------
Description:
After new index is created, it does not delete the links to the old indexes,
To recreate the issue,
1) do a incremental indexing
2) cd /proc/[JAVA_PID]/fd
3) ls -la
{code}
lr-x------ 1 solr roleusers 64 Jul 23 17:31 75 -> /home/..../solrhome/data/index/_kja.fdx (deleted)
lr-x------ 1 solr roleusers 64 Jul 23 17:31 76 -> /home/...../solrhome/data/index/_kk4.tis (deleted)
lr-x------ 1 solr roleusers 64 Jul 23 17:31 78 -> /home/..../solrhome/data/index/_kk4.frq (deleted)
lr-x------ 1 solr roleusers 64 Jul 23 17:31 79 -> /home/..../solrhome/data/index/_kk4.prx (deleted)
{code}
This is creating performance issues, (search slows down significantly)
Temp Resolution:
---- Restart solr
was:
After new index is created, it does not delete the links to the old indexes,
To recreate the issue,
1) do a incremental indexing
2) cd /proc/[java pid/fd
3) ls -la
{code}
lr-x------ 1 solr roleusers 64 Jul 23 17:31 75 -> /home/..../solrhome/data/index/_kja.fdx (deleted)
lr-x------ 1 solr roleusers 64 Jul 23 17:31 76 -> /home/...../solrhome/data/index/_kk4.tis (deleted)
lr-x------ 1 solr roleusers 64 Jul 23 17:31 78 -> /home/..../solrhome/data/index/_kk4.frq (deleted)
lr-x------ 1 solr roleusers 64 Jul 23 17:31 79 -> /home/..../solrhome/data/index/_kk4.prx (deleted)
{code}
This is creating performance issues, (search slows down significantly)
Temp Resolution:
---- Restart solr
> invalid links to solr indexes after a new index is created
> ----------------------------------------------------------
>
> Key: SOLR-1376
> URL: https://issues.apache.org/jira/browse/SOLR-1376
> Project: Solr
> Issue Type: Bug
> Components: clients - java
> Affects Versions: 1.3
> Reporter: kiran sugana
> Fix For: 1.4
>
>
> After new index is created, it does not delete the links to the old indexes,
> To recreate the issue,
> 1) do a incremental indexing
> 2) cd /proc/[JAVA_PID]/fd
> 3) ls -la
> {code}
> lr-x------ 1 solr roleusers 64 Jul 23 17:31 75 -> /home/..../solrhome/data/index/_kja.fdx (deleted)
> lr-x------ 1 solr roleusers 64 Jul 23 17:31 76 -> /home/...../solrhome/data/index/_kk4.tis (deleted)
> lr-x------ 1 solr roleusers 64 Jul 23 17:31 78 -> /home/..../solrhome/data/index/_kk4.frq (deleted)
> lr-x------ 1 solr roleusers 64 Jul 23 17:31 79 -> /home/..../solrhome/data/index/_kk4.prx (deleted)
> {code}
> This is creating performance issues, (search slows down significantly)
> Temp Resolution:
> ---- Restart solr
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.