You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Mike Drob (JIRA)" <ji...@apache.org> on 2015/03/04 01:22:05 UTC
[jira] [Updated] (SOLR-7187) SolrCloud does not fully clean
collection after delete
[ https://issues.apache.org/jira/browse/SOLR-7187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mike Drob updated SOLR-7187:
----------------------------
Description:
When I attempt to delete a collection using {{/admin/collections?action=DELETE&name=collection1}} if I go into HDFS I will still see remnants from the collection. No files, but empty directories stick around.
{noformat}
[root@solr1 ~]# sudo -u hdfs hdfs dfs -ls -R /solr/collection1
drwxr-xr-x - solr solr 0 2015-03-03 15:42 /solr/collection1/core_node1
drwxr-xr-x - solr solr 0 2015-03-03 15:42 /solr/collection1/core_node2
drwxr-xr-x - solr solr 0 2015-03-03 15:42 /solr/collection1/core_node3
drwxr-xr-x - solr solr 0 2015-03-03 15:42 /solr/collection1/core_node4
drwxr-xr-x - solr solr 0 2015-03-03 15:42 /solr/collection1/core_node5
drwxr-xr-x - solr solr 0 2015-03-03 15:42 /solr/collection1/core_node6
{noformat}
(Edit: I had the wrong log portion here originally)
In the logs, after deleting all the data, I see:
{noformat}
2015-03-03 16:15:14,762 INFO org.apache.solr.servlet.SolrDispatchFilter: [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&action=UNLOAD&core=collection1_shard5_replica1&wt=javabin&qt=/admin/cores&deleteDataDir=true&version=2} status=0 QTime=362
2015-03-03 16:15:14,787 INFO org.apache.solr.common.cloud.ZkStateReader: A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
2015-03-03 16:15:14,854 INFO org.apache.solr.cloud.DistributedQueue: LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
2015-03-03 16:15:14,879 INFO org.apache.solr.cloud.DistributedQueue: LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
2015-03-03 16:15:14,896 INFO org.apache.solr.cloud.DistributedQueue: LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
2015-03-03 16:15:14,920 INFO org.apache.solr.cloud.DistributedQueue: LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
2015-03-03 16:15:15,151 INFO org.apache.solr.cloud.DistributedQueue: LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
2015-03-03 16:15:15,170 INFO org.apache.solr.cloud.DistributedQueue: LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
2015-03-03 16:15:15,279 INFO org.apache.solr.common.cloud.ZkStateReader: A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
2015-03-03 16:15:15,546 INFO org.apache.solr.cloud.DistributedQueue: LatchChildWatcher fired on path: /overseer/collection-queue-work/qnr-0000000016 state: SyncConnected type NodeDataChanged
2015-03-03 16:15:15,562 INFO org.apache.solr.cloud.DistributedQueue: LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
2015-03-03 16:15:15,562 INFO org.apache.solr.cloud.OverseerCollectionProcessor: Overseer Collection Processor: Message id:/overseer/collection-queue-work/qn-0000000016 complete, response:{success={solr1.example.com:8983_solr={responseHeader={status=0,QTime=207}},solr1.example.com:8983_solr={responseHeader={status=0,QTime=243}},solr1.example.com:8983_solr={responseHeader={status=0,QTime=243}},solr1.example.com:8983_solr={responseHeader={status=0,QTime=342}},solr1.example.com:8983_solr={responseHeader={status=0,QTime=346}},solr1.example.com:8983_solr={responseHeader={status=0,QTime=362}}}}
{noformat}
This might be related to SOLR-5023, but I'm not sure.
was:
When I attempt to delete a collection using {{/admin/collections?action=DELETE&name=collection1}} if I go into HDFS I will still see remnants from the collection. No files, but empty directories stick around.
{noformat}
[root@drob-search-cdh-25682 ~]# sudo -u hdfs hdfs dfs -ls -R /solr/collection1
drwxr-xr-x - solr solr 0 2015-03-03 15:42 /solr/collection1/core_node1
drwxr-xr-x - solr solr 0 2015-03-03 15:42 /solr/collection1/core_node2
drwxr-xr-x - solr solr 0 2015-03-03 15:42 /solr/collection1/core_node3
drwxr-xr-x - solr solr 0 2015-03-03 15:42 /solr/collection1/core_node4
drwxr-xr-x - solr solr 0 2015-03-03 15:42 /solr/collection1/core_node5
drwxr-xr-x - solr solr 0 2015-03-03 15:42 /solr/collection1/core_node6
{noformat}
In the logs, after deleting all the data, I see:
{noformat}
2015-03-03 15:42:44,453 INFO org.apache.solr.handler.admin.CollectionsHandler: Deleting Collection : name=collection1&action=DELETE
2015-03-03 15:42:44,465 INFO org.apache.solr.cloud.DistributedQueue: LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
2015-03-03 15:42:44,474 INFO org.apache.solr.cloud.OverseerCollectionProcessor: Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000012 message:{
"operation":"deletecollection",
"name":"collection1"}
2015-03-03 15:42:44,474 WARN org.apache.solr.cloud.OverseerCollectionProcessor: OverseerCollectionProcessor.processMessage : deletecollection , {
"operation":"deletecollection",
"name":"collection1"}
2015-03-03 15:42:44,474 INFO org.apache.solr.cloud.OverseerCollectionProcessor: Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
2015-03-03 15:42:44,475 ERROR org.apache.solr.cloud.OverseerCollectionProcessor: Collection deletecollection of deletecollection failed:org.apache.solr.common.SolrException: Could not find collection:collection1
at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:145)
at org.apache.solr.cloud.OverseerCollectionProcessor.collectionCmd(OverseerCollectionProcessor.java:1074)
at org.apache.solr.cloud.OverseerCollectionProcessor.deleteCollection(OverseerCollectionProcessor.java:296)
at org.apache.solr.cloud.OverseerCollectionProcessor.processMessage(OverseerCollectionProcessor.java:244)
at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:171)
at java.lang.Thread.run(Thread.java:745)
2015-03-03 15:42:44,498 INFO org.apache.solr.cloud.DistributedQueue: LatchChildWatcher fired on path: /overseer/collection-queue-work/qnr-0000000012 state: SyncConnected type NodeDataChanged
2015-03-03 15:42:44,506 INFO org.apache.solr.cloud.DistributedQueue: LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
2015-03-03 15:42:44,506 INFO org.apache.solr.cloud.OverseerCollectionProcessor: Overseer Collection Processor: Message id:/overseer/collection-queue-work/qn-0000000012 complete, response:{Operation deletecollection caused exception:=org.apache.solr.common.SolrException: Could not find collection:collection1,exception={msg=Could not find collection:collection1,rspCode=400}}
{noformat}
This might be related to SOLR-5023, but I'm not sure.
> SolrCloud does not fully clean collection after delete
> ------------------------------------------------------
>
> Key: SOLR-7187
> URL: https://issues.apache.org/jira/browse/SOLR-7187
> Project: Solr
> Issue Type: Bug
> Components: SolrCloud
> Affects Versions: 4.10.3
> Reporter: Mike Drob
>
> When I attempt to delete a collection using {{/admin/collections?action=DELETE&name=collection1}} if I go into HDFS I will still see remnants from the collection. No files, but empty directories stick around.
> {noformat}
> [root@solr1 ~]# sudo -u hdfs hdfs dfs -ls -R /solr/collection1
> drwxr-xr-x - solr solr 0 2015-03-03 15:42 /solr/collection1/core_node1
> drwxr-xr-x - solr solr 0 2015-03-03 15:42 /solr/collection1/core_node2
> drwxr-xr-x - solr solr 0 2015-03-03 15:42 /solr/collection1/core_node3
> drwxr-xr-x - solr solr 0 2015-03-03 15:42 /solr/collection1/core_node4
> drwxr-xr-x - solr solr 0 2015-03-03 15:42 /solr/collection1/core_node5
> drwxr-xr-x - solr solr 0 2015-03-03 15:42 /solr/collection1/core_node6
> {noformat}
> (Edit: I had the wrong log portion here originally)
> In the logs, after deleting all the data, I see:
> {noformat}
> 2015-03-03 16:15:14,762 INFO org.apache.solr.servlet.SolrDispatchFilter: [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&action=UNLOAD&core=collection1_shard5_replica1&wt=javabin&qt=/admin/cores&deleteDataDir=true&version=2} status=0 QTime=362
> 2015-03-03 16:15:14,787 INFO org.apache.solr.common.cloud.ZkStateReader: A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> 2015-03-03 16:15:14,854 INFO org.apache.solr.cloud.DistributedQueue: LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> 2015-03-03 16:15:14,879 INFO org.apache.solr.cloud.DistributedQueue: LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> 2015-03-03 16:15:14,896 INFO org.apache.solr.cloud.DistributedQueue: LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> 2015-03-03 16:15:14,920 INFO org.apache.solr.cloud.DistributedQueue: LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> 2015-03-03 16:15:15,151 INFO org.apache.solr.cloud.DistributedQueue: LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> 2015-03-03 16:15:15,170 INFO org.apache.solr.cloud.DistributedQueue: LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> 2015-03-03 16:15:15,279 INFO org.apache.solr.common.cloud.ZkStateReader: A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> 2015-03-03 16:15:15,546 INFO org.apache.solr.cloud.DistributedQueue: LatchChildWatcher fired on path: /overseer/collection-queue-work/qnr-0000000016 state: SyncConnected type NodeDataChanged
> 2015-03-03 16:15:15,562 INFO org.apache.solr.cloud.DistributedQueue: LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
> 2015-03-03 16:15:15,562 INFO org.apache.solr.cloud.OverseerCollectionProcessor: Overseer Collection Processor: Message id:/overseer/collection-queue-work/qn-0000000016 complete, response:{success={solr1.example.com:8983_solr={responseHeader={status=0,QTime=207}},solr1.example.com:8983_solr={responseHeader={status=0,QTime=243}},solr1.example.com:8983_solr={responseHeader={status=0,QTime=243}},solr1.example.com:8983_solr={responseHeader={status=0,QTime=342}},solr1.example.com:8983_solr={responseHeader={status=0,QTime=346}},solr1.example.com:8983_solr={responseHeader={status=0,QTime=362}}}}
> {noformat}
> This might be related to SOLR-5023, but I'm not sure.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org