You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Tom Peters <tp...@synacor.com> on 2018/03/05 18:13:52 UTC
/var/solr/data has lots of index* directories
While trying to debug an issue with CDCR, I noticed that the /var/solr/data directories on my source cluster have wildly different sizes.
% for i in solr2-{a..e}; do echo -n "$i: "; ssh -A $i du -sh /var/solr/data; done
solr2-a: 9.5G /var/solr/data
solr2-b: 29G /var/solr/data
solr2-c: 6.6G /var/solr/data
solr2-d: 9.7G /var/solr/data
solr2-e: 19G /var/solr/data
The leader is currently "solr2-a"
Here's the actual index size:
Master (Searching)
1520273178244 # version
73034 # gen
3.66 GB # size
When I look inside /var/solr/data/ on solr2-b, I see a bunch of index.* directories:
% ls | grep index
index.20180223021742634
index.20180223024901983
index.20180223033852960
index.20180223034811193
index.20180223035648403
index.20180223041040318
index.properties
On solr2-a, I only see one index directory (index.20180222192820572).
Does anyone know why this will happen and how I can clean it up without potentially causing any issues? We're currently on version Solr 7.1.
This message and any attachment may contain information that is confidential and/or proprietary. Any use, disclosure, copying, storing, or distribution of this e-mail or any attached file by anyone other than the intended recipient is strictly prohibited. If you have received this message in error, please notify the sender by reply email and delete the message and any attachments. Thank you.
Re: /var/solr/data has lots of index* directories
Posted by Tom Peters <tp...@synacor.com>.
Thanks. I went ahead and did that.
I think the multiple directories stemmed from an issue I sent to the list a week or two ago about deleteByQueries knocking my replicas offline.
> On Mar 5, 2018, at 1:44 PM, Shalin Shekhar Mangar <sh...@gmail.com> wrote:
>
> You can look inside the index.properties. The directory name mentioned in
> that properties file is the one being used actively. The rest are old
> directories that should be cleaned up on Solr restart but you can delete
> them yourself without any issues.
>
> On Mon, Mar 5, 2018 at 11:43 PM, Tom Peters <tp...@synacor.com> wrote:
>
>> While trying to debug an issue with CDCR, I noticed that the
>> /var/solr/data directories on my source cluster have wildly different sizes.
>>
>> % for i in solr2-{a..e}; do echo -n "$i: "; ssh -A $i du -sh
>> /var/solr/data; done
>> solr2-a: 9.5G /var/solr/data
>> solr2-b: 29G /var/solr/data
>> solr2-c: 6.6G /var/solr/data
>> solr2-d: 9.7G /var/solr/data
>> solr2-e: 19G /var/solr/data
>>
>> The leader is currently "solr2-a"
>>
>> Here's the actual index size:
>>
>> Master (Searching)
>> 1520273178244 # version
>> 73034 # gen
>> 3.66 GB # size
>>
>> When I look inside /var/solr/data/ on solr2-b, I see a bunch of index.*
>> directories:
>>
>> % ls | grep index
>> index.20180223021742634
>> index.20180223024901983
>> index.20180223033852960
>> index.20180223034811193
>> index.20180223035648403
>> index.20180223041040318
>> index.properties
>>
>> On solr2-a, I only see one index directory (index.20180222192820572).
>>
>> Does anyone know why this will happen and how I can clean it up without
>> potentially causing any issues? We're currently on version Solr 7.1.
>>
>>
>> This message and any attachment may contain information that is
>> confidential and/or proprietary. Any use, disclosure, copying, storing, or
>> distribution of this e-mail or any attached file by anyone other than the
>> intended recipient is strictly prohibited. If you have received this
>> message in error, please notify the sender by reply email and delete the
>> message and any attachments. Thank you.
>>
>
>
>
> --
> Regards,
> Shalin Shekhar Mangar.
This message and any attachment may contain information that is confidential and/or proprietary. Any use, disclosure, copying, storing, or distribution of this e-mail or any attached file by anyone other than the intended recipient is strictly prohibited. If you have received this message in error, please notify the sender by reply email and delete the message and any attachments. Thank you.
Re: /var/solr/data has lots of index* directories
Posted by Shalin Shekhar Mangar <sh...@gmail.com>.
You can look inside the index.properties. The directory name mentioned in
that properties file is the one being used actively. The rest are old
directories that should be cleaned up on Solr restart but you can delete
them yourself without any issues.
On Mon, Mar 5, 2018 at 11:43 PM, Tom Peters <tp...@synacor.com> wrote:
> While trying to debug an issue with CDCR, I noticed that the
> /var/solr/data directories on my source cluster have wildly different sizes.
>
> % for i in solr2-{a..e}; do echo -n "$i: "; ssh -A $i du -sh
> /var/solr/data; done
> solr2-a: 9.5G /var/solr/data
> solr2-b: 29G /var/solr/data
> solr2-c: 6.6G /var/solr/data
> solr2-d: 9.7G /var/solr/data
> solr2-e: 19G /var/solr/data
>
> The leader is currently "solr2-a"
>
> Here's the actual index size:
>
> Master (Searching)
> 1520273178244 # version
> 73034 # gen
> 3.66 GB # size
>
> When I look inside /var/solr/data/ on solr2-b, I see a bunch of index.*
> directories:
>
> % ls | grep index
> index.20180223021742634
> index.20180223024901983
> index.20180223033852960
> index.20180223034811193
> index.20180223035648403
> index.20180223041040318
> index.properties
>
> On solr2-a, I only see one index directory (index.20180222192820572).
>
> Does anyone know why this will happen and how I can clean it up without
> potentially causing any issues? We're currently on version Solr 7.1.
>
>
> This message and any attachment may contain information that is
> confidential and/or proprietary. Any use, disclosure, copying, storing, or
> distribution of this e-mail or any attached file by anyone other than the
> intended recipient is strictly prohibited. If you have received this
> message in error, please notify the sender by reply email and delete the
> message and any attachments. Thank you.
>
--
Regards,
Shalin Shekhar Mangar.