You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by abhi Abhishek <ab...@gmail.com> on 2016/04/12 14:10:50 UTC
SOLR Upgrade 3.x to 4.10
Hi All,
I have SOLR 3.6 running currently, i am planning to upgrade this to
SOLR 4.10. Below were the thoughts we could come up with.
1. in place upgrade
I would be making the SOLR 4.10 slave of 3.6 and copy the indexes,
and optimize this index.
will optimizing the Lucene 3.3 index on SOLR 4 instance(with Lucene
4.10) change the index structure to Lucene 4.10? if not what would be the
version?
if i enable docvalues on certain fields before issuing optimize, will
it be able to incorporate ( create .dvd & .dvm files ) that in the newly
created index?
2. Re-Index the data
Seeking advice for minimum time to upgrade this with most features of SOLR
4.10
Thanks in Advance
Best Regards,
Abhishek
Re: SOLR Upgrade 3.x to 4.10
Posted by abhi Abhishek <ab...@gmail.com>.
Thanks Erick and Shawn for the input. it makes more sense to move to SOLR
5.x but we would like to get there in few iterations gradually making
incremental changes to have a smooth cut over.
our index size is 3TB (10 shards of 300G each), i was looking for a
alternate route which would save me from pain of re-indexing. any thoughts
for the same would help.
Best Regards,
Abhishek
On Wed, Apr 13, 2016 at 6:18 AM, Shawn Heisey <ap...@elyograg.org> wrote:
> On 4/12/2016 6:10 AM, abhi Abhishek wrote:
> > I have SOLR 3.6 running currently, i am planning to upgrade this to
> > SOLR 4.10. Below were the thoughts we could come up with.
> >
> > 1. in place upgrade
> > I would be making the SOLR 4.10 slave of 3.6 and copy the indexes,
> > and optimize this index.
> >
> > will optimizing the Lucene 3.3 index on SOLR 4 instance(with Lucene
> > 4.10) change the index structure to Lucene 4.10? if not what would be the
> > version?
>
> Yes, the optimize will change the index structure, but the contents of
> the index will not change, even if changes in Solr's analysis components
> would have resulted in different info going into the index based on your
> schema. Because the *query* analysis may also change with the upgrade,
> this might cause queries to no longer work the same, unless you reindex
> and verify that your analysis still does what you require. A few
> changes to analysis components in later versions can be changed back to
> earlier behavior with luceneMatchVersion, but this typically only
> happens with big changes -- such as the major bugfix for
> WordDelimiterFilterFactory in version 4.8.
>
> Reindexing for all upgrades is recommended when possible.
>
> > if i enable docvalues on certain fields before issuing optimize,
> will
> > it be able to incorporate ( create .dvd & .dvm files ) that in the newly
> > created index?
>
> No. You must entirely reindex to add docValues. Optimize just rewrites
> what's already present in the Lucene index.
>
> > 2. Re-Index the data
> >
> > Seeking advice for minimum time to upgrade this with most features of
> SOLR
> > 4.10
>
> This is impossible to answer. It will depend on how long it takes to
> index your data. That is very difficult to predict even if a lot of
> information is available.
>
> Thanks,
> Shawn
>
>
Re: SOLR Upgrade 3.x to 4.10
Posted by Shawn Heisey <ap...@elyograg.org>.
On 4/12/2016 6:10 AM, abhi Abhishek wrote:
> I have SOLR 3.6 running currently, i am planning to upgrade this to
> SOLR 4.10. Below were the thoughts we could come up with.
>
> 1. in place upgrade
> I would be making the SOLR 4.10 slave of 3.6 and copy the indexes,
> and optimize this index.
>
> will optimizing the Lucene 3.3 index on SOLR 4 instance(with Lucene
> 4.10) change the index structure to Lucene 4.10? if not what would be the
> version?
Yes, the optimize will change the index structure, but the contents of
the index will not change, even if changes in Solr's analysis components
would have resulted in different info going into the index based on your
schema. Because the *query* analysis may also change with the upgrade,
this might cause queries to no longer work the same, unless you reindex
and verify that your analysis still does what you require. A few
changes to analysis components in later versions can be changed back to
earlier behavior with luceneMatchVersion, but this typically only
happens with big changes -- such as the major bugfix for
WordDelimiterFilterFactory in version 4.8.
Reindexing for all upgrades is recommended when possible.
> if i enable docvalues on certain fields before issuing optimize, will
> it be able to incorporate ( create .dvd & .dvm files ) that in the newly
> created index?
No. You must entirely reindex to add docValues. Optimize just rewrites
what's already present in the Lucene index.
> 2. Re-Index the data
>
> Seeking advice for minimum time to upgrade this with most features of SOLR
> 4.10
This is impossible to answer. It will depend on how long it takes to
index your data. That is very difficult to predict even if a lot of
information is available.
Thanks,
Shawn
Re: SOLR Upgrade 3.x to 4.10
Posted by Erick Erickson <er...@gmail.com>.
I would always re-index if possible, it's more certain than upgrading
the indexes. It's "not possible" when it takes very long....
And why go for 4.10 rather than 5.5 (Note, 5.5.1 will be out Real Soon
Now). If you can re-index, I'd really think about upgrading to 5.5.1
and going from there.
Best,
Erick
On Tue, Apr 12, 2016 at 5:10 AM, abhi Abhishek <ab...@gmail.com> wrote:
> Hi All,
> I have SOLR 3.6 running currently, i am planning to upgrade this to
> SOLR 4.10. Below were the thoughts we could come up with.
>
> 1. in place upgrade
> I would be making the SOLR 4.10 slave of 3.6 and copy the indexes,
> and optimize this index.
>
> will optimizing the Lucene 3.3 index on SOLR 4 instance(with Lucene
> 4.10) change the index structure to Lucene 4.10? if not what would be the
> version?
> if i enable docvalues on certain fields before issuing optimize, will
> it be able to incorporate ( create .dvd & .dvm files ) that in the newly
> created index?
>
>
> 2. Re-Index the data
>
> Seeking advice for minimum time to upgrade this with most features of SOLR
> 4.10
>
> Thanks in Advance
>
> Best Regards,
> Abhishek