You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@solr.apache.org by Eashwar Natarajan <ea...@gmail.com> on 2022/11/14 03:44:18 UTC
Data Migration from Solr 8 to Solr Cloud 8
Hi all,
We have been using Solr 8 for quite a while.
We wanted to migrate the data from solr standalone 8 to solr cloud
8. Is there a way to do it apart from reindexing. Please advise.
Regards,
Eashwar
Re: Data Migration from Solr 8 to Solr Cloud 8
Posted by Vincenzo D'Amore <v....@gmail.com>.
Have you already decided what kind of strategy use to split the documents?
On Mon, 14 Nov 2022 at 10:24, Eashwar Natarajan <ea...@gmail.com> wrote:
> Hi Vincenzo,
>
> We have data totalling 450 GB in various cores and would want to
> improve read times and scalability. So we are thinking of moving to
> sharding.
>
> Regards,
> Eashwar
>
>
> On Mon, Nov 14, 2022 at 12:48 PM Vincenzo D'Amore <v....@gmail.com>
> wrote:
>
> > Hi Eashwar,
> >
> > may I ask you why do you want move to SolrCloud? Scalability? Or you
> > collection has grown so much that you are thinking to shard it?
> >
> > Ciao,
> > Vincenzo
> >
> > --
> > mobile: 3498513251
> > skype: free.dev
> >
> > > On 14 Nov 2022, at 04:45, Eashwar Natarajan <ea...@gmail.com>
> wrote:
> > >
> > > Hi all,
> > >
> > > We have been using Solr 8 for quite a while.
> > >
> > > We wanted to migrate the data from solr standalone 8 to solr
> cloud
> > > 8. Is there a way to do it apart from reindexing. Please advise.
> > >
> > > Regards,
> > > Eashwar
> >
>
--
Vincenzo D'Amore
Re: Data Migration from Solr 8 to Solr Cloud 8
Posted by Eashwar Natarajan <ea...@gmail.com>.
Hi Vincenzo,
We have data totalling 450 GB in various cores and would want to
improve read times and scalability. So we are thinking of moving to
sharding.
Regards,
Eashwar
On Mon, Nov 14, 2022 at 12:48 PM Vincenzo D'Amore <v....@gmail.com>
wrote:
> Hi Eashwar,
>
> may I ask you why do you want move to SolrCloud? Scalability? Or you
> collection has grown so much that you are thinking to shard it?
>
> Ciao,
> Vincenzo
>
> --
> mobile: 3498513251
> skype: free.dev
>
> > On 14 Nov 2022, at 04:45, Eashwar Natarajan <ea...@gmail.com> wrote:
> >
> > Hi all,
> >
> > We have been using Solr 8 for quite a while.
> >
> > We wanted to migrate the data from solr standalone 8 to solr cloud
> > 8. Is there a way to do it apart from reindexing. Please advise.
> >
> > Regards,
> > Eashwar
>
Re: Data Migration from Solr 8 to Solr Cloud 8
Posted by Vincenzo D'Amore <v....@gmail.com>.
Hi Eashwar,
may I ask you why do you want move to SolrCloud? Scalability? Or you collection has grown so much that you are thinking to shard it?
Ciao,
Vincenzo
--
mobile: 3498513251
skype: free.dev
> On 14 Nov 2022, at 04:45, Eashwar Natarajan <ea...@gmail.com> wrote:
>
> Hi all,
>
> We have been using Solr 8 for quite a while.
>
> We wanted to migrate the data from solr standalone 8 to solr cloud
> 8. Is there a way to do it apart from reindexing. Please advise.
>
> Regards,
> Eashwar
Re: Data Migration from Solr 8 to Solr Cloud 8
Posted by Shawn Heisey <ap...@elyograg.org>.
On 11/13/22 20:44, Eashwar Natarajan wrote:
> We have been using Solr 8 for quite a while.
>
> We wanted to migrate the data from solr standalone 8 to solr cloud
> 8. Is there a way to do it apart from reindexing. Please advise.
If your non-cloud index is not sharded but your cloud index is, then
that would be very difficult. If both are sharded, you will have
problems if the shard routing in the non-cloud setup is not 100%
identical to the way SolrCloud does routing.
If both are unsharded, then you can do it by creating the collection in
the cloud setup, shutting down all nodes in both setups, and replacing
the data directory on each replica in the cloud nodes with the data
directory from a non-cloud node, then starting all the Solr nodes back up.
Your best bet, regardless of whether there is any sharding, is to
reindex from scratch. It is STRONGLY recommended that you always have a
mechanism for doing a full reindex, because many of the changes you
might make to the index config will require a full reindex.
Thanks,
Shawn