You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Jose-Marcio Martins da Cruz <Jo...@mines-paristech.fr> on 2016/06/23 20:13:24 UTC
SolrCloud start up script
Hello,
I have a quite dumb question. I'm new to Nutch/Solr and we're migrating our Web indexer from a commercial product to
Nutch/Solr. I haven't yet understood all internal I need. After spending some time, I have a problem...
I've installed Nutch/Solr and everything works fine with Solr in standalone mode. I've even installed Solr with the
install_solr_service.sh script. Everything is fine.
Now, I want to go further and pass Solr to cloud mode. I haven't found an elegant way to modify /etc/init.d/solr script
nor /etc/default/solr.in.sh script in order to launch Solr in cloud mode. But I succeeded to start it with some dirty
workaround.
Can you point me some hints or links on how to do this cleanly ?
Remark : the only reason I'm trying to migrate to SolrCloud is to be able to do Basic Auth. We've just around 30,000
documents to index and standalone is enough to us.
Regards
JMarcio
Re: SolrCloud start up script
Posted by John Bickerstaff <jo...@johnbickerstaff.com>.
Good luck! Let me know if you run into any more trouble.
On Thu, Jun 23, 2016 at 4:01 PM, Jose-Marcio Martins da Cruz <
Jose-Marcio.Martins@mines-paristech.fr> wrote:
>
> Thank you John ! This is a good start.
>
> I understand that is seems more complicated than I though, but... Got the
> way !!!
>
> Regards
>
> José-Marcio
>
>
> On 06/23/2016 10:44 PM, John Bickerstaff wrote:
>
>> So, if you installed with the install script (warning: I used 5.4 but I
>> think everything is the same) and add this setting in your solr.in.sh
>> file
>> your solr boxes should start in cloud mode when the server starts up.
>>
>> The -c option also works, but for a production type installation, it's a
>> lot easier to have it "just start" when you start the server and issue
>> service solr restart when you want to restart...
>>
>> There is an instruction page for "installing Solr for Production" which
>> you
>> may want to look at...
>>
>> https://cwiki.apache.org/confluence/display/solr/Taking+Solr+to+Production
>>
>> Pay special attention to the part that talks about ZK_HOME and the chroot
>> suggestion. Using the chroot on the end of the list of ZK hosts keeps
>> your
>> solr "data files" separate from everything else in Zookeeper - which is
>> very handy if you're using Zookeeper for other tools.
>>
>> I wrestled through all of this a few months back - take a look at the
>> "Install Solr for Prod" page - I think that will help - then ping back if
>> you need more assistance getting it to run in cloud mode automatically.
>>
>> On Thu, Jun 23, 2016 at 2:36 PM, Jose-Marcio Martins da Cruz <
>> Jose-Marcio.Martins@mines-paristech.fr> wrote:
>>
>>
>>> Hi John,
>>>
>>> On 06/23/2016 10:18 PM, John Bickerstaff wrote:
>>>
>>> Jose,
>>>>
>>>> There is a setting in the solr.in.sh script that should make Solr start
>>>> in
>>>> "cloud" mode...
>>>>
>>>> It's ZK_HOST
>>>>
>>>> That's where you list the IP addresses (or hostnames) of your zookeeper
>>>> machines...
>>>>
>>>> Is this set?
>>>>
>>>>
>>> Non ! :-(
>>>
>>> I though I should just launch solr with "-c" option...
>>>
>>>
>>> What version of Solr are you using?
>>>>
>>>>
>>> The last one : 6.1.0; But I tried also with 6.0.1.
>>>
>>>
>>>
>>> On Thu, Jun 23, 2016 at 2:13 PM, Jose-Marcio Martins da Cruz <
>>>> Jose-Marcio.Martins@mines-paristech.fr> wrote:
>>>>
>>>>
>>>> Hello,
>>>>>
>>>>> I have a quite dumb question. I'm new to Nutch/Solr and we're migrating
>>>>> our Web indexer from a commercial product to Nutch/Solr. I haven't yet
>>>>> understood all internal I need. After spending some time, I have a
>>>>> problem...
>>>>>
>>>>> I've installed Nutch/Solr and everything works fine with Solr in
>>>>> standalone mode. I've even installed Solr with the
>>>>> install_solr_service.sh
>>>>> script. Everything is fine.
>>>>>
>>>>> Now, I want to go further and pass Solr to cloud mode. I haven't found
>>>>> an
>>>>> elegant way to modify /etc/init.d/solr script nor /etc/default/
>>>>> solr.in.sh
>>>>> script in order to launch Solr in cloud mode. But I succeeded to start
>>>>> it
>>>>> with some dirty workaround.
>>>>>
>>>>> Can you point me some hints or links on how to do this cleanly ?
>>>>>
>>>>> Remark : the only reason I'm trying to migrate to SolrCloud is to be
>>>>> able
>>>>> to do Basic Auth. We've just around 30,000 documents to index and
>>>>> standalone is enough to us.
>>>>>
>>>>> Regards
>>>>>
>>>>> JMarcio
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>
>>>
>>
>
Re: SolrCloud start up script
Posted by Jose-Marcio Martins da Cruz <Jo...@mines-paristech.fr>.
Thank you John ! This is a good start.
I understand that is seems more complicated than I though, but... Got the way !!!
Regards
Jos�-Marcio
On 06/23/2016 10:44 PM, John Bickerstaff wrote:
> So, if you installed with the install script (warning: I used 5.4 but I
> think everything is the same) and add this setting in your solr.in.sh file
> your solr boxes should start in cloud mode when the server starts up.
>
> The -c option also works, but for a production type installation, it's a
> lot easier to have it "just start" when you start the server and issue
> service solr restart when you want to restart...
>
> There is an instruction page for "installing Solr for Production" which you
> may want to look at...
>
> https://cwiki.apache.org/confluence/display/solr/Taking+Solr+to+Production
>
> Pay special attention to the part that talks about ZK_HOME and the chroot
> suggestion. Using the chroot on the end of the list of ZK hosts keeps your
> solr "data files" separate from everything else in Zookeeper - which is
> very handy if you're using Zookeeper for other tools.
>
> I wrestled through all of this a few months back - take a look at the
> "Install Solr for Prod" page - I think that will help - then ping back if
> you need more assistance getting it to run in cloud mode automatically.
>
> On Thu, Jun 23, 2016 at 2:36 PM, Jose-Marcio Martins da Cruz <
> Jose-Marcio.Martins@mines-paristech.fr> wrote:
>
>>
>> Hi John,
>>
>> On 06/23/2016 10:18 PM, John Bickerstaff wrote:
>>
>>> Jose,
>>>
>>> There is a setting in the solr.in.sh script that should make Solr start
>>> in
>>> "cloud" mode...
>>>
>>> It's ZK_HOST
>>>
>>> That's where you list the IP addresses (or hostnames) of your zookeeper
>>> machines...
>>>
>>> Is this set?
>>>
>>
>> Non ! :-(
>>
>> I though I should just launch solr with "-c" option...
>>
>>
>>> What version of Solr are you using?
>>>
>>
>> The last one : 6.1.0; But I tried also with 6.0.1.
>>
>>
>>
>>> On Thu, Jun 23, 2016 at 2:13 PM, Jose-Marcio Martins da Cruz <
>>> Jose-Marcio.Martins@mines-paristech.fr> wrote:
>>>
>>>
>>>> Hello,
>>>>
>>>> I have a quite dumb question. I'm new to Nutch/Solr and we're migrating
>>>> our Web indexer from a commercial product to Nutch/Solr. I haven't yet
>>>> understood all internal I need. After spending some time, I have a
>>>> problem...
>>>>
>>>> I've installed Nutch/Solr and everything works fine with Solr in
>>>> standalone mode. I've even installed Solr with the
>>>> install_solr_service.sh
>>>> script. Everything is fine.
>>>>
>>>> Now, I want to go further and pass Solr to cloud mode. I haven't found an
>>>> elegant way to modify /etc/init.d/solr script nor /etc/default/
>>>> solr.in.sh
>>>> script in order to launch Solr in cloud mode. But I succeeded to start it
>>>> with some dirty workaround.
>>>>
>>>> Can you point me some hints or links on how to do this cleanly ?
>>>>
>>>> Remark : the only reason I'm trying to migrate to SolrCloud is to be able
>>>> to do Basic Auth. We've just around 30,000 documents to index and
>>>> standalone is enough to us.
>>>>
>>>> Regards
>>>>
>>>> JMarcio
>>>>
>>>>
>>>>
>>>>
>>>>
>>>
>>
>
Re: SolrCloud start up script
Posted by John Bickerstaff <jo...@johnbickerstaff.com>.
So, if you installed with the install script (warning: I used 5.4 but I
think everything is the same) and add this setting in your solr.in.sh file
your solr boxes should start in cloud mode when the server starts up.
The -c option also works, but for a production type installation, it's a
lot easier to have it "just start" when you start the server and issue
service solr restart when you want to restart...
There is an instruction page for "installing Solr for Production" which you
may want to look at...
https://cwiki.apache.org/confluence/display/solr/Taking+Solr+to+Production
Pay special attention to the part that talks about ZK_HOME and the chroot
suggestion. Using the chroot on the end of the list of ZK hosts keeps your
solr "data files" separate from everything else in Zookeeper - which is
very handy if you're using Zookeeper for other tools.
I wrestled through all of this a few months back - take a look at the
"Install Solr for Prod" page - I think that will help - then ping back if
you need more assistance getting it to run in cloud mode automatically.
On Thu, Jun 23, 2016 at 2:36 PM, Jose-Marcio Martins da Cruz <
Jose-Marcio.Martins@mines-paristech.fr> wrote:
>
> Hi John,
>
> On 06/23/2016 10:18 PM, John Bickerstaff wrote:
>
>> Jose,
>>
>> There is a setting in the solr.in.sh script that should make Solr start
>> in
>> "cloud" mode...
>>
>> It's ZK_HOST
>>
>> That's where you list the IP addresses (or hostnames) of your zookeeper
>> machines...
>>
>> Is this set?
>>
>
> Non ! :-(
>
> I though I should just launch solr with "-c" option...
>
>
>> What version of Solr are you using?
>>
>
> The last one : 6.1.0; But I tried also with 6.0.1.
>
>
>
>> On Thu, Jun 23, 2016 at 2:13 PM, Jose-Marcio Martins da Cruz <
>> Jose-Marcio.Martins@mines-paristech.fr> wrote:
>>
>>
>>> Hello,
>>>
>>> I have a quite dumb question. I'm new to Nutch/Solr and we're migrating
>>> our Web indexer from a commercial product to Nutch/Solr. I haven't yet
>>> understood all internal I need. After spending some time, I have a
>>> problem...
>>>
>>> I've installed Nutch/Solr and everything works fine with Solr in
>>> standalone mode. I've even installed Solr with the
>>> install_solr_service.sh
>>> script. Everything is fine.
>>>
>>> Now, I want to go further and pass Solr to cloud mode. I haven't found an
>>> elegant way to modify /etc/init.d/solr script nor /etc/default/
>>> solr.in.sh
>>> script in order to launch Solr in cloud mode. But I succeeded to start it
>>> with some dirty workaround.
>>>
>>> Can you point me some hints or links on how to do this cleanly ?
>>>
>>> Remark : the only reason I'm trying to migrate to SolrCloud is to be able
>>> to do Basic Auth. We've just around 30,000 documents to index and
>>> standalone is enough to us.
>>>
>>> Regards
>>>
>>> JMarcio
>>>
>>>
>>>
>>>
>>>
>>
>
Re: SolrCloud start up script
Posted by Jose-Marcio Martins da Cruz <Jo...@mines-paristech.fr>.
Hi John,
On 06/23/2016 10:18 PM, John Bickerstaff wrote:
> Jose,
>
> There is a setting in the solr.in.sh script that should make Solr start in
> "cloud" mode...
>
> It's ZK_HOST
>
> That's where you list the IP addresses (or hostnames) of your zookeeper
> machines...
>
> Is this set?
Non ! :-(
I though I should just launch solr with "-c" option...
>
> What version of Solr are you using?
The last one : 6.1.0; But I tried also with 6.0.1.
>
> On Thu, Jun 23, 2016 at 2:13 PM, Jose-Marcio Martins da Cruz <
> Jose-Marcio.Martins@mines-paristech.fr> wrote:
>
>>
>> Hello,
>>
>> I have a quite dumb question. I'm new to Nutch/Solr and we're migrating
>> our Web indexer from a commercial product to Nutch/Solr. I haven't yet
>> understood all internal I need. After spending some time, I have a
>> problem...
>>
>> I've installed Nutch/Solr and everything works fine with Solr in
>> standalone mode. I've even installed Solr with the install_solr_service.sh
>> script. Everything is fine.
>>
>> Now, I want to go further and pass Solr to cloud mode. I haven't found an
>> elegant way to modify /etc/init.d/solr script nor /etc/default/solr.in.sh
>> script in order to launch Solr in cloud mode. But I succeeded to start it
>> with some dirty workaround.
>>
>> Can you point me some hints or links on how to do this cleanly ?
>>
>> Remark : the only reason I'm trying to migrate to SolrCloud is to be able
>> to do Basic Auth. We've just around 30,000 documents to index and
>> standalone is enough to us.
>>
>> Regards
>>
>> JMarcio
>>
>>
>>
>>
>
Re: SolrCloud start up script
Posted by John Bickerstaff <jo...@johnbickerstaff.com>.
Jose,
There is a setting in the solr.in.sh script that should make Solr start in
"cloud" mode...
It's ZK_HOST
That's where you list the IP addresses (or hostnames) of your zookeeper
machines...
Is this set?
What version of Solr are you using?
On Thu, Jun 23, 2016 at 2:13 PM, Jose-Marcio Martins da Cruz <
Jose-Marcio.Martins@mines-paristech.fr> wrote:
>
> Hello,
>
> I have a quite dumb question. I'm new to Nutch/Solr and we're migrating
> our Web indexer from a commercial product to Nutch/Solr. I haven't yet
> understood all internal I need. After spending some time, I have a
> problem...
>
> I've installed Nutch/Solr and everything works fine with Solr in
> standalone mode. I've even installed Solr with the install_solr_service.sh
> script. Everything is fine.
>
> Now, I want to go further and pass Solr to cloud mode. I haven't found an
> elegant way to modify /etc/init.d/solr script nor /etc/default/solr.in.sh
> script in order to launch Solr in cloud mode. But I succeeded to start it
> with some dirty workaround.
>
> Can you point me some hints or links on how to do this cleanly ?
>
> Remark : the only reason I'm trying to migrate to SolrCloud is to be able
> to do Basic Auth. We've just around 30,000 documents to index and
> standalone is enough to us.
>
> Regards
>
> JMarcio
>
>
>
>