You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by fabio1605 <fa...@btinternet.com> on 2013/07/02 17:16:00 UTC
Newbie SolR - Need advice
Hi
we have a MSSQL Server which is just getting far to large now and
performance is dying! the majority of our webservers mainly are doing search
function so i thought it may be best to move to SolR But i know very little
about it!
My questions are!
Does SolR Run as a bolt on to MSSQL - as in the data is still in MSSQL and
SolR is just the search bit between?
Im really struggling to understand the point of SOLR etc so if someone could
point me to a Dummies website id apprecaite it! google is throwing to much
confusion at me!
--
View this message in context: http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: Newbie SolR - Need advice
Posted by Jack Krupansky <ja...@basetechnology.com>.
Start with the Solr Tutorial.
http://lucene.apache.org/solr/tutorial.html
-- Jack Krupansky
-----Original Message-----
From: fabio1605
Sent: Tuesday, July 02, 2013 11:16 AM
To: solr-user@lucene.apache.org
Subject: Newbie SolR - Need advice
Hi
we have a MSSQL Server which is just getting far to large now and
performance is dying! the majority of our webservers mainly are doing search
function so i thought it may be best to move to SolR But i know very little
about it!
My questions are!
Does SolR Run as a bolt on to MSSQL - as in the data is still in MSSQL and
SolR is just the search bit between?
Im really struggling to understand the point of SOLR etc so if someone could
point me to a Dummies website id apprecaite it! google is throwing to much
confusion at me!
--
View this message in context:
http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: Newbie SolR - Need advice
Posted by fabio1605 <fa...@btinternet.com>.
Arrfh I see... So SolR is the search engine for a datastore.... Is that what mongo is.. A datastore bit.
Sent from Samsung Mobile
-------- Original message --------
From: "Jack Krupansky-2 [via Lucene]" <ml...@n3.nabble.com>
Date: 02/07/2013 17:51 (GMT+00:00)
To: fabio1605 <fa...@btinternet.com>
Subject: Re: Newbie SolR - Need advice
Consider DataStax Enterprise - it combines Cassandra for NoSql data storage
with Solr for indexing - fully integrated.
http://www.datastax.com/
-- Jack Krupansky
-----Original Message-----
From: fabio1605
Sent: Tuesday, July 02, 2013 12:44 PM
To: [hidden email]
Subject: Re: Newbie SolR - Need advice
Hi
Ok I'm even more confused now... Sorry for even more stupid questions.....
So if it's not a database replacement.... Where do we keep the database
then.....
We have a website that is a documentation website that store documents. It
has over 130 million records in a table and 50 million in 2 other plus lots
of little tables
Most searches are like searching on references or for customer information
etc.
However with so much information stored ms sql is starting to get slower....
We have approx 100 tables across 4 different database
So this is why I started to look at SolR
Q1 if we used SolR would we still use sql as well as SolR or does SolR
become sql (speaking theoretically)
Q2 if so... How do we move all the data across to SolR.
Q3 is SolR useful for what we need..... Or is sql the better option based
on our circumstances. 50percent of our load is from a website... 50
percent is from scripts adding the information to the site etc....
Sorry for the silly question I'm just getting really confused now
Sent from Samsung Mobile
-------- Original message --------
From: "Sandeep Mestry [via Lucene]"
<[hidden email]>
Date: 02/07/2013 17:29 (GMT+00:00)
To: fabio1605 <[hidden email]>
Subject: Re: Newbie SolR - Need advice
Hi Fabio,
No, Solr isn't the database replacement for MS SQL.
Solr is built on top of Lucene which is a search engine library for text
searches.
Solr in itself is not a replacement for any database as it does not support
any relational db features, however as Jack and David mentioned its fully
optimised search engine platform that can provide all search related
features like faceting, highlighting etc.
Solr does not have a *database*. It stores the data in binary files called
indexes <http://lucene.apache.org/core/3_0_3/fileformats.html>. These
indexes are populated with the data from the database. Solr provides an
inbuilt functionality through DataImportHandler component to get the data
and generate indexes.
When you say, your web servers are mainly doing search function, do you
mean it is a text search and you use queries with clauses as 'like', 'in'
etc. (in addition to multiple joints) to get the results? Does the web
application need faceting? If yes, then solr can be your friend to get it
through.
Do remember that it always takes some time to get the new concepts from
understanding through to implementation. As David mentioned already, it
*is* going to be a bumpy ride at the start but *definitely* a sensational
one.
Good Luck,
Sandeep
On 2 July 2013 17:09, fabio1605 <[hidden email]> wrote:
> Thanks guys
>
> So SolR is actually a database replacement for mssql... Am I right....
>
>
> We have a lot of perl scripts that contains lots of sql insert
> queries..... Etc
>
>
> How do we query the SolR database from scripts.... I know I have a lot to
> learn still so excuse my ignorance.
>
> Also... What is mongo and how does it compare
>
> I just don't understand how in 10years of Web development I have never
> heard of SolR till last week
>
>
>
>
> Sent from Samsung Mobile
>
> -------- Original message --------
> From: "David Quarterman [via Lucene]" <
> [hidden email]>
> Date: 02/07/2013 16:57 (GMT+00:00)
> To: fabio1605 <[hidden email]>
> Subject: RE: Newbie SolR - Need advice
>
> Hi Fabio,
>
> Like Jack says, try the tutorial. But to answer your question, SOLR isn't
> a bolt on to SQLServer or any other DB. It's a fantastically fast
> indexing/searching tool. You'll need to use the DataImportHandler (see the
> tutorial) to import your data from the DB into the indices that SOLR uses.
> Once in there, you'll have more power & flexibility than SQLServer would
> ever give you!
>
> Haven't tried SOLR on Windows (I guess your environment) but I'm sure
> it'll work using Jetty or Tomcat as web container.
>
> Stick with it. The ride can be bumpy but the experience is sensational!
>
> DQ
>
> -----Original Message-----
> From: fabio1605 [mailto:[hidden email]]
> Sent: 02 July 2013 16:16
> To: [hidden email]
> Subject: Newbie SolR - Need advice
>
> Hi
>
> we have a MSSQL Server which is just getting far to large now and
> performance is dying! the majority of our webservers mainly are doing
> search function so i thought it may be best to move to SolR But i know
> very
> little about it!
>
> My questions are!
>
> Does SolR Run as a bolt on to MSSQL - as in the data is still in MSSQL and
> SolR is just the search bit between?
>
> Im really struggling to understand the point of SOLR etc so if someone
> could point me to a Dummies website id apprecaite it! google is throwing
> to
> much confusion at me!
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>
> If you reply to this email, your message will be added to the discussion
> below:
>
> http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746p4074772.html
> To unsubscribe from Newbie SolR - Need advice, click here.
> NAML
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746p4074782.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
If you reply to this email, your message will be added to the discussion
below:
http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746p4074795.html
To unsubscribe from Newbie SolR - Need advice, click here.
NAML
--
View this message in context:
http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746p4074805.html
Sent from the Solr - User mailing list archive at Nabble.com.
If you reply to this email, your message will be added to the discussion below:
http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746p4074809.html
To unsubscribe from Newbie SolR - Need advice, click here.
NAML
--
View this message in context: http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746p4074815.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: Newbie SolR - Need advice
Posted by Jack Krupansky <ja...@basetechnology.com>.
Consider DataStax Enterprise - it combines Cassandra for NoSql data storage
with Solr for indexing - fully integrated.
http://www.datastax.com/
-- Jack Krupansky
-----Original Message-----
From: fabio1605
Sent: Tuesday, July 02, 2013 12:44 PM
To: solr-user@lucene.apache.org
Subject: Re: Newbie SolR - Need advice
Hi
Ok I'm even more confused now... Sorry for even more stupid questions.....
So if it's not a database replacement.... Where do we keep the database
then.....
We have a website that is a documentation website that store documents. It
has over 130 million records in a table and 50 million in 2 other plus lots
of little tables
Most searches are like searching on references or for customer information
etc.
However with so much information stored ms sql is starting to get slower....
We have approx 100 tables across 4 different database
So this is why I started to look at SolR
Q1 if we used SolR would we still use sql as well as SolR or does SolR
become sql (speaking theoretically)
Q2 if so... How do we move all the data across to SolR.
Q3 is SolR useful for what we need..... Or is sql the better option based
on our circumstances. 50percent of our load is from a website... 50
percent is from scripts adding the information to the site etc....
Sorry for the silly question I'm just getting really confused now
Sent from Samsung Mobile
-------- Original message --------
From: "Sandeep Mestry [via Lucene]"
<ml...@n3.nabble.com>
Date: 02/07/2013 17:29 (GMT+00:00)
To: fabio1605 <fa...@btinternet.com>
Subject: Re: Newbie SolR - Need advice
Hi Fabio,
No, Solr isn't the database replacement for MS SQL.
Solr is built on top of Lucene which is a search engine library for text
searches.
Solr in itself is not a replacement for any database as it does not support
any relational db features, however as Jack and David mentioned its fully
optimised search engine platform that can provide all search related
features like faceting, highlighting etc.
Solr does not have a *database*. It stores the data in binary files called
indexes <http://lucene.apache.org/core/3_0_3/fileformats.html>. These
indexes are populated with the data from the database. Solr provides an
inbuilt functionality through DataImportHandler component to get the data
and generate indexes.
When you say, your web servers are mainly doing search function, do you
mean it is a text search and you use queries with clauses as 'like', 'in'
etc. (in addition to multiple joints) to get the results? Does the web
application need faceting? If yes, then solr can be your friend to get it
through.
Do remember that it always takes some time to get the new concepts from
understanding through to implementation. As David mentioned already, it
*is* going to be a bumpy ride at the start but *definitely* a sensational
one.
Good Luck,
Sandeep
On 2 July 2013 17:09, fabio1605 <[hidden email]> wrote:
> Thanks guys
>
> So SolR is actually a database replacement for mssql... Am I right....
>
>
> We have a lot of perl scripts that contains lots of sql insert
> queries..... Etc
>
>
> How do we query the SolR database from scripts.... I know I have a lot to
> learn still so excuse my ignorance.
>
> Also... What is mongo and how does it compare
>
> I just don't understand how in 10years of Web development I have never
> heard of SolR till last week
>
>
>
>
> Sent from Samsung Mobile
>
> -------- Original message --------
> From: "David Quarterman [via Lucene]" <
> [hidden email]>
> Date: 02/07/2013 16:57 (GMT+00:00)
> To: fabio1605 <[hidden email]>
> Subject: RE: Newbie SolR - Need advice
>
> Hi Fabio,
>
> Like Jack says, try the tutorial. But to answer your question, SOLR isn't
> a bolt on to SQLServer or any other DB. It's a fantastically fast
> indexing/searching tool. You'll need to use the DataImportHandler (see the
> tutorial) to import your data from the DB into the indices that SOLR uses.
> Once in there, you'll have more power & flexibility than SQLServer would
> ever give you!
>
> Haven't tried SOLR on Windows (I guess your environment) but I'm sure
> it'll work using Jetty or Tomcat as web container.
>
> Stick with it. The ride can be bumpy but the experience is sensational!
>
> DQ
>
> -----Original Message-----
> From: fabio1605 [mailto:[hidden email]]
> Sent: 02 July 2013 16:16
> To: [hidden email]
> Subject: Newbie SolR - Need advice
>
> Hi
>
> we have a MSSQL Server which is just getting far to large now and
> performance is dying! the majority of our webservers mainly are doing
> search function so i thought it may be best to move to SolR But i know
> very
> little about it!
>
> My questions are!
>
> Does SolR Run as a bolt on to MSSQL - as in the data is still in MSSQL and
> SolR is just the search bit between?
>
> Im really struggling to understand the point of SOLR etc so if someone
> could point me to a Dummies website id apprecaite it! google is throwing
> to
> much confusion at me!
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>
> If you reply to this email, your message will be added to the discussion
> below:
>
> http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746p4074772.html
> To unsubscribe from Newbie SolR - Need advice, click here.
> NAML
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746p4074782.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
If you reply to this email, your message will be added to the discussion
below:
http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746p4074795.html
To unsubscribe from Newbie SolR - Need advice, click here.
NAML
--
View this message in context:
http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746p4074805.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: Newbie SolR - Need advice
Posted by fabio1605 <fa...@btinternet.com>.
Hi
Ok I'm even more confused now... Sorry for even more stupid questions.....
So if it's not a database replacement.... Where do we keep the database then.....
We have a website that is a documentation website that store documents. It has over 130 million records in a table and 50 million in 2 other plus lots of little tables
Most searches are like searching on references or for customer information etc.
However with so much information stored ms sql is starting to get slower....
We have approx 100 tables across 4 different database
So this is why I started to look at SolR
Q1 if we used SolR would we still use sql as well as SolR or does SolR become sql (speaking theoretically)
Q2 if so... How do we move all the data across to SolR.
Q3 is SolR useful for what we need..... Or is sql the better option based on our circumstances. 50percent of our load is from a website... 50 percent is from scripts adding the information to the site etc....
Sorry for the silly question I'm just getting really confused now
Sent from Samsung Mobile
-------- Original message --------
From: "Sandeep Mestry [via Lucene]" <ml...@n3.nabble.com>
Date: 02/07/2013 17:29 (GMT+00:00)
To: fabio1605 <fa...@btinternet.com>
Subject: Re: Newbie SolR - Need advice
Hi Fabio,
No, Solr isn't the database replacement for MS SQL.
Solr is built on top of Lucene which is a search engine library for text
searches.
Solr in itself is not a replacement for any database as it does not support
any relational db features, however as Jack and David mentioned its fully
optimised search engine platform that can provide all search related
features like faceting, highlighting etc.
Solr does not have a *database*. It stores the data in binary files called
indexes <http://lucene.apache.org/core/3_0_3/fileformats.html>. These
indexes are populated with the data from the database. Solr provides an
inbuilt functionality through DataImportHandler component to get the data
and generate indexes.
When you say, your web servers are mainly doing search function, do you
mean it is a text search and you use queries with clauses as 'like', 'in'
etc. (in addition to multiple joints) to get the results? Does the web
application need faceting? If yes, then solr can be your friend to get it
through.
Do remember that it always takes some time to get the new concepts from
understanding through to implementation. As David mentioned already, it
*is* going to be a bumpy ride at the start but *definitely* a sensational
one.
Good Luck,
Sandeep
On 2 July 2013 17:09, fabio1605 <[hidden email]> wrote:
> Thanks guys
>
> So SolR is actually a database replacement for mssql... Am I right....
>
>
> We have a lot of perl scripts that contains lots of sql insert
> queries..... Etc
>
>
> How do we query the SolR database from scripts.... I know I have a lot to
> learn still so excuse my ignorance.
>
> Also... What is mongo and how does it compare
>
> I just don't understand how in 10years of Web development I have never
> heard of SolR till last week
>
>
>
>
> Sent from Samsung Mobile
>
> -------- Original message --------
> From: "David Quarterman [via Lucene]" <
> [hidden email]>
> Date: 02/07/2013 16:57 (GMT+00:00)
> To: fabio1605 <[hidden email]>
> Subject: RE: Newbie SolR - Need advice
>
> Hi Fabio,
>
> Like Jack says, try the tutorial. But to answer your question, SOLR isn't
> a bolt on to SQLServer or any other DB. It's a fantastically fast
> indexing/searching tool. You'll need to use the DataImportHandler (see the
> tutorial) to import your data from the DB into the indices that SOLR uses.
> Once in there, you'll have more power & flexibility than SQLServer would
> ever give you!
>
> Haven't tried SOLR on Windows (I guess your environment) but I'm sure
> it'll work using Jetty or Tomcat as web container.
>
> Stick with it. The ride can be bumpy but the experience is sensational!
>
> DQ
>
> -----Original Message-----
> From: fabio1605 [mailto:[hidden email]]
> Sent: 02 July 2013 16:16
> To: [hidden email]
> Subject: Newbie SolR - Need advice
>
> Hi
>
> we have a MSSQL Server which is just getting far to large now and
> performance is dying! the majority of our webservers mainly are doing
> search function so i thought it may be best to move to SolR But i know very
> little about it!
>
> My questions are!
>
> Does SolR Run as a bolt on to MSSQL - as in the data is still in MSSQL and
> SolR is just the search bit between?
>
> Im really struggling to understand the point of SOLR etc so if someone
> could point me to a Dummies website id apprecaite it! google is throwing to
> much confusion at me!
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>
> If you reply to this email, your message will be added to the discussion
> below:
>
> http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746p4074772.html
> To unsubscribe from Newbie SolR - Need advice, click here.
> NAML
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746p4074782.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
If you reply to this email, your message will be added to the discussion below:
http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746p4074795.html
To unsubscribe from Newbie SolR - Need advice, click here.
NAML
--
View this message in context: http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746p4074805.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: Newbie SolR - Need advice
Posted by Sandeep Mestry <sa...@gmail.com>.
Hi Fabio,
No, Solr isn't the database replacement for MS SQL.
Solr is built on top of Lucene which is a search engine library for text
searches.
Solr in itself is not a replacement for any database as it does not support
any relational db features, however as Jack and David mentioned its fully
optimised search engine platform that can provide all search related
features like faceting, highlighting etc.
Solr does not have a *database*. It stores the data in binary files called
indexes <http://lucene.apache.org/core/3_0_3/fileformats.html>. These
indexes are populated with the data from the database. Solr provides an
inbuilt functionality through DataImportHandler component to get the data
and generate indexes.
When you say, your web servers are mainly doing search function, do you
mean it is a text search and you use queries with clauses as 'like', 'in'
etc. (in addition to multiple joints) to get the results? Does the web
application need faceting? If yes, then solr can be your friend to get it
through.
Do remember that it always takes some time to get the new concepts from
understanding through to implementation. As David mentioned already, it
*is* going to be a bumpy ride at the start but *definitely* a sensational
one.
Good Luck,
Sandeep
On 2 July 2013 17:09, fabio1605 <fa...@btinternet.com> wrote:
> Thanks guys
>
> So SolR is actually a database replacement for mssql... Am I right....
>
>
> We have a lot of perl scripts that contains lots of sql insert
> queries..... Etc
>
>
> How do we query the SolR database from scripts.... I know I have a lot to
> learn still so excuse my ignorance.
>
> Also... What is mongo and how does it compare
>
> I just don't understand how in 10years of Web development I have never
> heard of SolR till last week
>
>
>
>
> Sent from Samsung Mobile
>
> -------- Original message --------
> From: "David Quarterman [via Lucene]" <
> ml-node+s472066n4074772h31@n3.nabble.com>
> Date: 02/07/2013 16:57 (GMT+00:00)
> To: fabio1605 <fa...@btinternet.com>
> Subject: RE: Newbie SolR - Need advice
>
> Hi Fabio,
>
> Like Jack says, try the tutorial. But to answer your question, SOLR isn't
> a bolt on to SQLServer or any other DB. It's a fantastically fast
> indexing/searching tool. You'll need to use the DataImportHandler (see the
> tutorial) to import your data from the DB into the indices that SOLR uses.
> Once in there, you'll have more power & flexibility than SQLServer would
> ever give you!
>
> Haven't tried SOLR on Windows (I guess your environment) but I'm sure
> it'll work using Jetty or Tomcat as web container.
>
> Stick with it. The ride can be bumpy but the experience is sensational!
>
> DQ
>
> -----Original Message-----
> From: fabio1605 [mailto:[hidden email]]
> Sent: 02 July 2013 16:16
> To: [hidden email]
> Subject: Newbie SolR - Need advice
>
> Hi
>
> we have a MSSQL Server which is just getting far to large now and
> performance is dying! the majority of our webservers mainly are doing
> search function so i thought it may be best to move to SolR But i know very
> little about it!
>
> My questions are!
>
> Does SolR Run as a bolt on to MSSQL - as in the data is still in MSSQL and
> SolR is just the search bit between?
>
> Im really struggling to understand the point of SOLR etc so if someone
> could point me to a Dummies website id apprecaite it! google is throwing to
> much confusion at me!
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>
> If you reply to this email, your message will be added to the discussion
> below:
>
> http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746p4074772.html
> To unsubscribe from Newbie SolR - Need advice, click here.
> NAML
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746p4074782.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
RE: Newbie SolR - Need advice
Posted by David Quarterman <da...@corexe.com>.
Hi Fabio,
Sandeep is right - it'll take time. SOLR isn't straightforward when you first start out but the tutorial is the best first step. You can then adapt the various config files in the tutorial to adapt to your situation. I'd recommend a simple approach to get the hang of it and just index one table, specifying some fields to be searched in the schema.xml.
There are some good books around too (Sandeeps's recommendation on Lucidworks is good too). Apache Solr 3.1 Cookbook by Rafal Kuc (still valid for 4.x.x), Jack Krupansky's Solr 4.x Deep Dive - Early Access Release, Solr In Action by Trey Grainger & Tim Potter.
If you need help, shout! It's a great community.
Cheers, DQ
-----Original Message-----
From: fabio1605 [mailto:fabio.tozzi@btinternet.com]
Sent: 03 July 2013 09:55
To: solr-user@lucene.apache.org
Subject: Re: Newbie SolR - Need advice
Hi Sandeep
Thank you for your reply
Il have a read through the tutorials now that i understand the principle of all this,
i would ideally like to keep mssql and bolt solr on top of this so that we can keep mssql as we have a 200GB database
Cheers
--
View this message in context: http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746p4075026.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: Newbie SolR - Need advice
Posted by Sandeep Mestry <sa...@gmail.com>.
+1
On 3 July 2013 14:58, Jack Krupansky <ja...@basetechnology.com> wrote:
> Design your own application layer for both indexing and query that knows
> about both SQL and Solr. Give it a REST API and then your client
> applications can talk to your REST API and not have to care about the
> details of Solr or SQL. That's the best starting point.
>
>
> -- Jack Krupansky
>
> -----Original Message----- From: fabio1605
> Sent: Wednesday, July 03, 2013 4:55 AM
> To: solr-user@lucene.apache.org
> Subject: Re: Newbie SolR - Need advice
>
>
> Hi Sandeep
>
> Thank you for your reply
>
> Il have a read through the tutorials now that i understand the principle of
> all this,
>
> i would ideally like to keep mssql and bolt solr on top of this so that we
> can keep mssql as we have a 200GB database
>
> Cheers
>
>
>
> --
> View this message in context: http://lucene.472066.n3.**
> nabble.com/Newbie-SolR-Need-**advice-tp4074746p4075026.html<http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746p4075026.html>
> Sent from the Solr - User mailing list archive at Nabble.com.
>
Re: Newbie SolR - Need advice
Posted by Jack Krupansky <ja...@basetechnology.com>.
Design your own application layer for both indexing and query that knows
about both SQL and Solr. Give it a REST API and then your client
applications can talk to your REST API and not have to care about the
details of Solr or SQL. That's the best starting point.
-- Jack Krupansky
-----Original Message-----
From: fabio1605
Sent: Wednesday, July 03, 2013 4:55 AM
To: solr-user@lucene.apache.org
Subject: Re: Newbie SolR - Need advice
Hi Sandeep
Thank you for your reply
Il have a read through the tutorials now that i understand the principle of
all this,
i would ideally like to keep mssql and bolt solr on top of this so that we
can keep mssql as we have a 200GB database
Cheers
--
View this message in context:
http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746p4075026.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: Newbie SolR - Need advice
Posted by fabio1605 <fa...@btinternet.com>.
Hi Sandeep
Thank you for your reply
Il have a read through the tutorials now that i understand the principle of
all this,
i would ideally like to keep mssql and bolt solr on top of this so that we
can keep mssql as we have a 200GB database
Cheers
--
View this message in context: http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746p4075026.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: Newbie SolR - Need advice
Posted by Sandeep Mestry <sa...@gmail.com>.
Hi Fabio,
Yes, you're on right track.
I'd like to now direct you to first reply from Jack to go through solr
tutorial.
Even with Solr,, it will take some time to learn various bits and pieces
about designing fields, their field types, server configuration, etc. and
then tune the results to match the results that you're currently getting
from the database. There is lots of info available for Solr on web and do
check Lucidworks' Solr Reference Guide.
http://docs.lucidworks.com/display/solr/Apache+Solr+Reference+Guide;jsessionid=16ED0DB3B6F6BE8CEC6E6CDB207DBC49
Best of Solr Luck!
Sandeep
On 2 July 2013 20:47, fabio1605 <fa...@btinternet.com> wrote:
>
> So, you keep your mssql database, you just don't use it for searches -
> that'll relieve some of the load. Searches then all go through SOLR & its
> Lucene indexes. If your various tables need SQL joins, you specify those in
> the DataImportHandler (DIH) config. That way, when SOLR indexes everything,
> it indexes the data the way you want to see it.
>
> -- SO .... by this you mean we keep mssql as we do!!....
>
> But we use the website to run through SOLR.... SOLR will then handle the
> indexing and retrieval of data from its own index's, and will make its own
> calls to our MSSQL server when required....(i.e updating/adding to
> indexs..)
>
> Am I on the right tracks there now!
>
> So MSSQL becomes the datastore
> SOLR becomes the search engine...
>
>
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746p4074889.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
RE: Newbie SolR - Need advice
Posted by fabio1605 <fa...@btinternet.com>.
So, you keep your mssql database, you just don't use it for searches -
that'll relieve some of the load. Searches then all go through SOLR & its
Lucene indexes. If your various tables need SQL joins, you specify those in
the DataImportHandler (DIH) config. That way, when SOLR indexes everything,
it indexes the data the way you want to see it.
-- SO .... by this you mean we keep mssql as we do!!....
But we use the website to run through SOLR.... SOLR will then handle the
indexing and retrieval of data from its own index's, and will make its own
calls to our MSSQL server when required....(i.e updating/adding to indexs..)
Am I on the right tracks there now!
So MSSQL becomes the datastore
SOLR becomes the search engine...
--
View this message in context: http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746p4074889.html
Sent from the Solr - User mailing list archive at Nabble.com.
RE: Newbie SolR - Need advice
Posted by David Quarterman <da...@corexe.com>.
Don’t worry Fabio - nobody knows everything (apart from Hossman). Following on from Sandeep, to use SOLR, you extract the data from your MSSQL DB using the DataImportHandler and you can then query it, facet it, pivot it to your heart's content. And fast!
You can use almost anything to build the SOLR queries - Java & PHP being probably most popular. There is a library for Perl I think but never tried it.
So, you keep your mssql database, you just don't use it for searches - that'll relieve some of the load. Searches then all go through SOLR & its Lucene indexes. If your various tables need SQL joins, you specify those in the DataImportHandler (DIH) config. That way, when SOLR indexes everything, it indexes the data the way you want to see it.
DIH handles the data export from mssql -> SOLR and it's not too difficult to set up.
You imply you're adding (inserting) data. How much, how often? DIH has a delta import feature so you can add data on the fly to SOLR's indexes.
Much of it come down to the data model you have. My advice would be try it and see. You will be pleasantly surprised!
-----Original Message-----
From: fabio1605 [mailto:fabio.tozzi@btinternet.com]
Sent: 02 July 2013 17:10
To: solr-user@lucene.apache.org
Subject: RE: Newbie SolR - Need advice
Thanks guys
So SolR is actually a database replacement for mssql... Am I right....
We have a lot of perl scripts that contains lots of sql insert queries..... Etc
How do we query the SolR database from scripts.... I know I have a lot to learn still so excuse my ignorance.
Also... What is mongo and how does it compare
I just don't understand how in 10years of Web development I have never heard of SolR till last week
Sent from Samsung Mobile
-------- Original message --------
From: "David Quarterman [via Lucene]" <ml...@n3.nabble.com>
Date: 02/07/2013 16:57 (GMT+00:00)
To: fabio1605 <fa...@btinternet.com>
Subject: RE: Newbie SolR - Need advice
Hi Fabio,
Like Jack says, try the tutorial. But to answer your question, SOLR isn't a bolt on to SQLServer or any other DB. It's a fantastically fast indexing/searching tool. You'll need to use the DataImportHandler (see the tutorial) to import your data from the DB into the indices that SOLR uses. Once in there, you'll have more power & flexibility than SQLServer would ever give you!
Haven't tried SOLR on Windows (I guess your environment) but I'm sure it'll work using Jetty or Tomcat as web container.
Stick with it. The ride can be bumpy but the experience is sensational!
DQ
-----Original Message-----
From: fabio1605 [mailto:[hidden email]]
Sent: 02 July 2013 16:16
To: [hidden email]
Subject: Newbie SolR - Need advice
Hi
we have a MSSQL Server which is just getting far to large now and performance is dying! the majority of our webservers mainly are doing search function so i thought it may be best to move to SolR But i know very little about it!
My questions are!
Does SolR Run as a bolt on to MSSQL - as in the data is still in MSSQL and SolR is just the search bit between?
Im really struggling to understand the point of SOLR etc so if someone could point me to a Dummies website id apprecaite it! google is throwing to much confusion at me!
--
View this message in context: http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746.html
Sent from the Solr - User mailing list archive at Nabble.com.
If you reply to this email, your message will be added to the discussion below:
http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746p4074772.html
To unsubscribe from Newbie SolR - Need advice, click here.
NAML
--
View this message in context: http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746p4074782.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: Newbie SolR - Need advice
Posted by Walter Underwood <wu...@wunderwood.org>.
Solr is not a database and it does not handle SQL queries. --wunder
On Jul 2, 2013, at 9:09 AM, fabio1605 wrote:
> Thanks guys
>
> So SolR is actually a database replacement for mssql... Am I right....
>
>
> We have a lot of perl scripts that contains lots of sql insert queries..... Etc
>
>
> How do we query the SolR database from scripts.... I know I have a lot to learn still so excuse my ignorance.
>
> Also... What is mongo and how does it compare
>
> I just don't understand how in 10years of Web development I have never heard of SolR till last week
>
>
>
>
> Sent from Samsung Mobile
>
> -------- Original message --------
> From: "David Quarterman [via Lucene]" <ml...@n3.nabble.com>
> Date: 02/07/2013 16:57 (GMT+00:00)
> To: fabio1605 <fa...@btinternet.com>
> Subject: RE: Newbie SolR - Need advice
>
> Hi Fabio,
>
> Like Jack says, try the tutorial. But to answer your question, SOLR isn't a bolt on to SQLServer or any other DB. It's a fantastically fast indexing/searching tool. You'll need to use the DataImportHandler (see the tutorial) to import your data from the DB into the indices that SOLR uses. Once in there, you'll have more power & flexibility than SQLServer would ever give you!
>
> Haven't tried SOLR on Windows (I guess your environment) but I'm sure it'll work using Jetty or Tomcat as web container.
>
> Stick with it. The ride can be bumpy but the experience is sensational!
>
> DQ
>
> -----Original Message-----
> From: fabio1605 [mailto:[hidden email]]
> Sent: 02 July 2013 16:16
> To: [hidden email]
> Subject: Newbie SolR - Need advice
>
> Hi
>
> we have a MSSQL Server which is just getting far to large now and performance is dying! the majority of our webservers mainly are doing search function so i thought it may be best to move to SolR But i know very little about it!
>
> My questions are!
>
> Does SolR Run as a bolt on to MSSQL - as in the data is still in MSSQL and SolR is just the search bit between?
>
> Im really struggling to understand the point of SOLR etc so if someone could point me to a Dummies website id apprecaite it! google is throwing to much confusion at me!
>
>
>
> --
> View this message in context: http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>
> If you reply to this email, your message will be added to the discussion below:
> http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746p4074772.html
> To unsubscribe from Newbie SolR - Need advice, click here.
> NAML
>
>
>
> --
> View this message in context: http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746p4074782.html
> Sent from the Solr - User mailing list archive at Nabble.com.
--
Walter Underwood
wunder@wunderwood.org
Re: Newbie SolR - Need advice
Posted by Shawn Heisey <so...@elyograg.org>.
On 7/2/2013 10:09 AM, fabio1605 wrote:
> Thanks guys
>
> So SolR is actually a database replacement for mssql... Am I right....
>
>
> We have a lot of perl scripts that contains lots of sql insert queries..... Etc
>
>
> How do we query the SolR database from scripts.... I know I have a lot to learn still so excuse my ignorance.
>
> Also... What is mongo and how does it compare
>
> I just don't understand how in 10years of Web development I have never heard of SolR till last week
Solr is not really a database. Solr 4.x has a lot of features that make
it function well in some limited NoSQL roles, but it's a search engine,
not a database. It is a good idea to use the "stored" setting on your
Solr fields only for those fields that are required to fully display a
search result listing, then use your database as the canonical data
store for displaying full information for a single search result when
the user clicks on it.
Aside from letting you know that it's not a good idea to give Microsoft
your money, I can't really say anything bad about MSSQL. If it's
working for you and your performance (aside from search) is good,
there's no real reason to move away from it as a data repository.
MongoDB is a NoSQL database. That would be a candidate for replacing
MSSQL. Whether or not it could actually replace it depends on your data
model.
Thanks,
Shawn
RE: Newbie SolR - Need advice
Posted by fabio1605 <fa...@btinternet.com>.
Thanks guys
So SolR is actually a database replacement for mssql... Am I right....
We have a lot of perl scripts that contains lots of sql insert queries..... Etc
How do we query the SolR database from scripts.... I know I have a lot to learn still so excuse my ignorance.
Also... What is mongo and how does it compare
I just don't understand how in 10years of Web development I have never heard of SolR till last week
Sent from Samsung Mobile
-------- Original message --------
From: "David Quarterman [via Lucene]" <ml...@n3.nabble.com>
Date: 02/07/2013 16:57 (GMT+00:00)
To: fabio1605 <fa...@btinternet.com>
Subject: RE: Newbie SolR - Need advice
Hi Fabio,
Like Jack says, try the tutorial. But to answer your question, SOLR isn't a bolt on to SQLServer or any other DB. It's a fantastically fast indexing/searching tool. You'll need to use the DataImportHandler (see the tutorial) to import your data from the DB into the indices that SOLR uses. Once in there, you'll have more power & flexibility than SQLServer would ever give you!
Haven't tried SOLR on Windows (I guess your environment) but I'm sure it'll work using Jetty or Tomcat as web container.
Stick with it. The ride can be bumpy but the experience is sensational!
DQ
-----Original Message-----
From: fabio1605 [mailto:[hidden email]]
Sent: 02 July 2013 16:16
To: [hidden email]
Subject: Newbie SolR - Need advice
Hi
we have a MSSQL Server which is just getting far to large now and performance is dying! the majority of our webservers mainly are doing search function so i thought it may be best to move to SolR But i know very little about it!
My questions are!
Does SolR Run as a bolt on to MSSQL - as in the data is still in MSSQL and SolR is just the search bit between?
Im really struggling to understand the point of SOLR etc so if someone could point me to a Dummies website id apprecaite it! google is throwing to much confusion at me!
--
View this message in context: http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746.html
Sent from the Solr - User mailing list archive at Nabble.com.
If you reply to this email, your message will be added to the discussion below:
http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746p4074772.html
To unsubscribe from Newbie SolR - Need advice, click here.
NAML
--
View this message in context: http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746p4074782.html
Sent from the Solr - User mailing list archive at Nabble.com.
RE: Newbie SolR - Need advice
Posted by David Quarterman <da...@corexe.com>.
Hi Fabio,
Like Jack says, try the tutorial. But to answer your question, SOLR isn't a bolt on to SQLServer or any other DB. It's a fantastically fast indexing/searching tool. You'll need to use the DataImportHandler (see the tutorial) to import your data from the DB into the indices that SOLR uses. Once in there, you'll have more power & flexibility than SQLServer would ever give you!
Haven't tried SOLR on Windows (I guess your environment) but I'm sure it'll work using Jetty or Tomcat as web container.
Stick with it. The ride can be bumpy but the experience is sensational!
DQ
-----Original Message-----
From: fabio1605 [mailto:fabio.tozzi@btinternet.com]
Sent: 02 July 2013 16:16
To: solr-user@lucene.apache.org
Subject: Newbie SolR - Need advice
Hi
we have a MSSQL Server which is just getting far to large now and performance is dying! the majority of our webservers mainly are doing search function so i thought it may be best to move to SolR But i know very little about it!
My questions are!
Does SolR Run as a bolt on to MSSQL - as in the data is still in MSSQL and SolR is just the search bit between?
Im really struggling to understand the point of SOLR etc so if someone could point me to a Dummies website id apprecaite it! google is throwing to much confusion at me!
--
View this message in context: http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746.html
Sent from the Solr - User mailing list archive at Nabble.com.