You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by klunwebale <kl...@gmail.com> on 2015/01/06 09:39:53 UTC
Vertical search Engine
hello
i want to create a vertical search engine like trovit.com.
I have installed solr and solarium.
What else to i need can you recommend a suitable crawler
and how to structure my data to be indexed
--
View this message in context: http://lucene.472066.n3.nabble.com/Vertical-search-Engine-tp4177542.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: Vertical search Engine
Posted by Dominique Bejean <do...@eolya.fr>.
Hi,
You can have a look at www.crawl-anywhere.com
A web crawler on top of Solr. Used for following vertical search engines :
http://www.hurisearch.org/
http://www.searchamnesty.org/
Regards
Dominique
2015-01-06 15:22 GMT+01:00 Ahmet Arslan <io...@yahoo.com.invalid>:
> Hi,
>
> http://manifoldcf.apache.org is another option to consider.
> It is useful to crawl projected pages.
>
> Free resources :
>
> http://www.manning.com/wright/ManifoldCFinAction_manuscript.pdf
> https://manifoldcfinaction.googlecode.com/svn/trunk/pdfs/
>
> Ahmet
>
>
>
> On Tuesday, January 6, 2015 1:56 PM, Jack Krupansky <
> jack.krupansky@gmail.com> wrote:
> Consider the Fusion product from LucidWorks:
> http://lucidworks.com/product/fusion/
>
> Structuring of your data should be driven by your queries and access
> patterns - what are the most common queries and what are the most extreme
> and complex queries that you expect to handle, both tin terms of the
> queries are expressed and the results being returned.
>
> -- Jack Krupansky
>
>
> On Tue, Jan 6, 2015 at 3:39 AM, klunwebale <kl...@gmail.com> wrote:
>
> > hello
> >
> > i want to create a vertical search engine like trovit.com.
> >
> > I have installed solr and solarium.
> >
> > What else to i need can you recommend a suitable crawler
> > and how to structure my data to be indexed
> >
> >
> >
> > --
> > View this message in context:
> > http://lucene.472066.n3.nabble.com/Vertical-search-Engine-tp4177542.html
> > Sent from the Solr - User mailing list archive at Nabble.com.
> >
>
Re: Vertical search Engine
Posted by Ahmet Arslan <io...@yahoo.com.INVALID>.
Hi,
http://manifoldcf.apache.org is another option to consider.
It is useful to crawl projected pages.
Free resources :
http://www.manning.com/wright/ManifoldCFinAction_manuscript.pdf
https://manifoldcfinaction.googlecode.com/svn/trunk/pdfs/
Ahmet
On Tuesday, January 6, 2015 1:56 PM, Jack Krupansky <ja...@gmail.com> wrote:
Consider the Fusion product from LucidWorks:
http://lucidworks.com/product/fusion/
Structuring of your data should be driven by your queries and access
patterns - what are the most common queries and what are the most extreme
and complex queries that you expect to handle, both tin terms of the
queries are expressed and the results being returned.
-- Jack Krupansky
On Tue, Jan 6, 2015 at 3:39 AM, klunwebale <kl...@gmail.com> wrote:
> hello
>
> i want to create a vertical search engine like trovit.com.
>
> I have installed solr and solarium.
>
> What else to i need can you recommend a suitable crawler
> and how to structure my data to be indexed
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Vertical-search-Engine-tp4177542.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
Re: Vertical search Engine
Posted by Jack Krupansky <ja...@gmail.com>.
Consider the Fusion product from LucidWorks:
http://lucidworks.com/product/fusion/
Structuring of your data should be driven by your queries and access
patterns - what are the most common queries and what are the most extreme
and complex queries that you expect to handle, both tin terms of the
queries are expressed and the results being returned.
-- Jack Krupansky
On Tue, Jan 6, 2015 at 3:39 AM, klunwebale <kl...@gmail.com> wrote:
> hello
>
> i want to create a vertical search engine like trovit.com.
>
> I have installed solr and solarium.
>
> What else to i need can you recommend a suitable crawler
> and how to structure my data to be indexed
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Vertical-search-Engine-tp4177542.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
Re: Vertical search Engine
Posted by Furkan KAMACI <fu...@gmail.com>.
Hi,
You should estimate the size of the data you will index before you decide
crawler. Crawler is out of scope at this mail list. If you will crawl big
size of data you can check Apache Nutch user list.
Furkan KAMACI
2015-01-06 10:39 GMT+02:00 klunwebale <kl...@gmail.com>:
> hello
>
> i want to create a vertical search engine like trovit.com.
>
> I have installed solr and solarium.
>
> What else to i need can you recommend a suitable crawler
> and how to structure my data to be indexed
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Vertical-search-Engine-tp4177542.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>