You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by shekhar sharma <sh...@gmail.com> on 2012/07/20 07:57:19 UTC
Nutch and Solr
Hi All,
I am running Nutch(1.5.1) on Hadoop antd succesfully crawled some pages. I
would like to use Solr for indexing the crawled pages, but while going
through lot of posts, i found so many information that i am lost..
i have few questions..
(1) Can i use the solr jar which comes with Nutch distribution? or do i
have to install Solr seperately and integrate all of the three (nutch solr
and hadoop)
(2) Is it good to use Lily (Hadoop,HBase and Solr)
SOmewhere i read that distributing indexing is not possible, you need to
write your own indexing logic ..
Can you please suggest something?
Regards,
Som
RE: Nutch and Solr
Posted by Markus Jelsma <ma...@openindex.io>.
You don't run Solr on Hadoop, just separate of Nutch. Integration is the same as when running stand alone, it's http.
-----Original message-----
> From:shekhar sharma <sh...@gmail.com>
> Sent: Fri 20-Jul-2012 13:22
> To: user@nutch.apache.org
> Subject: Re: Nutch and Solr
>
> But would that integration of solr and nutch will work on hadoop?
> I can run nutch on hadoop but i am not sure about solr...Let me try
>
> Regards,
> Som
>
> On Fri, Jul 20, 2012 at 4:46 PM, Jim Chandler <ja...@gmail.com>wrote:
>
> > Hi Som,
> >
> > for (1) I found the following useful.
> > http://wiki.apache.org/nutch/NutchTutorial
> >
> > as for (2) I've never used Lily soI can't speak to that.
> >
> > Jim
> >
> > On Fri, Jul 20, 2012 at 1:57 AM, shekhar sharma <shekhar2581@gmail.com
> > >wrote:
> >
> > > Hi All,
> > > I am running Nutch(1.5.1) on Hadoop antd succesfully crawled some pages.
> > I
> > > would like to use Solr for indexing the crawled pages, but while going
> > > through lot of posts, i found so many information that i am lost..
> > > i have few questions..
> > >
> > > (1) Can i use the solr jar which comes with Nutch distribution? or do i
> > > have to install Solr seperately and integrate all of the three (nutch
> > solr
> > > and hadoop)
> > >
> > > (2) Is it good to use Lily (Hadoop,HBase and Solr)
> > >
> > > SOmewhere i read that distributing indexing is not possible, you need to
> > > write your own indexing logic ..
> > >
> > > Can you please suggest something?
> > >
> > > Regards,
> > > Som
> > >
> >
>
Re: Nutch and Solr
Posted by shekhar sharma <sh...@gmail.com>.
But would that integration of solr and nutch will work on hadoop?
I can run nutch on hadoop but i am not sure about solr...Let me try
Regards,
Som
On Fri, Jul 20, 2012 at 4:46 PM, Jim Chandler <ja...@gmail.com>wrote:
> Hi Som,
>
> for (1) I found the following useful.
> http://wiki.apache.org/nutch/NutchTutorial
>
> as for (2) I've never used Lily soI can't speak to that.
>
> Jim
>
> On Fri, Jul 20, 2012 at 1:57 AM, shekhar sharma <shekhar2581@gmail.com
> >wrote:
>
> > Hi All,
> > I am running Nutch(1.5.1) on Hadoop antd succesfully crawled some pages.
> I
> > would like to use Solr for indexing the crawled pages, but while going
> > through lot of posts, i found so many information that i am lost..
> > i have few questions..
> >
> > (1) Can i use the solr jar which comes with Nutch distribution? or do i
> > have to install Solr seperately and integrate all of the three (nutch
> solr
> > and hadoop)
> >
> > (2) Is it good to use Lily (Hadoop,HBase and Solr)
> >
> > SOmewhere i read that distributing indexing is not possible, you need to
> > write your own indexing logic ..
> >
> > Can you please suggest something?
> >
> > Regards,
> > Som
> >
>
Re: Nutch and Solr
Posted by Jim Chandler <ja...@gmail.com>.
Hi Som,
for (1) I found the following useful.
http://wiki.apache.org/nutch/NutchTutorial
as for (2) I've never used Lily soI can't speak to that.
Jim
On Fri, Jul 20, 2012 at 1:57 AM, shekhar sharma <sh...@gmail.com>wrote:
> Hi All,
> I am running Nutch(1.5.1) on Hadoop antd succesfully crawled some pages. I
> would like to use Solr for indexing the crawled pages, but while going
> through lot of posts, i found so many information that i am lost..
> i have few questions..
>
> (1) Can i use the solr jar which comes with Nutch distribution? or do i
> have to install Solr seperately and integrate all of the three (nutch solr
> and hadoop)
>
> (2) Is it good to use Lily (Hadoop,HBase and Solr)
>
> SOmewhere i read that distributing indexing is not possible, you need to
> write your own indexing logic ..
>
> Can you please suggest something?
>
> Regards,
> Som
>