You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Roger Marin <rs...@gmail.com> on 2011/07/01 05:22:28 UTC
Using Nutch 1.3 with an embedded solr server
Hello everyone,
I currently have Nutch 1.0 embedded in my application and I would like to
upgrade to the latest version of Nutch, looking at the changelog I see that
the nutch search API is deprecated
and all search functionality has been delegated to SOLR, now I am kinda new
to SOLR but since I am packaging nutch in my app I would need to embed SOLR
as well, looking at the
Nutch source, specifically the SolrIndexerJob, I see that nutch uses
a CommonsHttpSolrServer to index. I am not sure that this will work if I
wanted to use an embedded SOLR server
in my app.
Can anyone suggest what would be the best way to do this?
Thanks in advance.
Re: Using Nutch 1.3 with an embedded solr server
Posted by Roger Marin <rs...@gmail.com>.
Thanks, I'll upgrade to 1.2.
On 4 July 2011 10:12, Markus Jelsma <ma...@openindex.io> wrote:
>
> On Friday 01 July 2011 15:27:34 Roger Marin wrote:
> > Thanks Markus.
> >
> > I've been using nutch for around a year embedded in our app (a CMS) and
> it
> > has been deployed
> > to several of our clients with great success, it would be a pain to start
> > asking our clients to
> > install another tool in order to make crawling+search work, I would at
> > least like to keep it optional.
> > Is there any way I can use nutch 1.3 for crawling and search without
> solr?
>
> This is not possible. You can only upgrade to 1.2.
>
> >
> > Thanks again.
> >
> > On 1 July 2011 06:03, Markus Jelsma <ma...@openindex.io> wrote:
> > > Unless you have a super computer or an extremely small set of documents
> > > to crawl, i'd reconsider. They don't play well on the same (virtual)
> > > machine, let
> > > alone running together in the same application.
> > >
> > > > Hello everyone,
> > > >
> > > > I currently have Nutch 1.0 embedded in my application and I would
> like
> > > > to upgrade to the latest version of Nutch, looking at the changelog I
> > > > see
> > >
> > > that
> > >
> > > > the nutch search API is deprecated
> > > > and all search functionality has been delegated to SOLR, now I am
> kinda
> > >
> > > new
> > >
> > > > to SOLR but since I am packaging nutch in my app I would need to
> embed
> > >
> > > SOLR
> > >
> > > > as well, looking at the
> > > > Nutch source, specifically the SolrIndexerJob, I see that nutch uses
> > > > a CommonsHttpSolrServer to index. I am not sure that this will work
> if
> > > > I wanted to use an embedded SOLR server
> > > > in my app.
> > > >
> > > > Can anyone suggest what would be the best way to do this?
> > > >
> > > > Thanks in advance.
>
> --
> Markus Jelsma - CTO - Openindex
> http://www.linkedin.com/in/markus17
> 050-8536620 / 06-50258350
>
Re: Using Nutch 1.3 with an embedded solr server
Posted by Markus Jelsma <ma...@openindex.io>.
On Friday 01 July 2011 15:27:34 Roger Marin wrote:
> Thanks Markus.
>
> I've been using nutch for around a year embedded in our app (a CMS) and it
> has been deployed
> to several of our clients with great success, it would be a pain to start
> asking our clients to
> install another tool in order to make crawling+search work, I would at
> least like to keep it optional.
> Is there any way I can use nutch 1.3 for crawling and search without solr?
This is not possible. You can only upgrade to 1.2.
>
> Thanks again.
>
> On 1 July 2011 06:03, Markus Jelsma <ma...@openindex.io> wrote:
> > Unless you have a super computer or an extremely small set of documents
> > to crawl, i'd reconsider. They don't play well on the same (virtual)
> > machine, let
> > alone running together in the same application.
> >
> > > Hello everyone,
> > >
> > > I currently have Nutch 1.0 embedded in my application and I would like
> > > to upgrade to the latest version of Nutch, looking at the changelog I
> > > see
> >
> > that
> >
> > > the nutch search API is deprecated
> > > and all search functionality has been delegated to SOLR, now I am kinda
> >
> > new
> >
> > > to SOLR but since I am packaging nutch in my app I would need to embed
> >
> > SOLR
> >
> > > as well, looking at the
> > > Nutch source, specifically the SolrIndexerJob, I see that nutch uses
> > > a CommonsHttpSolrServer to index. I am not sure that this will work if
> > > I wanted to use an embedded SOLR server
> > > in my app.
> > >
> > > Can anyone suggest what would be the best way to do this?
> > >
> > > Thanks in advance.
--
Markus Jelsma - CTO - Openindex
http://www.linkedin.com/in/markus17
050-8536620 / 06-50258350
Re: Using Nutch 1.3 with an embedded solr server
Posted by Markus Jelsma <ma...@openindex.io>.
Unless you have a super computer or an extremely small set of documents to
crawl, i'd reconsider. They don't play well on the same (virtual) machine, let
alone running together in the same application.
> Hello everyone,
>
> I currently have Nutch 1.0 embedded in my application and I would like to
> upgrade to the latest version of Nutch, looking at the changelog I see that
> the nutch search API is deprecated
> and all search functionality has been delegated to SOLR, now I am kinda new
> to SOLR but since I am packaging nutch in my app I would need to embed SOLR
> as well, looking at the
> Nutch source, specifically the SolrIndexerJob, I see that nutch uses
> a CommonsHttpSolrServer to index. I am not sure that this will work if I
> wanted to use an embedded SOLR server
> in my app.
>
> Can anyone suggest what would be the best way to do this?
>
> Thanks in advance.