You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by praful <pr...@gmail.com> on 2012/07/09 18:21:08 UTC

Nutch.war file

Q-1) I tried building 'build.xml' from nutch folder by running it in eclipse
ant, but to my bad luck,i couldnt find nutch.war anywhere in my workplace.
It aint available inside the unzipped nutch-bin also.
Where can i find nutch.war file?? I am using Nutch-1.4


Q-2) I read somewhere that its better to crawl from Nutch and search via
Solr. So, I integrated Solr within Nutch. Would that mean I would see a new
replacement searching UI for Solr instead of Nutch searching UI or would it
be same as Nutch UI ?? 
I mean this Nutch UI [1]: 

http://www.google.co.in/imgres?q=nutch&um=1&hl=en&sa=N&biw=1366&bih=667&tbm=isch&tbnid=29yBPvjJbGXPTM:&imgrefurl=http://www.java.net/pub/a/today/2006/02/16/introduction-to-nutch-2.html&docid=69xYu60x353AyM&imgurl=http://today.java.net/images/2006/02/nutch-figure-2-1.gif&w=500&h=325&ei=B0D6T8bgA5GrrAeO_Z3eBg&zoom=1&iact=hc&vpx=687&vpy=192&dur=2329&hovh=181&hovw=279&tx=149&ty=100&sig=101777148678843861437&page=1&tbnh=121&tbnw=186&start=0&ndsp=18&ved=1t:429,r:3,s:0,i:96

--
View this message in context: http://lucene.472066.n3.nabble.com/Nutch-war-file-tp3993943.html
Sent from the Nutch - User mailing list archive at Nabble.com.

Re: Nutch.war file

Posted by praful <pr...@gmail.com>.
Thanks Lewis

I got Ajax-solr running. Thank You very much for your assistance
throughout.
I just want to ask 1 last question please.

I want to know that although ajax-solr is running but it's searching under
only reuters data. If I want to crawl the web using nutch and integrate it
with solr,then i have to replace solr's schema.xml file with nutch's
schema.xml file which will not be according to ajax-solr configuration.

How would I now integrate Solr with Nutch so as Ajax-Solr can search other
data on the web as well??

Thanks
Regards


--
View this message in context: http://lucene.472066.n3.nabble.com/Nutch-war-file-tp3993943p3995029.html
Sent from the Nutch - User mailing list archive at Nabble.com.

Re: Nutch.war file

Posted by Julien Nioche <li...@gmail.com>.
This us the nutch user mailing list, not the Ajax solr one. Thanks

On 14 July 2012 13:22, praful <pr...@gmail.com> wrote:

> Ajax-Solr isnt working yet. I am using Solr 3.4, edited the schema.xml file
> according to the tutorial provided at
> https://github.com/evolvingweb/ajax-solr/wiki/Reuters-tutorial. Changed my
> solrURL to http://http://localhost:8080/solr/. but still it does not run.
>
> I am opening index.html via tomcat. It just shows the index1 template with
> loading circle in the result section and thats it. No calender,no map
> nothing at all. Where does the problem lies??
>
> Moreover when i edited schema.xml and browse to
> http://localhost:8080/solr/,
> it then pops up an error saying "Server errors in solr configuration"??
>
> Plus what does these statements mean?
> *"If you are using your own Solr instance, you may want to change the
> values assigned to the fields keys."*
> *AND*
> *" If you are not using your own Solr instance, you may want to change (or
> remove) the lines adding facet links for topics, organisations and
> exchanges."*
> *
> *
> *
> *
> Kindly help. I am stuck with this for past 2 days now.
> Thanks
> Regards
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Nutch-war-file-tp3993943p3995002.html
> Sent from the Nutch - User mailing list archive at Nabble.com.
>



-- 
*
*Open Source Solutions for Text Engineering

http://digitalpebble.blogspot.com/
http://www.digitalpebble.com
http://twitter.com/digitalpebble

Re: Nutch.war file

Posted by praful <pr...@gmail.com>.
Ajax-Solr isnt working yet. I am using Solr 3.4, edited the schema.xml file
according to the tutorial provided at
https://github.com/evolvingweb/ajax-solr/wiki/Reuters-tutorial. Changed my
solrURL to http://http://localhost:8080/solr/. but still it does not run.

I am opening index.html via tomcat. It just shows the index1 template with
loading circle in the result section and thats it. No calender,no map
nothing at all. Where does the problem lies??

Moreover when i edited schema.xml and browse to http://localhost:8080/solr/,
it then pops up an error saying "Server errors in solr configuration"??

Plus what does these statements mean?
*"If you are using your own Solr instance, you may want to change the
values assigned to the fields keys."*
*AND*
*" If you are not using your own Solr instance, you may want to change (or
remove) the lines adding facet links for topics, organisations and
exchanges."*
*
*
*
*
Kindly help. I am stuck with this for past 2 days now.
Thanks
Regards


--
View this message in context: http://lucene.472066.n3.nabble.com/Nutch-war-file-tp3993943p3995002.html
Sent from the Nutch - User mailing list archive at Nabble.com.

Re: Nutch.war file

Posted by Lewis John Mcgibbney <le...@gmail.com>.
https://github.com/evolvingweb/ajax-solr/wiki/Reuters-tutorial

On Thu, Jul 12, 2012 at 5:20 PM, praful <pr...@gmail.com> wrote:
> On Thu, Jul 12, 2012 at 9:01 PM, lewis john mcgibbney [via Lucene] <





-- 
Lewis

Re: Nutch.war file

Posted by praful <pr...@gmail.com>.
On Thu, Jul 12, 2012 at 9:01 PM, lewis john mcgibbney [via Lucene] <
ml-node+s472066n3994663h83@n3.nabble.com> wrote:

> Hi praful,
>
> On Thu, Jul 12, 2012 at 12:33 PM, praful <[hidden email]<http://user/SendEmail.jtp?type=node&node=3994663&i=0>>
> wrote:
>
> > I dont know how to integrate it with Solr. Into which directory of Solr
> > does Ajax-Solr goes?
> > Please suggest something.
>
> This is for the google group. Please see
> https://groups.google.com/forum/?fromgroups#!forum/ajax-solr
>
> ------------I have gone through almost all the threads of this group but
couldnt find any appropriate solution for the same. Can you please help me
in rectifying the problem!!!

Thanks
Regards
Praful Bagai

>
>


--
View this message in context: http://lucene.472066.n3.nabble.com/Nutch-war-file-tp3993943p3994674.html
Sent from the Nutch - User mailing list archive at Nabble.com.

Re: Nutch.war file

Posted by Lewis John Mcgibbney <le...@gmail.com>.
Hi praful,

On Thu, Jul 12, 2012 at 12:33 PM, praful <pr...@gmail.com> wrote:

> I dont know how to integrate it with Solr. Into which directory of Solr
> does Ajax-Solr goes?
> Please suggest something.

This is for the google group. Please see
https://groups.google.com/forum/?fromgroups#!forum/ajax-solr

 Here's the link to patch
> https://issues.apache.org/jira/browse/SOLR-3244. I guess I didnt applied it
> properly using IDE. Whats the issue?

This is for the dev@solr lists I would suggest if you are using SOlr
Alpha versions.

Thanks and hope you get it sorted.

Lewis

Re: Nutch.war file

Posted by praful <pr...@gmail.com>.
Hi again Lewis,

I did a bit of R&D on Ajax-Solr for setting it up on my system.
I understood what it tries to do with the tutorial you provided me, but
unfortunately, I am not able to able to set it up on my system.
I dont know how to integrate it with Solr. Into which directory of Solr
does Ajax-Solr goes?
Please suggest something.

One thing more, I just upgraded my Solr to Solr4.0 Alpha version but my
tomcat isnt running it. It says I need to active the 'admin handlers' under
solrconfig.xml which is already active. I googled it and applied a patch to
it but still its not running. Here's the link to patch
https://issues.apache.org/jira/browse/SOLR-3244. I guess I didnt applied it
properly using IDE. Whats the issue?

Currently I am using Solr 3.4 and Nutch 1.4

Thanks
Regards
Praful Bagai


--
View this message in context: http://lucene.472066.n3.nabble.com/Nutch-war-file-tp3993943p3994623.html
Sent from the Nutch - User mailing list archive at Nabble.com.

Re: Nutch.war file

Posted by praful <pr...@gmail.com>.
Ohhhh...Thanks..I was waiting desperately for this mail. Kept refreshing
every minute or two.
Thanks a lot Lewis.
Will get back on to you when finished with the links you provided....
Regards


--
View this message in context: http://lucene.472066.n3.nabble.com/Nutch-war-file-tp3993943p3994257.html
Sent from the Nutch - User mailing list archive at Nabble.com.

Re: Nutch.war file

Posted by Lewis John Mcgibbney <le...@gmail.com>.
Hi,

On Tue, Jul 10, 2012 at 8:42 PM, praful <pr...@gmail.com> wrote:
----Can you please recommend some tools for the same .
>

http://wiki.apache.org/nutch/bin/nutch_readdb
http://wiki.apache.org/nutch/bin/nutch%20readlinkdb
http://wiki.apache.org/nutch/bin/nutch_readseg


>
> --------------Can I have a link of that page which will help me understand
> it much better??

https://github.com/evolvingweb/ajax-solr/

Lewis

Re: Nutch.war file

Posted by praful <pr...@gmail.com>.
>
>
> > But then how should we browse the crawled data which is fetched by nutch
> > crawler from various webpages??
>
> Well you can do it manually from the Nutch side by using the various

tools provided. Check out the wiki page on command line options. ------
>

------Can you please recommend some tools for the same .

>
> > I integrated Solr with Nutch and when i search something using Solr UI,
> it
> > just returns back a set of XML code, which to my knowledge is of no use.
> > How should i browse the data.??
>
> There are a number of client libraries to put on top of Solr. This is
> not really appropriate for Nutch user lists. One client library I've
> used quickly and simply in the past was ajax-solr however this may or
> may not suit your requirements/programming style!
>
> > I want that it should return back a set of webpages when a query is
> fired
> > ,just like Google result page does . Is it possible then??
> >
>
> Through a client library used on top of Solr yes...
>

--------------Can I have a link of that page which will help me understand
it much better??

Thanks
Regards


--
View this message in context: http://lucene.472066.n3.nabble.com/Nutch-war-file-tp3993943p3994242.html
Sent from the Nutch - User mailing list archive at Nabble.com.

Re: Nutch.war file

Posted by Lewis John Mcgibbney <le...@gmail.com>.
Hi,

On Tue, Jul 10, 2012 at 7:15 PM, praful <pr...@gmail.com> wrote:

> But then how should we browse the crawled data which is fetched by nutch
> crawler from various webpages??

Well you can do it manually from the Nutch side by using the various
tools provided. Check out the wiki page on command line options.

> I integrated Solr with Nutch and when i search something using Solr UI, it
> just returns back a set of XML code, which to my knowledge is of no use.
> How should i browse the data.??

There are a number of client libraries to put on top of Solr. This is
not really appropriate for Nutch user lists. One client library I've
used quickly and simply in the past was ajax-solr however this may or
may not suit your requirements/programming style!

> I want that it should return back a set of webpages when a query is fired
> ,just like Google result page does . Is it possible then??
>

Through a client library used on top of Solr yes...

hth

Lewis


>
>
> --
> View this message in context: http://lucene.472066.n3.nabble.com/Nutch-war-file-tp3993943p3994223.html
> Sent from the Nutch - User mailing list archive at Nabble.com.



-- 
Lewis

Re: Nutch.war file

Posted by praful <pr...@gmail.com>.
Thanks for commenting back.
But then how should we browse the crawled data which is fetched by nutch
crawler from various webpages??
I integrated Solr with Nutch and when i search something using Solr UI, it
just returns back a set of XML code, which to my knowledge is of no use.
How should i browse the data.??
I want that it should return back a set of webpages when a query is fired
,just like Google result page does . Is it possible then??

Thanks
Regards
Praful Bagai


--
View this message in context: http://lucene.472066.n3.nabble.com/Nutch-war-file-tp3993943p3994223.html
Sent from the Nutch - User mailing list archive at Nabble.com.

Re: Nutch.war file

Posted by Lewis John Mcgibbney <le...@gmail.com>.
Hi Praful,

On Mon, Jul 9, 2012 at 5:21 PM, praful <pr...@gmail.com> wrote:
> Q-1) I tried building 'build.xml' from nutch folder by running it in eclipse
> ant, but to my bad luck,i couldnt find nutch.war anywhere in my workplace.
> It aint available inside the unzipped nutch-bin also.
> Where can i find nutch.war file?? I am using Nutch-1.4

It no longer exists. If you wish to use it please use Nutch 1.2
(highly unrecommended though). Search was delegrated to Apache Solr
some time ago.

Best

Lewis

>
>
> Q-2) I read somewhere that its better to crawl from Nutch and search via
> Solr. So, I integrated Solr within Nutch. Would that mean I would see a new
> replacement searching UI for Solr instead of Nutch searching UI or would it
> be same as Nutch UI ??
> I mean this Nutch UI [1]:
>
> http://www.google.co.in/imgres?q=nutch&um=1&hl=en&sa=N&biw=1366&bih=667&tbm=isch&tbnid=29yBPvjJbGXPTM:&imgrefurl=http://www.java.net/pub/a/today/2006/02/16/introduction-to-nutch-2.html&docid=69xYu60x353AyM&imgurl=http://today.java.net/images/2006/02/nutch-figure-2-1.gif&w=500&h=325&ei=B0D6T8bgA5GrrAeO_Z3eBg&zoom=1&iact=hc&vpx=687&vpy=192&dur=2329&hovh=181&hovw=279&tx=149&ty=100&sig=101777148678843861437&page=1&tbnh=121&tbnw=186&start=0&ndsp=18&ved=1t:429,r:3,s:0,i:96
>
> --
> View this message in context: http://lucene.472066.n3.nabble.com/Nutch-war-file-tp3993943.html
> Sent from the Nutch - User mailing list archive at Nabble.com.



-- 
Lewis