You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by "Sethi, Parampreet" <pa...@teamaol.com> on 2011/07/18 22:52:51 UTC
Nutch War file
Hi All,
I downloaded the source code for Nutch 1.3 version. I tried generating war
file using command:
Ant war
But I am getting error (I checked the build.xml, the war task is indeed
missing.)
BUILD FAILED
Target "war" does not exist in the project "Nutch".
Is there any other way to generate nutch.war in 1.3 version?
Thanks
Param
Re: Nutch War file
Posted by lewis john mcgibbney <le...@gmail.com>.
You can start your solr instance and check that way...
Alternatively please have a look at at the various command line options for
checking the results of a Nutch crawl [1], I would focus on readdb for your
crawling first.
Checking downloaded html content can be done once you have undertaken a
parse with the parsechecker tool if I am not mistaken.
Well we have legacy Hadoop tutorials which in this instance can be found
here[2]. It would be great to get a Nutch 1.3 Hadoop tutorial up and running
however I have been slightly short on time. I think the new tutorial will
build from the one I have pointed you towards. Please feel free to provide
any information you feel necessary in order to get this geared towards Nutch
1.3
[1] http://wiki.apache.org/nutch/CommandLineOptions
[2] http://wiki.apache.org/nutch/NutchHadoopTutorial
On Mon, Jul 18, 2011 at 10:10 PM, Sethi, Parampreet <
parampreet.sethi@teamaol.com> wrote:
> Hey Lewis,
> Thanks for the quick reply. I have setup Nutch with Solr and I am able to
> index the documents in solr server. How can I check the downloaded html
> content? I need to parse the content to fetch rich snippets data from
> various sites.
>
> Also, I have installed hadoop separately on my system and was trying to
> integrate hadoop with Nutch. Is there any tutorial available to do this?
>
> Thanks
> Param
> AIM : parampreetsethi
> Blog: http://param-techie.blogspot.com
>
> On 7/18/11 5:01 PM, "lewis john mcgibbney" <le...@gmail.com>
> wrote:
>
> > Simple answer here is no.
> >
> > Both the web app and Lucene index which previously shipped with Nutch has
> > been deprecated.
> >
> > Please have a a look at the new tutorial [1] and the site for more
> > information on the new functionality and features which ship with Nutch
> 1.3
> >
> > [1] http://wiki.apache.org/nutch/RunningNutchAndSolr
> >
> >
> > On Mon, Jul 18, 2011 at 9:52 PM, Sethi, Parampreet <
> > parampreet.sethi@teamaol.com> wrote:
> >
> >> Hi All,
> >>
> >> I downloaded the source code for Nutch 1.3 version. I tried generating
> war
> >> file using command:
> >> Ant war
> >>
> >> But I am getting error (I checked the build.xml, the war task is indeed
> >> missing.)
> >>
> >> BUILD FAILED
> >> Target "war" does not exist in the project "Nutch".
> >>
> >> Is there any other way to generate nutch.war in 1.3 version?
> >>
> >> Thanks
> >> Param
> >>
> >>
> >
>
>
--
*Lewis*
Re: Nutch War file
Posted by El-Glabro <de...@t-hoster.com>.
I have solved my problem with this:
$ bin/nutch readseg -get crawl_urls/segments/XXXXXX
http://thepagethatyouwanttosee/uri/
On 18/07/11 23:10, Sethi, Parampreet wrote:
> Hey Lewis,
> Thanks for the quick reply. I have setup Nutch with Solr and I am able to
> index the documents in solr server. How can I check the downloaded html
> content? I need to parse the content to fetch rich snippets data from
> various sites.
>
> Also, I have installed hadoop separately on my system and was trying to
> integrate hadoop with Nutch. Is there any tutorial available to do this?
>
> Thanks
> Param
> AIM : parampreetsethi
> Blog: http://param-techie.blogspot.com
>
> On 7/18/11 5:01 PM, "lewis john mcgibbney"<le...@gmail.com>
> wrote:
>
>
>> Simple answer here is no.
>>
>> Both the web app and Lucene index which previously shipped with Nutch has
>> been deprecated.
>>
>> Please have a a look at the new tutorial [1] and the site for more
>> information on the new functionality and features which ship with Nutch 1.3
>>
>> [1] http://wiki.apache.org/nutch/RunningNutchAndSolr
>>
>>
>> On Mon, Jul 18, 2011 at 9:52 PM, Sethi, Parampreet<
>> parampreet.sethi@teamaol.com> wrote:
>>
>>
>>> Hi All,
>>>
>>> I downloaded the source code for Nutch 1.3 version. I tried generating war
>>> file using command:
>>> Ant war
>>>
>>> But I am getting error (I checked the build.xml, the war task is indeed
>>> missing.)
>>>
>>> BUILD FAILED
>>> Target "war" does not exist in the project "Nutch".
>>>
>>> Is there any other way to generate nutch.war in 1.3 version?
>>>
>>> Thanks
>>> Param
>>>
>>>
>>>
>>
>
Re: Nutch War file
Posted by El-Glabro <de...@t-hoster.com>.
Hi to all, also I am trying to configure Nutch and Solr for the first
time in these days, and also I am curious to know if it's possible to
"grep" some content from the pages fetched by Nutch.
Thanks in advance
El-Glabro
On 18/07/11 23:10, Sethi, Parampreet wrote:
> Hey Lewis,
> Thanks for the quick reply. I have setup Nutch with Solr and I am able to
> index the documents in solr server. How can I check the downloaded html
> content? I need to parse the content to fetch rich snippets data from
> various sites.
>
> Also, I have installed hadoop separately on my system and was trying to
> integrate hadoop with Nutch. Is there any tutorial available to do this?
>
> Thanks
> Param
> AIM : parampreetsethi
> Blog: http://param-techie.blogspot.com
>
> On 7/18/11 5:01 PM, "lewis john mcgibbney"<le...@gmail.com>
> wrote:
>
>
>> Simple answer here is no.
>>
>> Both the web app and Lucene index which previously shipped with Nutch has
>> been deprecated.
>>
>> Please have a a look at the new tutorial [1] and the site for more
>> information on the new functionality and features which ship with Nutch 1.3
>>
>> [1] http://wiki.apache.org/nutch/RunningNutchAndSolr
>>
>>
>> On Mon, Jul 18, 2011 at 9:52 PM, Sethi, Parampreet<
>> parampreet.sethi@teamaol.com> wrote:
>>
>>
>>> Hi All,
>>>
>>> I downloaded the source code for Nutch 1.3 version. I tried generating war
>>> file using command:
>>> Ant war
>>>
>>> But I am getting error (I checked the build.xml, the war task is indeed
>>> missing.)
>>>
>>> BUILD FAILED
>>> Target "war" does not exist in the project "Nutch".
>>>
>>> Is there any other way to generate nutch.war in 1.3 version?
>>>
>>> Thanks
>>> Param
>>>
>>>
>>>
>>
>
Re: Nutch War file
Posted by "Sethi, Parampreet" <pa...@teamaol.com>.
Hey Lewis,
Thanks for the quick reply. I have setup Nutch with Solr and I am able to
index the documents in solr server. How can I check the downloaded html
content? I need to parse the content to fetch rich snippets data from
various sites.
Also, I have installed hadoop separately on my system and was trying to
integrate hadoop with Nutch. Is there any tutorial available to do this?
Thanks
Param
AIM : parampreetsethi
Blog: http://param-techie.blogspot.com
On 7/18/11 5:01 PM, "lewis john mcgibbney" <le...@gmail.com>
wrote:
> Simple answer here is no.
>
> Both the web app and Lucene index which previously shipped with Nutch has
> been deprecated.
>
> Please have a a look at the new tutorial [1] and the site for more
> information on the new functionality and features which ship with Nutch 1.3
>
> [1] http://wiki.apache.org/nutch/RunningNutchAndSolr
>
>
> On Mon, Jul 18, 2011 at 9:52 PM, Sethi, Parampreet <
> parampreet.sethi@teamaol.com> wrote:
>
>> Hi All,
>>
>> I downloaded the source code for Nutch 1.3 version. I tried generating war
>> file using command:
>> Ant war
>>
>> But I am getting error (I checked the build.xml, the war task is indeed
>> missing.)
>>
>> BUILD FAILED
>> Target "war" does not exist in the project "Nutch".
>>
>> Is there any other way to generate nutch.war in 1.3 version?
>>
>> Thanks
>> Param
>>
>>
>
Re: Nutch War file
Posted by lewis john mcgibbney <le...@gmail.com>.
Simple answer here is no.
Both the web app and Lucene index which previously shipped with Nutch has
been deprecated.
Please have a a look at the new tutorial [1] and the site for more
information on the new functionality and features which ship with Nutch 1.3
[1] http://wiki.apache.org/nutch/RunningNutchAndSolr
On Mon, Jul 18, 2011 at 9:52 PM, Sethi, Parampreet <
parampreet.sethi@teamaol.com> wrote:
> Hi All,
>
> I downloaded the source code for Nutch 1.3 version. I tried generating war
> file using command:
> Ant war
>
> But I am getting error (I checked the build.xml, the war task is indeed
> missing.)
>
> BUILD FAILED
> Target "war" does not exist in the project "Nutch".
>
> Is there any other way to generate nutch.war in 1.3 version?
>
> Thanks
> Param
>
>
--
*Lewis*