You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Jihene Ferchichi Jmal <fe...@hotmail.fr> on 2011/12/06 09:03:09 UTC
search the web and get the number of hits corresponding to a
particular request
Hello,
I need to search the web with nutch and under eclipse.I am not familiar with nutch and I want please a documentary or someone who can explain in a simple way how to search the web and to get the number of hits corresponding to a particular request.I want in fact to get the page count of a word (how many pages contain the word ipod for example)like we can do with google or altavista. For ipod there are 1 280 000 000 pagesI need this number of hits.
Thank you very much for responding meI am sincerely in need of help
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------Jihene Ferchichi JmalPhD studentUniversity of Tunis
Higher Institute of Management
Department of Computer SciencesLARODECTunisiaMail : fer.jmal_jihene@hotmail.fr
-creéz votre site web (blog) gratuitement et facilement:www.viteblog.com
-passez vos annonces gratuitement cliquez ici: www.bicoeur.com
Re: search the web and get the number of hits corresponding to a
particular request
Posted by Lewis John Mcgibbney <le...@gmail.com>.
Apache Nutch focuses solely on Web crawling now. Most of this stuff relates
directly to term frequency or something similar and you will therefore
maybe be better heading over to the Solr lists for your searching queries.
If you check out the Nutch wiki you will see all of the documentation we
have relating to Crawling the Web. You can then index your material to
Solr. I hope this helps.
On Tue, Dec 6, 2011 at 8:03 AM, Jihene Ferchichi Jmal <
fer.jmal_jihene@hotmail.fr> wrote:
>
> Hello,
> I need to search the web with nutch and under eclipse.I am not familiar
> with nutch and I want please a documentary or someone who can explain in a
> simple way how to search the web and to get the number of hits
> corresponding to a particular request.I want in fact to get the page count
> of a word (how many pages contain the word ipod for example)like we can do
> with google or altavista. For ipod there are 1 280 000 000 pagesI need this
> number of hits.
> Thank you very much for responding meI am sincerely in need of help
>
> ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------Jihene
> Ferchichi JmalPhD studentUniversity of Tunis
> Higher Institute of Management
> Department of Computer SciencesLARODECTunisiaMail :
> fer.jmal_jihene@hotmail.fr
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> -creéz votre site web (blog) gratuitement et facilement:www.viteblog.com
>
> -passez vos annonces gratuitement cliquez ici: www.bicoeur.com
>
>
>
>
>
>
>
>
>
>
>
--
*Lewis*
RE: search the web and get the number of hits corresponding to a
particular request
Posted by Jihene Ferchichi Jmal <fe...@hotmail.fr>.
that's what I want to do.But I didn't find any free API to do this in my eclipse programI want to access to a search engine with my proper programDid you understand me please
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------Jihene Ferchichi JmalPhD studentUniversity of Tunis
Higher Institute of Management
Department of Computer SciencesLARODECTunisiaMail : fer.jmal_jihene@hotmail.fr
-creéz votre site web (blog) gratuitement et facilement:www.viteblog.com
-passez vos annonces gratuitement cliquez ici: www.bicoeur.com
> From: markus.jelsma@openindex.io
> To: user@nutch.apache.org
> Subject: Re: search the web and get the number of hits corresponding to a particular request
> Date: Tue, 6 Dec 2011 10:20:29 +0100
>
> It's expensive and hard indeed. Why not use a search engine such as Yahoo or
> Google or Baidu?
>
> > it's hard so !!!!there is not another manner to search the web pleaseyou
> > did not know another way?I am sorry if I insist but I am sincerely in need
> > for help :(
> >
> > ---------------------------------------------------------------------------
> > ---------------------------------------------------------------------------
> > ------------------------------------------------------------------------Jih
> > ene Ferchichi JmalPhD studentUniversity of Tunis Higher Institute of
> > Management
> > Department of Computer SciencesLARODECTunisiaMail :
> > fer.jmal_jihene@hotmail.fr
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > -creéz votre site web (blog) gratuitement et facilement:www.viteblog.com
> >
> > -passez vos annonces gratuitement cliquez ici: www.bicoeur.com
> >
> > > From: markus.jelsma@openindex.io
> > > To: user@nutch.apache.org
> > > Subject: Re: search the web and get the number of hits corresponding to a
> > > particular request Date: Tue, 6 Dec 2011 10:08:29 +0100
> > >
> > > Yes, i believe it is feasible but you are going to need a _lot_ of
> > > hardware and a solid understanding of Hadoop, on which Nutch runs.
> > >
> > > http://wiki.apache.org/nutch/
> > >
> > > > I ask you is it feasible with nutch?and can you send me the link of the
> > > > tutorial please?thank you
> > > >
> > > > -----------------------------------------------------------------------
> > > > ----
> > > > ----------------------------------------------------------------------
> > > > -----
> > > > ----------------------------------------------------------------------
> > > > --Jih ene Ferchichi JmalPhD studentUniversity of Tunis Higher Institute
> > > > of Management
> > > > Department of Computer SciencesLARODECTunisiaMail :
> > > > fer.jmal_jihene@hotmail.fr
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > -creéz votre site web (blog) gratuitement et
> > > > facilement:www.viteblog.com
> > > >
> > > > -passez vos annonces gratuitement cliquez ici: www.bicoeur.com
> > > >
> > > > > From: markus.jelsma@openindex.io
> > > > > To: user@nutch.apache.org
> > > > > Subject: Re: search the web and get the number of hits corresponding
> > > > > to a particular request Date: Tue, 6 Dec 2011 09:58:22 +0100
> > > > >
> > > > > Hi,
> > > > >
> > > > > If you're going to search the web i suggest you start with the
> > > > > tutorial and get familiar with Nutch.
> > > > >
> > > > > Cheers
> > > > >
> > > > > > Hello,
> > > > > > I need to search the web with nutch and under eclipse.I am not
> > > > > > familiar with nutch and I want please a documentary or someone who
> > > > > > can explain in a simple way how to search the web and to get the
> > > > > > number of hits corresponding to a particular request.I want in
> > > > > > fact to get the page count of a word (how many pages contain the
> > > > > > word ipod for example)like we can do with google or altavista. For
> > > > > > ipod there are 1 280 000 000 pagesI need this number of hits.
> > > > > > Thank you very much for responding meI am sincerely in need of
> > > > > > help
> > > > > >
> > > > > > -------------------------------------------------------------------
> > > > > > ---- ----
> > > > > > -------------------------------------------------------------------
> > > > > > --- -----
> > > > > > -------------------------------------------------------------------
> > > > > > --- --Jih ene Ferchichi JmalPhD studentUniversity of Tunis Higher
> > > > > > Institute of Management
> > > > > > Department of Computer SciencesLARODECTunisiaMail :
> > > > > > fer.jmal_jihene@hotmail.fr
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > -creéz votre site web (blog) gratuitement et
> > > > > > facilement:www.viteblog.com
> > > > > >
> > > > > > -passez vos annonces gratuitement cliquez ici: www.bicoeur.com
Re: search the web and get the number of hits corresponding to a particular request
Posted by Markus Jelsma <ma...@openindex.io>.
It's expensive and hard indeed. Why not use a search engine such as Yahoo or
Google or Baidu?
> it's hard so !!!!there is not another manner to search the web pleaseyou
> did not know another way?I am sorry if I insist but I am sincerely in need
> for help :(
>
> ---------------------------------------------------------------------------
> ---------------------------------------------------------------------------
> ------------------------------------------------------------------------Jih
> ene Ferchichi JmalPhD studentUniversity of Tunis Higher Institute of
> Management
> Department of Computer SciencesLARODECTunisiaMail :
> fer.jmal_jihene@hotmail.fr
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> -creéz votre site web (blog) gratuitement et facilement:www.viteblog.com
>
> -passez vos annonces gratuitement cliquez ici: www.bicoeur.com
>
> > From: markus.jelsma@openindex.io
> > To: user@nutch.apache.org
> > Subject: Re: search the web and get the number of hits corresponding to a
> > particular request Date: Tue, 6 Dec 2011 10:08:29 +0100
> >
> > Yes, i believe it is feasible but you are going to need a _lot_ of
> > hardware and a solid understanding of Hadoop, on which Nutch runs.
> >
> > http://wiki.apache.org/nutch/
> >
> > > I ask you is it feasible with nutch?and can you send me the link of the
> > > tutorial please?thank you
> > >
> > > -----------------------------------------------------------------------
> > > ----
> > > ----------------------------------------------------------------------
> > > -----
> > > ----------------------------------------------------------------------
> > > --Jih ene Ferchichi JmalPhD studentUniversity of Tunis Higher Institute
> > > of Management
> > > Department of Computer SciencesLARODECTunisiaMail :
> > > fer.jmal_jihene@hotmail.fr
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > -creéz votre site web (blog) gratuitement et
> > > facilement:www.viteblog.com
> > >
> > > -passez vos annonces gratuitement cliquez ici: www.bicoeur.com
> > >
> > > > From: markus.jelsma@openindex.io
> > > > To: user@nutch.apache.org
> > > > Subject: Re: search the web and get the number of hits corresponding
> > > > to a particular request Date: Tue, 6 Dec 2011 09:58:22 +0100
> > > >
> > > > Hi,
> > > >
> > > > If you're going to search the web i suggest you start with the
> > > > tutorial and get familiar with Nutch.
> > > >
> > > > Cheers
> > > >
> > > > > Hello,
> > > > > I need to search the web with nutch and under eclipse.I am not
> > > > > familiar with nutch and I want please a documentary or someone who
> > > > > can explain in a simple way how to search the web and to get the
> > > > > number of hits corresponding to a particular request.I want in
> > > > > fact to get the page count of a word (how many pages contain the
> > > > > word ipod for example)like we can do with google or altavista. For
> > > > > ipod there are 1 280 000 000 pagesI need this number of hits.
> > > > > Thank you very much for responding meI am sincerely in need of
> > > > > help
> > > > >
> > > > > -------------------------------------------------------------------
> > > > > ---- ----
> > > > > -------------------------------------------------------------------
> > > > > --- -----
> > > > > -------------------------------------------------------------------
> > > > > --- --Jih ene Ferchichi JmalPhD studentUniversity of Tunis Higher
> > > > > Institute of Management
> > > > > Department of Computer SciencesLARODECTunisiaMail :
> > > > > fer.jmal_jihene@hotmail.fr
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > -creéz votre site web (blog) gratuitement et
> > > > > facilement:www.viteblog.com
> > > > >
> > > > > -passez vos annonces gratuitement cliquez ici: www.bicoeur.com
RE: search the web and get the number of hits corresponding to a
particular request
Posted by Jihene Ferchichi Jmal <fe...@hotmail.fr>.
it's hard so !!!!there is not another manner to search the web pleaseyou did not know another way?I am sorry if I insist but I am sincerely in need for help :(
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------Jihene Ferchichi JmalPhD studentUniversity of Tunis
Higher Institute of Management
Department of Computer SciencesLARODECTunisiaMail : fer.jmal_jihene@hotmail.fr
-creéz votre site web (blog) gratuitement et facilement:www.viteblog.com
-passez vos annonces gratuitement cliquez ici: www.bicoeur.com
> From: markus.jelsma@openindex.io
> To: user@nutch.apache.org
> Subject: Re: search the web and get the number of hits corresponding to a particular request
> Date: Tue, 6 Dec 2011 10:08:29 +0100
>
> Yes, i believe it is feasible but you are going to need a _lot_ of hardware
> and a solid understanding of Hadoop, on which Nutch runs.
>
> http://wiki.apache.org/nutch/
>
>
> > I ask you is it feasible with nutch?and can you send me the link of the
> > tutorial please?thank you
> >
> > ---------------------------------------------------------------------------
> > ---------------------------------------------------------------------------
> > ------------------------------------------------------------------------Jih
> > ene Ferchichi JmalPhD studentUniversity of Tunis Higher Institute of
> > Management
> > Department of Computer SciencesLARODECTunisiaMail :
> > fer.jmal_jihene@hotmail.fr
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > -creéz votre site web (blog) gratuitement et facilement:www.viteblog.com
> >
> > -passez vos annonces gratuitement cliquez ici: www.bicoeur.com
> >
> > > From: markus.jelsma@openindex.io
> > > To: user@nutch.apache.org
> > > Subject: Re: search the web and get the number of hits corresponding to a
> > > particular request Date: Tue, 6 Dec 2011 09:58:22 +0100
> > >
> > > Hi,
> > >
> > > If you're going to search the web i suggest you start with the tutorial
> > > and get familiar with Nutch.
> > >
> > > Cheers
> > >
> > > > Hello,
> > > > I need to search the web with nutch and under eclipse.I am not familiar
> > > > with nutch and I want please a documentary or someone who can explain
> > > > in a simple way how to search the web and to get the number of hits
> > > > corresponding to a particular request.I want in fact to get the page
> > > > count of a word (how many pages contain the word ipod for example)like
> > > > we can do with google or altavista. For ipod there are 1 280 000 000
> > > > pagesI need this number of hits. Thank you very much for responding
> > > > meI am sincerely in need of help
> > > >
> > > > -----------------------------------------------------------------------
> > > > ----
> > > > ----------------------------------------------------------------------
> > > > -----
> > > > ----------------------------------------------------------------------
> > > > --Jih ene Ferchichi JmalPhD studentUniversity of Tunis Higher Institute
> > > > of Management
> > > > Department of Computer SciencesLARODECTunisiaMail :
> > > > fer.jmal_jihene@hotmail.fr
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > -creéz votre site web (blog) gratuitement et
> > > > facilement:www.viteblog.com
> > > >
> > > > -passez vos annonces gratuitement cliquez ici: www.bicoeur.com
Re: search the web and get the number of hits corresponding to a particular request
Posted by Markus Jelsma <ma...@openindex.io>.
Yes, i believe it is feasible but you are going to need a _lot_ of hardware
and a solid understanding of Hadoop, on which Nutch runs.
http://wiki.apache.org/nutch/
> I ask you is it feasible with nutch?and can you send me the link of the
> tutorial please?thank you
>
> ---------------------------------------------------------------------------
> ---------------------------------------------------------------------------
> ------------------------------------------------------------------------Jih
> ene Ferchichi JmalPhD studentUniversity of Tunis Higher Institute of
> Management
> Department of Computer SciencesLARODECTunisiaMail :
> fer.jmal_jihene@hotmail.fr
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> -creéz votre site web (blog) gratuitement et facilement:www.viteblog.com
>
> -passez vos annonces gratuitement cliquez ici: www.bicoeur.com
>
> > From: markus.jelsma@openindex.io
> > To: user@nutch.apache.org
> > Subject: Re: search the web and get the number of hits corresponding to a
> > particular request Date: Tue, 6 Dec 2011 09:58:22 +0100
> >
> > Hi,
> >
> > If you're going to search the web i suggest you start with the tutorial
> > and get familiar with Nutch.
> >
> > Cheers
> >
> > > Hello,
> > > I need to search the web with nutch and under eclipse.I am not familiar
> > > with nutch and I want please a documentary or someone who can explain
> > > in a simple way how to search the web and to get the number of hits
> > > corresponding to a particular request.I want in fact to get the page
> > > count of a word (how many pages contain the word ipod for example)like
> > > we can do with google or altavista. For ipod there are 1 280 000 000
> > > pagesI need this number of hits. Thank you very much for responding
> > > meI am sincerely in need of help
> > >
> > > -----------------------------------------------------------------------
> > > ----
> > > ----------------------------------------------------------------------
> > > -----
> > > ----------------------------------------------------------------------
> > > --Jih ene Ferchichi JmalPhD studentUniversity of Tunis Higher Institute
> > > of Management
> > > Department of Computer SciencesLARODECTunisiaMail :
> > > fer.jmal_jihene@hotmail.fr
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > -creéz votre site web (blog) gratuitement et
> > > facilement:www.viteblog.com
> > >
> > > -passez vos annonces gratuitement cliquez ici: www.bicoeur.com
RE: search the web and get the number of hits corresponding to a
particular request
Posted by Jihene Ferchichi Jmal <fe...@hotmail.fr>.
I ask you is it feasible with nutch?and can you send me the link of the tutorial please?thank you
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------Jihene Ferchichi JmalPhD studentUniversity of Tunis
Higher Institute of Management
Department of Computer SciencesLARODECTunisiaMail : fer.jmal_jihene@hotmail.fr
-creéz votre site web (blog) gratuitement et facilement:www.viteblog.com
-passez vos annonces gratuitement cliquez ici: www.bicoeur.com
> From: markus.jelsma@openindex.io
> To: user@nutch.apache.org
> Subject: Re: search the web and get the number of hits corresponding to a particular request
> Date: Tue, 6 Dec 2011 09:58:22 +0100
>
> Hi,
>
> If you're going to search the web i suggest you start with the tutorial and
> get familiar with Nutch.
>
> Cheers
>
> > Hello,
> > I need to search the web with nutch and under eclipse.I am not familiar
> > with nutch and I want please a documentary or someone who can explain in a
> > simple way how to search the web and to get the number of hits
> > corresponding to a particular request.I want in fact to get the page count
> > of a word (how many pages contain the word ipod for example)like we can do
> > with google or altavista. For ipod there are 1 280 000 000 pagesI need
> > this number of hits. Thank you very much for responding meI am sincerely
> > in need of help
> >
> > ---------------------------------------------------------------------------
> > ---------------------------------------------------------------------------
> > ------------------------------------------------------------------------Jih
> > ene Ferchichi JmalPhD studentUniversity of Tunis Higher Institute of
> > Management
> > Department of Computer SciencesLARODECTunisiaMail :
> > fer.jmal_jihene@hotmail.fr
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > -creéz votre site web (blog) gratuitement et facilement:www.viteblog.com
> >
> > -passez vos annonces gratuitement cliquez ici: www.bicoeur.com
Re: search the web and get the number of hits corresponding to a particular request
Posted by Markus Jelsma <ma...@openindex.io>.
Hi,
If you're going to search the web i suggest you start with the tutorial and
get familiar with Nutch.
Cheers
> Hello,
> I need to search the web with nutch and under eclipse.I am not familiar
> with nutch and I want please a documentary or someone who can explain in a
> simple way how to search the web and to get the number of hits
> corresponding to a particular request.I want in fact to get the page count
> of a word (how many pages contain the word ipod for example)like we can do
> with google or altavista. For ipod there are 1 280 000 000 pagesI need
> this number of hits. Thank you very much for responding meI am sincerely
> in need of help
>
> ---------------------------------------------------------------------------
> ---------------------------------------------------------------------------
> ------------------------------------------------------------------------Jih
> ene Ferchichi JmalPhD studentUniversity of Tunis Higher Institute of
> Management
> Department of Computer SciencesLARODECTunisiaMail :
> fer.jmal_jihene@hotmail.fr
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> -creéz votre site web (blog) gratuitement et facilement:www.viteblog.com
>
> -passez vos annonces gratuitement cliquez ici: www.bicoeur.com