You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hama.apache.org by 胡月胜 <ys...@gmail.com> on 2011/12/20 10:11:00 UTC
pagerank problem
Hi guys, I am a student of C&S and a beginner of HAMA. When I test HAMA
pagerank with the input file that download from the website(
http://hama-shortest-paths.googlecode.com/svn/trunk/hama-gsoc/files/pagerank/input/pagerankAdjacencylist.txt),
there is always terminated with a NullPointerExceptions. But when I use the
input file with my own's instead, the program can give the right answer. I
checked the HAMA wiki, found nothing about this problem. So, I need your
help. Thank you very much ! And sorry for my English.
Re: pagerank problem
Posted by 胡月胜 <ys...@gmail.com>.
Thank you.
在 2011年12月20日 下午8:51，Thomas Jungblut <th...@googlemail.com>写道：
> Hi,
>
> Edward has already told you to use the graph creator, this won't work for
> pagerank because this is for the SSSP example ;)
> However, I thought that the file worked somehow some time ago, but I don't
> really have the time to debug this.
> But if it works with your file, this is fine ;)
>
> The code to generate the pagerank graph is here:
>
> http://code.google.com/p/hama-shortest-paths/source/browse/trunk/hama-gsoc/src/de/jungblut/hama/util/AdjacencyListCreator.java
> The method called "createPageRankAdjacencyList()" is used for it, but be
> aware that it uses lots of memory.
> There is this file needed which contains urls delimited by "\n". (or in
> every line is a url).
> But I don't have this file anymore, which is worse. I remember processing
> the stuff from dmoz.org, but I don't remember where I put the source code
> to it.
>
> I hope I helped you a bit, rather than confusing you ;)
>
> 2011/12/20 Edward J. Yoon <ed...@apache.org>
>
> > oh, sorry. above files are just for SSSP example, not Pagerank.
> >
> > 2011/12/20 胡月胜 <ys...@gmail.com>:
> > > Thanks for your reply. I am using the 0.3.0 version. And Hadoop version
> > is
> > > 0.20.2. I will try the solutions you provided. Thank you!
> > >
> > > 2011/12/20 Edward J. Yoon <ed...@apache.org>
> > >
> > >> Or download this:
> > >>
> > >> http://udanax.org/sssp-small.seq
> > >>
> > >> By the way, what's version do you use? I would recommend you to use
> > TRUNK.
> > >>
> > >> On Tue, Dec 20, 2011 at 7:03 PM, Edward J. Yoon <
> edwardyoon@apache.org>
> > >> wrote:
> > >> > We'll update wiki soon. If you want to run now, Please use this
> > >> > MapReduce program to generate random graph:
> > >> >
> > >> > http://people.apache.org/~edwardyoon/RandomGraphGen.java
> > >> >
> > >> > On Tue, Dec 20, 2011 at 6:11 PM, 胡月胜 <ys...@gmail.com>
> wrote:
> > >> >> Hi guys, I am a student of C&S and a beginner of HAMA. When I test
> > HAMA
> > >> >> pagerank with the input file that download from the website(
> > >> >>
> > >>
> >
> http://hama-shortest-paths.googlecode.com/svn/trunk/hama-gsoc/files/pagerank/input/pagerankAdjacencylist.txt
> > >> ),
> > >> >> there is always terminated with a NullPointerExceptions. But when I
> > use
> > >> the
> > >> >> input file with my own's instead, the program can give the right
> > >> answer. I
> > >> >> checked the HAMA wiki, found nothing about this problem. So, I need
> > your
> > >> >> help. Thank you very much ! And sorry for my English.
> > >> >
> > >> >
> > >> >
> > >> > --
> > >> > Best Regards, Edward J. Yoon
> > >> > @eddieyoon
> > >>
> > >>
> > >>
> > >> --
> > >> Best Regards, Edward J. Yoon
> > >> @eddieyoon
> > >>
> >
> >
> >
> > --
> > Best Regards, Edward J. Yoon
> > @eddieyoon
> >
>
>
>
> --
> Thomas Jungblut
> Berlin <th...@gmail.com>
>
Re: pagerank problem
Posted by Thomas Jungblut <th...@googlemail.com>.
Hi,
Edward has already told you to use the graph creator, this won't work for
pagerank because this is for the SSSP example ;)
However, I thought that the file worked somehow some time ago, but I don't
really have the time to debug this.
But if it works with your file, this is fine ;)
The code to generate the pagerank graph is here:
http://code.google.com/p/hama-shortest-paths/source/browse/trunk/hama-gsoc/src/de/jungblut/hama/util/AdjacencyListCreator.java
The method called "createPageRankAdjacencyList()" is used for it, but be
aware that it uses lots of memory.
There is this file needed which contains urls delimited by "\n". (or in
every line is a url).
But I don't have this file anymore, which is worse. I remember processing
the stuff from dmoz.org, but I don't remember where I put the source code
to it.
I hope I helped you a bit, rather than confusing you ;)
2011/12/20 Edward J. Yoon <ed...@apache.org>
> oh, sorry. above files are just for SSSP example, not Pagerank.
>
> 2011/12/20 胡月胜 <ys...@gmail.com>:
> > Thanks for your reply. I am using the 0.3.0 version. And Hadoop version
> is
> > 0.20.2. I will try the solutions you provided. Thank you!
> >
> > 2011/12/20 Edward J. Yoon <ed...@apache.org>
> >
> >> Or download this:
> >>
> >> http://udanax.org/sssp-small.seq
> >>
> >> By the way, what's version do you use? I would recommend you to use
> TRUNK.
> >>
> >> On Tue, Dec 20, 2011 at 7:03 PM, Edward J. Yoon <ed...@apache.org>
> >> wrote:
> >> > We'll update wiki soon. If you want to run now, Please use this
> >> > MapReduce program to generate random graph:
> >> >
> >> > http://people.apache.org/~edwardyoon/RandomGraphGen.java
> >> >
> >> > On Tue, Dec 20, 2011 at 6:11 PM, 胡月胜 <ys...@gmail.com> wrote:
> >> >> Hi guys, I am a student of C&S and a beginner of HAMA. When I test
> HAMA
> >> >> pagerank with the input file that download from the website(
> >> >>
> >>
> http://hama-shortest-paths.googlecode.com/svn/trunk/hama-gsoc/files/pagerank/input/pagerankAdjacencylist.txt
> >> ),
> >> >> there is always terminated with a NullPointerExceptions. But when I
> use
> >> the
> >> >> input file with my own's instead, the program can give the right
> >> answer. I
> >> >> checked the HAMA wiki, found nothing about this problem. So, I need
> your
> >> >> help. Thank you very much ! And sorry for my English.
> >> >
> >> >
> >> >
> >> > --
> >> > Best Regards, Edward J. Yoon
> >> > @eddieyoon
> >>
> >>
> >>
> >> --
> >> Best Regards, Edward J. Yoon
> >> @eddieyoon
> >>
>
>
>
> --
> Best Regards, Edward J. Yoon
> @eddieyoon
>
--
Thomas Jungblut
Berlin <th...@gmail.com>
Re: pagerank problem
Posted by "Edward J. Yoon" <ed...@apache.org>.
oh, sorry. above files are just for SSSP example, not Pagerank.
2011/12/20 胡月胜 <ys...@gmail.com>:
> Thanks for your reply. I am using the 0.3.0 version. And Hadoop version is
> 0.20.2. I will try the solutions you provided. Thank you!
>
> 2011/12/20 Edward J. Yoon <ed...@apache.org>
>
>> Or download this:
>>
>> http://udanax.org/sssp-small.seq
>>
>> By the way, what's version do you use? I would recommend you to use TRUNK.
>>
>> On Tue, Dec 20, 2011 at 7:03 PM, Edward J. Yoon <ed...@apache.org>
>> wrote:
>> > We'll update wiki soon. If you want to run now, Please use this
>> > MapReduce program to generate random graph:
>> >
>> > http://people.apache.org/~edwardyoon/RandomGraphGen.java
>> >
>> > On Tue, Dec 20, 2011 at 6:11 PM, 胡月胜 <ys...@gmail.com> wrote:
>> >> Hi guys, I am a student of C&S and a beginner of HAMA. When I test HAMA
>> >> pagerank with the input file that download from the website(
>> >>
>> http://hama-shortest-paths.googlecode.com/svn/trunk/hama-gsoc/files/pagerank/input/pagerankAdjacencylist.txt
>> ),
>> >> there is always terminated with a NullPointerExceptions. But when I use
>> the
>> >> input file with my own's instead, the program can give the right
>> answer. I
>> >> checked the HAMA wiki, found nothing about this problem. So, I need your
>> >> help. Thank you very much ! And sorry for my English.
>> >
>> >
>> >
>> > --
>> > Best Regards, Edward J. Yoon
>> > @eddieyoon
>>
>>
>>
>> --
>> Best Regards, Edward J. Yoon
>> @eddieyoon
>>
--
Best Regards, Edward J. Yoon
@eddieyoon
Re: pagerank problem
Posted by 胡月胜 <ys...@gmail.com>.
Thanks for your reply. I am using the 0.3.0 version. And Hadoop version is
0.20.2. I will try the solutions you provided. Thank you!
2011/12/20 Edward J. Yoon <ed...@apache.org>
> Or download this:
>
> http://udanax.org/sssp-small.seq
>
> By the way, what's version do you use? I would recommend you to use TRUNK.
>
> On Tue, Dec 20, 2011 at 7:03 PM, Edward J. Yoon <ed...@apache.org>
> wrote:
> > We'll update wiki soon. If you want to run now, Please use this
> > MapReduce program to generate random graph:
> >
> > http://people.apache.org/~edwardyoon/RandomGraphGen.java
> >
> > On Tue, Dec 20, 2011 at 6:11 PM, 胡月胜 <ys...@gmail.com> wrote:
> >> Hi guys, I am a student of C&S and a beginner of HAMA. When I test HAMA
> >> pagerank with the input file that download from the website(
> >>
> http://hama-shortest-paths.googlecode.com/svn/trunk/hama-gsoc/files/pagerank/input/pagerankAdjacencylist.txt
> ),
> >> there is always terminated with a NullPointerExceptions. But when I use
> the
> >> input file with my own's instead, the program can give the right
> answer. I
> >> checked the HAMA wiki, found nothing about this problem. So, I need your
> >> help. Thank you very much ! And sorry for my English.
> >
> >
> >
> > --
> > Best Regards, Edward J. Yoon
> > @eddieyoon
>
>
>
> --
> Best Regards, Edward J. Yoon
> @eddieyoon
>
Re: pagerank problem
Posted by "Edward J. Yoon" <ed...@apache.org>.
Or download this:
http://udanax.org/sssp-small.seq
By the way, what's version do you use? I would recommend you to use TRUNK.
On Tue, Dec 20, 2011 at 7:03 PM, Edward J. Yoon <ed...@apache.org> wrote:
> We'll update wiki soon. If you want to run now, Please use this
> MapReduce program to generate random graph:
>
> http://people.apache.org/~edwardyoon/RandomGraphGen.java
>
> On Tue, Dec 20, 2011 at 6:11 PM, 胡月胜 <ys...@gmail.com> wrote:
>> Hi guys, I am a student of C&S and a beginner of HAMA. When I test HAMA
>> pagerank with the input file that download from the website(
>> http://hama-shortest-paths.googlecode.com/svn/trunk/hama-gsoc/files/pagerank/input/pagerankAdjacencylist.txt),
>> there is always terminated with a NullPointerExceptions. But when I use the
>> input file with my own's instead, the program can give the right answer. I
>> checked the HAMA wiki, found nothing about this problem. So, I need your
>> help. Thank you very much ! And sorry for my English.
>
>
>
> --
> Best Regards, Edward J. Yoon
> @eddieyoon
--
Best Regards, Edward J. Yoon
@eddieyoon
Re: pagerank problem
Posted by "Edward J. Yoon" <ed...@apache.org>.
We'll update wiki soon. If you want to run now, Please use this
MapReduce program to generate random graph:
http://people.apache.org/~edwardyoon/RandomGraphGen.java
On Tue, Dec 20, 2011 at 6:11 PM, 胡月胜 <ys...@gmail.com> wrote:
> Hi guys, I am a student of C&S and a beginner of HAMA. When I test HAMA
> pagerank with the input file that download from the website(
> http://hama-shortest-paths.googlecode.com/svn/trunk/hama-gsoc/files/pagerank/input/pagerankAdjacencylist.txt),
> there is always terminated with a NullPointerExceptions. But when I use the
> input file with my own's instead, the program can give the right answer. I
> checked the HAMA wiki, found nothing about this problem. So, I need your
> help. Thank you very much ! And sorry for my English.
--
Best Regards, Edward J. Yoon
@eddieyoon