You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hama.apache.org by Shuo Wang <ec...@gmail.com> on 2012/10/26 08:37:21 UTC
HAMA PageRank Null and Inifity Result
Hi,
I have run pagerank on HAMA. I find that sometimes the results have
many null and infinity. Can you tell me the reason why it has null and
infinity results? Does it relate with
the number of the vertices?
Re: HAMA PageRank Null and Inifity Result
Posted by Thomas Jungblut <th...@gmail.com>.
No idea, never seen this. When dividing by zero an Exception will be
thrown. So you either get very small numbers and get NaN somwhere, but no
idea where you get infitity or NULL.
2012/10/26 Shuo Wang <ec...@gmail.com>
> Ok, it maybe my own reason. Can you tell me when it will have the null or
> infinity result?
>
> 2012/10/26 Thomas Jungblut <th...@gmail.com>
>
> > Works for me:
> >
> > public static void main(String[] args) throws Exception {
> > > args = new String[] {"/tmp/pagerank-in/","/tmp/pagerank-out/"};
> > > HamaConfiguration conf = new HamaConfiguration();
> > > GraphJob createJob = PageRank.createJob(args, conf);
> > >
> > > createJob.waitForCompletion(true);
> > > }
> > >
> >
> > First few lines:
> >
> > > 506314 1.4833970375127825E-6
> > > 506310 9.504322290942259E-7
> > > 13230 5.222581456439986E-7
> > > 13234 6.976645076083461E-7
> > > 346617 1.156442788400425E-6
> > > 273676 5.770845524447161E-7
> > >
> >
> > LOG Counters:
> >
> > > Information: Counters: 9
> > > Okt 26, 2012 9:32:33 AM org.apache.hama.bsp.Counters log
> > > Information: org.apache.hama.bsp.JobInProgress$JobCounter
> > > Okt 26, 2012 9:32:33 AM org.apache.hama.bsp.Counters log
> > > Information: LAUNCHED_TASKS=4
> > > Okt 26, 2012 9:32:33 AM org.apache.hama.bsp.Counters log
> > > Information: org.apache.hama.bsp.BSPPeerImpl$PeerCounter
> > > Okt 26, 2012 9:32:33 AM org.apache.hama.bsp.Counters log
> > > Information: SUPERSTEPS=8
> > > Okt 26, 2012 9:32:33 AM org.apache.hama.bsp.Counters log
> > > Information: SUPERSTEP_SUM=36
> > > Okt 26, 2012 9:32:33 AM org.apache.hama.bsp.Counters log
> > > Information: IO_BYTES_READ=24644092
> > > Okt 26, 2012 9:32:33 AM org.apache.hama.bsp.Counters log
> > > Information: TIME_IN_SYNC_MS=72857
> > > Okt 26, 2012 9:32:33 AM org.apache.hama.bsp.Counters log
> > > Information: TOTAL_MESSAGES_SENT=18200056
> > > Okt 26, 2012 9:32:33 AM org.apache.hama.bsp.Counters log
> > > Information: TASK_INPUT_RECORDS=700000
> > > Okt 26, 2012 9:32:33 AM org.apache.hama.bsp.Counters log
> > > Information: TOTAL_MESSAGES_RECEIVED=9100028
> > > Okt 26, 2012 9:32:33 AM org.apache.hama.bsp.Counters log
> > > Information: TASK_OUTPUT_RECORDS=700000
> > >
> >
> > 2012/10/26 Shuo Wang <ec...@gmail.com>
> >
> > > Ok,I have sent my graph to thomas.jungblut@gmail.com .
> > >
> > > 2012/10/26 Thomas Jungblut <th...@gmail.com>
> > >
> > > > Can you please provide the graph?
> > > >
> > > > 2012/10/26 Shuo Wang <ec...@gmail.com>
> > > >
> > > > > I used the hama-examples-0.6.0-SNAPSHOT.jar in the
> > hama-0.6.0-SNAPSHOT.
> > > > >
> > > > > 2012/10/26 Thomas Jungblut <th...@gmail.com>
> > > > >
> > > > > > Sure do you divide by 0?
> > > > > > Am 26.10.2012 08:37 schrieb "Shuo Wang" <
> ecisp.wangshuo@gmail.com
> > >:
> > > > > >
> > > > > > > Hi,
> > > > > > >
> > > > > > > I have run pagerank on HAMA. I find that sometimes the
> > > > results
> > > > > > have
> > > > > > > many null and infinity. Can you tell me the reason why it has
> > null
> > > > and
> > > > > > > infinity results? Does it relate with
> > > > > > >
> > > > > > > the number of the vertices?
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: HAMA PageRank Null and Inifity Result
Posted by Shuo Wang <ec...@gmail.com>.
Ok, it maybe my own reason. Can you tell me when it will have the null or
infinity result?
2012/10/26 Thomas Jungblut <th...@gmail.com>
> Works for me:
>
> public static void main(String[] args) throws Exception {
> > args = new String[] {"/tmp/pagerank-in/","/tmp/pagerank-out/"};
> > HamaConfiguration conf = new HamaConfiguration();
> > GraphJob createJob = PageRank.createJob(args, conf);
> >
> > createJob.waitForCompletion(true);
> > }
> >
>
> First few lines:
>
> > 506314 1.4833970375127825E-6
> > 506310 9.504322290942259E-7
> > 13230 5.222581456439986E-7
> > 13234 6.976645076083461E-7
> > 346617 1.156442788400425E-6
> > 273676 5.770845524447161E-7
> >
>
> LOG Counters:
>
> > Information: Counters: 9
> > Okt 26, 2012 9:32:33 AM org.apache.hama.bsp.Counters log
> > Information: org.apache.hama.bsp.JobInProgress$JobCounter
> > Okt 26, 2012 9:32:33 AM org.apache.hama.bsp.Counters log
> > Information: LAUNCHED_TASKS=4
> > Okt 26, 2012 9:32:33 AM org.apache.hama.bsp.Counters log
> > Information: org.apache.hama.bsp.BSPPeerImpl$PeerCounter
> > Okt 26, 2012 9:32:33 AM org.apache.hama.bsp.Counters log
> > Information: SUPERSTEPS=8
> > Okt 26, 2012 9:32:33 AM org.apache.hama.bsp.Counters log
> > Information: SUPERSTEP_SUM=36
> > Okt 26, 2012 9:32:33 AM org.apache.hama.bsp.Counters log
> > Information: IO_BYTES_READ=24644092
> > Okt 26, 2012 9:32:33 AM org.apache.hama.bsp.Counters log
> > Information: TIME_IN_SYNC_MS=72857
> > Okt 26, 2012 9:32:33 AM org.apache.hama.bsp.Counters log
> > Information: TOTAL_MESSAGES_SENT=18200056
> > Okt 26, 2012 9:32:33 AM org.apache.hama.bsp.Counters log
> > Information: TASK_INPUT_RECORDS=700000
> > Okt 26, 2012 9:32:33 AM org.apache.hama.bsp.Counters log
> > Information: TOTAL_MESSAGES_RECEIVED=9100028
> > Okt 26, 2012 9:32:33 AM org.apache.hama.bsp.Counters log
> > Information: TASK_OUTPUT_RECORDS=700000
> >
>
> 2012/10/26 Shuo Wang <ec...@gmail.com>
>
> > Ok,I have sent my graph to thomas.jungblut@gmail.com .
> >
> > 2012/10/26 Thomas Jungblut <th...@gmail.com>
> >
> > > Can you please provide the graph?
> > >
> > > 2012/10/26 Shuo Wang <ec...@gmail.com>
> > >
> > > > I used the hama-examples-0.6.0-SNAPSHOT.jar in the
> hama-0.6.0-SNAPSHOT.
> > > >
> > > > 2012/10/26 Thomas Jungblut <th...@gmail.com>
> > > >
> > > > > Sure do you divide by 0?
> > > > > Am 26.10.2012 08:37 schrieb "Shuo Wang" <ecisp.wangshuo@gmail.com
> >:
> > > > >
> > > > > > Hi,
> > > > > >
> > > > > > I have run pagerank on HAMA. I find that sometimes the
> > > results
> > > > > have
> > > > > > many null and infinity. Can you tell me the reason why it has
> null
> > > and
> > > > > > infinity results? Does it relate with
> > > > > >
> > > > > > the number of the vertices?
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: HAMA PageRank Null and Inifity Result
Posted by Thomas Jungblut <th...@gmail.com>.
Works for me:
public static void main(String[] args) throws Exception {
> args = new String[] {"/tmp/pagerank-in/","/tmp/pagerank-out/"};
> HamaConfiguration conf = new HamaConfiguration();
> GraphJob createJob = PageRank.createJob(args, conf);
>
> createJob.waitForCompletion(true);
> }
>
First few lines:
> 506314 1.4833970375127825E-6
> 506310 9.504322290942259E-7
> 13230 5.222581456439986E-7
> 13234 6.976645076083461E-7
> 346617 1.156442788400425E-6
> 273676 5.770845524447161E-7
>
LOG Counters:
> Information: Counters: 9
> Okt 26, 2012 9:32:33 AM org.apache.hama.bsp.Counters log
> Information: org.apache.hama.bsp.JobInProgress$JobCounter
> Okt 26, 2012 9:32:33 AM org.apache.hama.bsp.Counters log
> Information: LAUNCHED_TASKS=4
> Okt 26, 2012 9:32:33 AM org.apache.hama.bsp.Counters log
> Information: org.apache.hama.bsp.BSPPeerImpl$PeerCounter
> Okt 26, 2012 9:32:33 AM org.apache.hama.bsp.Counters log
> Information: SUPERSTEPS=8
> Okt 26, 2012 9:32:33 AM org.apache.hama.bsp.Counters log
> Information: SUPERSTEP_SUM=36
> Okt 26, 2012 9:32:33 AM org.apache.hama.bsp.Counters log
> Information: IO_BYTES_READ=24644092
> Okt 26, 2012 9:32:33 AM org.apache.hama.bsp.Counters log
> Information: TIME_IN_SYNC_MS=72857
> Okt 26, 2012 9:32:33 AM org.apache.hama.bsp.Counters log
> Information: TOTAL_MESSAGES_SENT=18200056
> Okt 26, 2012 9:32:33 AM org.apache.hama.bsp.Counters log
> Information: TASK_INPUT_RECORDS=700000
> Okt 26, 2012 9:32:33 AM org.apache.hama.bsp.Counters log
> Information: TOTAL_MESSAGES_RECEIVED=9100028
> Okt 26, 2012 9:32:33 AM org.apache.hama.bsp.Counters log
> Information: TASK_OUTPUT_RECORDS=700000
>
2012/10/26 Shuo Wang <ec...@gmail.com>
> Ok,I have sent my graph to thomas.jungblut@gmail.com .
>
> 2012/10/26 Thomas Jungblut <th...@gmail.com>
>
> > Can you please provide the graph?
> >
> > 2012/10/26 Shuo Wang <ec...@gmail.com>
> >
> > > I used the hama-examples-0.6.0-SNAPSHOT.jar in the hama-0.6.0-SNAPSHOT.
> > >
> > > 2012/10/26 Thomas Jungblut <th...@gmail.com>
> > >
> > > > Sure do you divide by 0?
> > > > Am 26.10.2012 08:37 schrieb "Shuo Wang" <ec...@gmail.com>:
> > > >
> > > > > Hi,
> > > > >
> > > > > I have run pagerank on HAMA. I find that sometimes the
> > results
> > > > have
> > > > > many null and infinity. Can you tell me the reason why it has null
> > and
> > > > > infinity results? Does it relate with
> > > > >
> > > > > the number of the vertices?
> > > > >
> > > >
> > >
> >
>
Re: HAMA PageRank Null and Inifity Result
Posted by Shuo Wang <ec...@gmail.com>.
Ok,I have sent my graph to thomas.jungblut@gmail.com .
2012/10/26 Thomas Jungblut <th...@gmail.com>
> Can you please provide the graph?
>
> 2012/10/26 Shuo Wang <ec...@gmail.com>
>
> > I used the hama-examples-0.6.0-SNAPSHOT.jar in the hama-0.6.0-SNAPSHOT.
> >
> > 2012/10/26 Thomas Jungblut <th...@gmail.com>
> >
> > > Sure do you divide by 0?
> > > Am 26.10.2012 08:37 schrieb "Shuo Wang" <ec...@gmail.com>:
> > >
> > > > Hi,
> > > >
> > > > I have run pagerank on HAMA. I find that sometimes the
> results
> > > have
> > > > many null and infinity. Can you tell me the reason why it has null
> and
> > > > infinity results? Does it relate with
> > > >
> > > > the number of the vertices?
> > > >
> > >
> >
>
Re: HAMA PageRank Null and Inifity Result
Posted by Thomas Jungblut <th...@gmail.com>.
Can you please provide the graph?
2012/10/26 Shuo Wang <ec...@gmail.com>
> I used the hama-examples-0.6.0-SNAPSHOT.jar in the hama-0.6.0-SNAPSHOT.
>
> 2012/10/26 Thomas Jungblut <th...@gmail.com>
>
> > Sure do you divide by 0?
> > Am 26.10.2012 08:37 schrieb "Shuo Wang" <ec...@gmail.com>:
> >
> > > Hi,
> > >
> > > I have run pagerank on HAMA. I find that sometimes the results
> > have
> > > many null and infinity. Can you tell me the reason why it has null and
> > > infinity results? Does it relate with
> > >
> > > the number of the vertices?
> > >
> >
>
Re: HAMA PageRank Null and Inifity Result
Posted by Shuo Wang <ec...@gmail.com>.
I used the hama-examples-0.6.0-SNAPSHOT.jar in the hama-0.6.0-SNAPSHOT.
2012/10/26 Thomas Jungblut <th...@gmail.com>
> Sure do you divide by 0?
> Am 26.10.2012 08:37 schrieb "Shuo Wang" <ec...@gmail.com>:
>
> > Hi,
> >
> > I have run pagerank on HAMA. I find that sometimes the results
> have
> > many null and infinity. Can you tell me the reason why it has null and
> > infinity results? Does it relate with
> >
> > the number of the vertices?
> >
>
Re: HAMA PageRank Null and Inifity Result
Posted by Thomas Jungblut <th...@gmail.com>.
Sure do you divide by 0?
Am 26.10.2012 08:37 schrieb "Shuo Wang" <ec...@gmail.com>:
> Hi,
>
> I have run pagerank on HAMA. I find that sometimes the results have
> many null and infinity. Can you tell me the reason why it has null and
> infinity results? Does it relate with
>
> the number of the vertices?
>