Tried to aggregate value to unregistered aggregator max

[fabrizio silvestri <fa...@isti.cnr.it>]

Dear all,

I'm slowly getting there :)

The bug we found yesterday has been fixed. Now, I'm running into another issue.

If I run SimplePageRank using this command line:

hadoop jar giraph-0.2-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar
org.apache.giraph.GiraphRunner \
   org.apache.giraph.examples.SimplePageRankVertex -w 1 \
   -if org.apache.giraph.io.LongDoubleFloatDoubleTextInputFormat -ip graph.txt \
   -of org.apache.giraph.io.IdWithValueTextOutputFormat -op output

where graph.txt contains:

1 1.0 2 1.0 3 1.0 4 1.0
2 1.0 3 1.0 4 1.0
3 1.0 1 1.0 4 1.0
4 1.0 1 1.0 2 1.0 3 1.0

(Yes, we crafted a IF class to read this file :) )

>From the job monitor I can see that one of the tasks throws this exception:

java.lang.IllegalStateException: aggregate: Tried to aggregate value
to unregistered aggregator max
	at org.apache.giraph.graph.BspServiceWorker.aggregate(BspServiceWorker.java:703)
	at org.apache.giraph.graph.Vertex.aggregate(Vertex.java:319)
	at org.apache.giraph.examples.SimplePageRankVertex.compute(SimplePageRankVertex.java:77)
	at org.apache.giraph.graph.GraphMapper.map(GraphMapper.java:507)
	at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:571)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
	at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:396)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
	at org.apache.hadoop.mapred.Child.main(Child.java:249)

This is, indeed, strange as in SimplePageRankVertex.java I can see
that max has been in fact registered:

Any help will be much appreciated
f

Re: Tried to aggregate value to unregistered aggregator max

[Maja Kabiljo <ma...@fb.com>]

Hi Fabrizio,

You can see that aggregators are being registered in
MasterCompute.initialize(). So you need to let Giraph know which
MasterCompute class to use by setting '-mc'. Hope you'll be able to run it
now :-)

Best,
Maja

On 9/7/12 4:23 PM, "fabrizio silvestri" <fa...@isti.cnr.it>
wrote:

>Dear all,
>
>I'm slowly getting there :)
>
>The bug we found yesterday has been fixed. Now, I'm running into another
>issue.
>
>If I run SimplePageRank using this command line:
>
>hadoop jar 
>giraph-0.2-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar
>org.apache.giraph.GiraphRunner \
>   org.apache.giraph.examples.SimplePageRankVertex -w 1 \
>   -if org.apache.giraph.io.LongDoubleFloatDoubleTextInputFormat -ip
>graph.txt \
>   -of org.apache.giraph.io.IdWithValueTextOutputFormat -op output
>
>where graph.txt contains:
>
>1 1.0 2 1.0 3 1.0 4 1.0
>2 1.0 3 1.0 4 1.0
>3 1.0 1 1.0 4 1.0
>4 1.0 1 1.0 2 1.0 3 1.0
>
>(Yes, we crafted a IF class to read this file :) )
>
>From the job monitor I can see that one of the tasks throws this
>exception:
>
>java.lang.IllegalStateException: aggregate: Tried to aggregate value
>to unregistered aggregator max
>	at 
>org.apache.giraph.graph.BspServiceWorker.aggregate(BspServiceWorker.java:7
>03)
>	at org.apache.giraph.graph.Vertex.aggregate(Vertex.java:319)
>	at 
>org.apache.giraph.examples.SimplePageRankVertex.compute(SimplePageRankVert
>ex.java:77)
>	at org.apache.giraph.graph.GraphMapper.map(GraphMapper.java:507)
>	at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:571)
>	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
>	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
>	at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
>	at java.security.AccessController.doPrivileged(Native Method)
>	at javax.security.auth.Subject.doAs(Subject.java:396)
>	at 
>org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.
>java:1121)
>	at org.apache.hadoop.mapred.Child.main(Child.java:249)
>
>This is, indeed, strange as in SimplePageRankVertex.java I can see
>that max has been in fact registered:
>
>Any help will be much appreciated
>f