You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@giraph.apache.org by "Avery Ching (JIRA)" <ji...@apache.org> on 2011/09/16 07:54:09 UTC
[jira] [Issue Comment Edited] (GIRAPH-34) Failure of Vertex
reflection for putVertexList from GIRAPH-27
[ https://issues.apache.org/jira/browse/GIRAPH-34?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13105876#comment-13105876 ]
Avery Ching edited comment on GIRAPH-34 at 9/16/11 5:53 AM:
------------------------------------------------------------
Try running the unittests against an actual Hadoop instance (i.e. if you run 'mvn package -Dprop.mapred.job.tracker=localhost:50300 -Dtest=TestVertexRangeBalancer'). I have a fix for the first part (reflection), but it seems like there is another component to the bug where messages are getting delivered early in some weird cases...
Unfortunately it's a little hard to rip the fix out of my checkout since I was working on GIRAPH-11. This is a part of it to make the Vertex configurable since in putVertexList will reflect the Vertex and reflection fails because of trying to get the context from a null graph state. Sorry for the lack of detail but I have to wake up in less than 4 hours! =)
was (Author: aching):
Try running the unittests against an actual Hadoop instance (i.e. if you run 'mvn package -Dprop.mapred.job.tracker=localhost:50300 -Dtest=TestVertexRangeBalancer'). I have a fix for the first part (reflection), but it seems like there is another component to the bug where messages are getting delivered early in some weird cases...
Unfortunately it's a little hard to rip the fix out of my checkout since I was working on GIRAPH-17. This is a part of it to make the Vertex configurable since in putVertexList will reflect the Vertex and reflection fails because of trying to get the context from a null graph state. Sorry for the lack of detail but I have to wake up in less than 4 hours! =)
> Failure of Vertex reflection for putVertexList from GIRAPH-27
> --------------------------------------------------------------
>
> Key: GIRAPH-34
> URL: https://issues.apache.org/jira/browse/GIRAPH-34
> Project: Giraph
> Issue Type: Bug
> Reporter: Christian Kunz
> Assignee: Avery Ching
> Attachments: GIRAPH-34.patch
>
>
> Christian actually found this bug. I am filing the JIRA on his behalf. Here's my error when running TestVertexRangeBalancer.
> java.lang.RuntimeException: java.io.IOException: Call to returnwhose-lm/10.72.107.231:30002 failed on local exception: java.io.EOFException
> at org.apache.giraph.comm.BasicRPCCommunications.sendVertexListReq(BasicRPCCommunications.java:768)
> at org.apache.giraph.graph.BspServiceWorker.exchangeVertexRanges(BspServiceWorker.java:1282)
> at org.apache.giraph.graph.GraphMapper.map(GraphMapper.java:589)
> at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:369)
> at org.apache.hadoop.mapred.Child$4.run(Child.java:259)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
> at org.apache.hadoop.mapred.Child.main(Child.java:253)
> Caused by: java.io.IOException: Call to returnwhose-lm/10.72.107.231:30002 failed on local exception: java.io.EOFException
> at org.apache.hadoop.ipc.Client.wrapException(Client.java:1065)
> at org.apache.hadoop.ipc.Client.call(Client.java:1033)
> at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:224)
> at $Proxy3.putVertexList(Unknown Source)
> at org.apache.giraph.comm.BasicRPCCommunications.sendVertexListReq(BasicRPCCommunications.java:766)
> ... 10 more
> Caused by: java.io.EOFException
> at java.io.DataInputStream.readInt(DataInputStream.java:375)
> at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:767)
> at org.apache.hadoop.ipc.Client$Connection.run(Client.java:712)
> I identified and fixed the issue by making BasicVertex implement Configurable and making the graph state set in BasicRPCCommunications. There is one more error though that I'll try and solve before putting up a reviewboard.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira