[jira] [Commented] (GIRAPH-1104) NegativeArraySize exception in BigDataOutput

["Maja Kabiljo (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/GIRAPH-1104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415912#comment-15415912 ] 

Maja Kabiljo commented on GIRAPH-1104:
--------------------------------------

This didn't seem to solve the problem, https://reviews.facebook.net/D61839 does while following max byte[] size semantics from BigDataIO.

> NegativeArraySize exception in BigDataOutput
> --------------------------------------------
>
>                 Key: GIRAPH-1104
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-1104
>             Project: Giraph
>          Issue Type: Bug
>            Reporter: Sergey Edunov
>            Assignee: Sergey Edunov
>
> We're seeing this exception in some jobs. Supposedly related to high degree vertices
> Caused by: java.lang.NegativeArraySizeException
> 	at org.apache.giraph.utils.UnsafeByteArrayOutputStream.ensureSize(UnsafeByteArrayOutputStream.java:117)
> 	at org.apache.giraph.utils.UnsafeByteArrayOutputStream.write(UnsafeByteArrayOutputStream.java:168)
> 	at org.apache.giraph.utils.io.BigDataOutput.write(BigDataOutput.java:183)
> 	at org.apache.giraph.edge.ByteArrayEdges.write(ByteArrayEdges.java:204)
> 	at org.apache.giraph.ooc.data.DiskBackedPartitionStore.writeOutEdges(DiskBackedPartitionStore.java:353)
> 	at org.apache.giraph.ooc.data.DiskBackedPartitionStore.offloadInMemoryPartitionData(DiskBackedPartitionStore.java:389)
> 	at org.apache.giraph.ooc.data.DiskBackedDataStore.offloadPartitionDataProxy(DiskBackedDataStore.java:294)
> 	at org.apache.giraph.ooc.data.DiskBackedPartitionStore.offloadPartitionData(DiskBackedPartitionStore.java:318)
> 	at org.apache.giraph.ooc.command.StorePartitionIOCommand.execute(StorePartitionIOCommand.java:55)
> 	at org.apache.giraph.ooc.OutOfCoreIOCallable.call(OutOfCoreIOCallable.java:99)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)