You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@giraph.apache.org by "Aapo Kyrola (JIRA)" <ji...@apache.org> on 2014/06/18 14:46:12 UTC
[jira] [Created] (GIRAPH-921) Create ByteValueVertex to store
vertex values as bytes without object instance
Aapo Kyrola created GIRAPH-921:
----------------------------------
Summary: Create ByteValueVertex to store vertex values as bytes without object instance
Key: GIRAPH-921
URL: https://issues.apache.org/jira/browse/GIRAPH-921
Project: Giraph
Issue Type: Improvement
Components: graph
Reporter: Aapo Kyrola
Priority: Minor
Facebook task (bootcamped) #4320492
This modification creates an alternative to DefaultVertex that stores the vertex value as raw bytes and only realizes the object when getValue() is called. The purpose of this change is to reduce memory consumption when vertex values are large.
User must define their own BytesToValueConverter class to translate the object type to bytes and back. I created ones for float and doubles. Using Java's serialization is bad idea as it adds a lot of overhead (for example full class names). However, one could easily create a generic bytevalueconverter that uses java serialization.
Configuration -vcl is used to define the vertex class and -bc the converter. For example:
-vcl org.apache.giraph.graph.ByteValueVertex -bc org.apache.giraph.graph.byteconverters.DoubleConverter
--
This message was sent by Atlassian JIRA
(v6.2#6252)