You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@giraph.apache.org by "Sean Choi (JIRA)" <ji...@apache.org> on 2012/07/12 01:55:35 UTC
[jira] [Created] (GIRAPH-248) Generic IdentityVertex for IO testing
Sean Choi created GIRAPH-248:
--------------------------------
Summary: Generic IdentityVertex for IO testing
Key: GIRAPH-248
URL: https://issues.apache.org/jira/browse/GIRAPH-248
Project: Giraph
Issue Type: Improvement
Affects Versions: 0.2.0
Reporter: Sean Choi
Priority: Trivial
Fix For: 0.2.0
There seems to be no vertex that allows you to simply print what is given as input.
I suggest creating an IdentityVertex that takes an input and outputs the vertex, vertex value and edge information to verify that the inputformat is working correctly.
I will post a patch up pretty soon
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (GIRAPH-248) Generic IdentityVertex for IO testing
Posted by "Sean Choi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GIRAPH-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Choi updated GIRAPH-248:
-----------------------------
Attachment: (was: GIRAPH-248-1.patch)
> Generic IdentityVertex for IO testing
> -------------------------------------
>
> Key: GIRAPH-248
> URL: https://issues.apache.org/jira/browse/GIRAPH-248
> Project: Giraph
> Issue Type: Improvement
> Affects Versions: 0.2.0
> Reporter: Sean Choi
> Priority: Trivial
> Fix For: 0.2.0
>
>
> There seems to be no vertex that allows you to simply print what is given as input.
> I suggest creating an IdentityVertex that takes an input and outputs the vertex, vertex value and edge information to verify that the inputformat is working correctly.
> I will post a patch up pretty soon
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (GIRAPH-248) Generic IdentityVertex for IO
testing
Posted by "Avery Ching (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GIRAPH-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Avery Ching reassigned GIRAPH-248:
----------------------------------
Assignee: Sean Choi
> Generic IdentityVertex for IO testing
> -------------------------------------
>
> Key: GIRAPH-248
> URL: https://issues.apache.org/jira/browse/GIRAPH-248
> Project: Giraph
> Issue Type: Improvement
> Affects Versions: 0.2.0
> Reporter: Sean Choi
> Assignee: Sean Choi
> Priority: Trivial
> Fix For: 0.2.0
>
> Attachments: GIRAPH-248-1.patch
>
>
> There seems to be no vertex that allows you to simply print what is given as input.
> I suggest creating an IdentityVertex that takes an input and outputs the vertex, vertex value and edge information to verify that the inputformat is working correctly.
> I will post a patch up pretty soon
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GIRAPH-248) Generic IdentityVertex for IO
testing
Posted by "Eli Reisman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GIRAPH-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13413345#comment-13413345 ]
Eli Reisman commented on GIRAPH-248:
------------------------------------
Nice! I would say leave the vertex not to print the output but simply to do nothing (or voteToHalt() only) so that you can choose both input and output formats freely at the command line for testing different combinations and what happens when you use them together on your data. This will be super useful for testing, like IdentityMapper etc. in Hadoop.
You might even write a very generic text output dumper (maybe one where you can limit the size of the output at the command line too) for checking the first few 100 lines of output to make sure its looking right rather than the whole input file set, again to aid in a quick test. This could be a separate file so as not to force the IdentityVertex to use only one output format. As people add new IO formats, the various combinations will all need to be tried depending on the uses people put them too.
> Generic IdentityVertex for IO testing
> -------------------------------------
>
> Key: GIRAPH-248
> URL: https://issues.apache.org/jira/browse/GIRAPH-248
> Project: Giraph
> Issue Type: Improvement
> Affects Versions: 0.2.0
> Reporter: Sean Choi
> Priority: Trivial
> Fix For: 0.2.0
>
>
> There seems to be no vertex that allows you to simply print what is given as input.
> I suggest creating an IdentityVertex that takes an input and outputs the vertex, vertex value and edge information to verify that the inputformat is working correctly.
> I will post a patch up pretty soon
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (GIRAPH-248) Generic IdentityVertex for IO testing
Posted by "Sean Choi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GIRAPH-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Choi updated GIRAPH-248:
-----------------------------
Attachment: GIRAPH-248-1.patch
Giraph Issue 248 Patch
> Generic IdentityVertex for IO testing
> -------------------------------------
>
> Key: GIRAPH-248
> URL: https://issues.apache.org/jira/browse/GIRAPH-248
> Project: Giraph
> Issue Type: Improvement
> Affects Versions: 0.2.0
> Reporter: Sean Choi
> Priority: Trivial
> Fix For: 0.2.0
>
> Attachments: GIRAPH-248-1.patch
>
>
> There seems to be no vertex that allows you to simply print what is given as input.
> I suggest creating an IdentityVertex that takes an input and outputs the vertex, vertex value and edge information to verify that the inputformat is working correctly.
> I will post a patch up pretty soon
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GIRAPH-248) Generic IdentityVertex for IO
testing
Posted by "Sean Choi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GIRAPH-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13414021#comment-13414021 ]
Sean Choi commented on GIRAPH-248:
----------------------------------
A use case for IdentityVertex is to submit a job using SimpleLongDoubleDoubleDoubleIdentityVertex.
I have used lib.LongDoubleDoubleAdjacencyListVertexInputFormat and an arbitrary output format to check that my inputs have been read correctly and is outputted corrected with the right edge and vertex value assignments.
> Generic IdentityVertex for IO testing
> -------------------------------------
>
> Key: GIRAPH-248
> URL: https://issues.apache.org/jira/browse/GIRAPH-248
> Project: Giraph
> Issue Type: Improvement
> Affects Versions: 0.2.0
> Reporter: Sean Choi
> Priority: Trivial
> Fix For: 0.2.0
>
> Attachments: GIRAPH-248-1.patch
>
>
> There seems to be no vertex that allows you to simply print what is given as input.
> I suggest creating an IdentityVertex that takes an input and outputs the vertex, vertex value and edge information to verify that the inputformat is working correctly.
> I will post a patch up pretty soon
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (GIRAPH-248) Generic IdentityVertex for IO testing
Posted by "Sean Choi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GIRAPH-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Choi updated GIRAPH-248:
-----------------------------
Attachment: GIRAPH-248-1.patch
> Generic IdentityVertex for IO testing
> -------------------------------------
>
> Key: GIRAPH-248
> URL: https://issues.apache.org/jira/browse/GIRAPH-248
> Project: Giraph
> Issue Type: Improvement
> Affects Versions: 0.2.0
> Reporter: Sean Choi
> Priority: Trivial
> Fix For: 0.2.0
>
> Attachments: GIRAPH-248-1.patch
>
>
> There seems to be no vertex that allows you to simply print what is given as input.
> I suggest creating an IdentityVertex that takes an input and outputs the vertex, vertex value and edge information to verify that the inputformat is working correctly.
> I will post a patch up pretty soon
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GIRAPH-248) Generic IdentityVertex for IO
testing
Posted by "Sean Choi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GIRAPH-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13415639#comment-13415639 ]
Sean Choi commented on GIRAPH-248:
----------------------------------
Hello, I have corrected the checkstyle violations and mvn clean verify does not show any errors.
Thank you
> Generic IdentityVertex for IO testing
> -------------------------------------
>
> Key: GIRAPH-248
> URL: https://issues.apache.org/jira/browse/GIRAPH-248
> Project: Giraph
> Issue Type: Improvement
> Affects Versions: 0.2.0
> Reporter: Sean Choi
> Priority: Trivial
> Fix For: 0.2.0
>
> Attachments: GIRAPH-248-1.patch
>
>
> There seems to be no vertex that allows you to simply print what is given as input.
> I suggest creating an IdentityVertex that takes an input and outputs the vertex, vertex value and edge information to verify that the inputformat is working correctly.
> I will post a patch up pretty soon
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (GIRAPH-248) Generic IdentityVertex for IO testing
Posted by "Sean Choi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GIRAPH-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Choi updated GIRAPH-248:
-----------------------------
Attachment: GIRAPH-248-1.patch
GIRAPH 248 Patch updated and corrected checkstyle violations
> Generic IdentityVertex for IO testing
> -------------------------------------
>
> Key: GIRAPH-248
> URL: https://issues.apache.org/jira/browse/GIRAPH-248
> Project: Giraph
> Issue Type: Improvement
> Affects Versions: 0.2.0
> Reporter: Sean Choi
> Priority: Trivial
> Fix For: 0.2.0
>
> Attachments: GIRAPH-248-1.patch
>
>
> There seems to be no vertex that allows you to simply print what is given as input.
> I suggest creating an IdentityVertex that takes an input and outputs the vertex, vertex value and edge information to verify that the inputformat is working correctly.
> I will post a patch up pretty soon
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (GIRAPH-248) Generic IdentityVertex for IO
testing
Posted by "Avery Ching (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GIRAPH-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Avery Ching resolved GIRAPH-248.
--------------------------------
Resolution: Fixed
+1. Committed.
> Generic IdentityVertex for IO testing
> -------------------------------------
>
> Key: GIRAPH-248
> URL: https://issues.apache.org/jira/browse/GIRAPH-248
> Project: Giraph
> Issue Type: Improvement
> Affects Versions: 0.2.0
> Reporter: Sean Choi
> Assignee: Sean Choi
> Priority: Trivial
> Fix For: 0.2.0
>
> Attachments: GIRAPH-248-1.patch
>
>
> There seems to be no vertex that allows you to simply print what is given as input.
> I suggest creating an IdentityVertex that takes an input and outputs the vertex, vertex value and edge information to verify that the inputformat is working correctly.
> I will post a patch up pretty soon
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (GIRAPH-248) Generic IdentityVertex for IO testing
Posted by "Sean Choi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GIRAPH-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Choi updated GIRAPH-248:
-----------------------------
Attachment: GIRAPH-248-1.patch
Giraph Issue 248 Patch to add Identity Vertex
> Generic IdentityVertex for IO testing
> -------------------------------------
>
> Key: GIRAPH-248
> URL: https://issues.apache.org/jira/browse/GIRAPH-248
> Project: Giraph
> Issue Type: Improvement
> Affects Versions: 0.2.0
> Reporter: Sean Choi
> Priority: Trivial
> Fix For: 0.2.0
>
> Attachments: GIRAPH-248-1.patch
>
>
> There seems to be no vertex that allows you to simply print what is given as input.
> I suggest creating an IdentityVertex that takes an input and outputs the vertex, vertex value and edge information to verify that the inputformat is working correctly.
> I will post a patch up pretty soon
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GIRAPH-248) Generic IdentityVertex for IO
testing
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GIRAPH-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13415758#comment-13415758 ]
Hudson commented on GIRAPH-248:
-------------------------------
Integrated in Giraph-trunk-Commit #148 (See [https://builds.apache.org/job/Giraph-trunk-Commit/148/])
GIRAPH-248: Generic IdentityVertex for IO testing (Sean Choi via
aching). (Revision 1362289)
Result = SUCCESS
aching : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1362289
Files :
* /giraph/trunk/CHANGELOG
* /giraph/trunk/src/main/java/org/apache/giraph/examples/IdentityVertex.java
* /giraph/trunk/src/main/java/org/apache/giraph/examples/SimpleLongDoubleDoubleDoubleIdentityVertex.java
> Generic IdentityVertex for IO testing
> -------------------------------------
>
> Key: GIRAPH-248
> URL: https://issues.apache.org/jira/browse/GIRAPH-248
> Project: Giraph
> Issue Type: Improvement
> Affects Versions: 0.2.0
> Reporter: Sean Choi
> Assignee: Sean Choi
> Priority: Trivial
> Fix For: 0.2.0
>
> Attachments: GIRAPH-248-1.patch
>
>
> There seems to be no vertex that allows you to simply print what is given as input.
> I suggest creating an IdentityVertex that takes an input and outputs the vertex, vertex value and edge information to verify that the inputformat is working correctly.
> I will post a patch up pretty soon
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (GIRAPH-248) Generic IdentityVertex for IO testing
Posted by "Sean Choi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GIRAPH-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Choi updated GIRAPH-248:
-----------------------------
Attachment: GIRAPH-248-1.patch
> Generic IdentityVertex for IO testing
> -------------------------------------
>
> Key: GIRAPH-248
> URL: https://issues.apache.org/jira/browse/GIRAPH-248
> Project: Giraph
> Issue Type: Improvement
> Affects Versions: 0.2.0
> Reporter: Sean Choi
> Priority: Trivial
> Fix For: 0.2.0
>
> Attachments: GIRAPH-248-1.patch
>
>
> There seems to be no vertex that allows you to simply print what is given as input.
> I suggest creating an IdentityVertex that takes an input and outputs the vertex, vertex value and edge information to verify that the inputformat is working correctly.
> I will post a patch up pretty soon
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (GIRAPH-248) Generic IdentityVertex for IO testing
Posted by "Sean Choi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GIRAPH-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Choi updated GIRAPH-248:
-----------------------------
Attachment: (was: GIRAPH-248-1.patch)
> Generic IdentityVertex for IO testing
> -------------------------------------
>
> Key: GIRAPH-248
> URL: https://issues.apache.org/jira/browse/GIRAPH-248
> Project: Giraph
> Issue Type: Improvement
> Affects Versions: 0.2.0
> Reporter: Sean Choi
> Priority: Trivial
> Fix For: 0.2.0
>
> Attachments: GIRAPH-248-1.patch
>
>
> There seems to be no vertex that allows you to simply print what is given as input.
> I suggest creating an IdentityVertex that takes an input and outputs the vertex, vertex value and edge information to verify that the inputformat is working correctly.
> I will post a patch up pretty soon
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (GIRAPH-248) Generic IdentityVertex for IO testing
Posted by "Sean Choi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GIRAPH-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Choi updated GIRAPH-248:
-----------------------------
Attachment: (was: GIRAPH-248-1.patch)
> Generic IdentityVertex for IO testing
> -------------------------------------
>
> Key: GIRAPH-248
> URL: https://issues.apache.org/jira/browse/GIRAPH-248
> Project: Giraph
> Issue Type: Improvement
> Affects Versions: 0.2.0
> Reporter: Sean Choi
> Priority: Trivial
> Fix For: 0.2.0
>
> Attachments: GIRAPH-248-1.patch
>
>
> There seems to be no vertex that allows you to simply print what is given as input.
> I suggest creating an IdentityVertex that takes an input and outputs the vertex, vertex value and edge information to verify that the inputformat is working correctly.
> I will post a patch up pretty soon
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (GIRAPH-248) Generic IdentityVertex for IO testing
Posted by "Sean Choi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GIRAPH-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Choi updated GIRAPH-248:
-----------------------------
Attachment: (was: GIRAPH-248-1.patch)
> Generic IdentityVertex for IO testing
> -------------------------------------
>
> Key: GIRAPH-248
> URL: https://issues.apache.org/jira/browse/GIRAPH-248
> Project: Giraph
> Issue Type: Improvement
> Affects Versions: 0.2.0
> Reporter: Sean Choi
> Priority: Trivial
> Fix For: 0.2.0
>
> Attachments: GIRAPH-248-1.patch
>
>
> There seems to be no vertex that allows you to simply print what is given as input.
> I suggest creating an IdentityVertex that takes an input and outputs the vertex, vertex value and edge information to verify that the inputformat is working correctly.
> I will post a patch up pretty soon
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GIRAPH-248) Generic IdentityVertex for IO
testing
Posted by "Avery Ching (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GIRAPH-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13415536#comment-13415536 ]
Avery Ching commented on GIRAPH-248:
------------------------------------
Hi Sean, thanks for the patch. Did you try 'mvn clean verify'? I got 6 checkstyle errors. Please see https://cwiki.apache.org/confluence/display/GIRAPH/How+to+Contribute for more on contributing if you have any questions.
> Generic IdentityVertex for IO testing
> -------------------------------------
>
> Key: GIRAPH-248
> URL: https://issues.apache.org/jira/browse/GIRAPH-248
> Project: Giraph
> Issue Type: Improvement
> Affects Versions: 0.2.0
> Reporter: Sean Choi
> Priority: Trivial
> Fix For: 0.2.0
>
> Attachments: GIRAPH-248-1.patch
>
>
> There seems to be no vertex that allows you to simply print what is given as input.
> I suggest creating an IdentityVertex that takes an input and outputs the vertex, vertex value and edge information to verify that the inputformat is working correctly.
> I will post a patch up pretty soon
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira